Showing papers by "Zhibo Chen published in 2015"
TL;DR: Experimental results demonstrate that the orientation selectivity-based structure descriptor is robust to disturbance, and can effectively represent the structure degradation caused by different types of distortion.
Abstract: The human visual system is highly adaptive to extract structure information for scene perception, and structure character is widely used in perception-oriented image processing works. However, the existing structure descriptors mainly describe the luminance contrast of a local region, but cannot effectively represent the spatial correlation of structure. In this paper, we introduce a novel structure descriptor according to the orientation selectivity mechanism in the primary visual cortex. Research on cognitive neuroscience indicate that the arrangement of excitatory and inhibitory cortex cells arise orientation selectivity in a local receptive field, within which the primary visual cortex performs visual information extraction for scene understanding. Inspired by the orientation selectivity mechanism, we compute the correlations among pixels in a local region based on the similarities of their preferred orientation. By imitating the arrangement of the excitatory/inhibitory cells, the correlations between a central pixel and its local neighbors are binarized, and the spatial correlation is represented with a set of binary values, which is named the orientation selectivity-based pattern. Then, taking both the gradient magnitude and the orientation selectivity-based pattern into account, a rotation invariant structure descriptor is introduced. The proposed structure descriptor is applied in texture classification and reduced reference image quality assessment, as two different application domains to verify its generality and robustness. Experimental results demonstrate that the orientation selectivity-based structure descriptor is robust to disturbance, and can effectively represent the structure degradation caused by different types of distortion.
56 citations
26 May 2015
TL;DR: An objective image retargeting quality assessment method based on Hybrid Distortion Pooled Model considering image local similarity, content information loss and image structural distortion is proposed and results show improved consistency between the proposed HDPM method and the corresponding subjective evaluations.
Abstract: With the increasing popularity of mobile devices, there are more and more screens with heterogeneous resolutions. In order to solve the mismatching problem of images displaying on different screens, various image retargeting techniques have been proposed. However, little effective objective quality assessment metric for image retargeting has been proposed. In this paper, we propose an objective image retargeting quality assessment method based on Hybrid Distortion Pooled Model (HDPM) considering image local similarity, content information loss and image structural distortion. The proposed HDPM method measures the retargeted image's local similarity based on matching the similar block by Scale-Invariant Features Transform (SIFT) features and computing the corresponding blocks' similarity by structural similarity (SSIM). Furthermore, the image content information loss in retargeted image, which is regarded as the SIFT feature loss, is taken into account. Besides, we also consider image's structural distortion in the proposed method, which is based on GLCM (Gray-level co-occurrence matrix). To evaluate the effectiveness of the proposed method, extensive experiments have been conducted, and the results show improved consistency between the proposed HDPM method and the corresponding subjective evaluations.
11 citations
TL;DR: It is theoretically and experimentally demonstrated that applying l1/2 regularization to the directional derivatives of images leads to superior structure preservation, and the experimental results verify that OTV l 1/2 outperforms other similar models.
10 citations
Patent•
25 Nov 2015
TL;DR: In this paper, a comic book or narrative abstraction is used to provide a pictorial summary of a video, where the first part of the video is accessed and the second part is accessed.
Abstract: Various implementations relate to providing a pictorial summary, also referred to as a comic book or a narrative abstraction In one particular implementation, a first portion in a video is accessed, and a second portion in the video is accessed A weight for the first portion is determined, and a weight for the second portion is determined A first number and a second number are determined The first number identifies how many pictures from the first portion are to be used in a pictorial summary of the video The first number is one or more, and is determined based on the weight for the first portion The second number identifies how many pictures from the second portion are to be used in the pictorial summary of the video The second number is one or more, and is determined based on the weight for the second portion
2 citations