Journal ArticleDOI
Attention Driven Foveated Video Quality Assessment
Reads0
Chats0
TLDR
An advanced foveal imaging model is proposed to generate the perceived representation of video by integrating visual attention into the foveation mechanism, and a novel approach to predict video fixations is proposed by mimicking the essential functionality of eye movement.Abstract:
Contrast sensitivity of the human visual system to visual stimuli can be significantly affected by several mechanisms, e.g., vision foveation and attention. Existing studies on foveation based video quality assessment only take into account static foveation mechanism. This paper first proposes an advanced foveal imaging model to generate the perceived representation of video by integrating visual attention into the foveation mechanism. For accurately simulating the dynamic foveation mechanism, a novel approach to predict video fixations is proposed by mimicking the essential functionality of eye movement. Consequently, an advanced contrast sensitivity function, derived from the attention driven foveation mechanism, is modeled and then integrated into a wavelet-based distortion visibility measure to build a full reference attention driven foveated video quality (AFViQ) metric. AFViQ exploits adequately perceptual visual mechanisms in video quality assessment. Extensive evaluation results with respect to several publicly available eye-tracking and video quality databases demonstrate promising performance of the proposed video attention model, fixation prediction approach, and quality metric.read more
Citations
More filters
Journal ArticleDOI
From QoS to QoE: A Tutorial on Video Quality Assessment
TL;DR: A comprehensive survey of the evolution of video quality assessment methods, analyzing their characteristics, advantages, and drawbacks and identifying the future research directions of QoE is given.
Proceedings ArticleDOI
Quality Assessment of In-the-Wild Videos
TL;DR: This work proposes an objective no-reference video quality assessment method by integrating both effects of content-dependency and temporal-memory effects into a deep neural network, which outperforms five state-of-the-art methods by a large margin.
Journal ArticleDOI
Spatiotemporal Statistics for Video Quality Assessment
Xuelong Li,Qun Guo,Xiaoqiang Lu +2 more
TL;DR: A new NR-VQA metric based on the spatiotemporal natural video statistics in 3D discrete cosine transform (3D-DCT) domain is proposed, which is universal for multiple types of distortions and robust to different databases.
Journal ArticleDOI
No-reference image and video quality assessment: a classification and review of recent approaches
TL;DR: A classification and review of latest published research work in the area of NR image and video quality assessment is presented and the NR methods of visual quality assessment considered for review are structured into categories and subcategories based on the types of methodologies used for the underlying processing employed for quality estimation.
Journal ArticleDOI
VideoSet: A large-scale compressed video quality dataset based on JND measurement
Haiqiang Wang,Ioannis Katsavounidis,Jiantong Zhou,Jeong-Hoon Park,Shaw-Min Lei,Xin Zhou,Man-On Pun,Xin Jin,Ronggang Wang,Xu Wang,Yun Zhang,Jiwu Huang,Sam Kwong,C.-C. Jay Kuo +13 more
TL;DR: Wang et al. as mentioned in this paper built a large-scale JND-based coded video quality dataset, which consists of 220 5-s sequences in four resolutions (i.e., 1920 × 1080, 1280 × 720, 960 × 540 and 640 × 360 ).
References
More filters
Journal ArticleDOI
An introduction to ROC analysis
TL;DR: The purpose of this article is to serve as an introduction to ROC graphs and as a guide for using them in research.
Book
The Principles of Psychology
TL;DR: For instance, the authors discusses the multiplicity of the consciousness of self in the form of the stream of thought and the perception of space in the human brain, which is the basis for our work.
Proceedings Article
An iterative image registration technique with an application to stereo vision
Bruce D. Lucas,Takeo Kanade +1 more
TL;DR: In this paper, the spatial intensity gradient of the images is used to find a good match using a type of Newton-Raphson iteration, which can be generalized to handle rotation, scaling and shearing.
Journal ArticleDOI
A feature-integration theory of attention
Anne Treisman,Garry A. Gelade +1 more
TL;DR: A new hypothesis about the role of focused attention is proposed, which offers a new set of criteria for distinguishing separable from integral features and a new rationale for predicting which tasks will show attention limits and which will not.
Journal ArticleDOI
The Laplacian Pyramid as a Compact Image Code
Peter J. Burt,Edward H. Adelson +1 more
TL;DR: A technique for image encoding in which local operators of many scales but identical shape serve as the basis functions, which tends to enhance salient image features and is well suited for many image analysis tasks as well as for image compression.