scispace - formally typeset
Journal ArticleDOI

Memorability-based image compression

TLDR
The comparative analysis shows that the memorability-based compression outperforms the state-of-the-art compression techniques.
Abstract
This study is concerned with achieving the image compression using the concept of memorability. The authors have used memorability of an image, as a perceptual measure while image coding. In the proposed approach, a region-of-interest-based memorability preserving image compression algorithm which is accomplished via two sub-processes namely, memorability prediction and image compression is introduced. The memorability of images is predicted using convolutional neural network and restricted Boltzmann machine features. Based on these features, the memorability score of individual patches in an image is calculated and these scores are used to generate the memorability map. These memorability map values are used for optimised image compression. In order to validate the results, an eye tracking experiment with human participants is performed. The comparative analysis shows that the memorability-based compression outperforms the state-of-the-art compression techniques.

read more

Citations
More filters
Journal ArticleDOI

Sensing system of environmental perception technologies for driverless vehicle: A review of state of the art and challenges

TL;DR: This review paper attempts to systematically summarize environment perception technology and discuss the new challenges currently faced, including the advantages, disadvantages and applicable occasions of several commonly used sensing methods to provide a clear selection guide.
Posted Content

Efficient Video Summarization Framework using EEG and Eye-tracking Signals.

TL;DR: In this paper, an efficient video summarization framework that will give a gist of the entire video in a few key-frames or video skims is proposed, which relies on the cognitive judgments of human beings.
Proceedings ArticleDOI

Human Visual Learning Inspired Effective Training Methods

TL;DR: The results show that the performance of the network improves significantly when trained iteratively with increasing level of blur, and the model trained on gradually decreasing blurriness on Dog vs Cat dataset for classification task.
Posted Content

Understanding Character Recognition using Visual Explanations Derived from the Human Visual System and Deep Networks

TL;DR: In this article, the congruence of information gathering strategies between humans and deep neural networks has been examined in a character recognition task, where the authors use the visual fixation maps obtained from the eye-tracking experiment as a supervisory input to align the model's focus on relevant character regions.
References
More filters
Journal ArticleDOI

Efficient video coding based on audio-visual focus of attention

TL;DR: An efficient video coding method using audio-visual focus of attention, which is based on the observation that sound-emitting regions in an audio- visual sequence draw viewers' attention, is proposed and can yield considerable coding gains over the constant quantization mode of H.264/AVC.
Proceedings ArticleDOI

Image memorability and visual inception

TL;DR: The notion of image memorability and the elements that make it memorable are discussed and evidence for the phenomenon of visual inception is introduced: can the authors make people believe they have seen an image they have not?
Journal ArticleDOI

An embedded saliency map estimator scheme: application to video encoding.

TL;DR: A novel saliency-based computational model for visual attention that processes both top-down and bottom-up information and utilizes the wavelet decomposition for inline computation of the features that are used to create the topographic feature maps.
Proceedings ArticleDOI

Saliency-preserving video compression

TL;DR: Experimental results indicate that the proposed saliency-preserving framework for ROI video coding is able to improve the visual quality ofROI video at low bit rates.
Journal ArticleDOI

Saliency-based fidelity adaptation preprocessing for video coding

TL;DR: A video coding scheme which applies the technique of visual saliency computation to adjust image fidelity before compression and shows that the proposed algorithm can improve the compression ratio significantly while effectively preserving perceptual visual quality.