scispace - formally typeset
Journal ArticleDOI

Memorability-based image compression

TLDR
The comparative analysis shows that the memorability-based compression outperforms the state-of-the-art compression techniques.
Abstract
This study is concerned with achieving the image compression using the concept of memorability. The authors have used memorability of an image, as a perceptual measure while image coding. In the proposed approach, a region-of-interest-based memorability preserving image compression algorithm which is accomplished via two sub-processes namely, memorability prediction and image compression is introduced. The memorability of images is predicted using convolutional neural network and restricted Boltzmann machine features. Based on these features, the memorability score of individual patches in an image is calculated and these scores are used to generate the memorability map. These memorability map values are used for optimised image compression. In order to validate the results, an eye tracking experiment with human participants is performed. The comparative analysis shows that the memorability-based compression outperforms the state-of-the-art compression techniques.

read more

Citations
More filters
Journal ArticleDOI

Sensing system of environmental perception technologies for driverless vehicle: A review of state of the art and challenges

TL;DR: This review paper attempts to systematically summarize environment perception technology and discuss the new challenges currently faced, including the advantages, disadvantages and applicable occasions of several commonly used sensing methods to provide a clear selection guide.
Posted Content

Efficient Video Summarization Framework using EEG and Eye-tracking Signals.

TL;DR: In this paper, an efficient video summarization framework that will give a gist of the entire video in a few key-frames or video skims is proposed, which relies on the cognitive judgments of human beings.
Proceedings ArticleDOI

Human Visual Learning Inspired Effective Training Methods

TL;DR: The results show that the performance of the network improves significantly when trained iteratively with increasing level of blur, and the model trained on gradually decreasing blurriness on Dog vs Cat dataset for classification task.
Posted Content

Understanding Character Recognition using Visual Explanations Derived from the Human Visual System and Deep Networks

TL;DR: In this article, the congruence of information gathering strategies between humans and deep neural networks has been examined in a character recognition task, where the authors use the visual fixation maps obtained from the eye-tracking experiment as a supervisory input to align the model's focus on relevant character regions.
References
More filters
Journal ArticleDOI

What Makes a Photograph Memorable

TL;DR: It is shown that memorability is an intrinsic and stable property of an image that is shared across different viewers, and remains stable across delays, and is a first attempt to quantify this useful property of images.
Journal ArticleDOI

Defending Yarbus: eye movements reveal observers' task.

TL;DR: Yarbus's idea that human eye-movement patterns are modulated top down by different task demands is supported by the data and continues to be an inspiration for future computational and experimental eye- Movement research.
Journal ArticleDOI

Intrinsic and extrinsic effects on image memorability

TL;DR: This work finds that intrinsic differences in memorability exist at a finer-grained scale than previously documented and proposes an information-theoretic model of image distinctiveness that can automatically predict how changes in context change the memorability of natural images.
Journal ArticleDOI

Reconsidering Yarbus: a failure to predict observers' task from eye movement patterns.

TL;DR: The Yarbus finding is evocative, and while it is possible an observer's mental state might be decoded from some aspect of eye movements, static scan paths alone do not appear to be adequate to infer complex mental states of an observer.
Journal ArticleDOI

Semantic video analysis for adaptive content delivery and automatic description

TL;DR: An encoding framework which exploits semantics for video content delivery and shows that the use of semantic video analysis prior to encoding sensibly reduces the bandwidth requirements compared to traditional encoders not only for an object-based encoder but also for a frame- based encoder.