scispace - formally typeset
Open AccessProceedings ArticleDOI

A dataset of head and eye movements for 360° videos

Reads0
Chats0
TLDR
This paper presents a novel dataset of 360° videos with associated eye and head movement data, which is a follow-up to the previous dataset for still images and its associated code is made publicly available to support research on visual attention for 360° content.
Abstract
Research on visual attention in 360° content is crucial to understand how people perceive and interact with this immersive type of content and to develop efficient techniques for processing, encoding, delivering and rendering. And also to offer a high quality of experience to end users. The availability of public datasets is essential to support and facilitate research activities of the community. Recently, some studies have been presented analyzing exploration behaviors of people watching 360° videos, and a few datasets have been published. However, the majority of these works only consider head movements as proxy for gaze data, despite the importance of eye movements in the exploration of omnidirectional content. Thus, this paper presents a novel dataset of 360° videos with associated eye and head movement data, which is a follow-up to our previous dataset for still images [14]. Head and eye tracking data was obtained from 57 participants during a free-viewing experiment with 19 videos. In addition, guidelines on how to obtain saliency maps and scanpaths from raw data are provided. Also, some statistics related to exploration behaviors are presented, such as the impact of the longitudinal starting position when watching omnidirectional videos was investigated in this test. This dataset and its associated code are made publicly available to support research on visual attention for 360° content.

read more

Citations
More filters
Journal ArticleDOI

State-of-the-Art in 360° Video/Image Processing: Perception, Assessment and Compression

TL;DR: This article reviews both datasets and visual attention modelling approaches for 360° video/image, which either utilize the spherical characteristics or visual attention models, and overviews the compression approaches.
Journal ArticleDOI

A Survey on Adaptive 360° Video Streaming: Solutions, Challenges and Opportunities

TL;DR: The state-of-the-art on adaptive 360° video delivery solutions considering end-to-end video streaming in general and then specifically of 360°video delivery are presented.
Journal ArticleDOI

A Survey on 360° Video Streaming: Acquisition, Transmission, and Display

TL;DR: This survey presents the current literature related to 360° video streaming and presents the video and viewer datasets, which may be used to drive large-scale simulations and experiments.
Posted Content

State-of-the-art in 360{\deg} Video/Image Processing: Perception, Assessment and Compression

TL;DR: In this article, the authors review the state-of-the-art works on 360° video/image processing from the aspects of perception, assessment and compression, and summarize this overview paper and outlook the future research trends.
Proceedings ArticleDOI

Viewport Proposal CNN for 360° Video Quality Assessment

TL;DR: A viewport-based convolutional neural network (V-CNN) approach for VQA on 360° video, considering both auxiliary tasks of viewport proposal and viewport saliency prediction, which validate the effectiveness of the approach and achieves comparable performance in two auxiliary tasks.
References
More filters
Proceedings ArticleDOI

Identifying fixations and saccades in eye-tracking protocols

TL;DR: A taxonomy of fixation identification algorithms is proposed that classifies algorithms in terms of how they utilize spatial and temporal information in eye-tracking protocols in order to evaluate and compare these algorithms with respect to a number of qualitative characteristics.
Journal ArticleDOI

Guest Editors' Preface: Special issue

TL;DR: “Criminal Justice Drug Abuse Treatment Studies” (CJ-DATS) supports much of the corrections-based treatment research as part of the TCU CJ- DATS Project.
Journal ArticleDOI

Eye movements: The past 25 years

TL;DR: This article reviews the past 25 years of research on eye movements, focusing on three oculomotor behaviors: gaze control, smooth pursuit and saccades, and on their interactions with vision.
Proceedings ArticleDOI

A Framework to Evaluate Omnidirectional Video Coding Schemes

TL;DR: This paper extract viewport based head motion trajectories, and compares the original and coded videos on the viewport, and shows that the average viewport quality can be approximated by a weighted spherical PSNR.
Journal ArticleDOI

Saliency in VR: How Do People Explore Virtual Environments?

TL;DR: In this article, gaze and head orientation data of 169 users exploring stereoscopic, static omni-directional panoramas, for a total of 1980 head and gaze trajectories for three different viewing conditions were analyzed.
Related Papers (5)
Trending Questions (1)
Can eye tracking data used to evaluate 360 video?

Yes, eye tracking data can be used to evaluate 360° videos. The paper presents a dataset of 360° videos with associated eye and head movement data, highlighting the importance of eye movements in the exploration of omnidirectional content.