Hyper-Interactive video browsing by a remote controller and hand gestures
06 Dec 2005-pp 547-555
TL;DR: Three types of hyper-interactive controls are incorporated, which include a reference link of a video object to show supplementary information on the Web, a hyper link to enable hyper-video jumps, and a choice link for online answers to pre-designed questions.
Abstract: Interactive video browsing tools are designed for e-learning applications on future interactive TVs. The integrated system includes an authoring tool that produces multi-paths videos and a playback tool that uses video tracking technology and a remote controller. The playback tool enables multi-modal interaction between the user and a multi-story video clip. Three types of hyper-interactive controls are incorporated, which include a reference link of a video object to show supplementary information on the Web, a hyper link to enable hyper-video jumps, and a choice link for online answers to pre-designed questions. The underlying video is coded using the standard MPEG technology, with navigation information hidden in the user-defined data of MPEG. Thus, the default sequence of a hypervideo can also be presented using an ordinary video player.
Citations
More filters
TL;DR: This article analyzed more than 400 papers for relevant work in hypervideos and interactive multimedia presentations to discover a set of trends and unsolved problems, and propose directions for future research.
Abstract: Hypervideos and interactive multimedia presentations allow the creation of fully interactive and enriched video. It is possible to organize video scenes in a nonlinear way. Additional information can be added to the video ranging from short descriptions to images and more videos. Hypervideos are video-based but also provide navigation between video scenes and additional multimedia elements. Interactive multimedia presentations consist of different media with a temporal and spatial synchronization that can be navigated via hyperlinks. Their creation and description requires description formats, multimedia models, and standards—as well as players. Specialized authoring tools with advanced editing functions allow authors to manage all media files, link and arrange them to an overall presentation, and keep an overview during the whole process. They considerably simplify the creation process compared to writing and editing description documents in simple text editors. Data formats need features that describe interactivity and nonlinear navigation while maintaining temporal and spatial synchronization. Players should be easy to use with extended feature sets keeping elements synchronized. In this article, we analyzed more than 400 papers for relevant work in this field. From the findings we discovered a set of trends and unsolved problems, and propose directions for future research.
33 citations
Cites background from "Hyper-Interactive video browsing by..."
...[Hsu et al. 2005] video scenes in graph structure + text, images, web page files, URLs graph, choices by “hyperlink in a specified temporal-spatial domain,” no hotspots video preview, annotation area, graph view stand-alone player gesture controls –...
[...]
...” Nonlinear video with a graph structure offers hyperlinks “in a specified temporal-spatial domain” [Hsu et al. 2005]....
[...]
...This nonlinear structure can be navigated with “hyperlink[s] in a specified temporalspatial domain” [Hsu et al. 2005]....
[...]
...Clickable videos are mainly used for monetizing products or services in the Internet....
[...]
...Nonlinear video with a graph structure offers hyperlinks “in a specified temporal-spatial domain” [Hsu et al. 2005]....
[...]
References
More filters
Journal Article•
TL;DR: A fast and robust method for tracking a user's hand and multiple fingertips and gesture recognition based on measured fingertip trajectories for augmented desk interface systems, which is particularly advantageous for human-computer interaction (HCI).
170 citations
"Hyper-Interactive video browsing by..." refers background in this paper
...And the third step is to detect the palm is folding or unfolding [9, 10, 11]....
[...]
20 May 2002
TL;DR: In this paper, the location of each fingertip is located in each input infrared image frame and correspondences of detected fingertips between successive image frames are determined based on a prediction technique, which is particularly advantageous for human-computer interaction.
Abstract: We propose a fast and robust method for tracking a user's hand and multiple fingertips; we then demonstrate gesture recognition based on measured fingertip trajectories for augmented desk interface systems. Our tracking method is capable of tracking multiple fingertips in a reliable manner even in a complex background under a dynamically changing lighting condition without any markers. First, based on its geometrical features, the location of each fingertip is located in each input infrared image frame. Then, correspondences of detected fingertips between successive image frames are determined based on a prediction technique. Our gesture recognition system is particularly advantageous for human-computer interaction (HCI) in that users can achieve interactions based on symbolic gestures at the same time that they perform direct manipulation with their own hands and fingers. The effectiveness of our proposed method has been successfully demonstrated via a number of experiments.
167 citations
TL;DR: Both stand alone and relative evaluation metrics are developed to cover the cases for which a reference segmentation is missing or available for comparison, as well as for complete segmentation partitions.
Abstract: Video segmentation assumes a major role in the context of object-based coding and description applications. Evaluating the adequacy of a segmentation result for a given application is a requisite both to allow the appropriate selection of segmentation algorithms as well as to adjust their parameters for optimal performance. Subjective testing, the current practice for the evaluation of video segmentation quality, is an expensive and time-consuming process. Objective segmentation quality evaluation techniques can alternatively be used; however, it is recognized that, so far, much less research effort has been devoted to this subject than to the development of segmentation algorithms. This paper discusses the problem of video segmentation quality evaluation, proposing evaluation methodologies and objective segmentation quality metrics for individual objects as well as for complete segmentation partitions. Both standalone and relative evaluation metrics are developed to cover the cases for which a reference segmentation is missing or available for comparison.
128 citations
"Hyper-Interactive video browsing by..." refers background in this paper
...On the other hand, hypervideo and multi-story video are also an important video technology under development [4, 5, 6, 7]....
[...]
TL;DR: A generic framework to structure and dynamically present a new form of video- and text-based media called hypervideo is proposed, and an experimental hypermedia work, HyperCafe, is produced to illustrate the general properties and aesthetic techniques possible in such a medium.
Abstract: A formal methodology is needed to integrate and exchange spatial and temporal properties in hypermedia and hypertext. We propose a generic framework to structure and dynamically present a new form of video- and text-based media called hypervideo. We developed a Hypervideo Engine and produced an experimental hypermedia work, HyperCafe, to illustrate the general properties and aesthetic techniques possible in such a medium.
73 citations
"Hyper-Interactive video browsing by..." refers background in this paper
...On the other hand, hypervideo and multi-story video are also an important video technology under development [4, 5, 6, 7]....
[...]
Book•
[...]
01 Jan 1998
TL;DR: This brand new, comprehensive edition of the best-selling guide to DVD technology is a must-read for DVD hardware/software developers, A/V publishers, IT/MIS professionals, and video/audio professionals.
Abstract: From the Publisher:
This brand new, comprehensive edition of the best-selling guide to DVD technology is a must-read for DVD hardware/software developers, A/V publishers, IT/MIS professionals, and video/audio professionals. Includes a new chapter on DVD production, and completely new DVD-ROM demo material. Covers the use of DVD with computers -- plus rewritable DVD, DVD audio, DIVX, and other new technologies.
51 citations