Showing papers in "IEEE MultiMedia in 2008"

From Tapping to Touching: Making Touch Screens Accessible to Blind Users

Abstract: The NavTouch navigational method enables blind users to input text in a touch-screen device by performing directional gestures to navigate a vowel-indexed alphabet.

SmallBlue: People Mining for Expertise Search

Abstract: This issue introduces a SmallBlue. SmallBlue finds experts, communities, and personal networks in large organizations through data mining, information retrieval, and artificial intelligence. By analyzing data from communication sources (emails, instant messages, and calendars) and Web 2.0 sources (blogs, wikis, social bookmarking systems, online profiles, and so on), the system answers questions about who knows what and who knows whom. SmallBlue-like services and system should continue attracting both researchers and industry developers to exploit the potential value in business intelligence.

ZoneTag's Collaborative Tag Suggestions: What is This Person Doing in My Phone?

Abstract: We describe ZoneTag, a camera phone application that allows users to capture, annotate, and share photos directly from their phone. We describe the simple mechanism for deriving tag suggestions and the ensuing interaction design for presenting these suggestions to the user. We also discuss quantitative and qualitative results from an 18-months deployment of ZoneTag, emphasizing the way people use and understand tag suggestions. In addition, we highlight several emerging issues that could play an important role in the collaborative tagging for multimedia as well as other resources. While the quantitative study on the use of the suggested tags feature implies clear benefits for tag suggestions, a set of qualitative studies imply that while tag suggestions are helpful, there are multiple issues that arise and require careful consideration.

The MPEG Query Format: Unifying Access to Multimedia Retrieval Systems

Abstract: The growth of multimedia is increasing the need for standards for accessing and searching distributed repositories. The moving picture experts group (MPEG) is developing the MPEG query format (MPQF) to standardize this interface as part of MPEG-7. The objective is to make multimedia access and search easier and interoperable across search engines and repositories. This article describes the MPQF and highlights some of the ways it goes beyond today's query languages by providing capabilities for multimedia query-by-example and spatiotemporal queries.

VideOlympics: Real-Time Evaluation of Multimedia Retrieval Systems

Abstract: The first VideOlympics brings content-based analysis to the archive and allows for many-to- many communication between video search engines and their audience It was a great Success. The VideOlympics provided the excitement of a competition without the associated stress on the participants. For the first time, the audience was able to compare different multimedia retrieval systems on the same tasks and see how they performed with unrehearsed topics. Many audience members felt they understood the technology's capabilities after seeing it in live action and in several system variations.

Experiencing the Past through the Senses: An M-Learning Game at Archaeological Parks

Abstract: M-learning the combination of e-learn- ling with mobile technologies captures the very nature of e-learning by providing users with independence from the constraints of time and location.1 To exploit the potential of mobile technologies for learning, researchers must define new teaching and learning techniques.2 The Explore! m-learning system implements an excursion-game technique to help middle school students (ages 11 through 13) acquire historic knowledge while playing in an archaeological park.

Collaborative Tagging of Multimedia

Abstract: The four articles in this special issue focus on collaborative tagging of multimedia. The papers are summarized here.

Collaborative Tagging Applications and Approaches

Abstract: This article reviews the state of the art in collaborative tagging, its current challenges, and potential methods for resolving these challenges, with a special focus on Web-based, user-generated content applications.

Compressed-Domain Video Processing for Adaptation, Encryption, and Authentication

Abstract: A complete framework based on the MPEG-21 generic bitstream syntax description provides video adaptation, encryption, and authentication in the compressed domain. The system doesn't require any cascaded compression and decompression.

Video Scene Annotation Based on Web Social Activities

Abstract: This article describes a mechanism to acquire the semantics of video content from the activities of Web communities that use a bulletin-board system and Weblog tools to discuss video scenes.

Haptic-Enabled Telementoring Surgery Simulation

Abstract: Medical surgery involves a high degree of skill and experience, making the learning curve for medical trainees quite long. For instance, in eye cataract surgery, despite it only taking around seven minutes for a well-trained surgeon to perform and having a success rate of 99 percent, medical residents need months to become proficient in this procedure to avoid its typical complications. Medical trainees traditionally have acquired surgical skills through apprenticeships in which trainees observe senior surgeons, then perform under guidance until they achieve mastery. Training often makes use of cadavers or laboratory animals, but this type of training is becoming increasingly difficult to do in many countries due to ethical reasons. An effective alternative is medical simulation, which can enhance understanding, improve performance, and assess competence; in preoperative settings, it assists surgeons in remaining at a high technical skill level. Surgical simulation can provide high-fidelity training that increases the diffusion of innovative and less- invasive procedures while decreasing the surgeon's learning curve.

Dynamic Video Transcoding in Mobile Environments

Abstract: A transcoder with dynamic feedback addresses interactivity, packet loss, and client power constraints in mobile communication systems.

Two Novel Technologies for Accessible Math and Science Education

Abstract: We are using the results of the study to improve the design of both programs. We plan to repeat these evaluations several times as development of both programs progresses. Evaluation with kindergarten and elementary school deaf children and their teachers will be done in collaboration with the Indiana School for the Deaf and will start in the fall of 2009. We will report the results in a future article. A strong need exists for solutions that allow deaf users to communicate and interact in an environment free of prejudice, stigma, technological barrier, or other obstacles. The fact that all children were able to engage with and complete the tasks in both test systems is encouraging.

Loss Recovery in Application-Layer Multicast

Abstract: Application-layer multicast (ALM), sometimes called overlay multicast, can help circumvent the limitations in IP multicast and unicast. In this article, we discuss and compare different recovery mechanisms in ALM. The major challenge in loss recovery is how to achieve low residual loss rate with low recovery overhead. As discussed, a promising approach might be a combination of proactive and reactive techniques.

Applications and Issues in Pen-Centric Computing

Abstract: As part of the rapidly evolving field of designing more natural user interfaces for multimedia information, pen-centric computing refuses to disappear. As a quite natural and universal interface modality, it presents many challenges. In this article, the pen-centric computing group at Brown University, led by Andries Van Dam, surveys the many prototypes they have designed and implemented, and discuss the research issues in the field still to be explored.

Video Browsing on Handheld Devices—Interface Designs for the Next Generation of Mobile Video Players

Abstract: This paper gives an overview of a group's recent and ongoing work on creating a flexible, intuitive, and powerful interface to improve video browsing on handheld devices in a similar way to how the iPhone's interaction techniques revolutionized navigation in mobile static media. This paper presented several developed and evaluated concepts and related user-interface designs. The paper limit the discussion to the presentation of the designs and refer to the related publications for detailed descriptions of evaluations and user studies.

Hand-Gesture Computing for the Hearing and Speech Impaired

Abstract: An instrumented data glove with a wireless interface provides convenient and natural human- computer interaction for people with speech or hearing impairments.

Disability Standards for Multimedia on the Web

Abstract: In the context of video interaction there is a diversity of options for disabled people who want to access the Web. However, new developments for the Web that don't account for accessibility issues increase the digital divide and add barriers to access for all people, not just for those with special needs. To sort out such accessibility issues, the World Wide Web Consortium promoted a Web accessibility initiative (WAI) to promote publication of the Web content accessibility guideline 1.0 (WCAG 1.0). This article shows how the Web content accessibility guidelines adopted by several countries could be applied to make multimedia content accessible to those with special needs.

Daisy 3: A Standard for Accessible Multimedia Books

Abstract: The Daisy standard for multimedia representation of books and other material is designed to facilitate technologies that foster easy navigation and synchronized multimodal presentation for people with print-reading-related disabilities.

Educational Multimedia

Abstract: Making education more engaging, more enjoyable, and, in the end, more effective through the use of multimedia technology has been the goal of many researchers during the past few years. Encouraging results have been achieved so far. There are many examples where multimedia is used in educational scenarios with extraordinary benefits. The next generation of Web technologies and applications, popularly symmarized as Web 2.0, is serving another trigger for this area, which is often and rather surprisingly called E-Learning 2.0. Next generation of devices and technologies not only gives us new opportunities but also poses new problems. In the special section on educational multimedia, various authors submitted their work to showcase illustration regarding the current state of the field. Their work are as follows; "A virtual camera team for lecture recording", "Toward next-generation intelligent tutors", and "Application-specific music transcription for instrument tutoring". For the first one, the goal is to use a distributed computer system to produce lecture recordings that look like the result a professional human camera team would produce, that is, a video that is more lively and interesting than current single-camera recordings that don't cut away from the lecturer's talking head. For the second one, it explores the use of handwriting recognition-based interfaces in intelligent tutoring systems for students learning algebra. And lastly for the third one, this proposes a framework for the development of much better and more useful systems by integration of application-specific aspects into the development process.

Co-Annotea: A System for Tagging Relationships Between Multiple Mixed-Media Objects

Abstract: The Co-Annotea system allows users to annotate multiple mixed-media objects and the relationships between them to enable fast and efficient tagging and correlation of large multimedia collections. we believe the work described here is significant because it represents the first implementation of a new generation of semantic annotation tools.

Open DRM and the Future of Media

Abstract: Consumers want to use their digital content in the same way they have always used analog content. Consumer associations and governments are starting to request and even impose interoperability between DRM vendors' products. Therefore, interoperability has become a hot topic among content creators and distributors. Digital music providers and even authors are starting to refute the idea thatDRM is an ideal solution for protecting their rights. This is partly due to Apple and Microsoft not making their solutions interoperate.

The Search for Interoperability

Abstract: Today's Internet search engines are not providing adequate digital-content search. With the growth in the quantity of online digital content and growing interest from users, search engines will need to provide better capabilities for finding relevant content. A significant part of the solution can come from increased use of standardized metadata. Unfortunately, limitations to the breadth and depth of search will remain as commercial competition among search engines is preventing the convergence on a single international standard for search services. The result is a highly fragmented and frustrating digital-content search experience. However, the narrow silos of content and constrained search can be improved through cooperation among search engines by building on a common interoperable search framework. While the general problem is being explored through applications and extensions of the Z39.50 standard, new focused efforts, such as JPSearch and MPEG MAFs, might provide the needed breakthroughs.

Toward Next-Generation, Intelligent Tutors: Adding Natural Handwriting Input

Abstract: This article explores handwriting recognition-based interfaces in intelligent tutoring systems for students learning algebra equations

A Virtual Camera Team for Lecture Recording

Abstract: We present the design and implementation of a virtual camera team for recording classroom lectures. Our approach to lecture recording, with well-defined tasks for each module, has two significant advantages. First, the workload is distributed; for example, the camera-operator modules and not the director module produce the images. Second, it's easier to implement complex cinematographic rules using the well-defined roles of the virtual team members and the communication between them. In this way, the virtual camera team's behavior mimics the behavior of a human camera team and thus leads to more lively recordings than earlier approaches.

Digital Television Broadcasting in Brazil

Abstract: This paper discusses ISDTV. It was designed to fulfill the challenging and unique demands of broadcasting television in Brazil while promoting digital inclusion throughout the country. With ISDTV, channels occupy the same 6-MHz bandwidth of old analog stations, and it can deliver high-and standard-definition videos to fixed, mobile, and portable devices. In 10 years, the market for digital television sets in the country is expected to reach $100 billion. The Brazilian market is the biggest in South America, and significant efforts have been made by the Brazilian Ministry of Communications to promote the Brazilian standard throughout South America. So far, Chile, Argentina, Paraguay, and Venezuela are considering its adoption.

Interactive TV Services on Mobile Devices

Abstract: The recent digitalization of television creates new opportunities for enhancing the viewer's experience with interactivity. Interactive TV (iTV) is often solely understood as the ability to change a program's storyline. Besides this interpretation, iTV in general means providing some kind of interactive add-ons or TV-related content and services. For example, the viewer might participate in a game show, gather additional information on news topics, or buy a product presented in a commercial. The combination of digital TV and modern set-top boxes facilitates the deployment of such innovative services. In this context, we developed a prototype platform that uses mobile devices to support multiuser and personalized access for iTV services. The mobile devices connect to the set-top box with ad hoc mechanisms over an existing home network, enabling inexperienced users to access and use the services without having to worry about configuration.

Virtual Environments for Anyone

Abstract: Recently, powerful programmable GPUs and VR-style input devices like the Wii controller have become common. This brings the worlds of VR, computer graphics, and games together. The technological advances that enable one to move between those worlds and create game-like VR appliances such as Flight Vienna with inexpensive commodity hardware and development tools is discussed.

Handheld Experiences: Using Audio To Enhance the Illusion of Self-Motion

Abstract: Handheld multimedia devices could benefit from multisensory technologies. The authors discuss audio, visual, and tactile cues designed to maximize presence and the illusion of self-motion.

Digesting Commercial Clips from TV Streams

Abstract: A commercial system that performs syntactic and semantic analysis during a TV advertising break could facilitate innovative new applications, such as an intelligent set-top box that enhances the ability of viewers to monitor and manage commercials from TV streams.