Showing papers in "IEEE MultiMedia in 1997"

Virtualized reality: constructing virtual worlds from real scenes

Abstract: A new visual medium, Virtualized Reality, immerses viewers in a virtual reconstruction of real-world events. The Virtualized Reality world model consists of real images and depth information computed from these images. Stereoscopic reconstructions provide a sense of complete immersion, and users can select their own viewpoints at view time, independent of the actual camera positions used to capture the event.

Visually searching the Web for content

Abstract: New visual information in the form of images, graphics, animations and videos is published on the World Wide Web at an incredible rate. However, cataloging it exceeds the capabilities of current text-based Web search engines. WebSeek provides a complete system that collects visual information from the Web by automated agents, then catalogs and indexes it for fast searching and retrieval.

A taxonomy for networked virtual environments

Abstract: We discuss virtual environments in the context of how to distribute network communications, views, data, and processes while emphasizing those aspects critical to scaling environments. Systems that demand strong data consistency, causality, and reliable communications while supporting real-time interaction are not likely to scale very well. Furthermore, geographically dispersed systems require high-speed, multicast communication.

Virtual view generation for 3D digital video

Abstract: Virtual reality systems use digital models to provide interactive viewing. We present a 3D digital video system that attempts to provide the same capabilities for actual performances such as dancing. Recreating the original dynamic scene in 3D, the system allows photorealistic interactive playback from arbitrary viewpoints using video streams of a given scene from multiple perspectives.

The Split and Merge protocol for interactive video-on-demand

Abstract: A true video-on-demand (VoD) system lets users view any video program, at any time, and perform any VCR-like user interactions. To reduce the per-user video delivery cost, multiple users may be batched and share the same video stream. Existing sharing schemes do not allow true VoD. A new protocol, called Split and Merge (SAM), does allow true VoD. SAM also provides an innovative way to merge these individuals back into the batching streams when they resume normal play mode.

Authoring and navigating video in space and time

Abstract: A formal methodology is needed to integrate and exchange spatial and temporal properties in hypermedia and hypertext. We propose a generic framework to structure and dynamically present a new form of video- and text-based media called hypervideo. We developed a Hypervideo Engine and produced an experimental hypermedia work, HyperCafe, to illustrate the general properties and aesthetic techniques possible in such a medium.

Multimedia database management-requirements and issues

Abstract: The spatial, temporal, storage, retrieval, integration and presentation requirements of multimedia data differ significantly from those for traditional data. A multimedia database management system provides for the efficient storage and manipulation of multimedia data in all its varied forms. We look into the basic nature of multimedia data, highlight the need for multimedia DBMSs, and discuss the requirements and issues necessary for developing such systems.

Adaptation in distributed multimedia systems

Abstract: The real-time requirements of continuous media call for careful resource management in distributed multimedia systems. In complex and mobile systems, however, effective resource reservation becomes almost impossible. Recent research suggests adaptive applications as a complementary solution. This article reviews heterogeneous networks and the rationale behind adaptation, gives implementation examples, and discusses some outstanding research issues.

Virtualized reality : Constructing virtual worlds from real scenes : Immersive telepresence

Abstract: A new visual medium, Virtualized Reality, immerses viewers in a virtual reconstruction of real-world events. The Virtualized Reality world model consists of real images and depth information computed from these images. Stereoscopic reconstructions provide a sense of complete immersion, and users can select their own viewpoints at view time, independent of the actual camera positions used to capture the event.

Image-based virtual world generation

Abstract: The methodologies introduced here generate photographically realistic 3D worlds from 2D photographic images instead of from 3D geometrical models. If we call conventional methods "algorithm intensive", these methods are "data intensive". Several prototype systems, including the Virtual Dome and Camera with GPS, serve as examples. Of course, both types have their advantages, so trade-offs and combinations of the two are also discussed briefly.

Networked multimedia for medical imaging

Abstract: The development of biomedical imaging has revolutionized medical practice and health care delivery. The next wave of change, however, will come from merging medical imaging with multimedia technology. We discuss the necessary information infrastructure and supporting technology for this evolving field. We describe four types of clinical applications to illustrate the use and versatility of networked multimedia systems for image-assisted medical care.

Internet protocols for multimedia communications. II. Resource reservation, transport, and application protocols

Abstract: Part I (ibid., July-Oct. 1997) surveyed the evolution of Internet protocols and applications and described the Internet protocol IPv6 in detail. This part discusses new developments at the upper layers that support real-time Internet multimedia, such as audio and video conferencing and shared whiteboard applications. Application-level framing (ALF), proposed in 1990 for protocol and application design, now forms the basis for many new Internet protocols and applications, including Real-time Transport Protocol (RTP) and Mbone multimedia applications. RTP supports real-time applications that adapt to changing network situations to maintain the quality of service (QoS). The Resource Reservation Protocol (RSVP) provides new Internet services with higher quality than best-effort by means of resource reservations.

Evaluating object DBMSs for multimedia

Abstract: We describe functionality for determining an object database management system's suitability for developing multimedia applications. We discuss all levels of hardware and software support, as even the most ideal database software cannot operate independent of operating systems, networks and hardware. A review of the multimedia support provided by current commercial and research object database management systems is also included.

Multilevel scripting for responsive multimedia

Abstract: Responsive multimedia often involves collaboration among people of varying expertise and requires innovation at many levels. Tools should support the multilevel nature of these projects, in terms of both authoring and user base. We present a multilevel scripting environment we used to develop several major multimedia prototypes ranging from interactive stories to live communication systems.

IMMPS: a multimedia presentation design system

Abstract: Our interactive multimedia presentation development system uses artificial intelligence to specify knowledge inheritance relations between presentation windows. An object-oriented multimedia database organizes resources and presentations, and a database browser facilitates object reuse. The system runs under Windows 95 and can be used for general-purpose presentations or for education, training, or product demonstrations.

DataWeb: customizable database publishing for the Web

Abstract: The DataWeb project seeks to facilitate the querying and browsing of multimedia databases over a wide spectrum of networks and media. We developed an intelligent query facility that builds on the access paradigms supported by current hypertext-style Web applications and on decision support systems. This facility generalizes the basic navigation and abstraction mechanisms of these applications to make them extensible and scalable.

A revolution in education

Abstract: A classroom is equipped with strategically placed cameras to show the instructor, a zoomed view of material chosen by the instructor, the board, and all students in the class. Enough cameras provide different views to closely observe all activities of interest in the classroom. The board itself may be electronic-a computer display as well as a tablet used for input to a computer. The combined system builds a model of the classroom at every instant and permits interactive viewing of it. In live mode, the system lets any person anywhere be telepresent in the class and participate in it. You can observe and explore as you wish, rather than relying on what the cameraman wants you to see. In a real classroom, you have a fixed location and cannot move around without disturbing the class. Not so in remote mode. A remote student can electronically copy the contents of the classroom material, including the board display. A remote student can ask questions in class at any time, and their video may be displayed to the class at any time. In fact, it is possible to display all remote students as a video gallery to provide feedback to the instructor. This classroom removes the requirement of physically being in a class to attend. In archive mode, the system can reconstruct the class proceedings in telepresence mode to let a student visit, or revisit, the class from any viewpoint. All class activities are archived for this purpose. Postprocessing can further enhance features as required. Many other information sources can be attached to provide all information at one place. The archival system lets students tele-attend a class at their own convenience and pace. This does not mean just viewing a talking-head video, but immersion in the classroom.

Reducing initial latency in media servers

Abstract: A multimedia server needs to provide high bandwidth and continuous real-time delivery. We present techniques for reducing the initial latency of presentations. This is important in interactive applications such as video games and multimedia document browsing. On-disk partial data replication can significantly reduce initial latency without adversely affecting throughput.

Multimedia Database Systems - A New Frontier

Abstract: 21 U narguably, full use of data depends on the ability to access and manipulate it at different levels of representation. Traditionally, a database is viewed as a controlled collection of data related to a given entity, while a database management system (DBMS) is viewed as a collection of such interrelated data together with the sets of programs and operations used to define, create, store, access, manage, query, and present the information in the database. Therefore, to efficiently manage and manipulate multimedia data requires the development of multimedia database management systems. A multimedia DBMS must provide for the efficient storage and manipulation of data represented as text, images, audio, graphics, video, and so on. For conventional text-based information systems, data access and manipulation have advanced considerably. However, for multimedia systems incorporating diverse data types with diverse characteristics and properties, they pose novel problems and issues. The different data types involved in multimedia databases may require special methods for optimal storage, access, indexing, and retrieval. The multimedia DBMS should also accommodate the special requirements by providing some high-level abstractions to manage these different data types, along with a suitable interface for their presentation.

Compressing and transmitting visible human images

Abstract: We address compression and transmission issues related to images in the National Library of Medicine's Visible Human Project. In total, these images amount to about 235 Gbytes of data, challenging conventional storage, retrieval, and transmission methods. We discuss lossless and lossy methods to compress the images. We also consider advanced transmission-control protocol approaches plus a multisocket technique we developed for transmitting images over wide-area networks.

Multimedia goes mobile in broadcast networks

Abstract: In digital broadcasting systems, like Eureka 147 DAB, it is possible to separate the actual service from the transmission system Such a separation enables the distribution of any type of digital data to stationary, portable, or mobile terminals However, a radio channel for mobile reception has certain characteristics to which existing multimedia services must adapt We present a multimedia system model for digital broadcasting We also discuss implementing this model within the broadcasting framework

Multimedia database management : Requirements an issues : Multimedia database systems

Abstract: The spatial, temporal, storage, retrieval, integration, and presentation requirements of multimedia data differ significantly from those for traditional data. A multimedia database management system provides for the efficient storage and manipulation of multimedia data in all its varied forms. We look into the basic nature of multimedia data, highlight the need for multimedia DBMSs, and discuss the requirements and issues necessary for developing such systems.

Live Art

Abstract: If you really want to be smarter, reading can be one of the lots ways to evoke and realize. Many people who like reading will have more knowledge and experiences. Reading can be a way to gain information from economics, politics, science, fiction, literature, religion, and many others. As one of the part of book categories, live art always becomes the most wanted book. Many people are absolutely searching for this book. It means that many love to read this kind of book.

Building open programmable multimedia networks

Abstract: Recent advances in distributed systems and transportable software and increasing demand for better quality of service (QoS) control in multiservice networks are driving a reexamination of network software architectures. We established the Comet (Control, Management, and Telemedia) Group at Columbia University's Center for Telecommunications Research to provide comprehensive understanding of network software architecture for the 1990s and beyond. This research focuses on developing new network architectures that support service creation, QoS control, and the joint allocation of computing and communications resources. This provides an opportunity to reconcile the perspectives of the computing and communication communities. Future multiservice (multimedia) networks will carry traffic such as video, audio, and computer data with diverse QoS requirements. Such networks will thus require that we develop ways to manage many physical and logical entities, services, and users.

On coordinated display of structured video

Abstract: This article presents a taxonomy of resource scheduling techniques that enable a multidisk hardware platform to support coordinated displays. It describes three techniques that use the available disk bandwidth to minimize latency and memory requirements. A simulation study quantifies the tradeoffs associated with these techniques.

Opportunities for visual computing in healthcare

Abstract: Electronically connecting medical experts with patients permits remote care delivery from diagnostics to surgery. Traditional visual computing tasks such as volume rendering or image processing may also become more available when electronically local. Recent innovations in media processing and client-server technology will help process both video and graphics in real time and enable an electronically local environment for healthcare.

Web agents that work

Abstract: Intelligent search applications are the future direction for the World Wide Web and for the Internet in general, but without the ability to gather and understand exact information about multimedia data and documents, making these applications a reality will be difficult. In the future, we may have the technology necessary to read human-oriented multimedia documents. Making the Web less agent-hostile takes great strides toward that goal today.

MHEGAM-a multimedia messaging system

Abstract: MHEGAM (MHEC-1 Advanced Mail) is a complete multimedia messaging system for the creation, exchange, and restitution of multimedia messages that express spatial and temporal synchronization among their components. MHEGAM can be based on the standard messaging systems X.420 or MIME. We present the multimedia extensions MHECAM-X.420 and MHEGAM-MIME and discuss the multimedia message format and architecture components for both systems.

Internet protocols for multimedia communications. I. IPng-the foundation of Internet protocols

Abstract: Surveys recent and current standardization work by the Internet Engineering Task Force (IETF) on Internet communication protocols. The author describes the IPng project and the IPv6 protocol that will form the basis for upper-layer protocols such as resource reservation, transport and application level protocols. The IETF decided in 1992 to develop a new version of the Internet Protocol (IP) because the available address space of IP version 4 (IPv4) will probably run out early in the 21st Century. The need for a new IP version provided the opportunity to redesign the protocol and add new functions.