Showing papers on "Multimedia database published in 1995"

Multimedia and imaging databases

Abstract: From the Publisher: Affordable and mainstream manipulation of multimedia data types will lead to tremendous growth in imaging and multimedia data in general computing environments. Multimedia and imaging applications can now provide benefits to common business applications by integrating voice, sound, images, animation and digitized video. Ultimately, it will be possible to convert all information that is currently stored on paper, video and film into a digitized environment. This will allow users to organize, search and route multimedia objects over local and wide area networks in real time. The authors' introductory level presentation of this new class of data types supplies the database technology required for effective manipulation and storage. Multimedia and database experts, Khoshafian and Baker aptly illustrate the ability of multimedia database systems to concurrently share, access, and query large collections of multimedia information. They introduce the elemental concepts of object and relational databases and then apply them to multimedia and imaging databases. Fundamental database topics discussed include querying, transaction support, recovery, security, and storage. This book provides information essential to the incorporation of multimedia databases that will improve the quantity and quality of information manipulated by computer users in many areas including medicine, computer aided design, and information retrieval systems.

Continuous Media Sharing in Multimedia Database Systems

Abstract: The timeliness and synchronization requirements of multimedia data demand e&ient buffer management and disk access schemes for multimedia database systems. The data rates involved are very high and despite the developmenl of eficient storage and retrieval strategies, disk I/O is a potential bottleneck, which limits the number of concurrent sessions supported by a system. This calls for more eficient use of data that has already been brought into the buffer. We introduce the notion of continuous media caching, which is a simple and novel technique where data that have been played back by a user are preserved in a controlled fashion for use by subsequent users requesting the same data. We present heuristics to determine when continuous media sharing is beneficial and describe the bufler management algorithms. Simulation studies indicate that our technique substantially improves the performance of multimedia database applications where data sharing is possible.

Multimedia database management systems

Abstract: In this tutorial we present the current-state-of-the art in multimedia database management systems. We discuss various issues related to semantic modeling and indexing of multimedia information. Various schemes to represent temporal synchronization requirements are explored and the current research challenges facing the multimedia database community are highlighted.

An object-oriented multimedia database system for a news-on-demand application

Abstract: We describe the design of a multimedia database management system for a distributed news-on-demand multimedia information system. News-on-demand is an application that uses broadband network services to deliver news articles to subscribers in the form of multimedia documents. Different news providers insert articles into the database, which are then accessed by users remotely, over a broadband, asynchronous transfer-mode (ATM) network. The particulars of our design are an object-oriented approach and strict adherence to international standards, in particular the Standard Generalized Mark-up Language (SGML) and Hy-Time. The multimedia database system has a visual query facility, which is also described in this paper. The visual query interface provides three major facilities for end users: presentation, navigation, and querying of multimedia news documents. The main focus, however, is the querying of multimedia objects stored in the database.

A quality-of-service specification for multimedia presentations

Abstract: The bandwidth limitations of multimedia systems force trade-offs between presentation-data fidelity and real-time performance. For example, digital video is commonly encoded with lossy compression to reduce bandwidth, and frames may be skipped during playback to maintain synchronization. These trade-offs depend on device performance and physical data representations that are hidden by a database system. If a multimedia database is to support digital video and other continuous media data types, we argue that the database should provide a quality-of-service (QOS) interface to allow application control of presentation timing and information-loss trade-offs. This paper proposes a data model for continuous media that preserves device and physical data independence. We show how to define formal QOS constraints from a specification of ideal presentation outputs. Our definition enables meaningful requests for endto-end service guarantees, while leaving the database system free to optimize resource management. We propose one set of QOS parameters that constitute a complete model for presentation error, and we show how this error model extends the opportunities for resource optimization.

Multimedia Database Systems — The Notions and the Issues

Abstract: In this article, we give an overview of the usage of database systems in the emerging field of multimedia computing systems. We motivate that management of multimedia information requires support of temporal relationships, interactive operations, high data volume, and transport of multimedia data. The solutions achieved so far vary to which extend multimedia applications are supported. We suggest to use the notions of hybrid, structural, behavioral, and distributed multimedia systems to classify them. We emphasize the current issues in the area of multimedia database research. Multimedia data modeling, content-based retrieval, continuous storage management, and a distributed architecture are the constituents of multimedia database management systems. The developments achieved so far with the AMOS prototype currently under development at our institutes serve as an illustrating example of current efforts. Specifically, the design of a datatype for audio information, the modeling of meta information and of interactive multimedia presentations, the development of an object manager for continuous objects, and the integration of an information retrieval system in our system are described.

Modeling of Video Data for On-Line Object-Oriented Query Processing

Abstract: This paper presents a framework for data modeling and semantic abstraction of image/video data. The framework is based on spatio-temporal information associated with salient objects in an image or in a sequence of video frames and on a set of generalized n-ary operators defined to specify spatial and temporal relationships of objects present in the data. The methodology presented in this paper can manifest itself effectively in conceptualizing events and heterogeneous views in multimedia data as perceived by individual users. The proposed paradigm induces a multilevel indexing and searching mechanism that models information at various levels of granularity and hence allows processing of content-based queries in real time. We also devise a unified object-oriented interface for users with heterogeneous views to specify quem’es on the unbiased encoded data. Currently this framework is being developed to realize a highly integrated multimedia database architecture. 1

Method for transparent marking of digital images for storage, retrieval and processing within a computer database

Abstract: A method for including additional data, such as identifying text, within a stored digital image, the additional data being hidden from view when the image is displayed. The method includes the step of identifying a region within the digital image which contains picture elements, or pixels, having either a constant intensity, hue or saturation value, or a random distribution of such values for the storage of “hidden” data. An pixel value is determined which differs slightly or blends well with the values contained within the image region into which the hidden data is to be written; and the additional data is saved within the constant or random content image region at this determined intensity value. The intensity value utilized for the encoding of the hidden data or text, although differing slightly from the intensity values of the background pixels within the image region into which the hidden data or text is written, is selected such that the difference between the pixel value of the background and the pixel value of the hidden data is indiscernible when the image is viewed by the human eye. The hidden data stored with the digital image may be identifying text which can be used to aid in the storage, recognition, classification, recovery and retrieval of digital images within a multimedia database.

Spatio-temporal modeling of video data for on-line object-oriented query processing

Abstract: The paper presents a framework for data modeling and semantic abstraction of image/video data. The framework is based on spatio-temporal information associated with salient objects in an image or in a sequence of video frames and on a set of generalized n-ary operators defined to specify spatial and temporal relationships of objects present in the data. The methodology presented in this paper can manifest itself effectively in conceptualizing events and heterogeneous views in multimedia data as perceived by individual users. The proposed paradigm induces a multilevel indexing and searching mechanism that models information at various levels of granularity and hence allows processing of content-based queries in real time. We also devise a unified object-oriented interface for users with heterogeneous views to specify queries on the unbiased encoded data. This framework is being developed to realize a highly integrated multimedia database architecture.

ATM connection and traffic management schemes for multimedia internetworking

Abstract: The rapid advances being made in microprocessor technology have stimulated significant interest in distributed multimedia applications supported by high-speed networks. Examples of distributed multimedia applications include multimedia database retrieval, distributed multimedia documents, and video mail. Due to the large amount of multimedia traffic for audio/visual applications, these applications require high speed networks to retrieve data in real time, instead of huge local disk storage

The management and applications of teleaction objects

Abstract: Teleaction objects (TAOs) possess private knowledge specific to the object instances. The user can create and modify the private knowledge of a TAO, so that it automatically reacts to certain events to preperform operations for generating timely responses, improving operational efficiency and maintaining consistency. Moreover, TAOs also possess a hypergraph structure leading to the effective presentation and efficient communication of multimedia information. The active multimedia system (AMS) is designed to manage the TAOs. In the AMS, each TAO has its own private knowledge, realized by the active index cells. The applications to smart multimedia mail and multimedia information retrieval are described to illustrate the usefulness of TAOs. We discuss the advantages of the proposed approach and future research.

Building a medical multimedia database system to integrate clinical information: an application of high-performance computing and communications technology.

Abstract: The rapid growth of diagnostic-imaging technologies over the past two decades has dramatically increased the amount of nontextual data generated in clinical medicine. The architecture of traditional, text-oriented, clinical information systems has made the integration of digitized clinical images with the patient record problematic. Systems for the classification, retrieval, and integration of clinical images are in their infancy. Recent advances in high-performance computing, imaging, and networking technology now make it technologically and economically feasible to develop an integrated, multimedia, electronic patient record. As part of The National Library of Medicine's Biomedical Applications of High-Performance Computing and Communications program, we plan to develop Image Engine, a prototype microcomputer-based system for the storage, retrieval, integration, and sharing of a wide range of clinically important digital images. Images stored in the Image Engine database will be indexed and organized using the Unified Medical Language System Metathesaurus and will be dynamically linked to data in a text-based, clinical information system. We will evaluate Image Engine by initially implementing it in three clinical domains (oncology, gastroenterology, and clinical pathology) at the University of Pittsburgh Medical Center.

Playout management-an integrated service of a multimedia database management system

Abstract: Playout management subsumes lower and higher level system tasks necessary to execute stored multimedia presentations. For multimedia database management systems, we propose the integration of a respective playout management service. On one hand, this provides optimal database management support for multimedia applications. On the other, this makes the handling of multimedia data within a multimedia database management system more efficient since the storage, retrieval, buffering, and playout management is performed by one consistent system. As an example, we introduce the integrated playout management service of the AMOS system, a distributed object-oriented multimedia database management system. An extension toward reactive adaptive playout management making the multimedia database management system able to overcome insufficient system performance while realizing multimedia presentations is also briefly discussed.

Special issue on multimedia database systems

Abstract: The areas expected to benefit enormously from the emerging multimedia technologies include advanced information management systems for a broad range of applications, remote collaboration via video teleconferencing, improved simulation methodologies for all disciplines of science and engineering, and better human-computer interfaces. Vast libraries of information including arbitrary amounts of text, video, pictures, and sound have the potential to be used more efficiently than the traditional book, record, and tape libraries of today. These applications are just samples of the things possible with the development and use of multimedia databases. As the need for multimedia information systems is growing rapidly in various fields, management of such information is becoming a focal point of research in the database community. This partially explains the explosion of research in the areas related to the understanding, development, and use of multimedia-related technologies. With all the euphoria surrounding the potential benefits of the coming multimedia revolution, computer scientists and engineers are faced with real technological challenges that are pushing the available hardware, as well as the ingenuity of human thought, to their limits. Some of the hardware problems are:

STORM: structural and temporal object-oriented multimedia database system

Abstract: The STORM DBMS integrates structural and temporal aspects for building different presentations of multimedia objects (i.e. text, audio, image, video). We integrate structural operators (e.g. tuple, list, set) and temporal relationships (e.g. before, after, equal) for defining multimedia presentations. Temporal aspects are modeled through the notion of Temporal Shadow which incorporates free or bound durations and/or delays. Our approach provides sequential and parallel presentations synchronizing different objects. These presentations are themselves stored as database objects and can be derived automatically from the schema, updated and queried.

Multimedia Applications and Their Implications on Database Architectures

Abstract: Over the last five to six years everybody has been talking about multimedia computing and how multimedia computing would change our ways of doing business and of running our every day life. In all the excitement around multimedia and the rapid creation of early products a more systematic investigation and development has been left to find. However, more recently companies, developers, and researchers have come about and realize now that a more systematic approach to multimedia in the long run will be beneficial to everybody. Using some typical application scenarios we will investigate the functionality required in multimedia databases and illustrate that "simple" extensions of relational databases are not the answer but that more advanced systems, incorporating concepts of object-oriented or active databases as well as handling functionality for (new) multimedia data types, are needed. We discuss the characteristics of multimedia data and observations with respect to requirements for multimedia database systems. Then, general conclusions from the characteristics and observations with respect to the functional building blocks of a multimedia database system are drawn. Based on a reference architecture we discuss individual extensions of database technology required for multimedia database systems.

The virtual hospital. Providing multimedia decision support tools via the Internet.

Abstract: Physicians in the clinical setting remain isolated from important sources of medical information. The authors have created a multimedia database known as The Virtual Hospital that improves access to current medical data, which is used to improve patient care decisions. The Virtual Hospital is a digital health sciences library stored on a server (computer) at The University of Iowa and delivered via the Internet to inexpensive personal computers in the workplace. The emerging standard of the World Wide Web is used to provide cross-platform distribution.

Scheduling issues in multimedia query optimization

Abstract: This paper examines the scheduling of concurrent requests on multimedia storage servers consisting of multiple resources, which is a central issue in processing and optimization of complex queries in multimedia database systems [Chaudhuri 1994]. It introduces a formal model for the demands imposed by multimedia requests on the server resources, described a heuristic algorithm for scheduling the requests that is based on the formal model, and presents a formal result that bounds the performance of the schedule produced by the algorithm compared to the optimal schedule. Scheduling requests that involve continuous media data types, for example, audio and video objects, is a challenging problem due to the following distinguishing characteristics of multimedia environments:

Multimedia database creation and management utilizing an evaluation of file contents in the database management

Abstract: A graphic, representing possible values of attribute data for multimedia data to be stored, is displayed, and a desired position on the graphic is designated to store the multimedia data and the attribute data. Multimedia data and attribute data of the multimedia data are stored in a memory, status of the attribute data is displayed in a graphic form, a desired position on the graphic is designated, and the multimedia data is read form the memory in accordance with the designation.

An Approach to Quality of Service Management for Distributed Multimedia Applications

Abstract: Emerging high-speed networks and powerful end-systems give rise to a new class of applications such as video-on-demand and teleconferencing. Such applications are very demanding on Quality of Service (QoS) because of the isochronous nature of media they are using. To provide QoS support on an end-to-end basis, the need for the integration of network, transport, and operating services arises. Thus to support the new emerging services, an end-to-end QoS management is required. This paper deals with QoS management for multimedia applications by taking remote access to multimedia database as a case study. The example application is introduced and the entities involved in QoS provision are identified. QoS management activities are defined and a basic QoS management architecture for multimedia applications is presented. A general framework for QoS (re)negotiation is defined and an instantiation of this framework in the context of the example application is presented.

Hyperimages: using object recognition for navigation through images in multimedia

Abstract: Multimedia involves the use of multiple forms of communication media in an interactive and integrated manner. At present, textual data is the media predominantly used to provide the interactivity due to the ease with which discrete semantic elements are identified. It is common practice to follow links from words or phrases within text to associated information elsewhere in the database. To achieve a similar degree of functionality with visual information typically requires that each image (or video sequence) be processed by hand, indicating the objects and locations within the image -- a process that is excessively expensive and time-consuming for large databases. This paper describes the implementation of a simple object recognition system that allows the specification of 3D models that can then be used to recognize objects within any image, in an analogous fashion to words within text. This enables image data to become a truly active media, within a multimedia database. It provides a significantly enhanced level of functionality while keeping the authoring effort to a minimum. The basic algorithms are described and then an example application is outlined, along with feedback from users of the system.

The role of database systems in the management of multimedia information

Abstract: Our research into multimedia information management and storage focuses on enabling database systems to deal with multimedia content at a high level of abstraction. We examine the database system's role in managing multimedia data. Database systems need to do more than providing a document model or binary large objects to implement multimedia database systems. We examine what the database system's role is in managing multimedia data. We then show how the role of the database system merges with the role of media servers that is an extension of traditional file servers with isochronous multimedia data delivery capabilities. The database system provides richer data management opportunities than media servers because of its increased knowledge of the stored multimedia data. This allows the database system to optimize and better manage system resources and multimedia data delivery.

A multimedia query specification language

Abstract: Typically, multimedia applications involve thousands of hours of video, images, audio, text and graphics that need to be stored, retrieved and manipulated in a large multimedia database. There is therefore an important need for novel techniques and systems which provide an efficient retrieval facility of the voluminous information stored in the multimedia database. Such facility will consist of a query language, a data structure, and a content searching algorithm. We propose a multimedia query specification language that can be used to describe the multimedia content portion to be retrieved from the database. Such a content portion is termed a multimedia segment which may contain information on the media as well as the temporal and spatial relationships that may exist between these media.

Query Languages in Multimedia Database Systems

Abstract: Declarative query languages are an important feature of database management systems and have played an important role in their success. As database management technology enters the multimedia information system area, the availability of special-purpose query languages for multimedia applications will be equally important. In this report 1 , we survey multimedia query languages and query models. Particularly, we look at those systems from the point of view of well-deened queries, fuzzy queries, visual queries, and query presentations. Several research issues, such as generic multimedia query languages, incremental queries, fuzzy queries, spatio-temporal queries, feature storage and organization, are also identiied. In our opinion these are vital issues for the success and development of a multimedia query language.

Views of media objects in multimedia databases

Abstract: Multimedia database systems must manage large amounts of graphical, textual, and audio data. To compound the problem, if a multimedia designer creates a new media image from an existing item, current systems store the new object as an independent image. This space is wasted since the data already exists in the system. In order to eliminate this wasted space, views of stored objects should be used instead of replicated data. Views are well known in relational databases to have both benefits and drawbacks. In order to overcome these drawbacks, the paper defines a view schema, which mirrors the media hierarchy; a view dag which determines the base files used to create the view; and view independence, a paradigm for performing operations on views. The criteria for a canonical media algebra are outlined. A canonical media algebra allows multiple editors to instantiate a view. Finally, optimization of specifications is discussed.

Multimedia databases and servers

Abstract: Database technology is evolving to accommodate complex multimedia objects — data types that present unique challenges in the storage and movement of large time-dependent objects. The manipulation and analysis of these large and semantically rich objects require techniques far different from those used for alphanumeric databases. This paper presents multimedia server-based architectures based on massively parallel processor systems and an object-relational database management system. The transition from client-centric multimedia applications to a client/server environment is examined, and several applications are discussed that illustrate the use of multimedia database servers based on the object-relational model. Finally, this paper reviews the architecture of two scaleable multimedia servers that can support these applications: MoonBase, a database server with full content analysis capability for multimedia objects, and the audio/video server, a system-based file server that can operate within the MoonBase architecture.

A Temporal Expansion to the Multimedia Object Model in OMEGA

Abstract: Although object-oriented technology is necessary to construct a multimedia database management system, it is not sufficient because it lacks some functions which are essential to support temporal and spatial multimedia objects. In this paper, we investigate temporal multimedia object modeling issues: We first deIIne temporal objects, temporal attributes, and temporal relationships among objects. Then a five temporal axes model for representing temporal multimedia objects is introduced. The five temporal axes an absolute, a relative, a quasi-, a physical, and a presentation time axis are necessary to describe timedependent properties of multimedia objects in modeling, implementing and use. This model is a temporal expansion to the OMEGA multimedia object model which has been under development at the University of Library and Information Science.