Showing papers on "Multimedia database published in 2010"

Bilvideo-7: an MPEG-7- compatible video indexing and retrieval system

Abstract: Early prototype multimedia database management systems used the query-by-example paradigm to respond to user queries. Users needed to formulate their queries by providing examples or sketches. The query-by-keyword paradigm, on the other hand, has emerged due to the desire to search multimedia content in terms of semantic concepts using keywords or sentences rather than low-level multimedia descriptors. After all, it's much easier to formulate some queries by using keywords. However, some queries are still easier to formulate by examples or sketches-for example, the trajectory of a moving object.

iPod, iPhone, and now iPad: The evolution of multimedia access in a mobile teaching context

Abstract: The problem presented in this poster session is “How can a multimedia database be easily used as a teaching tool in the classroom?” This poster presents the iPad as a mobile handheld delivery tool for multimedia database components. Teaching strategies which utilize the iPad as a teaching tool benefit from several key affordances over previous iPod generations: easy of interaction (touch screen), increased screen size, controllable multimedia playback, significant volume, and various data collection capabilities. The teaching strategy described in this poster is the leading of mobile small group demonstrations using finely controlled multimedia playback. An overview of the process required to easily create a multimedia database on an iPad is presented as a critical component of successful use. This poster session describes a specific application of the iPad in the classroom and further research needs to explore iPad data collection capabilities to extend the use into other educational contexts.

Multimedia Databases and Data Management: A Survey

Abstract: The exponential growth of the technological advancements has resulted in high-resolution devices, such as digital cameras, scanners, monitors, and printers, which enable the capturing and displaying of multimedia data in high-density storage devices. Furthermore, more and more applications need to live with multimedia data. However, the gap between the characteristics of various media types and the application requirements has created the need to develop advanced techniques for multimedia data management and the extraction of relevant information from multimedia databases. Though many research efforts have been devoted to the areas of multimedia databases and data management, it is still far from maturity. The purpose of this article is to discuss how the existing techniques, methodologies, and tools addressed relevant issues and challenges to enable a better understanding in multimedia databases and data management. The focuses include: 1 how to develop a formal structure that can be used to capture the distinguishing content of the media data in a multimedia database MMDB and to form an abstract space for the data to be queried; 2 how to develop advanced content analysis and retrieval techniques that can be used to bridge the gaps between the semantic meaning and low-level media characteristics to improve multimedia information retrieval; and 3 how to develop query mechanisms that can handle complex spatial, temporal, and/or spatio-temporal relationships of multimedia data to answer the imprecise and incomplete queries issued to an MMDB.

Extraction and classification of unstructured data in WebPages for structured multimedia database via XML

Abstract: Nowadays, there is a vast amount of information available in the internet. The useful data must be captured and stored for future purposes. One of the major unsolved problems in the information technology (IT) industry is the management of unstructured data. The unstructured data such as multimedia files, documents, spreadsheets, news, emails, memorandums, reports and web pages are difficult to capture and store in the common database storage. The underlying reason is due to the tools and techniques that proved to be so successful in transforming structured data into business intelligence and actionable information, simply do not work when it comes to unstructured data. As a result, new approaches are necessary. Attempts have been undertaken by several researchers to deal with unstructured data, but, so far it is hard to find a tool that can store and retrieve the extracted and classified unstructured data into a structured database system. This paper is to present our research on unstructured data identification, extraction and classification of web pages, which is then transformed into structured format in Extensible Markup Language (XML) document, and later stored into a multimedia database. The contribution of this research is in the approach of capturing the unstructured data and the efficiency of a multimedia database to handle this kind of data. The stored data could give benefits to various communities such as students, lecturers, researchers and IT managers because it can be used for any planning, decision-making, day-today operations, and other future purposes.

SemaSun: Visualization of Semantic Knowledge based on an improved Sunburst Visualization Metaphor

Abstract: Ontologies have become an established data model for conceptualizing knowledge entities and describing semantic relationships between them. They are used to model the concepts of specific domains and are widespread in the areas of the semantic web, digital libraries and multimedia database management. To gain the most possible benefit from this data model, it is important to offer adequate visualizations, so that users can easily acquire the knowledge. Most ontology visualization techniques are based on hierarchical or graph-based visualization metaphors. This may result in information-loss, visual clutter, cognitive overload or context-loss. In this paper we describe a new approach of ontology visualization technique called SemaSun that is based on the sunburst visualization metaphor. We improved this metaphor, which is naturally designed for displaying hierarchical data, to the tasks of displaying multiple inheritance and semantic relations. This approach also offers incremental ontology exploring to reduce the cognitive load without losing the informational context.

A language-based approach to indexing heterogeneous multimedia lifelog

Abstract: Lifelog systems, inspired by Vannevar Bush's concept of "MEMory EXtenders" (MEMEX), are capable of storing a person's lifetime experience as a multimedia database. Despite such systems' huge potential for improving people's everyday life, there are major challenges that need to be addressed to make such systems practical. One of them is how to index the inherently large and heterogeneous lifelog data so that a person can efficiently retrieve the log segments that are of interest. In this paper, we present a novel approach to indexing lifelogs using activity language. By quantizing the heterogeneous high dimensional sensory data into text representation, we are able to apply statistical natural language processing techniques to index, recognize, segment, cluster, retrieve, and infer high-level semantic meanings of the collected lifelogs. Based on this indexing approach, our lifelog system supports easy retrieval of log segments representing past similar activities and generation of salient summaries serving as overviews of segments.

The study of multimedia data model technology based on cloud computing

Abstract: The study describes the cloud computing-based multimedia database and the different traditional database, object-oriented database model of the concept, discusses the cloud-based object-oriented multimedia database of two ways, and summarized the characteristics of such multimedia database model, superiority and development.

Combining semantic, social, and acoustic similarity for retrieval of environmental sounds

Abstract: Recent work in audio information retrieval has demonstrated the effectiveness of combining semantic information, such as descriptive, tags with acoustic content. However, these methods largely ignore the possibility of tag queries that do not yet exist in the database and the possibility of similar terms. In this work, we propose a network structure integrating similarity between semantic tags, content-based similarity between environmental audio recordings, and the collective sound descriptions provided by a user community. We then demonstrate the effectiveness of our approach by comparing the use of existing similarity measures for incorporating new vocabulary into an audio annotation and retrieval system.

Automatic index construction for multimedia digital libraries

Abstract: Indexing remains one of the most popular tools provided by digital libraries to help users identify and understand the characteristics of the information they need. Despite extensive studies of the problem of automatic index construction for text-based digital libraries, the construction of multimedia digital libraries continues to represent a challenge, because multimedia objects usually lack sufficient text information to ensure reliable index learning. This research attempts to tackle the problem of automatic index construction for multimedia objects by employing Web usage logs and limited keywords pertaining to multimedia objects. The tests of two proposed algorithms use two different data sets with different amounts of textual information. Web usage logs offer precious information for building indexes of multimedia digital libraries with limited textual information. The proposed methods generally yield better indexes, especially for the artwork data set.

A computation-oriented multimedia data streams model for content-based information retrieval

Abstract: Multimedia applications nowadays are becoming prevalent. In the past the relational database model was generalized to the multimedia database model. More recently the relational database model was generalized to the data streams model, as the technology advanced and data became bulky and unbounded in size due to the utilization of sensor networks. In this paper we take one more step of generalization by providing a multimedia data streams model. The objective is to furnish a formal framework to design multimedia data streams (MMDS) schema for efficient content based information retrieval. We also extend the functional dependency theory and the normalization framework to handle multimedia data streams. Finally we present algorithmic methods of generating continuous multimedia queries along with examples for illustration.

Techniques for efficiently searching in spatial, temporal, spatio-temporal, and multimedia databases

Abstract: This tutorial provides a comprehensive and comparative overview of general techniques to efficiently support similarity queries in spatial, temporal, spatio-temporal, and multimedia databases In particular, it identifies the most generic query types and discusses general algorithmic methods to answer such queries efficiently In addition, the tutorial sketches important applications of the introduced methods, and presents sample implementations of the general approaches within each of the aforementioned database types The intended audience of this tutorial ranges from novice researchers to advanced experts as well as practitioners from any application domain dealing with spatial, temporal, spatio-temporal, and/or multimedia data

Method and apparatus for searching video

Abstract: The invention discloses a video searching method and a device. The method includes: collecting and memorizing a video sequence, carrying out motion detection on the video sequence as well as calculating and memorizing the motion description values of motion fragments when each motion fragment is detected; when one motion fragment is needed to be searched in the video sequence, calculating the motion description value of the motion fragment which needs to be searched and matching the motion description value obtained by calculation to be matched with the memorized motion description value of each motion fragment one by one; if the two values are matched, then outputting the motion fragment in the database. The invention quantizes the motion detection result of the video sequence and can affect the search of the video data only by using the existing relation database with mature technology without applying complex multimedia database, thus the search of the video data is realized easilyand the search speed is improved.

A Multiple-Instance Learning Based Approach to Multimodal Data Mining

Abstract: This paper presents multiple-instance learning based approach to multimodal data mining in a multimedia database. This approach is a highly scalable and adaptable framework that the authors call co-learning. Theoretic analysis and empirical evaluations demonstrate the advantage of the strong scalability and adaptability. Although this framework is general for multimodal data mining in any specific domain, to evaluate this framework, the authors apply it to the Berkeley Drosophila ISH embryo image database for the evaluations of the mining performance in comparison with a state-of-the-art multimodal data mining method to showcase the promise of the co-learning framework.

Context-based Multimedia Content Management Framework and Its Location-aware Web Applications

Abstract: This paper treats a context-based multimedia content management system (MCMS), whose various types of contents are easily gathered from everywhere at anytime using mobile phones, and stored in a web server as a multimedia database. In this paper, the authors propose the framework of software components for developing location-aware web applications that use multimedia contents stored in the multimedia database on the web server. The authors also introduce several practical location-aware web applications, e.g., Google Maps based Sight-seeing information system, Google Maps based web Natural Science Dictionary, etc. that are already developed using the proposed components. One of the prospective applications of the proposed framework is Google Maps based Life-log system. Data stored by a lot of users using their mobile phones are regarded as their Life-log data because the data includes location data by GPS, date/time data, other related multimedia data such as picture images, movies, recorded sounds and texts. By analyzing them using any data-mining methods, it is possible to extract activity patterns of the users those are very useful for various web services like recommendation systems. As a theoretical aspect of the paper, the authors discuss data analyzing techniques to be used in the proposed framework.

A Data Mining Model and Methods Based on Multimedia Database

Abstract: Multimedia Mining is a young but challenging subfield in Data Mining. There are not unified conclusions in the concept, content and methods of Multimedia Mining, Multimedia mining architecture and framework has to be further studied. Based on these, it introduces a appropriate data mining model based on multimedia database; it has analyzed the methods which are associated with the model: data cube, clustering, classification and association rules; at last it has given a instance of data mining in multimedia database which used association rules.

A Multimedia Database Server Functionality

Abstract: This paper presents a dedicated multimedia database server optimized for working with medical images. The presented server can manage alphanumerical and multimedia data collections with at most few tens of thousands records. An element of originality for this system is that alongwith classical operations for databases, it includes a series ofmethods used for extracting visual information from images(texture and color characteristics). This information is saved directly into database in a special data type and can be retrieved using methods for text based or content-basedqueries. These methods are also integrated into the server.

iTeach, iDance: Using the iPad in the body-kinesthetic teaching context

Abstract: This session explores a particular classroom application of the iPad and extends ongoing research on pedagogical applications of mobile multimedia databases in the physical education classroom. In this study, the researcher identified mobile small group demonstration capabilities and ease of video database access as key characteristics of the iPad as a teaching tool. The described uses include: leading demonstration and discussions, easy access to extension materials, and opportunities for scaffolding of learning materials. This research explores a specific application of the iPad mobile device in the classroom that is possible due to the device’s large screen format. It extends the research on a specific classroom application of a mobile device and points to other potential applications. Further research exploring the extension of this iPad application to other body-kinesthetic teaching contexts, such as the general physical education classroom, is needed.

A Hierarchical Bitmap Indexing Method for Similarity Search in High-Dimensional Multimedia Databases

Abstract: This paper proposes an efficient indexing mechanism for similarity search in high-dimensional multimedia database that quickly filter-outs the irrelevant objects using a novel indexing structure, called HBI (Hierarchical Bitmap Index). In this bitmap index, the feature (or attribute) value of object at each dimension is represented with a set of two bits each of which indicates whether it is relatively high ('11'), low ('00'), or neither ('01') compared to the feature values of other objects at a hierarchical organized interval. This approximation helps to reduce the CPU time of filtering process because many irrelevant objects could be simply excluded by just XORing the bitmaps of two objects. Upon experimental results, we find that there is an optimal number of bitmaps that keeps the filtering rate as high as possible while keeping the search time as short as possible. Furthermore, we also find that the similarity search using the proposed indexing mechanism is about 2-3 times faster than VA-File while guaranteeing the exact solutions.

Optimizing similarity-based image joins in a multimedia database

Abstract: Commonly used content-based image retrieval systems focus on the problem of finding similar images for a given single query object out of a database of media objects. We consider a similarity-based image join of two image tables, where the image data components are represented by their respective feature vectors. For each image of the first table, similar images are looked up in the second table. Matching tuples are combined. We consider multiple joins which allows one to join a previous join result to another image table, and so on. Thus, each multiple join result tuple contains n images, if n tables are joined. An image of the result tuple is therefore not only similar to the image from its join partner, but also to the image similar to it. In this context, the paper presents processing and optimizing strategies for multiple similarity-based image joins and a cost model for integrating them in a multimedia database. The cost model is validated by an X-tree reference implementation. The presented strategies in this paper are currently been implemented in Oracle Multimedia.

Concept based interactive retrieval for social environment

Abstract: Following the recent developments in social networking, there is an emerging interest to share experiences online with social peers through multimedia data. Consequently, exponential amount of multimedia information has been generated by everyday users and shared among social peers. As opposed to conventional digital archives, the user generated content archive does not confine to one particular domain and therefore semantic indexing of the content requires the creation of large number of training samples for each semantic query concept. Addressing this problem, we present an interactive multi-concept based browsing and retrieval framework using which users can construct high-level semantic queries based on mid-level primitive features. The proposed framework integrates innovative visualisation methodology developed for browsing, navigating and retrieving information from multimedia database. The framework is user centric and supports interactive formulation of high-level semantic queries for content retrieval using available content annotation. The performance of the proposed framework is evaluated using annotation based on automatic algorithms against Support Vector Machines, Multi-feature classification and particle swarm optimisation based relevance feedback techniques.

A Multimedia Database Application for Vehicle Surveillance System

Abstract: Vehicles surveillance system provide a large range of informational services for the driver and administrator such as multi view road and driver surveillance videos from multiple cameras mounted on the vehicle, video shots highlighting the traffic conditions on the roads and monitoring driving behavior. Annotation and retrieving of these video streams has an importance role on visual aids for safety and vehicle guidance. Using video as a primary multimedia data source requires effective ways of retrieving the desired video data from a database. To do so, a model that classifies vehicle video data on the basis of traffic information and its semantic properties which were described by driver's eye gaze direction was developed in this paper. Then the annotated video data based on the model is organized and streamed by retrieval platform and adaptive streaming method. The experimental results show that this model is a good example for evidence-based traffic instruction programs.

A cross-dimension indexing structure for query-by-singing

Abstract: This paper proposes a novel cross-dimension indexing structure for the query by singing (QBS) via singing segment input. Content-Based Song Retrieval (CBSR) is a branch of Content-Based Audio Retrieval (CBAR). Query by Humming / Singing of CBMR(Content-Based Music Retrieval) / CBSR offers a totally new retrieval method by searching the desired music or song based on the users humming or singing segments via microphone and then real-time retrieval the intended song from a large or web-based multimedia database on the internet quickly. The base of our study on which the user's acoustic input and separated and subtracted melody features, pitch features and lyrics or vocalization features of lyrics into vector index sets database. First, we consider these features among melody, pitch, lyrics or lyrics vocalization. Second, we design a cross-dimension indexing (CDIndex) to scripts these relationships. Third, from 1000 candidate for songs, using vocalization feature of lyrics value filters out 70% unlikely candidates. And then compares the melody feature of query singing segment input with the remaining 30% candidates in a detailed manner, at last search related picture. The output of QBS will be a ranked song list with lyrics, singer and picture. The CDIndex is given in the paper to descript how to builds the cross-linking-index each other among melody, pitch, keyword of lyrics, and picture. The proposed CDIndex can be extended applied to cross-media information retrieval system in digital multimedia database or over the Internet. It will improve the user's experience by applying this new song retrieval method.

A Multimedia Database Server: Implementation and Functions.

Abstract: The paper presents the implementation and performances of a Multimedia Database Server software tool used for managing medium sized image collections. The software tool uses traditional data types (integer, double, char, varchar) and a new complex data type, called image. This type is used for storing the image along with the information extracted. This refers to the image’s size and type, color and texture characteristics. An element of originality for this software is the content based retrieval module that allows the user to build content based visual queries to the image level. The server’s performances are studied from the quality of the retrieval point of view. For the tests there are used both color and texture characteristics which are automatically extracted.

Antique coin image retrieval based on synthetic feature

Abstract: Multimedia database retrieval is a key technology used to construct a modern digital museum. The antique coin images are the important component parts of multimedia database in digital museum. In this paper, we design an antique coin image retrieval (ACIR) system using synthetic features. The synthetic features include two parts: one is the histogram of centroid distance (HCD) as a coarse feature descriptor and the other is the modified moment invariants (MMI) as a fine feature descriptor. HCD is a contour-based shape feature descriptor with great efficiency when the shapes of objects in two target images have obvious differences. MMI is a region-based feature descriptor which can well distinguish interior details of images. A Synthetic feature matching strategy is proposed to measure the similarity between the query image and database images. The experimental results demonstrate that the algorithm of synthetic feature matching is effective and efficient in ACIR system. And we also believe that our work can dedicate to the construction of digital museum.

Modeling Multimedia Synchronization Using a Time Petri Net Based Approach

Abstract: Multimedia refers to the presentation of collections of both static and dynamic data (i.e., data with natural time dependencies e.g., audio or video) in a specified order and time. Therefore, their mutual synchronization must assure a proper temporal order of presentation events. Multimedia synchronization can be defined as a mutual assignment of data items and time instants. These time instants may be known in advance (e.g., standard consumer data players) or they can be also results of some unknown function of time (event driven synchronization) or known with some limited accuracy (e.g., random network delays). The modelling and the presentation of multimedia scenarios are challenges of multimedia applications. Multimedia scenarios are results of temporal composition and user interactions of multimedia objects in an application domain, and lot of works discussed this notion (Adjeroh & Lee, 1995; Perez-Luque & Little, 1996). Temporal compositions consist in presenting multimedia objects which requires synchronization among different media. Most of specification models are based on Allen’s relations (Allen, 1983). Allen defined seven basic relations between two temporal intervals. For example, a TV program starts at 9:00 pm, and finishes at 11:00 pm. The TV program can be considered as one of multimedia objects. In addition, “interval” is considered as a range from 9:00 pm to 11:00 pm, and “duration” as two hours. Allen’s relations require this duration of the interval. Before designing the specification model, interval duration must be known. This means that multimedia database systems must determine duration of multimedia objects, because presentations are almost dependent of duration. Our approach defines a tool that has two important inter-dependent features: User temporal specification based on an appropriate temporal specification language, which is itself based on an extension of Allen’s temporal relations (Allen, 1983). This extension models both existing temporal arrangement and dependency relations between multimedia objects, and this is an interesting point of our work. Automatic generation of a time Petri net based on the previous temporal specification. The time Petri net is stored in an object called “scenario object”. The user may request the simulation and the interpretation of the scenario object which leads to scenario

Study of web-based nonmaterial culture conservation and education platform

Abstract: Nonmaterial culture conservation is an important and urgent mission for all nations and people. The conservation of nonmaterial cultures not only means exhibiting them in TV programs but also recording all the close related items of them and propagandizing them in social education. The good conservation depends on good technology. With the application of multimedia database and web technology, multimedia information can be collected and transferred in internet. The platform of nonmaterial culture conservation aims to create a web-based multimedia system which can support the collection, classification and distribution of multimedia data about nonmaterial culture. The platform also can server the society as a social education website to propagandize the knowledge of nonmaterial culture and show the brilliant culture in detail by multimedia technology. The paper discusses the structure of system and key technologies applied in the platform, generates a route of nonmaterial culture conservation.

Wireless multimedia lamp box

Abstract: The utility model discloses a wireless multimedia lamp box which comprises a lamp box. The utility model is characterized in that the lamp box is internally provided with the following components: a hard disk internally provided with a multimedia database, a processor module, a power supply module and a bluetooth wireless module. The corresponding functional pin outside the processor module is electrically connected with the hard disk of the multimedia database, a power supply module and a bluetooth wireless module. The corresponding functional pin outside the processor module can also be connected with a Wi-Fi wireless module. The utility model integrates the bluetooth technique, the WLAN (WIFI) wireless technique and lamp box advertisement, and can provide the functions such as downloading of movie, MP3, ring, game, novel, picture, and the like, and small-distance precise advertisement pushing.

An implementation of MPEG Query Format over relational-based multimedia database

Abstract: The MPEG Query Format (MPQF) which MPEG Group is developing is to standardize query interface for XML-based multimedia retrieval systems However MPQF is not directly supported by any database products including native XML database and relational database Since relational databases such as Oracle, DB2 and MS SQL Server are still the mainstream database products in practice to store multimedia data such as MPEG-7 and Dublin Core XML document, this paper aims to propose a method to translate an MPQF query to SQL that relational-based multimedia database can evaluate and execute

Media release system based on internet of things

Abstract: The utility model discloses a media release system based on the internet of things, which consists of a background server and a foreground server. The background server consists of a personalized release management system and a media resource management system. The personalized release management system consists of a user inquiry management system, a media release strategy customization server and a personalized service management system. The media resource management system consists of a multimedia database, multimedia data acquiring and editing server, a multimedia database retrieval system, a multimedia data storage system and a multimedia data release server. The foreground server consists of a service perception system and a multimedia data release system. The service perception system is in information communication with the personalized service management system in the personalized release management system. The multimedia data release system is in information communication with the multimedia data release server in the media resource management system. The media release system based on the internet of things provides personalized, smooth and high-quality media resource contents to release and has the characteristics of non contact and personalization.

Analyzes of the processing performances of a multimedia database server

Abstract: The paper presents an original dedicated integrated software system for managing and querying alphanumerical information and images from medical domain. The software has a modularized architecture controlled by a multimedia relational database management server. The server is designed to manage database creation, updating and complex querying based on several criteria: simple text-based or content-based image query on color or texture feature, extracted from color and gray-scale image.