James M. Turner

Bio: James M. Turner is an academic researcher from Université de Montréal. The author has contributed to research in topics: Search engine indexing & Conceptual framework. The author has an hindex of 8, co-authored 37 publications receiving 181 citations. Previous affiliations of James M. Turner include École Normale Supérieure.

Towards computer-vision software tools to increase production and accessibility of video description for people with vision loss

Abstract: This paper presents the status of a R&D project targeting the development of computer-vision tools to assist humans in generating and rendering video description for people with vision loss. Three principal issues are discussed: (1) production practices, (2) needs of people with vision loss, and (3) current system design, core technologies and implementation. The paper provides the main conclusions of consultations with producers of video description regarding their practices and with end-users regarding their needs, as well as an analysis of described productions that lead to propose a video description typology. The current status of a prototype software is also presented (audio-vision manager) that uses many computer-vision technologies (shot transition detection, key-frame identification, key-face recognition, key-text spotting, visual motion, gait/gesture characterization, key-place identification, key-object spotting and image categorization) to automatically extract visual content, associate textual descriptions and add them to the audio track with a synthetic voice. A proof of concept is also briefly described for a first adaptive video description player which allows end users to select various levels of video description.

A Digital Archives Framework for the Preservation of Cultural Artifacts with Technological Components

Abstract: The preservation of artistic works with technological components, such as musical works, is recognised as an issue by both the artistic community and the archival community. Preserving such works involves tackling the difficulties associated with digital information in general, but also raises its own specific problems, such as constantly evolving digital instruments embodied within software and idiosyncratic human-computer interactions. Because of these issues, standards in place for archiving digital information are not always suitable for the preservation of these works. The impact on the organisation and the descriptions of such archives need to be conceptualised in order to provide these technological components with readability, authenticity and intelligibility. While previous projects emphasized readability and authenticity, less effort has been dedicated to addressing intelligibility issues. The research into the specification of significant properties and its extension, namely significant knowledge, offers some grounds for reflecting on this question. Furthermore, the relevance of taking into account the creative process involved in the production of technological components offers an opportunity to redefine the status of technological agents in the performative aspect of digital records. Altogether, the research on significant knowledge and creative processes provide us with a conceptual framework that we propose to bring together with digital archives models to form a coherent framework.

Image Retrieval from the World Wide Web: Issues, Techniques, and Systems

Abstract: With the explosive growth of the World Wide Web, the public is gaining access to massive amounts of information. However, locating needed and relevant information remains a difficult task, whether the information is textual or visual. Text search engines have existed for some years now and have achieved a certain degree of success. However, despite the large number of images available on the Web, image search engines are still rare. In this article, we show that in order to allow people to profit from all this visual information, there is a need to develop tools that help them to locate the needed images with good precision in a reasonable time, and that such tools are useful for many applications and purposes. The article surveys the main characteristics of the existing systems most often cited in the literature, such as ImageRover, WebSeek, Diogenes, and Atlas WISE. It then examines the various issues related to the design and implementation of a Web image search engine, such as data gathering and digestion, indexing, query specification, retrieval and similarity, Web coverage, and performance evaluation. A general discussion is given for each of these issues, with examples of the ways they are addressed by existing engines, and 130 related references are given. Some concluding remarks and directions for future research are also presented.

Reusing Online Resources: A Sustainable Approach to E-Learning

Abstract: From the Publisher: To improve the cost effectiveness and sustainability of e-learning, many national and international initiatives are pioneering new ways in which educators can share their curricula with teachers and learners around the world. To enable this global sharing, educators must learn to design, manage and implement reusable electronic educational resources. This unique book outlines approaches to sharing and reusing resources for e-learning. Drawing upon research by 30 prominent scholars from seven countries, the authors offer multiple perspectives from schools, continuing and higher education institutions as well as industry. It is essential reading for those implementing e-learning in education and corporate training, including teachers, trainers, academics, educational developers and support staff as well as senior managers.

End-User Searching Challenges Indexing Practices inthe Digital Newspaper Photo Archive

Abstract: Previous research in conceptual indexing methods of images has furnished us with refined theoretical frameworks characterising various aspects of images that could and should be indexed using textual descriptors. The development of digital image processing technologies has bred a brigade of content-based indexing and retrieval methods available for applications. What the users need and in what kinds of environments different indexing and retrieval methods are relevant, has remained an area of less intensive research work. This article presents the results of a field study concentrating on journalists as users of a digital newspaper photo archive. The expressed photo needs, applied selection criteria and observed searching behaviours in journalists' daily work were contrasted with the indexing practices applied by the archivists. The results showed that the journalists achieved satisfactory results when trivial query terms were available, e.g. when photos of named persons were needed. Browsing was the main searching strategy applied by the journalists, but the system did not support browsing well. The access problems faced by the users in particular photo needs are discussed in detail. The paper concludes by discussing the potential approaches in developing both the concept-based and content-based indexing methods as well as the user interfaces in photo retrieval systems.

Attributes of images in describing tasks

Abstract: With the current rapid expansion in imaging technologies, access to collections of images is a subject of major interest. This exploratory research investigated image attributes typically noted by participants in a series of describing tasks involving activities such as viewing images, describing them for a retrieval system, and describing them from memory. Content analysis and descriptive statistics were used to characterize textual statements generated by participants; this analysis produced forty-seven image attributes which were grouped conceptually into twelve higher level classes of attributes. The data suggest that access to a wide range of attributes is needed to address all facets of interest to those using pictorial images. They further suggest that certain classes of attributes may appear more frequently in a set of tasks relating to the description of images, including literal objects, the human form and associated attributes, and color and location terms, More unexpectedly, terms describing the ‘story’ within the image also appeared frequently in this research. The disjunction between these results and those attributes typically addressed in traditional image indexing systems suggest revisiting assumptions upon which image indexing and retrieval systems are being created.

Conceptual framework for indexing visual information at multiple levels

Abstract: In this paper, we present a conceptual framework for indexing different aspects of visual information. Our framework unifies concepts from this literature in diverse fields such as cognitive psychology, library sciences, art, and the more recent content-based retrieval. We present multiple level structures for visual and non-visual and non- visual information. The ten-level visual structure presented provides a systematic way of indexing images based on syntax and semantics, and includes distinctions between general concept and visual concept. We define different types of relations at different levels of the visual structure, and also use a semantic information table to summarize important aspects related to an image. While the focus is on the development of a conceptual indexing structure, our aim is also to bring together the knowledge from various fields, unifying the issues that should be considered when building a digital image library. Our analysis stresses the limitations of state of the art content-based retrieval systems and suggests areas in which improvements are necessary.