We present a syntax-based statistical translation model. Our model transforms a source-language parse tree into a target-language string by applying stochastic operations at each node. These operations capture linguistic differences such as word order and case marking. Model parameters are estimated in polynomial time using an EM algorithm. The model produces word alignments that are better than those produced by IBM Model 5.

https://faculty.washington.edu/fxia/courses/LING580MT/yamada_2001.pdf

A Syntax-based Statistical Translation Model

Contents Preface Acknowledgements 1 Introduction 2 User Interfaces for Search by Marti Hearst 3 Modeling 4 Retrieval Evaluation 5 Relevance Feedback and Query Expansion 6 Documents: Languages & Properties with Gonzalo Navarro and Nivio Ziviani 7 Queries: Languages & Properties with Gonzalo Navarro 8 Text Classification with Marcos Gonccalves 9 Indexing and Searching with Gonzalo Navarro 10 Parallel and Distributed IR with Eric Brown 11 Web Retrieval with Yoelle Maarek 12 Web Crawling with Carlos Castillo 13 Structured Text Retrieval with Mounia Lalmas 14 Multimedia Information Retrieval by Dulce Poncele'on and Malcolm Slaney 15 Enterprise Search by David Hawking 16 Library Systems by Edie Rasmussen 17 Digital Libraries by Marcos Gonccalves A Open Source Search Engines with Christian Middleton B Biographies Bibliography Index

Modern Information Retrieval: The Concepts and Technology Behind Search

Digital libraries (DLs) are complex information systems and therefore demand formal foundations lest development efforts diverge and interoperability suffers. In this article, we propose the fundamental abstractions of Streams, Structures, Spaces, Scenarios, and Societies (5S), which allow us to define digital libraries rigorously and usefully. Streams are sequences of arbitrary items used to describe both static and dynamic (e.g., video) content. Structures can be viewed as labeled directed graphs, which impose organization. Spaces are sets with operations on those sets that obey certain constraints. Scenarios consist of sequences of events or actions that modify states of a computation in order to accomplish a functional requirement. Societies are sets of entities and activities and the relationships among them. Together these abstractions provide a formal foundation to define, relate, and unify concepts---among others, of digital objects, metadata, collections, and services---required to formalize and elucidate "digital libraries". The applicability, versatility, and unifying power of the 5S model are demonstrated through its use in three distinct applications: building and interpretation of a DL taxonomy, informal and formal analysis of case studies of digital libraries (NDLTD and OAI), and utilization as a formal basis for a DL description language.

Streams, structures, spaces, scenarios, societies (5s): A formal model for digital libraries

The availability of map interfaces and location-aware devices makes a growing amount of unstructured, geo-referenced information available on the Web. This type of information can be valuable not only for browsing, finding and making sense of individual items, but also in aggregate form to help understand data trends and features. In particular, over twenty million geo-referenced photos are now available on Flickr, a photo-sharing website - the first major collection of its kind. These photos are often associated with user-entered unstructured text labels (i.e., tags). We show how we analyze the tags associated with the geo-referenced Flickr images to generate aggregate knowledge in the form of "representative tags" for arbitrary areas in the world. We use these tags to create a visualization tool, World Explorer, tha tcan help expose the content of the data, using a map interface to display the derived tags and the original photo items. We perform a qualitative evaluation of World Explorer that outlines the visualization's benefits in browsing this type of content. We provide insights regarding the aggregate versus individual-item requirements in browsing digital geo-referenced material.

http://www.rahulnair.net/files/JCDL07-ahern-WorldExplorer.pdf

World explorer: visualizing aggregate data from unstructured text in geo-referenced collections

Serendipity, a trigger of exciting yet unexpected discoveries, is an important but comparatively neglected factor in information seeking, research, and ideation. We suggest that serendipity can be facilitated through visualization. To explore this, we introduce the Bohemian Bookshelf, which aims to support serendipitous discoveries in the context of digital book collections. The Bohemian Bookshelf consists of five interlinked visualizations each offering a unique overview of the collection. It aims at encouraging serendipity by (1) offering multiple visual access points to the collection, (2) highlighting adjacencies between books, (3) providing flexible visual pathways for exploring the collection, (4) enticing curiosity through abstract, metaphorical, and visually distinct representations of books, and (5) enabling a playful approach to information exploration. A deployment at a library revealed that visitors embraced this approach of utilizing visualization to support open-ended explorations and serendipitous discoveries. This encourages future explorations into promoting serendipity through information visualization.

/pdf/the-bohemian-bookshelf-supporting-serendipitous-book-1wp763whu4.pdf

The bohemian bookshelf: supporting serendipitous book discoveries through information visualization

The National Science Digital Library (NSDL), launched in December 2002, is emerging as a center of innovation in digital libraries as applied to education. As a part of this extensive project, the GetSmart system was created to apply knowledge management techniques in a learning environment. The design of the system is based on an analysis of learning theory and the information search process. Its key notion is the integration of search tools and curriculum support with concept mapping. More than 100 students at the University of Arizona and Virginia Tech used the system in the fall of 2002. A database of more than one thousand student-prepared concept maps has been collected with more than forty thousand relationships expressed in semantic, graphical, node-link representations. Preliminary analysis of the collected data is revealing interesting knowledge representation patterns.

Convergence of knowledge management and e-learning: the GetSmart experience

We describe four usability-enhancing interfaces to CITIDEL aimed at improving the user experience and supporting personalized information access by targeted communities. These comprise: a multimodal interaction facility with capability for out-of-turn input, interactive visualizations for exploratory analysis, a translation center exposing multilingual interfaces, as well as traditional usability enhancements. Pilot studies demonstrate the resulting improvements in quality, as measured across a number of metrics.

/pdf/enhancing-usability-in-citidel-multimodal-multilingual-and-4k7nhbyexc.pdf

Enhancing usability in CITIDEL: multimodal, multilingual, and interactive visualization interfaces

Exploring services for digital libraries (DLs) include two major paradigms, browsing and searching, as well as other services such as clustering and visualization. In this paper, we formalize and generalize DL exploring services within a DL theory. We develop theorems to indicate that browsing and searching can be converted or mapped to each other under certain conditions. The theorems guide the design and implementation of exploring services for an integrated archaeological DL, ETANA-DL. Its integrated browsing and searching can support users in moving seamlessly between these operations, minimizing context switching, and keeping users focused. It also integrates browsing and searching into a single visual interface for DL exploration. A user study to evaluate ETANA-DL's exploring services helped validate our hypotheses.

Exploring digital libraries: integrating browsing, searching, and visualization

Log analysis can be a primary source of knowledge about how digital library patrons actually use DL systems and services and how systems behave while trying to support user information seeking activities. Log recording and analysis allow evaluation assessment, and open opportunities to improvements and enhanced new services. In this paper, we propose an XML-based digital library log format standard that captures a rich, detailed set of system and user behaviors supported by current digital library services. The format is implemented in a generic log component tool, which can be plugged into any digital library system. The focus of the work is on interoperability, reusability, and completeness. Specifications, implementation details, and examples of use within the MARIAN digital library system are described.

/pdf/an-xml-log-standard-and-tool-for-digital-library-logging-4id94keft2.pdf

An XML Log Standard and Tool for Digital Library Logging Analysis

The Digital Library (DL) field is one of the most promising areas of application for information visualization technology. In this paper, we propose a visual user interface tool kit for digital libraries, to deliver an overview of document sets, with support for interactive direct manipulation. Our system, Citiviz, employs a dynamic hyperbolic tree to display hierarchical relationships among documents, based on where their topics fit into the ACM classification system. Also, Citiviz provides an interactive, animated 2-dimensional scatter plot. With it, users may gain insight by changing various parameters, or may directly jump to a particular document based on its label or location. According to a preliminary evaluation, our system shows advantages in performance and user preference relative to traditional text based DL web interfaces.

/pdf/citiviz-a-visual-user-interface-to-the-citidel-system-2zyqthhia5.pdf

Rao Shen

Papers

Convergence of knowledge management and e-learning: the GetSmart experience

Enhancing usability in CITIDEL: multimodal, multilingual, and interactive visualization interfaces

Exploring digital libraries: integrating browsing, searching, and visualization

An XML Log Standard and Tool for Digital Library Logging Analysis

Citiviz: A Visual User Interface to the CITIDEL System