Showing papers by "Michael L. Nelson published in 2003"
TL;DR: The OAI‐PMH is a move away from distributed searching, focusing on the arguably simpler model of “metadata harvesting”, and some of the entirely new DL projects that it has made possible, such as the Technical Report Interchange Project are discussed.
Abstract: The Open Archives Initiative Protocol for Metadata Harvesting (OAI‐PMH) is an evolving protocol and philosophy regarding interoperability for digital libraries (DLs). Previously, “distributed searching” models were popular for DL interoperability. However, experience has shown distributed searching systems across large numbers of DLs to be difficult to maintain in an Internet environment. The OAI‐PMH is a move away from distributed searching, focusing on the arguably simpler model of “metadata harvesting”. We detail NASA’s involvement in defining and testing the OAI‐PMH and experience to date with adapting existing NASA distributed searching DLs (such as the NASA Technical Report Server) to use the OAI‐PMH and metadata harvesting. We discuss some of the entirely new DL projects that the OAI‐PMH has made possible, such as the Technical Report Interchange Project. We explain the strategic importance of the OAI‐PMH to the mission of NASA’s Scientific and Technical Information Program.
24 citations
27 May 2003
TL;DR: This work defines some metrics for describing the synchronization problem in the OAI-PMH and proposes several approaches for harvesters to implement better synchronization.
Abstract: The Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) began as an alternative to distributed searching of scholarly e-print repositories. The model embraced by the OAI-PMH is that of metadata harvesting, where value-added services (by a "service provider") are constructed on cached copies of the metadata extracted from the repositories of the harvester's choosing. While this model dispenses with the well-known problems of distributed searching, it introduces the problem of synchronization. Stated simply, this problem arises when the service provider's copy of the metadata does not match the metadata currently at the constituent repositories. We define some metrics for describing the synchronization problem in the OAI-PMH. Based on these metrics, we study the synchronization problem of the OAI-PMH framework and propose several approaches for harvesters to implement better synchronization. In particular, if a repository knows its update frequency, it can publish it in an OAI-PMH identify response using an optional about container that borrows from RDF Site Syndication (RSS) Format.
14 citations
08 Dec 2003
TL;DR: This paper presents the impact of value-added services like citation and reference processing, equation searching, and data normalization on the process of dynamic harvesting in Archon and presents performance data for the overhead of using these services over the regular harvesting.
Abstract: The Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) is a de facto standard for federation of digital repositories. OAI-PMH defines how repositories (data providers) expose their metadata as well as how harvesters (service providers) extract the metadata. In this paper we will concentrate on our experience as service providers. Although OAI-PMH makes it easy to harvest data from data providers, adding specialized services requires significant work beyond the OAI-PMH capabilities. Harvesting provides only the basic services to get metadata from repositories. However, processing these data or retrieving related metadata is not part of the OAI-PMH. In this paper, we will present the impact of value-added services like citation and reference processing, equation searching, and data normalization on the process of dynamic harvesting in Archon. Dynamic harvesting introduces challenges of keeping specialized-services consistent with ingestion of new metadata records. Archon is a NSDL NSF funded digital library that federates physics collections. We present performance data for the overhead of using these services over the regular harvesting. We also present the implementation of Simple Object Access Protocol (SOAP) web services (and corresponding client) that enhances the usability of our collections by allowing third parties to provide their own clients to search our databases directly.
7 citations
01 Sep 2003
TL;DR: The “OAI Metadata Harvesting Workshop” was held on Saturday 31 May as part of JCDL 2003 and there were 11 participants including OAI service provider implementers, data provider implementer and researchers, from both the US and Europe.
Abstract: The “OAI Metadata Harvesting Workshop” was held on Saturday 31 May as part of JCDL 2003. There were 11 participants including OAI service provider implementers, data provider implementers and researchers, from both the US and Europe. Most participants made short presentations to highlight interesting topics or issues, and time was allocated for discussion following each presentation. This report extends the brief summary earlier presented in [20]. Further details, including slides from the presentations, are available from the workshop web site [19].
6 citations
21 Nov 2003
6 citations
27 May 2003
TL;DR: Though the Open Archive Initiative Protocol for Metadata Harvesting (OAI-PMH) is becoming the de facto standard for digital libraries, some of its predecessors are still in use.
Abstract: Though the Open Archive Initiative Protocol for Metadata Harvesting (OAI-PMH) is becoming the de facto standard for digital libraries, some of its predecessors are still in use. Although a limited number of Dienst repositories continue to be populated, others are precariously unsupported. The Dienst Open Archive Gateway (DOG) is a gateway between the OAI-PMH and the Dienst (version 4.1) protocol. DOG allows OAI-PMH harvesters to extract metadata records (in RFC-1807 or Dublin Core) from Dienst servers.
4 citations
01 Jan 2003
3 citations
TL;DR: Nelson et al. as discussed by the authors presented the report on the Third ACM/IEEE Joint Conference on Digital Libraries (JCDL) 2003 and accepted it for inclusion in Computer Science Faculty Publications by an authorized administrator of ODU Digital Commons.
Abstract: This Article is brought to you for free and open access by the Computer Science at ODU Digital Commons. It has been accepted for inclusion in Computer Science Faculty Publications by an authorized administrator of ODU Digital Commons. For more information, please contact digitalcommons@odu.edu. Repository Citation Nelson, Michael L., "Report on the Third ACM/IEEE Joint Conference on Digital Libraries ( JCDL)" (2003). Computer Science Faculty Publications. Paper 32. http://digitalcommons.odu.edu/computerscience_fac_pubs/32
2 citations
01 Jan 2003
TL;DR: Though the Open Archive Initiative Protocol for Metadata Harvesting (OAI-PMH) is becoming the defacto standard for digital libraries, some of its predecessors are still in use.
Abstract: Though the Open Archive Initiative Protocol for Metadata Harvesting (OAI-PMH) is becoming the defacto standard for digital libraries, some of its predecessors are still in use. Although a limited number of Dienst repositories continue to be populated, others are precariously unsupported. The Dienst Open Archive Gateway (DOG) is a gateway between the OAI-PMH and the Dienst (version 4.1) protocol. DOG allows OAI-PMH harvesters to extract metadata records (in RFC-1807 or Dublin Core) from Dienst repositories.
1 citations