Open AccessPosted Content
Distributed Metadata with the AMGA Metadata Catalog
Nuno Santos,Birger Koblitz +1 more
TLDR
The replication and distribution mechanisms the authors have designed and implemented into the AMGA Metadata Catalog, which is part of the gLite software stack being developed for the EGEE project, are presented.Abstract:
Catalog Services play a vital role on Data Grids by allowing users and applications to discover and locate the data needed. On large Data Grids, with hundreds of geographically distributed sites, centralized Catalog Services do not provide the required scalability, performance or fault-tolerance. In this article, we start by presenting and discussing the general requirements on Grid Catalogs of applications being developed by the EGEE user community. This provides the motivation for the second part of the article, where we present the replication and distribution mechanisms we have designed and implemented into the AMGA Metadata Catalog, which is part of the gLite software stack being developed for the EGEE project. Implementing these mechanisms in the catalog itself has the advantages of not requiring any special support from the relational database back-end, of being database independent, and of allowing tailoring the mechanisms to the specific requirements and characteristics of Metadata Catalogs.read more
Citations
More filters
Journal IssueDOI
The XtreemFS architecture—a case for object-based file systems in Grids
Felix Hupfeld,Toni Cortes,Björn Kolbeck,Jan Stender,Erich Focht,Matthias Hess,Jesús Malo,Jonathan Marti,Eugenio Cesario +8 more
TL;DR: This paper describes how the challenge of extending the object-based storage architecture for the Grid in XtreemFS, an object- based file system for federated infrastructures, is being solved.
Journal ArticleDOI
The AMGA Metadata Service
TL;DR: The AMGA metadata catalogue, which was developed as part of the EGEE (enabling Grids for EsciencE) project’s gLite Grid middleware, provides access to meta data for files stored on the Grid, as well as a simplified general access to relational data stored in database systems.
Journal IssueDOI
Interoperation of world-wide production e-Science infrastructures
Morris Riedel,Erwin Laure,Th. Soddemann,Laurence Field,John-Paul Navarro,James Casey,Maarten Litmaath,J. Ph. Baud,Birger Koblitz,Charlie Catlett,D. Skow,C. Zheng,Philip M. Papadopoulos,Mason J. Katz,N. Sharma,O. Smirnova,Balazs Konya,Peter Arzberger,Frank Würthwein,A. Rana,Tim Martin,M. Wan,Von Welch,T. Rimovsky,Steven Newhouse,A. Vanni,Yoshio Tanaka,Yusuke Tanimura,Tsutomu Ikegami,David Abramson,Colin Enticott,G. Jenkins,Ruth Pordes,Steven Timm,G. Moont,M. Aggarwal,David Colling,O. van der Aa,Alex Sim,Vijaya Natarajan,Arie Shoshani,J. Gu,S. Chen,G. Galang,Riccardo Zappi,L. Magnoni,V. Ciaschini,Michele Pace,Valerio Venturi,Moreno Marzolla,Paolo Andreetto,B. Cowles,Shaowen Wang,Y. Saeki,Hitoshi Sato,Satoshi Matsuoka,Putchong Uthayopas,Somsak Sriprayoonsakul,O. Koeroo,Matthew Viljoen,Laura Pearlman,Stephen Pickles,David Wallom,G. R. Moloney,Jerome Lauret,J. Marsteller,Paul Sheldon,S. Pathak,S. De Witt,J. Mencák,Jens Jensen,M. Hodges,D.A. Ross,Sugree Phatanapherom,Gilbert Netzer,A. R. Gregersen,Michael Jones,Péter Kacsuk,Achim Streit,Daniel Mallmann,Felix Wolf,Th. Lippert,Th. Delaitre,Eduardo Huedo,N. I. Geddes +84 more
TL;DR: The Grid Interoperation Now—Community Group of the Open Grid Forum—organizes and manages interoperation efforts among those production Grid infrastructures to reach the goal of a world-wide Grid vision on a technical level in the near future.
Journal ArticleDOI
A Secure Grid Medical Data Manager Interfaced to the gLite Middleware
Johan Montagnat,Akos Frohner,Daniel Jouvenot,Christophe Pera,Peter Z. Kunszt,Birger Koblitz,Nuno Santos,Charles Loomis,Romain Texier,Diane Lingrand,Patrick Guio,Ricardo Rocha,Antonio Sobreira de Almeida,Zoltan Farkas +13 more
TL;DR: This paper describes the design of a medical data management system taking advantage of the advanced gLite data management services, developed in the context of the EGEE project, to fulfill the stringent needs of the medical community.
XtreemFS: a case for object-based storage in Grid data management
Felix Hupfeld,Toni Cortes,Bjoern Kolbeck,Jan Stender,Erich Focht,Matthias Hess,Jesús Malo,Jonathan Marti,Eugenio Cesario +8 more
TL;DR: This position paper describes how the challenge of extending the object- based storage architecture for the Grid in XtreemFS, an object-based le system for federated infrastructures can be an alternative when adapted to the characteristics of a Grid environment.
References
More filters
Proceedings ArticleDOI
The dangers of replication and a solution
TL;DR: In this article, a two-tier replication algorithm is proposed that allows mobile (disconnected) applications to propose tentative update transactions that are later applied to a master copy to avoid the instability of other replication schemes.
Proceedings ArticleDOI
The SDSC storage resource broker
TL;DR: The architecture and various features of the SDSC SRB are described, which provides applications a uniform API to access heterogeneous distributed storage resources including, filesystems, database systems, and archival storage systems.
Proceedings ArticleDOI
A low latency, loss tolerant architecture and protocol for wide area group communication
TL;DR: The design of the transport protocols of the spread wide area group communication system is presented, highlighting the value of using overlay networks for application level group communication services and the requirements and design of effective low latency link protocols used to construct wide areagroup communication.
Journal ArticleDOI
Metadata services on the Grid
TL;DR: An interface for metadata access on the Grid is presented, designed to support flexible schema management, efficient retrieval of large result sets and to allow a broad range of implementations.
Journal Article
Bridging clinical information systems and grid middleware: a Medical Data Manager.
Johan Montagnat,Daniel Jouvenot,Christophe Pera,Akos Frohner,Peter Z. Kunszt,Birger Koblitz,Nuno Santos,Charles Loomis +7 more
TL;DR: The effort to deploy a Medical Data Management service on top of the EGEE grid infrastructure, which offers a high level data management service, compatible with clinical practices, which encourages the migration of medical applications towards grid infrastructures.