Book ChapterDOI
A Case Study on the Use of Workflow Technologies for Scientific Analysis: Gravitational Wave Data Analysis
TLDR
This chapter uses LIGO as an application case study in workflow design and implementation and outlines a few directions for future development and provides some long-term vision for applications related to gravitational wave data analysis.Abstract:
Modern scientific experiments acquire large amounts of data that must be analyzed in subtle and complicated ways to extract the best results. The Laser Interferometer Gravitational Wave Observatory (LIGO) is an ambitious effort to detect gravitational waves produced by violent events in the universe, such as the collision of two black holes or the explosion of supernovae [37,258]. The experiment records approximately 1 TB of data per day, which is analyzed by scientists in a collaboration that spans four continents. LIGO and distributed computing have grown up side by side over the past decade, and the analysis strategies adopted by LIGO scientists have been strongly influenced by the increasing power of tools to manage distributed computing resources and the workflows to run on them. In this chapter, we use LIGO as an application case study in workflow design and implementation. The software architecture outlined here has been used with great efficacy to analyze LIGO data [2–5] using dedicated computing facilities operated by the LIGO Scientific Collaboration, the LIGO Data Grid. It is just the first step, however. Workflow design and implementation lies at the interface between computing and traditional scientific activities. In the conclusion, we outline a few directions for future development and provide some long-term vision for applications related to gravitational wave data analysis.read more
Citations
More filters
Journal ArticleDOI
Pegasus, a workflow management system for science automation
Ewa Deelman,Karan Vahi,Gideon Juve,Mats Rynge,S. Callaghan,Philip Maechling,Rajiv Mayani,Weiwei Chen,Rafael Ferreira da Silva,Miron Livny,Kent Wenger +10 more
TL;DR: An integrated view of the Pegasus system is provided, showing its capabilities that have been developed over time in response to application needs and to the evolution of the scientific computing platforms.
Journal ArticleDOI
Characterizing and profiling scientific workflows
TL;DR: A characterization of workflows from six diverse scientific applications, including astronomy, bioinformatics, earthquake science, and gravitational-wave physics is provided, based on novel workflow profiling tools that provide detailed information about the various computational tasks that are present in the workflow.
Proceedings ArticleDOI
Characterization of scientific workflows
TL;DR: This work provides a characterization of workflows from five diverse scientific applications, describing their composition and data and computational requirements, and describes a workflow generator that produces synthetic, parameterizable workflows that closely resemble these workflows.
SWIRE: The SIRTF Wide-area InfraRed Extragalactic Survey
TL;DR: The SWIRE project as mentioned in this paper is the largest of the SIRTF Legacy programs, which surveys 65 sq. deg. in seven high latitude fields selected to be the best wide low-extinction windows into the extragalactic sky.
References
More filters
Journal ArticleDOI
Maps of Dust Infrared Emission for Use in Estimation of Reddening and Cosmic Microwave Background Radiation Foregrounds
TL;DR: In this article, a reprocessed composite of the COBE/DIRBE and IRAS/ISSA maps, with the zodiacal foreground and confirmed point sources removed, is presented.
Journal ArticleDOI
The Two Micron All Sky Survey (2MASS)
Michael F. Skrutskie,Michael F. Skrutskie,Roc M. Cutri,R. Stiening,Martin D. Weinberg,Stephen E. Schneider,John M. Carpenter,Chas Beichman,R. Capps,T. Chester,J. Elias,John P. Huchra,James Liebert,C. Lonsdale,David G. Monet,Stephan D. Price,Patrick Seitzer,Thomas H. Jarrett,J. D. Kirkpatrick,John E. Gizis,E. Howard,T. Evans,John W. Fowler,L. Fullmer,Robert L. Hurt,R. M. Light,E. L. Kopan,K. A. Marsh,H. McCallon,R. Tam,S. D. Van Dyk,S. Wheelock +31 more
TL;DR: The Two Micron All Sky Survey (2MASS) as mentioned in this paper collected 25.4 Tbytes of raw imaging data from two dedicated 1.3 m diameter telescopes located at Mount Hopkins, Arizona and CerroTololo, Chile.
Journal ArticleDOI
Communicating sequential processes
TL;DR: It is suggested that input and output are basic primitives of programming and that parallel composition of communicating sequential processes is a fundamental program structuring method.
Journal ArticleDOI
Extinction risk from climate change
Chris D. Thomas,Alison Cameron,Rhys E. Green,Rhys E. Green,Michel Bakkenes,Linda J. Beaumont,Yvonne C. Collingham,Barend F.N. Erasmus,Marinez Ferreira de Siqueira,Alan Grainger,Lee Hannah,Lesley Hughes,Brian Huntley,Albert S. van Jaarsveld,Guy F. Midgley,Lera Miles,Lera Miles,Miguel A. Ortega-Huerta,A. Townsend Peterson,Oliver L. Phillips,Stephen E. Williams +20 more
TL;DR: Estimates of extinction risks for sample regions that cover some 20% of the Earth's terrestrial surface show the importance of rapid implementation of technologies to decrease greenhouse gas emissions and strategies for carbon sequestration.
Journal ArticleDOI
The Anatomy of the Grid: Enabling Scalable Virtual Organizations
TL;DR: The authors present an extensible and open Grid architecture, in which protocols, services, application programming interfaces, and software development kits are categorized according to their roles in enabling resource sharing.