The grid2003 production grid: principles and practice

Ian Foster(Argonne National Laboratory), J. Gieraltowski(Argonne National Laboratory), S. Gose(Argonne National Laboratory), Natalia Maltsev(Argonne National Laboratory), E. N. May(Argonne National Laboratory), Alexis Rodriguez(Argonne National Laboratory), Dinanath Sulakhe(Argonne National Laboratory), A. Vaniachine(Argonne National Laboratory), M. Green(Lawrence Berkeley National Laboratory), Russ Miller(University at Buffalo, State University of New York), J Letts(University at Buffalo, State University of New York), T. A. Martin(University of San Diego), J. T. Shank(Boston University), S. Youssef(Boston University), D. Bury(University of San Diego), Cătălin Dumitrescu(University of Chicago), D. Engh(University of Chicago), R. W. Gardner(University of Chicago), D. L. Adams(Brookhaven College), Richard S. Baker(Brookhaven College), Wei Deng(Brookhaven College), Jazz Mack Smith(Brookhaven College), Yu Dai(Brookhaven College), Marco Mambelli(University of Chicago), Y. Smirnov(University of Chicago), Jens Voeckler(University of Chicago), Michael Wilde(University of Chicago), Yong Zhao(University of Chicago), Xin Zhao(University of Chicago), I. Legrand(California Institute of Technology), Sarbjeet Singh(California Institute of Technology), Conrad Steenberg(California Institute of Technology), Y. Xia(California Institute of Technology), P. Avery(University of Chicago), R. Cavanaugh, B. Kim, C. Prescott, J. L. Rodriguez, Aljoscha Zahn, Anzar Afaq(Argonne National Laboratory), E. Berman(Fermi National Accelerator Laboratory), J. Annis(Fermi National Accelerator Laboratory), L. A. T. Bauerdick(Fermi National Accelerator Laboratory), M. Ernst(Fermi National Accelerator Laboratory), I. Fisk(Fermi National Accelerator Laboratory), L. Giacchetti(Fermi National Accelerator Laboratory), G. Graham(Fermi National Accelerator Laboratory), A. Heavey(Fermi National Accelerator Laboratory), Johannes W. Kaiser(Fermi National Accelerator Laboratory), S. P. Mc Kee, N. Kuropatkin(Fermi National Accelerator Laboratory), R. Pordes(Fermi National Accelerator Laboratory), V. Sekhri(Fermi National Accelerator Laboratory), J. Weigand(Fermi National Accelerator Laboratory), Y. Wu(Fermi National Accelerator Laboratory), Chris Jordan(University of Michigan), Jim Prewett(University of New Mexico), T. L. Thomas(University of New Mexico), Keith Baker(Fermi National Accelerator Laboratory), Lawrence Sorrillo(Hampton University), H. Severini(University of New Mexico), J. Huth(Hampton University), Ben Clifford(University of Oklahoma), Ewa Deelman, L. Flon, Carl Kesselman, Gaurang Mehta, N. Olomu, Karan Vahi, Matthew S. Allen, L. Grundhoefer, John W. Hicks, F. Luehring, S. Peck, Rob Quick, Stephen Simms, K. De(The University of Texas at Arlington), Patrick J McGuigan(The University of Texas at Arlington), M. Sosebee(The University of Texas at Arlington), György Fekete(Johns Hopkins University), Jan Vandenberg(Johns Hopkins University), D Bradley(The University of Texas at Arlington), P. Couvares, Arthur De Smet, C. Kireyev, E K Paulson, A. Roy, K. Cho(Johns Hopkins University), K. Kwon(Kyungpook National University), D. C. Son(Lawrence Berkeley National Laboratory), H. Park(Kyungpook National University), Scott Koranda, B. Moe, Shane Canon(Lawrence Berkeley National Laboratory), Keith Jackson(Lawrence Berkeley National Laboratory), David E. Konerding(Lawrence Berkeley National Laboratory), Jason Lee(Lawrence Berkeley National Laboratory), D. Olson(Lawrence Berkeley National Laboratory), I. Sakrejda(Lawrence Berkeley National Laboratory), Brian Tierney(Lawrence Berkeley National Laboratory), Benjamin P. Brown, Paul Sheldon(Vanderbilt Health)
Unknown
November 12, 2004
10.1109/hpdc.2004.1323544
Cited by 54

Abstract

The Grid2003 Project has deployed a multivirtual organization, application-driven grid laboratory ("Grid3") that has sustained for several months the production-level services required by physics experiments of the Large Hadron Collider at CERN (ATLAS and CMS), the Sloan Digital Sky Survey project, the gravitational wave search experiment LIGO, the BTeV experiment at Fermilab, as well as applications in molecular structure analysis and genome analysis, and computer science research projects in such areas as job and data scheduling. The deployed infrastructure has been operating since November 2003 with 27 sites, a peak of 2800 processors, work loads from 10 different applications exceeding 1300 simultaneous jobs, and data transfers among sites of greater than 2 TB/day. We describe the principles that have guided the development of this unique infrastructure and the practical experiences that have resulted from its creation and use. We discuss application requirements for grid services deployment and configuration, monitoring infrastructure, application performance, metrics, and operational experiences. We also summarize lessons learned.

Related Papers

No related papers found

Powered by citation graph analysis