Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Open Grid Forum 27<br />Banff, Canada<br />Requirements for Future Cyber-Infrastructure Workshop<br />Tuesday, October 13t...
Brief description of the project.<br />Where are the project participants from?<br />How is the e-infrastructure provided?...
Scientific Mission: Directly detect the oscillations of space-time predicted by Einstein’s General Theory of Relativity<br...
In-Band Sources of Gravitational Waves<br />Periodic (Pulsar) Sources<br />Compact Binary (Black Holes, Neutron Stars) Coa...
Partners in a Global Network<br />LLO<br />LHO<br />VIRGO<br />GEO600<br />TAMA300<br />AIGO<br />
The LIGO Scientific Collaboration (LSC) is a dynamic group of approximately 700 scientists from approximately 70 instituti...
LIGO Data Grid<br />The LIGO Scientific Collaboration operates 9 clusters, <br />with a total of approximately 17,000 core...
Architecturally, the LIGO Data Grid relies on a fundamental design choice: <br />Replication & Cataloging of Science Data ...
The LIGO Data Grid is scaled to provide full coverage of the Compact Binary Coalescence (CBC) analysis<br />This doesn’t h...
Reaches out to the the masses with personal computers and idle compute cycles looking for an application<br />BOINC Applic...
Half a million registered participants.
 Open Science Grid ranked #2 contributor</li></ul>through adaption of BOING to submission<br />mechanism onto grids.<br />
Open Science Grid<br />LIGO is a key stakeholder in the OSG<br />OSG is used opportunistically by LIGO to gain additional ...
CBC Workflow DAG mini-Cartoon<br />LIGO’s Compact Binary Coalescence Analysis relies on in-house tools<br />to generate wo...
Upcoming SlideShare
Loading in …5
×

Ogf27 Ligo

460 views

Published on

Presentation in Open Grid From 27 Conference Workshop on Future Requirements for Cyber Infrastructure

  • Be the first to comment

  • Be the first to like this

Ogf27 Ligo

  1. 1. Open Grid Forum 27<br />Banff, Canada<br />Requirements for Future Cyber-Infrastructure Workshop<br />Tuesday, October 13th, 2009<br />LIGO Cyber InfrastructureKent BlackburnLSC / LIGO / Caltech<br />LIGO-G0900945<br />
  2. 2. Brief description of the project.<br />Where are the project participants from?<br />How is the e-infrastructure provided?<br />What level of interoperability is required: data, compute, service?<br />Workshop Questions:<br />
  3. 3. Scientific Mission: Directly detect the oscillations of space-time predicted by Einstein’s General Theory of Relativity<br />Two Observatory Sites: Hanford, WA & Livingston, LA<br />L-shaped arms 4 kilometers long on a side.<br />Largest high vacuum system on the Earth’s surface.<br />Able to measure length changes on one one-thousandth the size of a proton over the 4 km distance<br />Instrumentation records roughly one and a quarter Terabytes per day<br />Funded by the National Science Foundation<br />LIGO: Laser Interferometer Gravitational-Wave Observatory<br />
  4. 4. In-Band Sources of Gravitational Waves<br />Periodic (Pulsar) Sources<br />Compact Binary (Black Holes, Neutron Stars) Coalescence<br />Unmodeled Bursts (Supernovae) <br />Gravitational Stochastic (Big Bang) Background<br />
  5. 5. Partners in a Global Network<br />LLO<br />LHO<br />VIRGO<br />GEO600<br />TAMA300<br />AIGO<br />
  6. 6. The LIGO Scientific Collaboration (LSC) is a dynamic group of approximately 700 scientists from approximately 70 institutions worldwide who have joined together in the search for gravitational waves from the the most violent events in the universe. <br />The LIGO Data Grid (LDG) is a collection of computing resources owned and managed by the LSC<br />Provides computing infrastructure necessary for analysis of LIGO data in the search for gravitational waves.<br />Several sites are (will be) part of the Open Science Grid.<br />LIGO Scientific Collaboration<br />
  7. 7. LIGO Data Grid<br />The LIGO Scientific Collaboration operates 9 clusters, <br />with a total of approximately 17,000 cores in total.<br />Condor is deployed on all LDG sites.<br />AEI Hannover<br />Cardiff<br />AEI Berlin<br />Syracuse<br />LIGO <br />Hanford<br />UW Milwaukee<br />LIGO <br />MIT<br />LIGO <br />Caltech<br />LIGO <br />Livingston<br />
  8. 8. Architecturally, the LIGO Data Grid relies on a fundamental design choice: <br />Replication & Cataloging of Science Data to all centers as a service<br />Users are not entangled by issues of getting data to their jobs/workflows<br />Satellite tools are needed to provide integrity and interoperability<br />Source Code Version Control and Repositories<br />Data Analysis Tool Distributions compatible with user platforms and skills<br />Web servers, Wikis, Document Databases, Data Analysis Databases, Audio/Video Conferencing, …<br />Cyber-Infrastructure Tools<br />
  9. 9. The LIGO Data Grid is scaled to provide full coverage of the Compact Binary Coalescence (CBC) analysis<br />This doesn’t have head room for large new analysis models<br />As a baseline scope, this also supports Burst, Stochastic and a limited (targeted) form of the Periodic analyses<br />LIGO also incorporates additional cyber-infrastructures to assure flexibility and new thinking<br />BOINC Applications<br />Periodic searches could utilize every computer on Earth!<br />Open Science Grid<br />Many common services & software with the LIGO Data Grid<br />More on Cyber-Infrastructures<br />
  10. 10. Reaches out to the the masses with personal computers and idle compute cycles looking for an application<br />BOINC Application (Einstein@Home)<br /><ul><li>Einstein@Home is a World Year of Physics </li></ul>2005 and an International Year of Astronomy 2009 project supported by the American Physical Society (APS) and by a number of international organizations. <br /><ul><li> Analysis is dominated by large FFTs.
  11. 11. Half a million registered participants.
  12. 12. Open Science Grid ranked #2 contributor</li></ul>through adaption of BOING to submission<br />mechanism onto grids.<br />
  13. 13. Open Science Grid<br />LIGO is a key stakeholder in the OSG<br />OSG is used opportunistically by LIGO to gain additional computing resources for two of LIGO’s analyses:<br />LIGO Applications<br />Opens Science Grid<br />Compact Binary Coalescence Workflows (60,000 DAG nodes)<br />Einstein@Home on the OSG<br />
  14. 14. CBC Workflow DAG mini-Cartoon<br />LIGO’s Compact Binary Coalescence Analysis relies on in-house tools<br />to generate workflows with complex interdependencies between jobs <br />and data. A typical analysis run involves tens to hundreds of thousands of <br />DAG nodes requiring roughly a week to run each workflow.<br />
  15. 15. The enormous variety of interfaces, services, tools making up the cyber-infrastructure used by the LIGO Scientific Collaboration introduces a challenging authentication/authorization problem<br />Dozens of credentials are need by each participant to be able to conduct daily science mission oriented tasks<br />LIGO is actively pursuing a single Auth(2) solution under the purview of the “Auth-Project”<br />Still under active development<br />Facing many challenges from existing infrastructure policies, requiring adoption of redundant or home grown technologies to support user community<br />Challenges Looking Forward<br />
  16. 16. What are we looking for?<br />Rules that are easy to master.<br />Ability to distribute objects/apps transparently around the cyber-infrastructure.<br />Evolution when objects warrant.<br />Sufficiently sophisticated to support complex goals.<br />Have some fun on the way!<br />

×