Ogf27 Ligo


Published on

Presentation in Open Grid From 27 Conference Workshop on Future Requirements for Cyber Infrastructure

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Ogf27 Ligo

  1. 1. Open Grid Forum 27<br />Banff, Canada<br />Requirements for Future Cyber-Infrastructure Workshop<br />Tuesday, October 13th, 2009<br />LIGO Cyber InfrastructureKent BlackburnLSC / LIGO / Caltech<br />LIGO-G0900945<br />
  2. 2. Brief description of the project.<br />Where are the project participants from?<br />How is the e-infrastructure provided?<br />What level of interoperability is required: data, compute, service?<br />Workshop Questions:<br />
  3. 3. Scientific Mission: Directly detect the oscillations of space-time predicted by Einstein’s General Theory of Relativity<br />Two Observatory Sites: Hanford, WA & Livingston, LA<br />L-shaped arms 4 kilometers long on a side.<br />Largest high vacuum system on the Earth’s surface.<br />Able to measure length changes on one one-thousandth the size of a proton over the 4 km distance<br />Instrumentation records roughly one and a quarter Terabytes per day<br />Funded by the National Science Foundation<br />LIGO: Laser Interferometer Gravitational-Wave Observatory<br />
  4. 4. In-Band Sources of Gravitational Waves<br />Periodic (Pulsar) Sources<br />Compact Binary (Black Holes, Neutron Stars) Coalescence<br />Unmodeled Bursts (Supernovae) <br />Gravitational Stochastic (Big Bang) Background<br />
  5. 5. Partners in a Global Network<br />LLO<br />LHO<br />VIRGO<br />GEO600<br />TAMA300<br />AIGO<br />
  6. 6. The LIGO Scientific Collaboration (LSC) is a dynamic group of approximately 700 scientists from approximately 70 institutions worldwide who have joined together in the search for gravitational waves from the the most violent events in the universe. <br />The LIGO Data Grid (LDG) is a collection of computing resources owned and managed by the LSC<br />Provides computing infrastructure necessary for analysis of LIGO data in the search for gravitational waves.<br />Several sites are (will be) part of the Open Science Grid.<br />LIGO Scientific Collaboration<br />
  7. 7. LIGO Data Grid<br />The LIGO Scientific Collaboration operates 9 clusters, <br />with a total of approximately 17,000 cores in total.<br />Condor is deployed on all LDG sites.<br />AEI Hannover<br />Cardiff<br />AEI Berlin<br />Syracuse<br />LIGO <br />Hanford<br />UW Milwaukee<br />LIGO <br />MIT<br />LIGO <br />Caltech<br />LIGO <br />Livingston<br />
  8. 8. Architecturally, the LIGO Data Grid relies on a fundamental design choice: <br />Replication & Cataloging of Science Data to all centers as a service<br />Users are not entangled by issues of getting data to their jobs/workflows<br />Satellite tools are needed to provide integrity and interoperability<br />Source Code Version Control and Repositories<br />Data Analysis Tool Distributions compatible with user platforms and skills<br />Web servers, Wikis, Document Databases, Data Analysis Databases, Audio/Video Conferencing, …<br />Cyber-Infrastructure Tools<br />
  9. 9. The LIGO Data Grid is scaled to provide full coverage of the Compact Binary Coalescence (CBC) analysis<br />This doesn’t have head room for large new analysis models<br />As a baseline scope, this also supports Burst, Stochastic and a limited (targeted) form of the Periodic analyses<br />LIGO also incorporates additional cyber-infrastructures to assure flexibility and new thinking<br />BOINC Applications<br />Periodic searches could utilize every computer on Earth!<br />Open Science Grid<br />Many common services & software with the LIGO Data Grid<br />More on Cyber-Infrastructures<br />
  10. 10. Reaches out to the the masses with personal computers and idle compute cycles looking for an application<br />BOINC Application (Einstein@Home)<br /><ul><li>Einstein@Home is a World Year of Physics </li></ul>2005 and an International Year of Astronomy 2009 project supported by the American Physical Society (APS) and by a number of international organizations. <br /><ul><li> Analysis is dominated by large FFTs.
  11. 11. Half a million registered participants.
  12. 12. Open Science Grid ranked #2 contributor</li></ul>through adaption of BOING to submission<br />mechanism onto grids.<br />
  13. 13. Open Science Grid<br />LIGO is a key stakeholder in the OSG<br />OSG is used opportunistically by LIGO to gain additional computing resources for two of LIGO’s analyses:<br />LIGO Applications<br />Opens Science Grid<br />Compact Binary Coalescence Workflows (60,000 DAG nodes)<br />Einstein@Home on the OSG<br />
  14. 14. CBC Workflow DAG mini-Cartoon<br />LIGO’s Compact Binary Coalescence Analysis relies on in-house tools<br />to generate workflows with complex interdependencies between jobs <br />and data. A typical analysis run involves tens to hundreds of thousands of <br />DAG nodes requiring roughly a week to run each workflow.<br />
  15. 15. The enormous variety of interfaces, services, tools making up the cyber-infrastructure used by the LIGO Scientific Collaboration introduces a challenging authentication/authorization problem<br />Dozens of credentials are need by each participant to be able to conduct daily science mission oriented tasks<br />LIGO is actively pursuing a single Auth(2) solution under the purview of the “Auth-Project”<br />Still under active development<br />Facing many challenges from existing infrastructure policies, requiring adoption of redundant or home grown technologies to support user community<br />Challenges Looking Forward<br />
  16. 16. What are we looking for?<br />Rules that are easy to master.<br />Ability to distribute objects/apps transparently around the cyber-infrastructure.<br />Evolution when objects warrant.<br />Sufficiently sophisticated to support complex goals.<br />Have some fun on the way!<br />