Your SlideShare is downloading. ×
0
Cyberinfrastructure in Louisiana: From Black Holes to Hurricanes<br />Gabrielle Allen<br />Department of Computer Science<...
Complex Problem SolvingComputation as Third Pillar of Scientific Investigation<br />Real world <br />    applications<br /...
3<br />    LIGO:  Laser Interferometric Gravitational Wave Observatory<br />Ties together theory, computation, and experim...
4<br />Louisiana Coastal Area<br />Rich dynamic environment for modeling: coupled models, multi-scale, realtime data (sens...
Hurricane Gustav<br />
6<br />Highly scalable algorithms (Petascale, exascale computing, heterogeneous architectures)<br />Storage & networks: pr...
PITAC Report Summary (June 2005): <br />7<br />“Computational science -- the use of advanced computing capabilities to und...
Louisiana Response: Center for Computation & Technology (CCT)<br />8<br />State commitment for IT in 2002<br />$25M/year f...
CCT Plan: Designing a Computational Science Initiative at LSU<br />Cyberinfrastructure: access to local/national compute, ...
Growth of CCT<br />September 2003<br />May 2008<br />
CCT Focus Areas: Faculty Led<br />Areas chosen to bring together interdisciplinary researchers towards common theme: <br /...
Recruiting Faculty<br />Joint appointments: 50% CCT, 50% home department<br />Tenure resides in department, but CCT has in...
Recruiting Faculty<br />Joint appointments: 50% CCT, 50% home department<br />Tenure resides in department, but CCT has in...
External Funding: Increasingly able to respond to large solicitations<br />
Vision: combine research and infrastructure<br />Research<br />Computer science<br />Applications<br />Tools<br />CyD Divi...
Hardware
Operations
Policies</li></ul>16<br />16<br />CyberinfrastructureDevelopment<br />
CI in Louisiana<br />TeraGrid<br />LONI Institute: People and Collaborations<br />Cybertools: Tools and Services<br />LA T...
18<br />State initiative ($50M) to support research (2004):<br />40 Gbps optical network + NLR<br />Connects stateuniversi...
LONI Compute Resources<br />
Support: HPC@LSU<br />Partnership between LSU CCT and LSU ITS to support and maintain LSU HPC resources and provide user t...
NSF EPSCOR RIICyberTools Project: Enabler and Driver<br />21<br />$12M from NSF/BOR, 2007-2010, 9 research institutions in...
Cybertools Infrastructure<br />22<br />WP1: Scheduling and Data Services<br />Infrastructure deployment, high availability...
Cybertools Infrastructure<br />23<br />WP1: Scheduling and Data Services<br />Infrastructure deployment, high availability...
<ul><li>Extensible, open-sourced co-allocation system
Can already reserve:
Time on supercomputers (advance reservation), and
Dedicated paths on GMPLS-based networks with simple topologies
Uses Paxos Commit to atomically reserve multiple resources, while providing a highly-available service
Used to coordinate bookings across EnLIGHTened and G-lambda testbedsin largest demonstration of its kind to date
Used for setting up the network for Thomas Sterling’s HPC Class which goes out live in HD</li></ul>Credit: Jon MacLaren<br...
Vish<br />
Above left: co-located and distributed users collaboratively manipulate a 3D visualization in an AccessGrid meeting using ...
Simple API for Grid Applications<br />
Cactus Framework<br />
Cactus<br />Component-based HPC framework <br /><ul><li>Freely-available environment for</li></ul>collaborative <br />appl...
Upcoming SlideShare
Loading in...5
×

Ci days notre_dame_april2010

290

Published on

Cyberinfrastructure in Louisiana: From Black Holes to Hurricanes. Presentation at Cyberinfrastructure Days, Notre Dame, April 29-30, 2010. http://ci.nd.edu/

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
290
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Ci days notre_dame_april2010"

  1. 1. Cyberinfrastructure in Louisiana: From Black Holes to Hurricanes<br />Gabrielle Allen<br />Department of Computer Science<br />Center for Computation & Technology<br />Louisiana State University<br />http://www.cct.lsu.edu/~gallen<br />
  2. 2. Complex Problem SolvingComputation as Third Pillar of Scientific Investigation<br />Real world <br /> applications<br />Communities<br />No single group, university, or state can do these problems<br />Must integrate CS, Math, Bio, Sensors, Engineering, more...<br />Data everywhere<br />Supercomputers generate petabytes<br />2<br />
  3. 3. 3<br /> LIGO: Laser Interferometric Gravitational Wave Observatory<br />Ties together theory, computation, and experiment<br />Gravitational Wave Astronomy<br />
  4. 4. 4<br />Louisiana Coastal Area<br />Rich dynamic environment for modeling: coupled models, multi-scale, realtime data (sensors, satellites)<br />Models, Data, Grids for …<br />Hurricane forecasts<br />Emergency preparedness <br />Wetland reconstruction<br />Ecological studies and fish populations<br />Oilspillbehaviour<br />Levee design<br />Rescue<br />Hypoxia “Dead Zone”<br />Algae blooms<br />24/7/365 shipping forecasts<br />
  5. 5. Hurricane Gustav<br />
  6. 6. 6<br />Highly scalable algorithms (Petascale, exascale computing, heterogeneous architectures)<br />Storage & networks: provenance, metadata<br />Visualization (Large data, interactive, remote, AMR)<br />Software engineering (code generation, verification & validation, interfaces, interoperability, etc)<br />Workflows, Grid & distributed computing<br />Education <br />Research Issues<br />
  7. 7. PITAC Report Summary (June 2005): <br />7<br />“Computational science -- the use of advanced computing capabilities to understand and solve complex problems -- is critical to scientific leadership, economic competitiveness, and national security. It is one of the most important technical fields of the 21st century because it is essential to advances throughout society.”<br />“Universities must significantly change organizational structures: multidisciplinary & collaborative research are needed [for US] to remain competitive in global science”<br />Complex problems: Innovations will occur at boundaries<br />
  8. 8. Louisiana Response: Center for Computation & Technology (CCT)<br />8<br />State commitment for IT in 2002<br />$25M/year for Vision 20/20, $9M to LSU<br />University commitment to build new programs<br />Opportunity to build new world class program in interdisciplinary research & education<br />Ed Seidel recruited to LSU, created & implemented vision for state-wide collaboration<br />Center for Computation & Technology (2003)<br />Louisiana Optical Network Initiative (2005)<br />CyberTools (2007), LONI Institute (2007)<br />Multidisciplinary Hiring Initiatives (2007)<br />
  9. 9. CCT Plan: Designing a Computational Science Initiative at LSU<br />Cyberinfrastructure: access to local/national compute, storage, network, visualization resources; support; end-to-end integration. <br />Interdisciplinary research: university policies on joint appointments, university-wide curricula, appreciation of computational science outcomes (e.g. software, data)<br /><ul><li>Computational research: faculty who develop or use computation as part of their research; undergraduate and graduate courses to train and educate students</li></li></ul><li>10<br />CCT Strategic Plan<br />Mission: The CCT at LSU is an innovative and interdisciplinary research environment, advancing computational sciences, technologies, and the disciplines they touch. The CCT serves Louisiana through international collaboration, leading progress through revolutionary advancement in academia and industry.<br />Strategic Plan:<br />Research<br />Education<br />Service<br />Infrastructure<br />Economic Development<br />https://cct.lsu.edu/uploads/CCTStrategicPlan20062010.pdf<br />
  10. 10. Growth of CCT<br />September 2003<br />May 2008<br />
  11. 11. CCT Focus Areas: Faculty Led<br />Areas chosen to bring together interdisciplinary researchers towards common theme: <br />Faculty, Research Staff, Postdocs, Students<br />System Science & Engineering / Core Computing Science / Coast to Cosmos / Material World / Cultural Computing<br />
  12. 12. Recruiting Faculty<br />Joint appointments: 50% CCT, 50% home department<br />Tenure resides in department, but CCT has input in P&T<br />Reduced teaching load to accommodate higher level service<br />Also associate faculty from campus<br />
  13. 13. Recruiting Faculty<br />Joint appointments: 50% CCT, 50% home department<br />Tenure resides in department, but CCT has input in P&T<br />Reduced teaching load to accommodate higher level service<br />Also associate faculty from campus<br />Currently recruiting faculty in <br />digital media and arts<br />
  14. 14. External Funding: Increasingly able to respond to large solicitations<br />
  15. 15. Vision: combine research and infrastructure<br />Research<br />Computer science<br />Applications<br />Tools<br />CyD Division at CCT to coordinate this<br />CyDstaff:PhDs in CS and applications who understand the whole picture and want to grow the ecosystem<br /><ul><li>Infrastructure
  16. 16. Hardware
  17. 17. Operations
  18. 18. Policies</li></ul>16<br />16<br />CyberinfrastructureDevelopment<br />
  19. 19. CI in Louisiana<br />TeraGrid<br />LONI Institute: People and Collaborations<br />Cybertools: Tools and Services<br />LA Tech<br />LONI: ~100TF IBM, Dell Supercomputers<br />LSU<br />LONI: 40 Gbpsnetwork<br />SUBR<br />UNO<br />National Lambda Rail<br />Tulane<br />UL-L<br />17<br />
  20. 20. 18<br />State initiative ($50M) to support research (2004):<br />40 Gbps optical network + NLR<br />Connects stateuniversities, health science centers <br />Compute resources: ~100 Tflops across state<br />Data resources ~500TB with NSF PetaShare<br />LONI customers: MS universities, K12, hospitals, LPB<br />Louisiana Optical Network (LONI)<br />
  21. 21. LONI Compute Resources<br />
  22. 22. Support: HPC@LSU<br />Partnership between LSU CCT and LSU ITS to support and maintain LSU HPC resources and provide user training<br />HPC@LSU also supports/maintains LONI, through support from Louisiana BoR<br />HPC@LSU also supports TeraGrid, through support from NSF<br />20<br />
  23. 23. NSF EPSCOR RIICyberTools Project: Enabler and Driver<br />21<br />$12M from NSF/BOR, 2007-2010, 9 research institutions in Louisiana<br />
  24. 24. Cybertools Infrastructure<br />22<br />WP1: Scheduling and Data Services<br />Infrastructure deployment, high availability, scheduling, data archiving and retrieval, metadata<br />WP2: Information Services and Portals<br />Information services (infrastructure, apps, experiments), application interfaces for scientists, portals for information gathering<br />WP3: Visualization services<br />Data/viz integration, HD streaming viz, advanced viz facilities, integration with application toolkits<br />WP4: Application toolkits<br />Toolkits to support similation codes (CFD, MD, other), application managers, SAGA interfaces<br />
  25. 25. Cybertools Infrastructure<br />23<br />WP1: Scheduling and Data Services<br />Infrastructure deployment, high availability, scheduling, data archiving and retrieval, metadata<br />WP2: Information Services and Portals<br />Information services (infrastructure, apps, experiments), application interfaces for scientists, portals for information gathering<br />WP3: Visualization services<br />Data/viz integration, HD streaming viz, advanced viz facilities, integration with application toolkits<br />WP4: Application toolkits<br />Toolkits to support similation codes (CFD, MD, other), application managers, SAGA interfaces<br />Each Workpackage has state-wide collaboration meetings bi-weekly<br />Graduate students have interdisciplinary committees<br />Working with LONI staff to support state software<br />Cyberinfrastructure software developed in collaboration with science drivers <br />
  26. 26.
  27. 27. <ul><li>Extensible, open-sourced co-allocation system
  28. 28. Can already reserve:
  29. 29. Time on supercomputers (advance reservation), and
  30. 30. Dedicated paths on GMPLS-based networks with simple topologies
  31. 31. Uses Paxos Commit to atomically reserve multiple resources, while providing a highly-available service
  32. 32. Used to coordinate bookings across EnLIGHTened and G-lambda testbedsin largest demonstration of its kind to date
  33. 33. Used for setting up the network for Thomas Sterling’s HPC Class which goes out live in HD</li></ul>Credit: Jon MacLaren<br />25<br />HARC: Highly Available Resource Co-scheduler<br />
  34. 34. Vish<br />
  35. 35. Above left: co-located and distributed users collaboratively manipulate a 3D visualization in an AccessGrid meeting using viz tangibles interaction devices Right: an “interaction tray” is used together with RFID-tagged “tangible menus” to access and manipulate scientific visualizations<br />27<br />Credit: Brygg Ulmer<br />Viz Tangibles<br />
  36. 36. Simple API for Grid Applications<br />
  37. 37. Cactus Framework<br />
  38. 38. Cactus<br />Component-based HPC framework <br /><ul><li>Freely-available environment for</li></ul>collaborative <br />application development<br />Cutting edge CS<br /><ul><li>Grid computing, petascale, accelerators, steering, remote viz</li></ul>Active user & developer communities<br /><ul><li>10 year pedigree, >$10M support
  39. 39. Numerical Relativity, CFD, Coastal, Reservoir Engineering, …</li></ul>Domain-specific toolkits, e.g. CFD toolkit<br /><ul><li>FD/FV/FE numerical methods
  40. 40. Structured, multi-block, unstructured
  41. 41. Uses PETSc, Trilinos, MUMPS, HYPRE</li></ul>30<br />
  42. 42. LONI Institute<br />$15M 5-year project (2007-2012)<br />$7M BoR, $8M from universities<br />Create bold new inter-university superstructure<br />New faculty (12), staff (6), students (36); train others. Focus on CS, Bio, Materials, but all disciplines impacted<br />Promote research at interfaces for innovation<br />Draw on, enhance strengths of all universities<br />Solve complex problems through collaboration & computation<br />Much stronger recruiting opportunities for all institutions<br />Statewide interdisciplinary education & research program<br />Create University-Industry Research Centers (UIRCs)<br />Transform our state<br />Such committed cooperation between sites extraordinary<br />31<br />
  43. 43. NSF TeraGrid<br />32<br />
  44. 44. Motivation:Gamma-Ray Burst Grand Challenge<br />Most energetic events in the universe<br />Mechanism still a riddle;grand challenge in astrophysics<br />Modelling requires expertise in many fields of physics(general relativity, magneto-hydrodynamics, neutrinos, ...)<br />Requires petascale computing<br />ACM, doi:10.1145/1341811.1341831<br />
  45. 45. Einstein Toolkithttp://www.einsteintoolkit.org<br />Based on Cactus Framework<br />Over 130 open, community developed Cactus modules<br />Building a consortium of users<br />Governance and software development<br />Members<br />40 listed on web page<br />10 different groups<br />US, Japan, Mexico, Spain, Germany, Canada<br />300 science publications, 50 student theses<br />
  46. 46. Einstein Toolkit<br />Research/Funding<br />Relativistic astrophysics (black holes, supernova, Gamma Ray bursts) (PIF, ++)<br />Large scale computing (PetaApps, PRAC, Blue Waters)<br />Verification, performance (Alpaca, HPCOPS)<br />Data and metadata (PIF)<br />Visualization, interaction, high speed networks (CyberTools, EAGER)<br />Other apps: Coastal, CFD (CyberTools)<br />
  47. 47. Winners IEEE SCALE09! (Hutanu, Schnetter et al)<br /><ul><li>2048 core simulation code
  48. 48. 8 node renderer at LSU
  49. 49. Remote LONI nodes as data servers
  50. 50. 10243 spatial resolution (1GByte/timestep)
  51. 51. 20 timesteps cached remotely
  52. 52. Scalable Approach!!!</li></li></ul><li>Conclusions<br />37<br />Cyberinfrastructure has played a crucial role in Louisiana in building an environment able to support and nurture high quality research<br />Advances were needed in many areas:<br />Networks, Computing, Tools & services, Applications, People<br />Real results:<br />REU program in computational science, 16 undergrads <br />2 of 16 Blue Waters undergraduate internships to LA<br />PetaApps, PRAC, CAREER awards<br />Louisiana is developing cyberinfrastructure for its own researchers, and for the nation (Cactus, PetaShare, SAGA, HARC, Vish, ….)<br />
  53. 53. References<br />Louisiana: A Model for Advancing Regional e-Research through Cyberinfrastructure,<br />D. S. Katz, G. Allen, R. Cortez, C. Cruz-Neira, R. Gottumukkala, Z. D. Green- wood, L. Guice, S. Jha, R. Kolluru, T. Kosar, L. Leger, H. Liu, C. McMahon, J. Nabrzyski, B. Rodriguez-Milla, E. Seidel, G. Speyrer, M. Stubblefield, B. Voss, S. Whittenburg, Phil. Trans. R. Soc. A 28, June 2009, vol. 367, no. 1897, 2459-2469, (2009).<br />Computational Science, Infrastructure and Interdisciplinary Research on University Campuses: Experiences and Lessons from the Center for Computation & Technology,<br />G. Allen, D. S. Katz,, CCT Technical Report Series, CCT-TR-2010-1, 2010 (Full version soon)<br />Einstein Toolkit Consortium<br />www.einsteintoolkit.org<br />Cactus Framework<br />www.cactuscode.org<br />
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×