Cyberinfrastructure for Ocean Cabled Observatories

628 views

Published on

05.11.15
Invited Talk, NEPTUNE Regional Cabled Ocean Observatory Workshop
Title: Cyberinfrastructure for Ocean Cabled Observatories
La Jolla, CA

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
628
On SlideShare
0
From Embeds
0
Number of Embeds
18
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Accomplishment Instrument to OptIPuter resources data distribution architecture
  • Cyberinfrastructure for Ocean Cabled Observatories

    1. 1. “ Cyberinfrastructure for Ocean Cabled Observatories" Invited Talk NEPTUNE Regional Cabled Ocean Observatory Workshop Seattle, WA November 15, 2005 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD
    2. 2. Goal – From Expedition to Cabled Observatories with Streaming Stereo HDTV Robotic Cameras Scenes from The Aliens of the Deep, Directed by James Cameron & Steven Quale http://disney.go.com/disneypictures/aliensofthedeep/alienseduguide.pdf
    3. 3. A Near Future Metagenomics Fiber Optic Cable Observatory Source John Delaney, UWash
    4. 4. Adding Web & Grid Services to Optical Channels to Provide Real Time Control of Ocean Observatories <ul><li>Goal: </li></ul><ul><ul><li>Prototype Cyberinfrastructure for NSF’s Ocean Research Interactive Observatory Networks (ORION) Building on OptIPuter </li></ul></ul><ul><li>LOOKING NSF ITR with PIs: </li></ul><ul><ul><li>John Orcutt & Larry Smarr - UCSD </li></ul></ul><ul><ul><li>John Delaney & Ed Lazowska –UW </li></ul></ul><ul><ul><li>Mark Abbott – OSU </li></ul></ul><ul><li>Collaborators at: </li></ul><ul><ul><li>MBARI, WHOI, NCSA, UIC, CalPoly, UVic, CANARIE, Microsoft, NEPTUNE-Canarie </li></ul></ul>LOOKING: ( L aboratory for the O cean O bservatory K nowledge In tegration G rid) LOOKING is Driven By NEPTUNE CI Requirements http://lookingtosea.ucsd.edu/ Making Management of Gigabit Flows Routine
    5. 5. MARS Cable Observatory Testbed – LOOKING “Living Laboratory” Tele-Operated Crawlers Central Lander MARS Installation Oct 2005 -Jan 2006 Source: Jim Bellingham, MBARI
    6. 6. Grand Challenge: A Total Knowledge Integration System for the Coastal Zone <ul><li>Moorings </li></ul><ul><li>Ships </li></ul><ul><li>Autonomous Vehicles </li></ul><ul><li>Satellite Remote Sensing </li></ul><ul><li>Drifters </li></ul><ul><li>Long Range HF Radar </li></ul><ul><li>Near-Shore Waves/Currents (CDIP) </li></ul><ul><li>COAMPS Wind Model </li></ul><ul><li>Nested ROMS Models </li></ul><ul><li>Data Assimilation and Modeling </li></ul><ul><li>Data Systems </li></ul>Pilot Project Components www.sccoos.org/ www.cocmp.org
    7. 7. ROADNet Architecture: SensorNets, Storage Research Broker, Web Services, Work Flow Kepler Web Services SRB Antelope Frank Vernon, SIO; Tony Fountain, Ilkay Altintas, SDSC
    8. 8. Calit2’s Direct Access Core Architecture Supporting Massive Instrumental Datasets Flat File Server Farm W E B PORTAL + Web Services Traditional User Response Request Data- Base Farm 10 GigE Fabric Source: Phil Papadopoulos, SDSC, Calit2 Dedicated Compute Farm (100s of CPUs) TeraGrid: Cyberinfrastructure Backplane (scheduled activities, e.g. all by all comparison) (10000s of CPUs) Web (other service) Local Cluster Local Environment Direct Access Lambda Cnxns Campus Grid OptIPuter Campus Cloud
    9. 9. Looking High Level LOOKING Service System Architecture Source: Matthew Arrott, Calit2
    10. 10. A National Cyberinfrastructure is Emerging for Data Intensive Science Source: Guy Almes, Office of Cyberinfrastructure, NSF Education & Training Data Tools & Services Collaboration & Communication Tools & Services High Performance Computing Tools & Services
    11. 11. Challenge: Average Throughput of NASA Data Products to End User is < 50 Mbps Tested October 2005 http://ensight.eos.nasa.gov/Missions/icesat/index.shtml Internet2 Backbone is 10,000 Mbps! Throughput is < 0.5% to End User
    12. 12. Dedicated Optical Channels Makes High Performance Cyberinfrastructure Possible Parallel Lambdas are Driving Optical Networking The Way Parallel Processors Drove 1990s Computing ( WDM) Source: Steve Wallach, Chiaro Networks “ Lambdas”
    13. 13. National Lambda Rail (NLR) and TeraGrid Provides Cyberinfrastructure Backbone for U.S. Researchers San Francisco Pittsburgh Cleveland San Diego Los Angeles Portland Seattle Pensacola Baton Rouge Houston San Antonio Las Cruces / El Paso Phoenix New York City Washington, DC Raleigh Jacksonville Dallas Tulsa Atlanta Kansas City Denver Ogden/ Salt Lake City Boise Albuquerque UC-TeraGrid UIC/NW-Starlight Chicago International Collaborators NLR 4 x 10Gb Lambdas Initially Capable of 40 x 10Gb wavelengths at Buildout NSF’s TeraGrid Has 4 x 10Gb Lambda Backbone Links Two Dozen State and Regional Optical Networks DOE, NSF, & NASA Using NLR
    14. 14. Brain Imaging Collaboration -- UCSD & Osaka Univ. Using Real-Time Instrument Steering and HDTV Southern California OptIPuter Most Powerful Electron Microscope in the World -- Osaka, Japan Source: Mark Ellisman, UCSD UCSD HDTV
    15. 15. Multiple HD Streams Over Lambdas Will Radically Transform Global Collaboration U. Washington JGN II Workshop Osaka, Japan Jan 2005 Prof. Osaka Prof. Aoyama Prof. Smarr Source: U Washington Research Channel Telepresence Using Uncompressed 1.5 Gbps HDTV Streaming Over IP on Fiber Optics-- 75x Home Cable “HDTV” Bandwidth!
    16. 16. <ul><li>September 26-30, 2005 </li></ul><ul><li>Calit2 @ University of California, San Diego </li></ul><ul><li>California Institute for Telecommunications and Information Technology </li></ul>Calit2@UCSD Is Connected to the World at 10Gbps T H E G L O B A L L A M B D A I N T E G R A T E D F A C I L I T Y Maxine Brown, Tom DeFanti, Co-Chairs www.igrid2005.org 50 Demonstrations, 20 Counties, 10 Gbps/Demo i Grid 2005
    17. 17. Prototyping Cabled Ocean Observatories Enabling High Definition Video Exploration of Deep Sea Vents Source John Delaney & Deborah Kelley, UWash Canadian-U.S. Collaboration
    18. 18. The OptIPuter Project – Linking Global Scale Science Resources to User’s Linux Clusters <ul><li>NSF Large Information Technology Research Proposal </li></ul><ul><ul><li>Calit2 (UCSD, UCI) and UIC Lead Campuses—Larry Smarr PI </li></ul></ul><ul><ul><li>Partnering Campuses: USC, SDSU, NW, TA&M, UvA, SARA, NASA </li></ul></ul><ul><li>Industrial Partners </li></ul><ul><ul><li>IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent </li></ul></ul><ul><li>$13.5 Million Over Five Years—Entering 4 th Year </li></ul><ul><li>Creating a LambdaGrid “Web” for Gigabyte Data Objects </li></ul>NIH Biomedical Informatics NSF EarthScope and ORION Research Network
    19. 19. Increasing Data Rate into Lab by 100x, Requires High Resolution Portals to Global Science Data 650 Mpixel 2-Photon Microscopy Montage of HeLa Cultured Cancer Cells Green: Actin Red: Microtubles Light Blue: DNA Source: Mark Ellisman, David Lee, Jason Leigh, Tom Deerinck
    20. 20. Campuses Must Provide Fiber Infrastructure to End-User Laboratories & Large Rotating Data Stores SIO Ocean Supercomputer IBM Storage Cluster 2 Ten Gbps Campus Lambda Raceway Streaming Microscope Source: Phil Papadopoulos, SDSC, Calit2 UCSD Campus LambdaStore Architecture Global LambdaGrid
    21. 21. Tiled Walls Allow for Integration of Streaming High Resolution Video Calit2@UCI Apple Tiled Display Wall Driven by 25 Dual-Processor G5s 50 Apple 30” Cinema Displays 200 Million Pixels of Viewing Real Estate! Source: Falko Kuester, Calit2@UCI NSF Infrastructure Grant Data—One Foot Resolution USGS Images of La Jolla, CA HDTV Digital Cameras Digital Cinema
    22. 22. OptIPuter Scalable Adaptive Graphics Environment (SAGE) Allows Integration of HD Streams LambdaCam Used to Capture the Tiled Display on a Web Browser <ul><li>HD Video from BIRN Trailer </li></ul><ul><li>Macro View of Montage Data </li></ul><ul><li>Micro View of Montage Data </li></ul><ul><li>Live Streaming Video of the RTS-2000 Microscope </li></ul><ul><li>HD Video from the RTS Microscope Room </li></ul>Source: David Lee, NCMIR, UCSD SAGE Developed Under Jason Leigh, EVL
    23. 23. Combining Telepresence with Remote Interactive Analysis of Data Over NLR HDTV Over Lambda OptIPuter Visualized Data SIO/UCSD NASA Goddard www.calit2.net/articles/article.php?id=660 August 8, 2005 25 Miles Venter Institute

    ×