The OptIPuter and Its Applications

662 views

Published on

09.07.27
Invited Talk
IEEE/LEOS Summer 2009 Topicals Meeting
on Future Global Networks
Title: The OptIPuter and Its Applications
Newport Beach, CA

Published in: Education, Spiritual
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
662
On SlideShare
0
From Embeds
0
Number of Embeds
30
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

The OptIPuter and Its Applications

  1. 1. The OptIPuter and Its Applications Invited Talk IEEE/LEOS Summer 2009 Topicals Meeting on Future Global Networks July 27, 2009 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD
  2. 2. Abstract The NSF-funded OptIPuter project enables user-controlled 10Gbps dedicated lightpaths to provide direct access to global data repositories, scientific instruments, and computational resources from “OptIPortals,” PC clusters which provide scalable visualization in user's campus laboratories. I will describe applications from several disciplines of this global "OptIPlatform".
  3. 3. The OptIPuter Creates an OptIPlanet Collaboratory: Enabling Data-Intensive e-Research www.evl.uic.edu/cavern/sage “OptIPlanet: The OptIPuter Global Collaboratory” – Special Section of Future Generations Computer Systems, Volume 25, Issue 2, February 2009 Calit2 (UCSD, UCI), SDSC, and UIC Leads—Larry Smarr PI Univ. Partners: NCSA, USC, SDSU, NW, TA&M, UvA, SARA, KISTI, AIST Industry: IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent
  4. 4. Academic Research “OptIPlatform” Cyberinfrastructure: A 10Gbps Lightpath Cloud HD/4k Video Cams HD/4k Telepresence Instruments End User HPC OptIPortal 10G Lightpaths National LambdaRail Data Campus Repositories Optical & Clusters Switch HD/4k Video Images
  5. 5. Creating a California Cyberinfrastructure of OptIPuter “On-Ramps” to NLR, I2DC, & TeraGrid UC Davis UC Berkeley UC San Francisco UC Merced UC Santa Cruz Creating a Critical Mass of OptIPuter End Users on a Secure LambdaGrid UC Los Angeles UC Santa Barbara UC Riverside UC Irvine CENIC Workshop at Calit2 UC San Diego Sept 15-16, 2008
  6. 6. CENIC’s New “Hybrid Network” - Traditional Routed IP and the New Switched Ethernet and Optical Services CENIC Invested ~ $14M in Upgrade Now Campuses Need to Upgrade Source: Jim Dolgonas, CENIC
  7. 7. The “Golden Spike” UCSD Experimental Optical Core: Ready to Couple Users to CENIC L1, L2, L3 Services Quartzite Communications To 10GigE cluster Goals by 2008: Core Year 3 node interfaces >= 60 endpoints at 10 GigE CENIC L1, L2 >= 30 Packet switched Wavelength Quartzite Selective Services Corewavelengths ..... Switch >= 30 Switched >= 400 Connected endpoints Lucent To 10GigE cluster node interfaces and other switches To cluster nodes ..... Glimmerglass Approximately 0.5 Tbps ..... To cluster nodes GigE Switch with Dual 10GigE Upliks Arrive at the “Optical” Production OOO Switch To cluster nodes Center of Hybrid Campus 32 10GigE ..... Switch GigE Switch with Dual 10GigE Upliks Force10 ... To Packet Switch CalREN-HPR GigE Switch with Dual 10GigE Upliks other Research nodes Cloud GigE Funded by 10GigE NSF MRI Campus Research 4 GigE 4 pair fiber Grant Cloud Cisco 6509 Juniper T320 OptIPuter Border Router Source: Phil Papadopoulos, SDSC/Calit2 (Quartzite MRI PI, OptIPuter co-PI)
  8. 8. Calit2 Sunlight Optical Exchange Contains Quartzite Maxine Brown, EVL, UIC OptIPuter Project Manager
  9. 9. Campus Fiber Network Based on Quartzite Allowed UCSD CI Design Team to Architect Shared Resources HPC System Cluster Condo PetaScale Data Analysis UCSD Storage Facility UC Grid Pilot Digital Collections DNA Arrays, Lifecycle Research Mass Spec., Microscopes, Management Cluster OptiPortal Research Genome Instrument Sequencers N x 10Gbe Source: Phil Papadopoulos, SDSC/Calit2
  10. 10. Calit2 Microbial Metagenomics Cluster- Next Generation Optically Linked Science Data Server Source: Phil Papadopoulos, SDSC, Calit2 512 Processors ~200TB ~5 Teraflops Sun 1GbE X4500 ~ 200 Terabytes Storage and Storage 10GbE Switched 10GbE / Routed Core
  11. 11. Next Great Planetary Instrument: The Square Kilometer Array Requires Dedicated Fiber www.skatelescope.org Transfers Of 1 TByte Images World-wide Will Be Needed Every Minute!
  12. 12. My OptIPortalTM – Affordable Termination Device for the OptIPuter Global Backplane • 20 Dual CPU Nodes, 20 24” Monitors, ~$50,000 • 1/4 Teraflop, 5 Terabyte Storage, 45 Mega Pixels--Nice PC! • Scalable Adaptive Graphics Environment ( SAGE) Jason Leigh, EVL-UIC Source: Phil Papadopoulos SDSC, Calit2
  13. 13. Use of OptIPortal to Interactively View Multi-Scale Biomedical Imaging 200 Megapixels! Source: Mark Ellisman, David Green: Purkinje Cells Lee, Red: Glial Cells Jason Light Blue: Nuclear DNA Leigh Two-Photon Laser Confocal Microscope Montage of 40x36=1440 Images in 3 Channels of a Mid-Sagittal Section of Rat Cerebellum Acquired Over an 8-hour Period
  14. 14. Scalable Displays Allow Both Global Content and Fine Detail Source: Mark Ellisman, David Lee, Jason Leigh
  15. 15. Allows for Interactive Zooming from Cerebellum to Individual Neurons Source: Mark Ellisman, David Lee, Jason Leigh
  16. 16. On-Line Resources Help You Build Your Own OptIPortal www.optiputer.net http://wiki.optiputer.net/optiportal www.evl.uic.edu/cavern/sage http://vis.ucsd.edu/~cglx/
  17. 17. Launch of the 100 Megapixel OzIPortal Kicked Off a Rapid Build Out of Australian OptIPortals January 15, 2008 Smarr OptIPortal Road Show January 15, 2008 No Calit2 Person Physically Flew to Australia to Bring This Up! Covise, Phil Weber, Jurgen Schulze, Calit2 CGLX, Kai-Uwe Doerr , Calit2 http://www.calit2.net/newsroom/release.php?id=1421
  18. 18. Building a Data and Visualization Intensive Working Environment Across Remote Sites NASA Ames Visit Feb. 29, 2008 HiPerVerse: First ½ Gigapixel Distributed OptIPortal- 124 Tiles Sept. 15, 2008 Calit2@ UCI wall Calit2@ UCSD wall UCSD cluster: 15 x Quad core Dell XPS with Dual nVIDIA 5600s UCI cluster: 25 x Dual Core Apple G5
  19. 19. OptIPuter Persistent Infrastructure Enables Calit2 and U Washington CAMERA Collaboratory Photo Credit: Alan Decker Feb. 29, 2008 Ginger Armbrust’s Diatoms: Micrographs, Chromosomes, Genetic Assembly iHDTV: 1500 Mbits/sec Calit2 to UW Research Channel Over NLR
  20. 20. Telepresence Meeting Using Digital Cinema 4k Streams 4k = 4000x2000 Pixels = 4xHD Streaming 4k 100 Times with JPEG the Resolution 2000 of YouTube! Compression ½ Gbit/sec Lays Technical Basis for Global Keio University Digital President Anzai Cinema Sony UCSD NTT Chancellor Fox SGI Calit2@UCSD Auditorium
  21. 21. Cisco CWave for CineGrid: A New Cyberinfrastructure for High Resolution Media Streaming* Source: John (JJ) Jamison, Cisco PacificWave 1000 Denny Way (Westin Bldg.) Seattle StarLight Northwestern Univ Level3 Chicago 1360 Kifer Rd. McLean Sunnyvale 2007 Equinix 818 W. 7th St. Los Angeles CENIC Wave Cisco Has Built 10 GigE Waves on CENIC, PW, & NLR and Installed Large 6506 Switches for Calit2 Access Points in San Diego, Los Angeles, San Diego Sunnyvale, Seattle, Chicago and McLean CWave core PoP for CineGrid Members Some of These Points are also GLIF GOLEs 10GE waves on NLR and CENIC (LA to SD) * May 2007
  22. 22. Rendering Supercomputer Data at 4k Digital Cinema Resolution Source: Donna Cox, Robert Patterson, Bob Wilhelmson, NCSA
  23. 23. Providing End-to-End CI for Petascale End Users Mike Norman, SDSC October 10, 2008 Two 64K Images From a log of gas temperature log of gas density Cosmological Simulation of Galaxy Cluster Formation
  24. 24. Open Cloud OptIPuter Testbed--Manage and Compute Large Datasets Over 10Gbps Lambdas CENIC NLR C-Wave Dragon Open Source SW HW Phase 1 (2008)  Hadoop • 4 racks  Sector/Sphere MREN – 120 Nodes  Thrift, GPB – 480 Cores  Eucalyptus • 10+ Gb/s WAN  Benchmarks Phase 2 (2009) will add additional racks to current sites and increase number of sites 24 Source: Robert Grossman, UIC
  25. 25. Terasort on Open Cloud Testbed Sorting 10 Billion Records (1.2 TB) at 4 Sites (120 Nodes) Sustaining >5 Gbps--Only 5% Distance Penalty
  26. 26. OpenCloud Testbed Wins Against All Comers! Supercomputing 2008
  27. 27. Just in Time OptIPlanet Collaboratory: Live Session Between NASA Ames and Calit2@UCSD Feb 19, 2009 From Start to This Image in Less Than 2 Weeks! View from NASA Ames Lunar Science Institute Mountain View, CA Virtual Handshake HD compressed 6:1 NASA Interest in Supporting Virtual Institutes Source: Falko Kuester, Calit2; Michael Sims, NASA
  28. 28. EVL’s SAGE OptIPortal VisualCasting Multi-Site OptIPuter Collaboratory CENIC CalREN-XD Workshop Sept. 15, 2008 Total Aggregate VisualCasting Bandwidth for Nov. 18, 2008 EVL-UI Chicago Sustained 10,000-20,000 Mbps! At Supercomputing 2008 Austin, Texas November, 2008 Streaming 4k SC08 Bandwidth Challenge Entry Remote: On site: U of Michigan SARA (Amsterdam) UIC/EVL U Michigan GIST / KISTI (Korea) U of Queensland Osaka Univ. (Japan) Russian Academy of Science Masaryk Univ. (CZ) Requires 10 Gbps Lightpath to Each Site Source: Jason Leigh, Luc Renambot, EVL, UI Chicago

×