"The OptIPuter, Quartzite, and Starlight Projects:  A Campus to Global-Scale Testbed for  Optical Technologies Enabli...
Abstract and OFC Invited Paper <ul><li>Abstract </li></ul><ul><ul><li>Dedicated optical connections have significant advan...
The Evolution from Supercomputer-Centric to a Net-Centric Architecture Megabit/s Gigabit/s Terabit/s Source: Timothy Lance...
Calit2 -- Research and Living Laboratories on the Future of the Internet www.calit2.net University of California San Diego...
The OptIPuter Project –    Bringing the Power of Lambdas to End Users <ul><li>NSF Large Information Technology Research Pr...
Opt ical Networking,  I nternet  P rotocol, Comp uter Bringing the Power of Lambdas to Users <ul><li>Extending Grid Middle...
Tiled LCD Displays Driven by Linux Graphics Clusters Allow for Both Global Context and High Levels of Detail &quot;Source:...
Interactively Zooming In Using EVL’s JuxtaView  on NCMIR’s Sun Microsystems Visualization Node &quot;Source: Data from JPL...
Highest Resolution Zoom on NCMIR 40 MPixel OptIPuter Display Node &quot;Source: Data from JPL/Mica; Display UCSD NCMIR, Da...
LambdaRAM:  Clustered Memory To Provide Low Latency Access To Large Remote Data Sets <ul><li>Giant Pool of Cluster Memory ...
OptIPuter Challenge is to Couple Cluster Endpoints  to WAN DWDM Dedicated Photonic Channels <ul><li>Scalable Adaptive Grap...
UCSD Campus LambdaStore Architecture Dedicated Lambdas to Labs Creates Campus LambdaGrid SIO Ocean Supercomputer IBM Stora...
OptIPuter Software Architecture--a Service-Oriented Architecture Integrating Lambdas Into the Grid Distributed Application...
A Photonics-Centric View of UCSD’s ECE Department - Many Are Involved with Calit2 Photonics Program J. Ford  S. Esener Y.H...
UCSD ECE, Jacobs School, and Calit2 Set Photonics as a High Priority for Faculty Recruiting All Joined UCSD in Last 2.5 Ye...
NSF Quartzite Research Instrumentation Award  ECE Faculty Augment OptIPuter Testbed <ul><li>Hybrid System of Packet-Based ...
The Optical Core of the UCSD Campus-Scale Testbed -- Evaluating Packet Routing versus Lambda Switching <ul><li>Goals by 20...
UCSD Quartzite Testbed -- Lucent 1xK Wavelength-Selective Switch MEMS Wavelength Switching Concept:  Modular Transparent D...
Packet-Rate Wavelength Routing and Multicasting Parametric  λ -Conversion + Passive Waveguide Routing   <ul><li>Convention...
Experimental Demo:  λ -Conversion @ 40 Gb/s UCSD Parametric Processing Laboratory OC-768 Packet Switched  in Primitive Par...
Scalable Intelligent Optical Networks (SION) Photonics Research Testbed To Enable Cross-Integrational  Photonics Systems R...
NLR Will Provide an Experimental Network Infrastructure for U.S. Scientists & Researchers First Light September 2004  “ Na...
The OptIPuter LambdaGrid  is Rapidly Expanding  1 GE Lambda 10 GE Lambda Source: Greg Hidley, Aaron Chin, Calit2 UCSD Star...
OptIPuter Has Built on the Lessons Learned from the OMNInet Metro Area OOO Testbed NTON 10 Gb Lambdas StarLight: the Large...
Dedicated Research 10Gb Optical  Circuits in 2005  North America, Europe and Japan US IRNC (black) – 20Gb  NYC—Amsterdam –...
Calient Lambda Switches Now Installed  at StarLight and NetherLight Source: Maxine Brown, OptIPuter Project Manager Univer...
Multiple HD Streams Over Lambdas  Will Radically Transform Campus Collaboration U. Washington JGN II Workshop Osaka, Japan...
Calit2 Collaboration Rooms Testbed  UCI to UCSD In 2005 Calit2 will  Link Its Two Buildings  via CENIC-XD Dedicated Fiber ...
<ul><li>September 26-30, 2005 </li></ul><ul><li>University of California, San Diego </li></ul><ul><li>California Institute...
Upcoming SlideShare
Loading in …5
×

The OptiPuter, Quartzite, and Starlight Projects: A Campus to Global-Scale Testbed for Optical Technologies Enabling LambdaGrid Computing

772 views

Published on

05.03.09
Invited Talk
Optical Fiber Communication Conference (OFC2005)
Title: The OptiPuter, Quartzite, and Starlight Projects: A Campus to Global-Scale Testbed for Optical Technologies Enabling LambdaGrid Computing
Anaheim, CA

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
772
On SlideShare
0
From Embeds
0
Number of Embeds
25
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

The OptiPuter, Quartzite, and Starlight Projects: A Campus to Global-Scale Testbed for Optical Technologies Enabling LambdaGrid Computing

  1. 1. &quot;The OptIPuter, Quartzite, and Starlight Projects: A Campus to Global-Scale Testbed for Optical Technologies Enabling LambdaGrid Computing” Invited Talk Optical Fiber Communication Conference (OFC2005) Anaheim, CA March 9, 2005 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD
  2. 2. Abstract and OFC Invited Paper <ul><li>Abstract </li></ul><ul><ul><li>Dedicated optical connections have significant advantages over shared internet connections. The OptIPuter project (www.optiputer.net) uses medical and earth sciences imaging as application drivers. Quartzite (UCSD) and Starlight (Chicago) create unique combinations of OEO routers and OOO and wavelength-selective optical switches. </li></ul></ul><ul><li>Invited Paper for OFC 2005 </li></ul><ul><ul><li>The OptIPuter, Quartzite, and Starlight Projects: </li></ul></ul><ul><ul><li>A Campus to Global-Scale Testbed for Optical Technologies Enabling LambdaGrid Computing </li></ul></ul><ul><li>By Larry Smarr, </li></ul><ul><ul><li>Harry E. Gruber Professor, Department of Computer Science and Engineering, UCSD </li></ul></ul><ul><ul><li>Director, California Institute of Telecommunications and Information Technology </li></ul></ul><ul><li>With Shaya Fainman, Joseph Ford, Phil Papadopoulos </li></ul><ul><ul><li>University of California, San Diego </li></ul></ul><ul><li>and Tom DeFanti, Maxine Brown, and Jason Leigh </li></ul><ul><ul><li>Electronic Visualization Laboratory </li></ul></ul><ul><ul><li>University of Illinois at Chicago </li></ul></ul>
  3. 3. The Evolution from Supercomputer-Centric to a Net-Centric Architecture Megabit/s Gigabit/s Terabit/s Source: Timothy Lance, President, NYSERNet 1 GFLOP Cray2 60 TFLOP Altix Bandwidth of NYSERNet Research Network Backbones T1 32 10Gb “ Lambdas”
  4. 4. Calit2 -- Research and Living Laboratories on the Future of the Internet www.calit2.net University of California San Diego & Irvine Campuses Faculty & Staff Working in Multidisciplinary Teams With Students, Industry, and the Community One Focus Area is Net-Centric Optical Architectures
  5. 5. The OptIPuter Project – Bringing the Power of Lambdas to End Users <ul><li>NSF Large Information Technology Research Proposal </li></ul><ul><ul><li>Calit2 (UCSD, UCI) and UIC Lead Campuses—Larry Smarr PI </li></ul></ul><ul><ul><li>Partnering Campuses: USC, SDSU, NW, TA&M, UvA, SARA, NASA </li></ul></ul><ul><li>Industrial Partners </li></ul><ul><ul><li>IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent </li></ul></ul><ul><li>$13.5 Million Over Five Years </li></ul><ul><li>Linking Global Scale Science Projects to User’s Linux Clusters </li></ul>NIH Biomedical Informatics NSF EarthScope and ORION http://ncmir.ucsd.edu/gallery.html siovizcenter.ucsd.edu/library/gallery/shoot1/index.shtml Research Network
  6. 6. Opt ical Networking, I nternet P rotocol, Comp uter Bringing the Power of Lambdas to Users <ul><li>Extending Grid Middleware to Control: </li></ul><ul><ul><li>Cluster Enpoints- Storage, Visualization, & Computing </li></ul></ul><ul><ul><ul><li>Linux Clusters With 1 or 10 Gbps I/O per Node </li></ul></ul></ul><ul><ul><ul><li>Scalable Visualization Displays with OptIPuter Clusters </li></ul></ul></ul><ul><ul><li>Jitter-Free, Fixed Latency, Predictable Optical Circuits </li></ul></ul><ul><ul><ul><li>One or Parallel Dedicated Light-Pipes </li></ul></ul></ul><ul><ul><ul><ul><li>1 or 10 Gbps WAN Lambdas </li></ul></ul></ul></ul><ul><ul><ul><li>Uses Internet Protocol, But Does NOT Require TCP </li></ul></ul></ul><ul><ul><ul><li>Exploring Both Intelligent Routers and Passive Switches </li></ul></ul></ul><ul><li>Applications Drivers: </li></ul><ul><ul><li>Earth and Ocean Sciences </li></ul></ul><ul><ul><li>Biomedical Imaging </li></ul></ul>
  7. 7. Tiled LCD Displays Driven by Linux Graphics Clusters Allow for Both Global Context and High Levels of Detail &quot;Source: Data from JPL/Mica; Display UCSD NCMIR, David Lee&quot; 150 MPixel Rover Image on 40 MPixel OptIPuter Visualization Node Display
  8. 8. Interactively Zooming In Using EVL’s JuxtaView on NCMIR’s Sun Microsystems Visualization Node &quot;Source: Data from JPL/Mica; Display UCSD NCMIR, David Lee&quot;
  9. 9. Highest Resolution Zoom on NCMIR 40 MPixel OptIPuter Display Node &quot;Source: Data from JPL/Mica; Display UCSD NCMIR, David Lee&quot;
  10. 10. LambdaRAM: Clustered Memory To Provide Low Latency Access To Large Remote Data Sets <ul><li>Giant Pool of Cluster Memory Provides Low-Latency Access to Large Remote Data Sets </li></ul><ul><ul><li>Data Is Prefetched Dynamically </li></ul></ul><ul><ul><li>LambdaStream Protocol Integrated into JuxtaView Montage Viewer </li></ul></ul><ul><li>3 Gbps Experiments from Chicago to Amsterdam to UIC </li></ul><ul><ul><li>LambdaRAM Accessed Data From Amsterdam Faster Than From Local Disk </li></ul></ul>all 8-14 none all 8-14 1-7 Displayed region Visualization of the Pre-Fetch Algorithm none Data on Disk in Amsterdam Local Wall Source: David Lee, Jason Leigh
  11. 11. OptIPuter Challenge is to Couple Cluster Endpoints to WAN DWDM Dedicated Photonic Channels <ul><li>Scalable Adaptive Graphics Environment (SAGE) Controls: </li></ul><ul><li>100 Megapixels Display </li></ul><ul><ul><li>55-Panel </li></ul></ul><ul><li>1/4 TeraFLOP </li></ul><ul><ul><li>Driven by 30 Node Cluster of 64 bit Dual Opterons </li></ul></ul><ul><li>1/3 Terabit/sec I/O </li></ul><ul><ul><li>30 x 10GE interfaces </li></ul></ul><ul><ul><li>Linked to OptIPuter </li></ul></ul><ul><li>1/8 TB RAM </li></ul><ul><li>60 TB Disk </li></ul>Source: Jason Leigh, Tom DeFanti, EVL@UIC OptIPuter Co-PIs NSF LambdaVision MRI@UIC
  12. 12. UCSD Campus LambdaStore Architecture Dedicated Lambdas to Labs Creates Campus LambdaGrid SIO Ocean Supercomputer IBM Storage Cluster Extreme Switch with 2 Ten Gbps Uplinks Streaming Microscope Source: Phil Papadopoulos, SDSC, Calit2
  13. 13. OptIPuter Software Architecture--a Service-Oriented Architecture Integrating Lambdas Into the Grid Distributed Applications/ Web Services Telescience Vol-a-Tile SAGE JuxtaView Visualization Data Services LambdaRAM PIN/PDC Lambdas IP+TP Discovery and Control GTP XCP UDT LambdaStream CEP RBUDP DVC Configuration Distributed Virtual Computer (DVC) API DVC Runtime Library Globus XIO DVC Services DVC Core Services DVC Job Scheduling DVC Communication Resource Identify/Acquire Namespace Management Security Management High Speed Communication Storage Services GRAM GSI RobuStore
  14. 14. A Photonics-Centric View of UCSD’s ECE Department - Many Are Involved with Calit2 Photonics Program J. Ford S. Esener Y.H. Lo M. Heller S. Bhatia Bio Engineering Chemistry C Tu Communications EM waves RF Electronic Circuits Computer Engineering Electronic Devices & Materials Optical Interconnects Thrust Bio Photonics Thrust Photonic Networks Thrust G. Papen S. Fainman Ed Yu C. Guest Signal Processing Systems Materials P.K Yu S. Radic D. Wang S. Mookherjea Most Are Involved with Calit2 Photonics Program
  15. 15. UCSD ECE, Jacobs School, and Calit2 Set Photonics as a High Priority for Faculty Recruiting All Joined UCSD in Last 2.5 Years Shayan Mookherjea , Asst. Professor, Electrical and Computer Engineering Expertise: Optical Devices and Optical Communication Networks, Including Photonics, Lightwave Systems and Nano-Scale Optics Ph.D. : Electrical Engineering, Caltech, 2003 Background: 2003 Wilts Prize for Best Thesis in Caltech Electrical Engineering Stojan Radic , Assoc. Professor, Electrical and Computer Engineering Expertise: Optical Communication Networks; All-Optical Processing; Parametric Processes in High-confinement Fiber and Semiconductor Devices Ph.D. : Institute of Optics, University of Rochester, 1995 Background: Corning research, Bell Labs Trans. Dept., Nortel Chair Assoc. Prof., Duke Deli Wang , Asst. Professor, Electrical and Computer Engineering Expertise: Nanoscale Science and Technology; Semiconductor Nanomaterials and Devices for Electronic, Optoelectronic and Biological Applications Ph.D. : Materials, UC Santa Barbara, 2001 Background: Postdoctoral Fellow, Harvard University Joseph Ford , Assoc. Professor, Electrical and Computer Engineering Expertise: Optoelectronic Subsystems Integration (MEMS, Diffractive Optics, VLSI); Fiber Optic and Free-Space Communications Ph.D. : Applied Physics, UCSD, 1992 Background: Bell Labs Adv. Photonics Dept., Chief Scientist, Optical Micro-Machines. George Papen , Professor, Electrical and Computer Engineering Expertise: Advanced Photonic Systems Including Optical Communication Systems, Optical Networking, and Environmental And Atmospheric Remote Sensing Ph.D. : Electrical and Computer Engineering from the University of Wisconsin, 1989 Background: University of Illinois at Urbana-Champaign UCSD Photonics
  16. 16. NSF Quartzite Research Instrumentation Award ECE Faculty Augment OptIPuter Testbed <ul><li>Hybrid System of Packet-Based and Circuit-Based Devices </li></ul><ul><li>Match the Network to the Number of Existing Endpoints </li></ul><ul><li>Greatly Increase the Number of 10Gb Optical Paths </li></ul><ul><ul><li>Evaluating DWDM and CWDM Technologies for Campus Scale </li></ul></ul><ul><li>Hybrid Network “Switch Stack” at Campus Collocation Point </li></ul><ul><ul><li>Packet Switch—Chiaro Networks </li></ul></ul><ul><ul><li>Transparent Optical Switch--Glimmerglass </li></ul></ul><ul><ul><ul><li>Physically Build New Topologies Without Physical Rewiring </li></ul></ul></ul><ul><ul><li>Experimental Pre-Commercial Devices </li></ul></ul><ul><ul><ul><li>Lucent Wavelength-Selective Switch </li></ul></ul></ul><ul><ul><li>Experimental Academic Devices </li></ul></ul><ul><ul><ul><li>Radic/Ford Packet-Rate Wavelength Routing and Multicasting </li></ul></ul></ul>Source: Phil Papadopoulos, SDSC, Calit2—Quartzite PI
  17. 17. The Optical Core of the UCSD Campus-Scale Testbed -- Evaluating Packet Routing versus Lambda Switching <ul><li>Goals by 2007: </li></ul><ul><li>>= 50 endpoints at 10 GigE </li></ul><ul><li>>= 32 Packet switched </li></ul><ul><li>>= 32 Switched wavelengths </li></ul><ul><li>>= 300 Connected endpoints </li></ul>Approximately 0.5 TBit/s Arrive at the “Optical” Center of Campus Switching will be a Hybrid Combination of: Packet, Lambda, Circuit -- OOO and Packet Switches Already in Place Source: Phil Papadopoulos, SDSC, Calit2 Funded by NSF MRI Grant Lucent Glimmerglass Chiaro Networks
  18. 18. UCSD Quartzite Testbed -- Lucent 1xK Wavelength-Selective Switch MEMS Wavelength Switching Concept: Modular Transparent DWDM Network Provisioning 64 Channel 4×4 WS-OXC Prototype Micro-Electro-Mechanical Switching + Free-Space Optical Wavelength MUX Millisecond-Rate Provisioning for DWDM & CWDM Networks
  19. 19. Packet-Rate Wavelength Routing and Multicasting Parametric λ -Conversion + Passive Waveguide Routing <ul><li>Conventional 10 GbE Terminals Connected via Transparent Passive Router + NLO </li></ul>Ultra-fast Parametric λ - Conversion 1 2 3 K N-1 N 1 2 3 l M-1 M Node IN Node OUT … and Routed to Arbitrary Output Input Packet  -Translated… AWG Router Waveguide <ul><li>Wavelength Band Translation </li></ul><ul><li>1 to 100nm Translation </li></ul><ul><li>Amplification & 2R Regeneration </li></ul>Time-of-Flight Transparent Routing <ul><li>Passive Silica Waveguide </li></ul><ul><li>40x40 Channels, 50 GHz Passband </li></ul>Source: Joseph Ford, Stojan Radic, ECE, UCSD A B C P Q NxN  UCSD Photonics
  20. 20. Experimental Demo: λ -Conversion @ 40 Gb/s UCSD Parametric Processing Laboratory OC-768 Packet Switched in Primitive Parametric Cell <ul><li>Parametric Processing </li></ul><ul><li>Nonlinear Processing in High Confinement Fiber / SOA / QD </li></ul><ul><li>Sub-Picosecond Response Time + Time-of-Flight </li></ul><ul><li>Advantages over Conventional O-E-O Routing </li></ul><ul><li>Data Rate / Format Independent: Transparent to 1 Tb/s </li></ul><ul><li>Routes Signals by Multichannel Band (Not Single λ ) </li></ul><ul><li>Selective Conjugation Supports Long-Haul Transmission </li></ul>Source: Joseph Ford, Stojan Radic, ECE, UCSD UCSD Photonics
  21. 21. Scalable Intelligent Optical Networks (SION) Photonics Research Testbed To Enable Cross-Integrational Photonics Systems Research Fundamentally novel device capabilities New component capabilities Specific component performance specs Network-enabling components needed Performance metrics and drivers Novel networking capabilities Devices & Subsystems Network Architectures Physical Layer System Control Photonics Testbed UCSD Photonics
  22. 22. NLR Will Provide an Experimental Network Infrastructure for U.S. Scientists & Researchers First Light September 2004 “ National LambdaRail” Partnership Serves Very High-End Experimental and Research Applications 4 x 10Gb Wavelengths Initially Capable of 40 x 10Gb wavelengths at Buildout Links Two Dozen State and Regional Optical Networks DOE and NASA Using NLR
  23. 23. The OptIPuter LambdaGrid is Rapidly Expanding 1 GE Lambda 10 GE Lambda Source: Greg Hidley, Aaron Chin, Calit2 UCSD StarLight Chicago UIC EVL NU CENIC San Diego GigaPOP CalREN-XD 8 8 NetherLight Amsterdam U Amsterdam NASA Ames NASA Goddard NLR NLR 2 SDSU CICESE via CUDI CENIC/Abilene Shared Network PNWGP Seattle CAVEwave/NLR NASA JPL ISI UCI CENIC Los Angeles GigaPOP 2 2
  24. 24. OptIPuter Has Built on the Lessons Learned from the OMNInet Metro Area OOO Testbed NTON 10 Gb Lambdas StarLight: the Largest 1 GE & 10 GE Exchange for Supporting U.S. / International Research & Education Networks NTONC C DWDM RAM
  25. 25. Dedicated Research 10Gb Optical Circuits in 2005 North America, Europe and Japan US IRNC (black) – 20Gb NYC—Amsterdam – 10Gb LA—Tokyo GEANT/I2 (orange) – 30Gb London, etc.—NYC UK to US (red) – 10Gb London—Chicago SURFnet to US (light blue) – 10Gb Amsterdam—NYC – 10Gb Amsterdam—Chicago Canadian CA*net4 to US (white) – 30Gb Chicago-Canada-NYC – 30Gb Chicago-Canada-Seattle Japan JGN II to US (grey) – 10Gb Chicago—Tokyo European (not GEANT) (yellow) – 10Gb Amsterdam—CERN – 10Gb Prague—Amsterdam – 2.5Gb Stockholm—Amsterdam – 10Gb London—Amsterdam IEEAF lambdas (dark blue) – 10Gb NYC—Amsterdam – 10Gb Seattle—Tokyo CAVEwave/PacificWave (purple ) – 10Gb Chicago—Seattle—SD – 10Gb Seattle—LA—SD Northern Light UKLight PNWGP Japan Manhattan Landing CERN
  26. 26. Calient Lambda Switches Now Installed at StarLight and NetherLight Source: Maxine Brown, OptIPuter Project Manager University of Amsterdam is an OptIPuter Partner Now Supporting 10GE International Lambdas
  27. 27. Multiple HD Streams Over Lambdas Will Radically Transform Campus Collaboration U. Washington JGN II Workshop Osaka, Japan Jan 2005 Prof. Osaka Prof. Aoyama Prof. Smarr Source: U Washington Research Channel Telepresence Using Uncompressed 1.5 Gbps HDTV Streaming Over IP on Fiber Optics
  28. 28. Calit2 Collaboration Rooms Testbed UCI to UCSD In 2005 Calit2 will Link Its Two Buildings via CENIC-XD Dedicated Fiber over 75 Miles Using OptIPuter Architecture to Create a Distributed Collaboration Laboratory UC Irvine UC San Diego UCI VizClass UCSD NCMIR Source: Falko Kuester, UCI & Mark Ellisman, UCSD
  29. 29. <ul><li>September 26-30, 2005 </li></ul><ul><li>University of California, San Diego </li></ul><ul><li>California Institute for Telecommunications and Information Technology </li></ul>The Networking Double Header of the Century Will Be Driven by LambdaGrid Applications i Grid 2 oo 5 T H E G L O B A L L A M B D A I N T E G R A T E D F A C I L I T Y Maxine Brown, Tom DeFanti, Co-Organizers www.startap.net/igrid2005/ http://sc05.supercomp.org

×