The OptIPlanet Collaboratory


               Invited Presentation
                  Calit2@UCSD
               September 16, 2008


                       Dr. Larry Smarr
Director, California Institute for Telecommunications and
                  Information Technology
                Harry E. Gruber Professor,
      Dept. of Computer Science and Engineering
          Jacobs School of Engineering, UCSD
Interactive OptIPlanet Collaboratory Prototype: Using
     Analog Communications to Prototype the Fiber Optic Future
“What we really have to do is eliminate distance between
individuals who want to interact with other people and                             SIGGRAPH 1989
with other computers.”
― Larry Smarr, Director, NCSA

                                                         Illinois


                                                                                         Boston



                “We’re using satellite technology…
                to demo what It might be like to have
                high-speed fiber-optic links between
                advanced computers
                in two different geographic locations.”
                ― Al Gore, Senator
                  Chair, US Senate Subcommittee on Science, Technology and Space
The OptIPuter Project: High Resolution Collaboratory
Over Dedicated Optical Channels to Global Science Data
                                                                            Scalable
                                                                           Adaptive
                                                                           Graphics
                                                                          Environment
                                                                            (SAGE)




                                                                                Now in
                                                                               Sixth and
                                                                               Final Year
                                                                                  Picture
                                                                                  Source:
                                                                                   Mark
                                                                                 Ellisman,
                                                                                 David Lee,
                                                                                Jason Leigh
         Calit2 (UCSD, UCI), SDSC, and UIC Leads—Larry Smarr PI
       Univ. Partners: NCSA, USC, SDSU, NW, TA&M, UvA, SARA, KISTI, AIST
        Industry: IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent
CENIC’s New “Hybrid Network” - Traditional Routed IP
 and the New Switched Ethernet and Optical Services




 ~ $14M
Invested
    in
Upgrade




             Now
           Campuses
            Need to
            Upgrade


                      Source: Jim Dolgonas, CENIC
The “Golden Spike” UCSD Experimental Optical Core:
     Ready to Couple Users to CENIC L1, L2, L3 Services
                                       Quartzite Communications
  To 10GigE cluster                    Goals by 2008:
                                                  Core Year 3
   node interfaces
                                       >= 60 endpoints at 10 GigE                CENIC L1, L2
                                       >= 30 Packet switched Wavelength
                                               Quartzite         Selective
                                                                                   Services
                                                 Corewavelengths
       .....


                                                                  Switch
                                       >= 30 Switched
                                       >= 400 Connected endpoints
                                                                Lucent                   To 10GigE cluster
                                                                                        node interfaces and
                                                                                             other switches


To cluster nodes
                   .....
                                                                  Glimmerglass
                                          Approximately 0.5 Tbps                           .....
                                                                                                   To cluster nodes


            GigE Switch with
           Dual 10GigE Upliks
                                           Arrive at the “Optical”
                                                             Production
                                                               OOO
                                                               Switch
To cluster nodes
                                         Center of Hybrid Campus
                                               32 10GigE

                   .....
                                                    Switch                          GigE Switch with
                                                                                   Dual 10GigE Upliks
                                                                       Force10
                                                 ...


                                        To             Packet Switch             CalREN-HPR
            GigE Switch with
           Dual 10GigE Upliks           other                                     Research
                                        nodes
                                                                                    Cloud
    GigE
                           Funded by
 10GigE
                            NSF MRI                                              Campus Research
  4 GigE
  4 pair fiber               Grant                                                   Cloud
                                                       Cisco 6509
                                                       Juniper T320

                                                  OptIPuter Border Router
                                 Source: Phil Papadopoulos, SDSC/Calit2
                                      (Quartzite PI, OptIPuter co-PI)
Calit2 Sunlight
Optical Exchange Contains Quartzite




                                      10:45 am
                                       Feb. 21,
                                        2008
Block Layout of UCSD
Quartzite/OptIPuter Network


                                         For Full
                                      UCSD OptIPuter
                                         Map see
                                       Elazar Harel
                                        Talk Today



                     Glimmerglass

                     OOO Switch




                                ~50 10 Gbps Lightpaths
                                   10 More to Come
                      Quartzite
              Application Specific
              Embedded Switches
Calit2 Microbial Metagenomics Cluster-
Next Generation Optically Linked Science Data Server
                              Source: Phil Papadopoulos, SDSC, Calit2




     512 Processors                            ~200TB
       ~5 Teraflops             1GbE             Sun
                                                X4500
 ~ 200 Terabytes Storage         and
                                               Storage
                               10GbE
                               Switche
                                  d/            10GbE
                               Routed
                                Core
CAMERA’s
Global Microbial Metagenomics CyberCommunity
       2200 Registered Users From Over 50 Countries
Embedded iHDTV in an OptIPortal
                      Enables Collaboration
Photo: Maxine Brown, EVL




   Larry Smarr in Reno     Source: Michael Wellings   Ginger Armbrust in Seattle
                              Research Channel
                              Univ. Washington
Genome and Medical Biosciences Building
        First 10Gbps OptIPortal End Point at UC Davis
                  Next CAMERA OptIPortal
~70 Faculty
~25+ new
~700 people

Six floors
225,000 sq ft
$98M

Molecular Medicine
Genomics & Bioinformatics
Pharmacology
Biomedical Engineering                        Jonathan Eisen
Enabling Genomics Facility
Imaging & Vivarium
OptIPuter Persistent Global Backplane
 Dana
is Rapidly Expanding and Enabling Applications
 Roode                Pete
UCI Talk
UCI                  Siegel
                    UCD Talk          CineGrid
                                        Talk
                                                   Jason Leigh
           Richard Weinberg                           SAGE
           Alternate Endings                      VisualCasting
                USC Talk                            UIC Demo


  Elazar
   Harel
 UCSD Talk




                Source:Brian Dunne, Calit2@UCSD
Calit2 at UCI and UCSD Are Prototyping
Gigabit Applications— Today 2 Gbps Paths are Used
ONS 15540 WDM at UCI
campus MPOE (CPL)                                                                          10 GE DWDM Network
                                                                                                  Line

                        1 GE DWDM Network
                               Line                      Tustin CENIC CalREN
                                                                 POP
                                                                                                                          UCSD Optiputer
             Calit2 Building                                            Wave-2: layer-2 GE.                                  Network
Floor 4 Catalyst 6500                                                   67.58.33.0/25 using 11-
                                                                        126 at UCI. GTWY is .1
                                                                                                     Engineering Gateway Building,
                                       SPDS
                                                                                                                             Kim Jitter
Floor 3 Catalyst 6500                                                                                                        Measurements
                                                                                                                             Lab E1127
                                                    Wave-1: layer-2 GE                                 Catalyst 3750 in
                                     Los            67.58.21.128/25 UCI using                          1st floor IDF
Floor 2 Catalyst 6500
                                     Angeles        141-254. GTWY .128




                                                                                                        Catalyst 3750 in
                                                                                                        NACS Machine
                                                                                                                              ESMF
                              HIPerWall
                                                                UCInet                                  Room (Optiputer)

                   Catalyst 6500,
                                                                                                       Beckman Laser Institute Bldg.

                   1st floor MDF                                                                           Berns’ Lab--
                                                                       Catalyst 3750 in CSI
                                                                                                         Remote Microscopy
                                                                                        10 GE
                    Created 09-27-2005 by Garrett Hildebrand                            Wave 1 1GE
                    Modified 02-28-2006 by Smarr/Hildebrand                             Wave 2 1GE
The Calit2 OptIPortals at UCSD and UCI
              Are Now a Gbit/s HD Collaboratory
                                 NASA Ames Visit Feb. 29, 2008




                                             HiPerVerse:
                                          First ½ Gigapixel
                                             Distributed
                                             OptIPortal-
                                              124 Tiles
                                              Yesterday
                                           Sept. 15, 2008
                           Calit2@ UCI wall




Calit2@ UCSD wall
EVL’s SAGE VisualCasting
                  Multi-Site OptIPuter Collaboratory
                                       CENIC CalREN-XD Workshop Sept. 15, 2008
EVL-UI Chicago

                                                                      Streaming 4k




U Michigan




                 Source: Jason Leigh, Luc Renambot, EVL, UI Chicago
OptIPortals
              Are Being Adopted Globally




AIST-Japan    Osaka U-Japan             KISTI-Korea        CNIC-China


                        UZurich
NCHC-Taiwan



                                  SARA- Netherlands Brno-Czech Republic




                                                      U. Melbourne,
  EVL@UIC         Calit2@UCSD            Calit2@UCI   Australia
Green
                                                    Initiative:

                                                    Can Optical
                                                  Fiber Replace
                                                   Airline Travel
                                                  for Continuing
                                                  Collaborations
                                                         ?




Source: Maxine Brown, OptIPuter Project Manager
New Year’s Challenge: Streaming Underwater Video
    From Taiwan’s Kenting Reef to Calit2’s OptIPortal
 My next plan is
to stream stable Remote Videos                           Local Images
   and quality
  underwater
     images
    to Calit2,
  hopefully by
 PRAGMA 14. --
Fang-Pang to LS
  Jan. 1, 2008



 March 6, 2008
     Plan
 Accomplished!

                               March 26, 2008


           UCSD: Rajvikram Singh, Sameer Tilak, Jurgen Schulze, Tony Fountain, Peter Arzberger
           NCHC : Ebbe Strandell, Sun-In Lin, Yao-Tsung Wang, Fang-Pang Lin
Coupling CENIC/PW to AARNet International Network:
      The Core of the OptIPlanet Collaboratory
Launch of the 100 Megapixel OzIPortal Over Qvidium
 Compressed HD on 1 Gbps CENIC/PW/AARNet Fiber




January 15, 2008
                    Covise, Phil Weber, Jurgen Schulze, Calit2
                           CGLX, Kai-Uwe Doerr , Calit2
                   www.calit2.net/newsroom/release.php?id=1219
“Using the Link to Build the Link”
Calit2 and Univ. Melbourne Technology Teams




  No Calit2 Person Physically Flew to Australia to Bring This Up!

         www.calit2.net/newsroom/release.php?id=1219
Victoria Premier and Australian Deputy Prime Minister
                  Asking Questions




             www.calit2.net/newsroom/release.php?id=1219
University of Melbourne Vice Chancellor Glyn Davis
    in Calit2 Replies to Question from Australia
OptIPuterizing Australian Universities in 2008:
               CENIC Coupling to AARNet

                      UMelbourne/Calit2 Telepresence Session May 21, 2008

                          Augmented by Many Physical Visits This Year
                             Culminating in Two Week Lecture Tour
                              of Australian Research Universities
                                  by Larry Smarr October 2008


   Phil Scanlan
     Founder-
Australian American
Leadership Dialogue
   www.aald.org
Smarr American Australian Leadership Dialogue
OptIPlanet Collaboratory Lecture Tour October 2008
AARNet National Network
                          •   Oct 2—University of Adelaide
                          •   Oct 6—Univ of Western Australia
                          •   Oct 8—Monash Univ.; Swinburne
                              Univ.
                          •   Oct 9—Univ. of Melbourne
                          •   Oct 10—Univ. of Queensland
                          •   Oct 11—AIMS, James Cook Univ.,
                              Townsville
                          •   Oct 13—Univ. of Technology,
                              Sydney
                          •   Oct 14—Univ. of New South Wales
                          •   Oct 15—Leadership Dialogue
                              Scholar Oration, Canberra
                          •   Oct 16—CSIRO OptIPortal
                              Dedication; ANU; AARNet
                          •   Oct 16—Sydney Univ.
University of Queensland OptIPortal




    B. Pailthorpe, Univ. Queensland, April ’08
     www.vislab.uq.edu.au/research/optiputer/
OptIPortable - at QuestNet-08 too!




    B. Pailthorpe, QciF at QuestNet, July’08
OptIPortal in Canberra Discovery Center




        Source: Dave Smith, CSIRO ICT Centre
HD Talk to Monash University from Calit2




July 31, 2008
AARNet 10Gbps Access Product is Here!!!

• HD and Other High Bandwidth Applications Combined
  with “Big Research” Pushing Large Data Sets Means
  1 Gbps is No Longer Adequate for All Users
        Vivaty

• Will Permit Rresearchers to Exchange Large Amounts of
  Data within Australia, and Internationally via SXTransPORT




                           © 2008, AARNet Pty Ltd         30
                 Slide From Chris Hancock, CEO AARNet

The OptIPlanet Collaboratory

  • 1.
    The OptIPlanet Collaboratory Invited Presentation Calit2@UCSD September 16, 2008 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD
  • 2.
    Interactive OptIPlanet CollaboratoryPrototype: Using Analog Communications to Prototype the Fiber Optic Future “What we really have to do is eliminate distance between individuals who want to interact with other people and SIGGRAPH 1989 with other computers.” ― Larry Smarr, Director, NCSA Illinois Boston “We’re using satellite technology… to demo what It might be like to have high-speed fiber-optic links between advanced computers in two different geographic locations.” ― Al Gore, Senator Chair, US Senate Subcommittee on Science, Technology and Space
  • 3.
    The OptIPuter Project:High Resolution Collaboratory Over Dedicated Optical Channels to Global Science Data Scalable Adaptive Graphics Environment (SAGE) Now in Sixth and Final Year Picture Source: Mark Ellisman, David Lee, Jason Leigh Calit2 (UCSD, UCI), SDSC, and UIC Leads—Larry Smarr PI Univ. Partners: NCSA, USC, SDSU, NW, TA&M, UvA, SARA, KISTI, AIST Industry: IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent
  • 4.
    CENIC’s New “HybridNetwork” - Traditional Routed IP and the New Switched Ethernet and Optical Services ~ $14M Invested in Upgrade Now Campuses Need to Upgrade Source: Jim Dolgonas, CENIC
  • 5.
    The “Golden Spike”UCSD Experimental Optical Core: Ready to Couple Users to CENIC L1, L2, L3 Services Quartzite Communications To 10GigE cluster Goals by 2008: Core Year 3 node interfaces >= 60 endpoints at 10 GigE CENIC L1, L2 >= 30 Packet switched Wavelength Quartzite Selective Services Corewavelengths ..... Switch >= 30 Switched >= 400 Connected endpoints Lucent To 10GigE cluster node interfaces and other switches To cluster nodes ..... Glimmerglass Approximately 0.5 Tbps ..... To cluster nodes GigE Switch with Dual 10GigE Upliks Arrive at the “Optical” Production OOO Switch To cluster nodes Center of Hybrid Campus 32 10GigE ..... Switch GigE Switch with Dual 10GigE Upliks Force10 ... To Packet Switch CalREN-HPR GigE Switch with Dual 10GigE Upliks other Research nodes Cloud GigE Funded by 10GigE NSF MRI Campus Research 4 GigE 4 pair fiber Grant Cloud Cisco 6509 Juniper T320 OptIPuter Border Router Source: Phil Papadopoulos, SDSC/Calit2 (Quartzite PI, OptIPuter co-PI)
  • 6.
    Calit2 Sunlight Optical ExchangeContains Quartzite 10:45 am Feb. 21, 2008
  • 7.
    Block Layout ofUCSD Quartzite/OptIPuter Network For Full UCSD OptIPuter Map see Elazar Harel Talk Today Glimmerglass OOO Switch ~50 10 Gbps Lightpaths 10 More to Come Quartzite Application Specific Embedded Switches
  • 8.
    Calit2 Microbial MetagenomicsCluster- Next Generation Optically Linked Science Data Server Source: Phil Papadopoulos, SDSC, Calit2 512 Processors ~200TB ~5 Teraflops 1GbE Sun X4500 ~ 200 Terabytes Storage and Storage 10GbE Switche d/ 10GbE Routed Core
  • 9.
    CAMERA’s Global Microbial MetagenomicsCyberCommunity 2200 Registered Users From Over 50 Countries
  • 10.
    Embedded iHDTV inan OptIPortal Enables Collaboration Photo: Maxine Brown, EVL Larry Smarr in Reno Source: Michael Wellings Ginger Armbrust in Seattle Research Channel Univ. Washington
  • 11.
    Genome and MedicalBiosciences Building First 10Gbps OptIPortal End Point at UC Davis Next CAMERA OptIPortal ~70 Faculty ~25+ new ~700 people Six floors 225,000 sq ft $98M Molecular Medicine Genomics & Bioinformatics Pharmacology Biomedical Engineering Jonathan Eisen Enabling Genomics Facility Imaging & Vivarium
  • 12.
    OptIPuter Persistent GlobalBackplane Dana is Rapidly Expanding and Enabling Applications Roode Pete UCI Talk UCI Siegel UCD Talk CineGrid Talk Jason Leigh Richard Weinberg SAGE Alternate Endings VisualCasting USC Talk UIC Demo Elazar Harel UCSD Talk Source:Brian Dunne, Calit2@UCSD
  • 13.
    Calit2 at UCIand UCSD Are Prototyping Gigabit Applications— Today 2 Gbps Paths are Used ONS 15540 WDM at UCI campus MPOE (CPL) 10 GE DWDM Network Line 1 GE DWDM Network Line Tustin CENIC CalREN POP UCSD Optiputer Calit2 Building Wave-2: layer-2 GE. Network Floor 4 Catalyst 6500 67.58.33.0/25 using 11- 126 at UCI. GTWY is .1 Engineering Gateway Building, SPDS Kim Jitter Floor 3 Catalyst 6500 Measurements Lab E1127 Wave-1: layer-2 GE Catalyst 3750 in Los 67.58.21.128/25 UCI using 1st floor IDF Floor 2 Catalyst 6500 Angeles 141-254. GTWY .128 Catalyst 3750 in NACS Machine ESMF HIPerWall UCInet Room (Optiputer) Catalyst 6500, Beckman Laser Institute Bldg. 1st floor MDF Berns’ Lab-- Catalyst 3750 in CSI Remote Microscopy 10 GE Created 09-27-2005 by Garrett Hildebrand Wave 1 1GE Modified 02-28-2006 by Smarr/Hildebrand Wave 2 1GE
  • 14.
    The Calit2 OptIPortalsat UCSD and UCI Are Now a Gbit/s HD Collaboratory NASA Ames Visit Feb. 29, 2008 HiPerVerse: First ½ Gigapixel Distributed OptIPortal- 124 Tiles Yesterday Sept. 15, 2008 Calit2@ UCI wall Calit2@ UCSD wall
  • 15.
    EVL’s SAGE VisualCasting Multi-Site OptIPuter Collaboratory CENIC CalREN-XD Workshop Sept. 15, 2008 EVL-UI Chicago Streaming 4k U Michigan Source: Jason Leigh, Luc Renambot, EVL, UI Chicago
  • 16.
    OptIPortals Are Being Adopted Globally AIST-Japan Osaka U-Japan KISTI-Korea CNIC-China UZurich NCHC-Taiwan SARA- Netherlands Brno-Czech Republic U. Melbourne, EVL@UIC Calit2@UCSD Calit2@UCI Australia
  • 17.
    Green Initiative: Can Optical Fiber Replace Airline Travel for Continuing Collaborations ? Source: Maxine Brown, OptIPuter Project Manager
  • 18.
    New Year’s Challenge:Streaming Underwater Video From Taiwan’s Kenting Reef to Calit2’s OptIPortal My next plan is to stream stable Remote Videos Local Images and quality underwater images to Calit2, hopefully by PRAGMA 14. -- Fang-Pang to LS Jan. 1, 2008 March 6, 2008 Plan Accomplished! March 26, 2008 UCSD: Rajvikram Singh, Sameer Tilak, Jurgen Schulze, Tony Fountain, Peter Arzberger NCHC : Ebbe Strandell, Sun-In Lin, Yao-Tsung Wang, Fang-Pang Lin
  • 19.
    Coupling CENIC/PW toAARNet International Network: The Core of the OptIPlanet Collaboratory
  • 20.
    Launch of the100 Megapixel OzIPortal Over Qvidium Compressed HD on 1 Gbps CENIC/PW/AARNet Fiber January 15, 2008 Covise, Phil Weber, Jurgen Schulze, Calit2 CGLX, Kai-Uwe Doerr , Calit2 www.calit2.net/newsroom/release.php?id=1219
  • 21.
    “Using the Linkto Build the Link” Calit2 and Univ. Melbourne Technology Teams No Calit2 Person Physically Flew to Australia to Bring This Up! www.calit2.net/newsroom/release.php?id=1219
  • 22.
    Victoria Premier andAustralian Deputy Prime Minister Asking Questions www.calit2.net/newsroom/release.php?id=1219
  • 23.
    University of MelbourneVice Chancellor Glyn Davis in Calit2 Replies to Question from Australia
  • 24.
    OptIPuterizing Australian Universitiesin 2008: CENIC Coupling to AARNet UMelbourne/Calit2 Telepresence Session May 21, 2008 Augmented by Many Physical Visits This Year Culminating in Two Week Lecture Tour of Australian Research Universities by Larry Smarr October 2008 Phil Scanlan Founder- Australian American Leadership Dialogue www.aald.org
  • 25.
    Smarr American AustralianLeadership Dialogue OptIPlanet Collaboratory Lecture Tour October 2008 AARNet National Network • Oct 2—University of Adelaide • Oct 6—Univ of Western Australia • Oct 8—Monash Univ.; Swinburne Univ. • Oct 9—Univ. of Melbourne • Oct 10—Univ. of Queensland • Oct 11—AIMS, James Cook Univ., Townsville • Oct 13—Univ. of Technology, Sydney • Oct 14—Univ. of New South Wales • Oct 15—Leadership Dialogue Scholar Oration, Canberra • Oct 16—CSIRO OptIPortal Dedication; ANU; AARNet • Oct 16—Sydney Univ.
  • 26.
    University of QueenslandOptIPortal B. Pailthorpe, Univ. Queensland, April ’08 www.vislab.uq.edu.au/research/optiputer/
  • 27.
    OptIPortable - atQuestNet-08 too! B. Pailthorpe, QciF at QuestNet, July’08
  • 28.
    OptIPortal in CanberraDiscovery Center Source: Dave Smith, CSIRO ICT Centre
  • 29.
    HD Talk toMonash University from Calit2 July 31, 2008
  • 30.
    AARNet 10Gbps AccessProduct is Here!!! • HD and Other High Bandwidth Applications Combined with “Big Research” Pushing Large Data Sets Means 1 Gbps is No Longer Adequate for All Users Vivaty • Will Permit Rresearchers to Exchange Large Amounts of Data within Australia, and Internationally via SXTransPORT © 2008, AARNet Pty Ltd 30 Slide From Chris Hancock, CEO AARNet