“ Towards Telepresence " Opening Talk Delegation from the Chief of Naval Operations’ Strategic Studies Group Cyberspace & Maritime Operations in 2030 [email_address] March 13, 2007 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology; Harry E. Gruber Professor,  Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD
Two New Calit2 Buildings Provide  New Laboratories for “Living in the Future” Over 1000 Researchers in Two Buildings Linked via Dedicated Optical Networks International Conferences and Testbeds New Laboratories Nanotechnology Virtual Reality, Digital Cinema UC Irvine www.calit2.net Preparing for a World in Which  Distance is Eliminated… UC San Diego
TV and Movies of 40 Years Ago Envisioned Telepresence Displays Source: Star Trek 1966-68; Barbarella 1968
The Beginnings of Commercialization: PicturePhone Introduced 40 Years Ago www.bellsystemmemorial.com/telephones-picturephone.html
The Bellcore VideoWindow --  A Working Telepresence Experiment “ Imagine sitting in your work place lounge having coffee with some colleagues. Now imagine that you and your colleagues are still in the same room, but are separated by a large sheet of glass that does not interfere with your ability to carry on a clear, two-way conversation. Finally, imagine that you have split the room into two parts and moved one part 50 miles down the road, without impairing the quality of your interaction with your friends.” Source: Fish, Kraut, and Chalfonte-CSCW 1990 Proceedings (1989)
Televisualization: Telepresence Remote Interactive Visual Supercomputing Multi-disciplinary Scientific Visualization A Simulation of Telepresence Using Analog Communications to Prototype the Digital Future “ We’re using satellite technology…to demo what It might be like to have high-speed  fiber-optic links between advanced  computers in two different geographic locations.” ― Al Gore, Senator Chair, US Senate Subcommittee on Science, Technology and Space Illinois Boston SIGGRAPH 1989 ATT &  Sun “ What we really have to do is eliminate distance between individuals who want to interact with other people and with other computers.” ― Larry Smarr, Director, NCSA
First Trans-Pacific Super High Definition Telepresence Meeting in New Calit2 Digital Cinema Auditorium Lays Technical Basis for Global Digital Cinema Sony  NTT  SGI Keio University  President Anzai UCSD  Chancellor Fox
iGrid Lambda  4k Digital Cinema  Streaming Services:  The CineGrid Node at  Keio University, Tokyo Japan SXRD-105  4K Projector Imagica 4K  Film Scanner Sony 4K Projectors Olympus 4K Cameras NTT JPEG2000 Codec
Gigabit/s Wireless is Already a Product! Distance/Topology/Segments  CBD/Dense  Urban Urban Industrial Suburban Residential Suburban Rural 10  Gbps 1 Gbps 100 Mbps 10 Mbps Short <1km Short/Medium 1-2km Medium 2-5 km Medium/Long >5 km Long >10 km 802.11 a/b/g Point to Point Microwave $2B-$3B/Year Fiber – Multi-billion $ Market Demand 802.16 “Wi-Max” $2-$4B in 5 years E-Band mmW radio fills the gap between current broadband access technologies and enables Next Generation networking E-Band Market Opportunity   $1B+ FSO & 60GHz Radio ~$300M
National Lambda Rail (NLR) and TeraGrid Provides  Cyberinfrastructure Backbone for U.S. Researchers NLR 4 x 10Gb Lambdas Initially Capable of 40 x 10Gb wavelengths at Buildout Links Two Dozen State and Regional Optical Networks DOE, NSF, & NASA Using NLR  San Francisco Pittsburgh Cleveland San Diego Los Angeles Portland Seattle Pensacola Baton Rouge Houston San Antonio Las Cruces / El Paso Phoenix New York City Washington, DC Raleigh Jacksonville Dallas Tulsa Atlanta Kansas City Denver Ogden/ Salt Lake City Boise Albuquerque UC-TeraGrid UIC/NW-Starlight Chicago International  Collaborators NSF’s TeraGrid Has 4 x 10Gb  Lambda Backbone
September 26-30, 2005 Calit2 @ University of California, San Diego California Institute for Telecommunications and Information Technology Borderless Collaboration Between Global University Research Centers at 10Gbps T   H   E  G   L   O   B   A   L  L   A   M   B   D   A  I   N   T   E   G   R   A   T   E   D  F   A   C   I   L   I   T   Y   Maxine Brown, Tom DeFanti, Co-Chairs www.igrid2005.org 100Gb of Bandwidth into the Calit2@UCSD Building More than 150Gb GLIF Transoceanic Bandwidth! 450 Attendees, 130 Participating Organizations 20 Countries Driving 49 Demonstrations 1- or 10- Gbps  Per Demo i Grid  2005
OptIPuter / OptIPortal Demonstration of SAGE Applications MagicCarpet Streaming Blue Marble dataset from San Diego to EVL using UDP. 6.7Gbps JuxtaView Locally streaming the aerial photography of downtown Chicago using TCP. 850 Mbps Bitplayer Streaming animation of tornado simulation using UDP. 516 Mbps SVC Locally streaming HD camera live video using UDP. 538Mbps ~ 9 Gbps in Total.  SAGE Can Simultaneously Support These Applications Without Decreasing Their Performance Source:  Xi Wang, UIC/EVL
3D Videophones Are Here!  The Personal Varrier Autostereo Display Varrier is a Head-Tracked Autostereo Virtual Reality Display 30” LCD Widescreen Display with 2560x1600 Native Resolution A Photographic Film Barrier Screen Affixed to a Glass Panel  Cameras Track Face with Neural Net to Locate Eyes The Display Eliminates the Need to Wear Special Glasses Source: Daniel Sandin, Thomas DeFanti, Jinghua Ge, Javier Girado, Robert Kooima, Tom Peterka—EVL, UIC
Partnering with UIC Electronic Visualization Lab  to Create Next Generation OptIPortals Varrier Autostereo Virtual Reality Head-Tracked No Need for Glasses 65 LCD Tiles 45  Mpixels/eye of Visual Stereo PentaCAVE— High Definition Surround VR Working Prototype 4 Mpixel Wall Full Scale PentaCAVE Being Built 6 JVC HD2K Projectors Per Wall 30 Mpixel/eye of Stereo w/5-Walls Dan Sandin, Greg Dawe, Tom Peterka, Tom DeFanti, Jason Leigh, Jinghua Ge, Javier Girado, Bob Kooima, Todd Margolis, Lance Long, Alan Verlo, Maxine Brown, Jurgen Schulze, Qian Liu, Ian Kaufman, Bryan Glogowski  Experience  Both  Today!
Varrier and StarCAVE in Calit2 Immersion Visualization Room Summer 2007
High Resolution Aerial Photography Generates Images With 10,000 Times More Data than Landsat7 Shane DeGross, Telesis USGS Landsat7 Imagery 100 Foot Resolution Draped on elevation data New USGS Aerial Imagery At 1-Foot Resolution ~10x10 square miles of 350 US Cities  2.5 Billion Pixel Images Per City!
Prototyping the PC of 2015 One Hundred Million Pixels Connected at 10Gbps Calit2 Working with NASA, USGS, NOAA, NIEHS, EPA, SDSU, SDSC, Duke, … 100M Pixel Tiled Wall in Calit2@UCSD Building Source: Jason Leigh, EVL, UIC
Multi-Gigapixel Images are Available  from Film Scanners Today The Gigapxl Project http://gigapxl.org Balboa Park, San Diego Multi-GigaPixel Image
Large Image with Enormous Detail Require Interactive LambdaVision Systems One Square Inch Shot From 100 Yards The OptIPuter Project is Pursuing Obtaining some of these Images for LambdaVision 100M Pixel Walls http://gigapxl.org
The New Optical Core of the UCSD Campus-Scale Testbed: Moving to Parallel Lambdas in 2007 Goals by 2007: >= 50 endpoints at 10 GigE >= 32 Packet switched >= 32 Switched wavelengths >= 300 Connected endpoints Approximately 0.5 TBit/s Arrive at the “Optical” Center of Campus Switching will be a Hybrid Combination of:  Packet, Lambda, Circuit -- OOO and Packet Switches Already in Place Funded by NSF MRI Grant Lucent Glimmerglass Force10 Source: Phil Papadopoulos, SDSC, Calit2
The Calit2 Terabit LAN OptIPuter  Supporting Highly Parallel 4k CineGrid 4k Sources Disk Precomputed Images 128 4k Cameras 512 HD Cameras Each Node Drives 4k Stream Uncompressed 4k 6 Gbps Flows Each LCD Displays 4k Source: Larry Smarr, Calit2 16’ 64’ One Billion Pixel Wall 128 (16x8) 4k LCDs 128 WDM Fiber 128 10G NICs 128 10G NICs 128 Node Cluster
A Vision for the Future:  Towards Gigapixel Displays Source:  Jason Leigh, EVL, UIC Augmented  Reality SuperHD  StreamingVideo Gigapixel Wall Paper 1 GigaPixel x 3 Bytes/pixel x 8 bits/byte x 30 frames/sec ~ 1 Terabit/sec!

Towards Telepresence

  • 1.
    “ Towards Telepresence&quot; Opening Talk Delegation from the Chief of Naval Operations’ Strategic Studies Group Cyberspace & Maritime Operations in 2030 [email_address] March 13, 2007 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology; Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD
  • 2.
    Two New Calit2Buildings Provide New Laboratories for “Living in the Future” Over 1000 Researchers in Two Buildings Linked via Dedicated Optical Networks International Conferences and Testbeds New Laboratories Nanotechnology Virtual Reality, Digital Cinema UC Irvine www.calit2.net Preparing for a World in Which Distance is Eliminated… UC San Diego
  • 3.
    TV and Moviesof 40 Years Ago Envisioned Telepresence Displays Source: Star Trek 1966-68; Barbarella 1968
  • 4.
    The Beginnings ofCommercialization: PicturePhone Introduced 40 Years Ago www.bellsystemmemorial.com/telephones-picturephone.html
  • 5.
    The Bellcore VideoWindow-- A Working Telepresence Experiment “ Imagine sitting in your work place lounge having coffee with some colleagues. Now imagine that you and your colleagues are still in the same room, but are separated by a large sheet of glass that does not interfere with your ability to carry on a clear, two-way conversation. Finally, imagine that you have split the room into two parts and moved one part 50 miles down the road, without impairing the quality of your interaction with your friends.” Source: Fish, Kraut, and Chalfonte-CSCW 1990 Proceedings (1989)
  • 6.
    Televisualization: Telepresence RemoteInteractive Visual Supercomputing Multi-disciplinary Scientific Visualization A Simulation of Telepresence Using Analog Communications to Prototype the Digital Future “ We’re using satellite technology…to demo what It might be like to have high-speed fiber-optic links between advanced computers in two different geographic locations.” ― Al Gore, Senator Chair, US Senate Subcommittee on Science, Technology and Space Illinois Boston SIGGRAPH 1989 ATT & Sun “ What we really have to do is eliminate distance between individuals who want to interact with other people and with other computers.” ― Larry Smarr, Director, NCSA
  • 7.
    First Trans-Pacific SuperHigh Definition Telepresence Meeting in New Calit2 Digital Cinema Auditorium Lays Technical Basis for Global Digital Cinema Sony NTT SGI Keio University President Anzai UCSD Chancellor Fox
  • 8.
    iGrid Lambda 4k Digital Cinema Streaming Services: The CineGrid Node at Keio University, Tokyo Japan SXRD-105 4K Projector Imagica 4K Film Scanner Sony 4K Projectors Olympus 4K Cameras NTT JPEG2000 Codec
  • 9.
    Gigabit/s Wireless isAlready a Product! Distance/Topology/Segments CBD/Dense Urban Urban Industrial Suburban Residential Suburban Rural 10 Gbps 1 Gbps 100 Mbps 10 Mbps Short <1km Short/Medium 1-2km Medium 2-5 km Medium/Long >5 km Long >10 km 802.11 a/b/g Point to Point Microwave $2B-$3B/Year Fiber – Multi-billion $ Market Demand 802.16 “Wi-Max” $2-$4B in 5 years E-Band mmW radio fills the gap between current broadband access technologies and enables Next Generation networking E-Band Market Opportunity $1B+ FSO & 60GHz Radio ~$300M
  • 10.
    National Lambda Rail(NLR) and TeraGrid Provides Cyberinfrastructure Backbone for U.S. Researchers NLR 4 x 10Gb Lambdas Initially Capable of 40 x 10Gb wavelengths at Buildout Links Two Dozen State and Regional Optical Networks DOE, NSF, & NASA Using NLR San Francisco Pittsburgh Cleveland San Diego Los Angeles Portland Seattle Pensacola Baton Rouge Houston San Antonio Las Cruces / El Paso Phoenix New York City Washington, DC Raleigh Jacksonville Dallas Tulsa Atlanta Kansas City Denver Ogden/ Salt Lake City Boise Albuquerque UC-TeraGrid UIC/NW-Starlight Chicago International Collaborators NSF’s TeraGrid Has 4 x 10Gb Lambda Backbone
  • 11.
    September 26-30, 2005Calit2 @ University of California, San Diego California Institute for Telecommunications and Information Technology Borderless Collaboration Between Global University Research Centers at 10Gbps T H E G L O B A L L A M B D A I N T E G R A T E D F A C I L I T Y Maxine Brown, Tom DeFanti, Co-Chairs www.igrid2005.org 100Gb of Bandwidth into the Calit2@UCSD Building More than 150Gb GLIF Transoceanic Bandwidth! 450 Attendees, 130 Participating Organizations 20 Countries Driving 49 Demonstrations 1- or 10- Gbps Per Demo i Grid 2005
  • 12.
    OptIPuter / OptIPortalDemonstration of SAGE Applications MagicCarpet Streaming Blue Marble dataset from San Diego to EVL using UDP. 6.7Gbps JuxtaView Locally streaming the aerial photography of downtown Chicago using TCP. 850 Mbps Bitplayer Streaming animation of tornado simulation using UDP. 516 Mbps SVC Locally streaming HD camera live video using UDP. 538Mbps ~ 9 Gbps in Total. SAGE Can Simultaneously Support These Applications Without Decreasing Their Performance Source: Xi Wang, UIC/EVL
  • 13.
    3D Videophones AreHere! The Personal Varrier Autostereo Display Varrier is a Head-Tracked Autostereo Virtual Reality Display 30” LCD Widescreen Display with 2560x1600 Native Resolution A Photographic Film Barrier Screen Affixed to a Glass Panel Cameras Track Face with Neural Net to Locate Eyes The Display Eliminates the Need to Wear Special Glasses Source: Daniel Sandin, Thomas DeFanti, Jinghua Ge, Javier Girado, Robert Kooima, Tom Peterka—EVL, UIC
  • 14.
    Partnering with UICElectronic Visualization Lab to Create Next Generation OptIPortals Varrier Autostereo Virtual Reality Head-Tracked No Need for Glasses 65 LCD Tiles 45 Mpixels/eye of Visual Stereo PentaCAVE— High Definition Surround VR Working Prototype 4 Mpixel Wall Full Scale PentaCAVE Being Built 6 JVC HD2K Projectors Per Wall 30 Mpixel/eye of Stereo w/5-Walls Dan Sandin, Greg Dawe, Tom Peterka, Tom DeFanti, Jason Leigh, Jinghua Ge, Javier Girado, Bob Kooima, Todd Margolis, Lance Long, Alan Verlo, Maxine Brown, Jurgen Schulze, Qian Liu, Ian Kaufman, Bryan Glogowski Experience Both Today!
  • 15.
    Varrier and StarCAVEin Calit2 Immersion Visualization Room Summer 2007
  • 16.
    High Resolution AerialPhotography Generates Images With 10,000 Times More Data than Landsat7 Shane DeGross, Telesis USGS Landsat7 Imagery 100 Foot Resolution Draped on elevation data New USGS Aerial Imagery At 1-Foot Resolution ~10x10 square miles of 350 US Cities 2.5 Billion Pixel Images Per City!
  • 17.
    Prototyping the PCof 2015 One Hundred Million Pixels Connected at 10Gbps Calit2 Working with NASA, USGS, NOAA, NIEHS, EPA, SDSU, SDSC, Duke, … 100M Pixel Tiled Wall in Calit2@UCSD Building Source: Jason Leigh, EVL, UIC
  • 18.
    Multi-Gigapixel Images areAvailable from Film Scanners Today The Gigapxl Project http://gigapxl.org Balboa Park, San Diego Multi-GigaPixel Image
  • 19.
    Large Image withEnormous Detail Require Interactive LambdaVision Systems One Square Inch Shot From 100 Yards The OptIPuter Project is Pursuing Obtaining some of these Images for LambdaVision 100M Pixel Walls http://gigapxl.org
  • 20.
    The New OpticalCore of the UCSD Campus-Scale Testbed: Moving to Parallel Lambdas in 2007 Goals by 2007: >= 50 endpoints at 10 GigE >= 32 Packet switched >= 32 Switched wavelengths >= 300 Connected endpoints Approximately 0.5 TBit/s Arrive at the “Optical” Center of Campus Switching will be a Hybrid Combination of: Packet, Lambda, Circuit -- OOO and Packet Switches Already in Place Funded by NSF MRI Grant Lucent Glimmerglass Force10 Source: Phil Papadopoulos, SDSC, Calit2
  • 21.
    The Calit2 TerabitLAN OptIPuter Supporting Highly Parallel 4k CineGrid 4k Sources Disk Precomputed Images 128 4k Cameras 512 HD Cameras Each Node Drives 4k Stream Uncompressed 4k 6 Gbps Flows Each LCD Displays 4k Source: Larry Smarr, Calit2 16’ 64’ One Billion Pixel Wall 128 (16x8) 4k LCDs 128 WDM Fiber 128 10G NICs 128 10G NICs 128 Node Cluster
  • 22.
    A Vision forthe Future: Towards Gigapixel Displays Source: Jason Leigh, EVL, UIC Augmented Reality SuperHD StreamingVideo Gigapixel Wall Paper 1 GigaPixel x 3 Bytes/pixel x 8 bits/byte x 30 frames/sec ~ 1 Terabit/sec!