“ Genomic Research: The Jump to Light Speed " Invited Talk  Genomes, Medicine, and the Environment Conference 2005  H...
Genomic Data Is Growing Rapidly,  But  Metagenomics Will Vastly Increase The Scale… GenBank Protein Data Bank www.rcsb.org...
Metagenomics Will Couple to Earth Observations  Which Add Several TBs/Day Source: Glenn Iona, EOSDIS Element Evolution  Te...
Challenge: Average Throughput of NASA Data Products  to End User is Only < 50 Megabits/s  Tested from GSFC-ICESAT January ...
Solution: Individual 1 or 10Gbps Lightpaths  -- “Lambdas on Demand” ( WDM) Source: Steve Wallach, Chiaro Networks “ Lambdas”
National Lambda Rail (NLR) and TeraGrid Provides  Cyberinfrastructure Backbone for U.S. Researchers San Francisco Pittsbur...
The Global Lambda Integrated Facility (GLIF)  Creates MetaComputers on the Scale of Planet Earth  Many Countries are Inter...
Two New Calit2 Buildings Will Provide  a Persistent Collaboration “Living Laboratory” <ul><li>Over 1000 Researchers in Two...
<ul><li>September 26-30, 2005 </li></ul><ul><li>Calit2 @ University of California, San Diego </li></ul><ul><li>California ...
First Trans-Pacific Super High Definition  Telepresence Meeting Over 1 Gbps Lambda SHD=  4x HD Sony  NTT  SGI Keio Univers...
Lambdas Enable First Remote Interactive High Definition Video Exploration of Deep Sea Vents Source John Delaney & Deborah ...
A Near Future Metagenomics  Lambda-Enabled Data Generator Source John Delaney, UWash
NSF’s Ocean Observatories Initiative (OOI) Envisions Global, Regional, and Coastal Scales LEO15 Inset Courtesy of Rutgers ...
Adding Web and Grid Services to Lambdas  to Provide Real Time Control of Ocean Observatories <ul><li>Goal:  </li></ul><ul>...
Use SCCOOS As Prototype  for Coastal Zone Data Assimilation Testbed www.sccoos.org Goal: Link SCCOOS Sites with LambdaGrid...
Use OptIPuter to Couple Data Assimilation Models  to Remote Data Sources Including Biology Regional Ocean Modeling System ...
The OptIPuter Project –    Creating a LambdaGrid “Web” for Gigabyte Data Objects <ul><li>NSF Large Information Technology ...
Calit2 Intends to Jump Beyond Traditional Web-Accessible Databases Data  Backend (DB, Files) W E B  PORTAL (pre-filtered, ...
Calit2’s Direct Access Core Architecture  Creates Next Generation Metagenomics Server Traditional User Response Request So...
Vast Data Sets Will Require High Resolution Data Analysis Facilities SDSC SIO Newsday Photo Ira Schwarz Celera  Control Ro...
Realizing the Dream: High Resolution Portals to Global Science Data 650 Mpixel 2-Photon Microscopy  Montage of HeLa Cultur...
Scalable Displays Being Developed  for Multi-Scale Biomedical Imaging Green: Purkinje Cells Red: Glial Cells Light Blue: N...
Scalable Displays Allow Both  Global Content and Fine Detail Source: Mark Ellisman, David Lee, Jason Leigh 30 MPixel SunSc...
Allows for Interactive Zooming  from Cerebellum to Individual Neurons Source: Mark Ellisman, David Lee, Jason Leigh
Metagenomics “Extreme Assembly”  Requires Large Amount of Pixel Real Estate Source: Karin Remington J. Craig Venter Instit...
Metagenomics Requires a Global View of Data  and the Ability to Zoom Into Detail Interactively Overlay of Metagenomics Dat...
OptIPuter Scalable Adaptive Graphics Environment (SAGE) Allows Integration of HD Streams LambdaCam Used to Capture the Til...
Extending Telepresence with  Remote Interactive Analysis of Data Over NLR SIO/UCSD NASA  Goddard www.calit2.net/articles/a...
Upcoming SlideShare
Loading in …5
×

Genomic Research: The Jump to Light Speed

632 views
558 views

Published on

05.10.19
Invited Talk Genomes, Medicine, and the Environment Conference 2005
Title: Genomic Research: The Jump to Light Speed
Hilton Head, SC

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
632
On SlideShare
0
From Embeds
0
Number of Embeds
11
Actions
Shares
0
Downloads
4
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Genomic Research: The Jump to Light Speed

  1. 1. “ Genomic Research: The Jump to Light Speed &quot; Invited Talk Genomes, Medicine, and the Environment Conference 2005 Hilton Head, SC October 19, 2005 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology; Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD
  2. 2. Genomic Data Is Growing Rapidly, But Metagenomics Will Vastly Increase The Scale… GenBank Protein Data Bank www.rcsb.org/pdb/holdings.html www.ncbi.nlm.nih.gov/Genbank 100 Billion Bases! Total Data < 1TB
  3. 3. Metagenomics Will Couple to Earth Observations Which Add Several TBs/Day Source: Glenn Iona, EOSDIS Element Evolution Technical Working Group January 6-7, 2005
  4. 4. Challenge: Average Throughput of NASA Data Products to End User is Only < 50 Megabits/s Tested from GSFC-ICESAT January 2005 http://ensight.eos.nasa.gov/Missions/icesat/index.shtml
  5. 5. Solution: Individual 1 or 10Gbps Lightpaths -- “Lambdas on Demand” ( WDM) Source: Steve Wallach, Chiaro Networks “ Lambdas”
  6. 6. National Lambda Rail (NLR) and TeraGrid Provides Cyberinfrastructure Backbone for U.S. Researchers San Francisco Pittsburgh Cleveland San Diego Los Angeles Portland Seattle Pensacola Baton Rouge Houston San Antonio Las Cruces / El Paso Phoenix New York City Washington, DC Raleigh Jacksonville Dallas Tulsa Atlanta Kansas City Denver Ogden/ Salt Lake City Boise Albuquerque UC-TeraGrid UIC/NW-Starlight Chicago International Collaborators NLR 4 x 10Gb Lambdas Initially Capable of 40 x 10Gb wavelengths at Buildout NSF’s TeraGrid Has 4 x 10Gb Lambda Backbone Links Two Dozen State and Regional Optical Networks DOE, NSF, & NASA Using NLR
  7. 7. The Global Lambda Integrated Facility (GLIF) Creates MetaComputers on the Scale of Planet Earth Many Countries are Interconnecting Optical Research Networks to form a Global SuperNetwork www.glif.is Created in Reykjavik, Iceland 2003 www.glif.is Created in Reykjavik, Iceland 2003
  8. 8. Two New Calit2 Buildings Will Provide a Persistent Collaboration “Living Laboratory” <ul><li>Over 1000 Researchers in Two Buildings </li></ul><ul><ul><li>Linked via Dedicated Optical Networks </li></ul></ul><ul><ul><li>International Conferences and Testbeds </li></ul></ul><ul><li>New Laboratory Facilities </li></ul><ul><ul><li>Virtual Reality, Digital Cinema, HDTV </li></ul></ul><ul><ul><li>Nanotech, BioMEMS, Chips, Radio, Photonics, Grid, Data, Applications </li></ul></ul>Bioengineering UC San Diego UC Irvine Learning to Live on Lambdas
  9. 9. <ul><li>September 26-30, 2005 </li></ul><ul><li>Calit2 @ University of California, San Diego </li></ul><ul><li>California Institute for Telecommunications and Information Technology </li></ul>The Networking Double Header of the Century Is Driven by LambdaGrid Applications i Grid 2 oo 5 T H E G L O B A L L A M B D A I N T E G R A T E D F A C I L I T Y Maxine Brown, Tom DeFanti, Co-Organizers www.startap.net/igrid2005/ http://sc05.supercomp.org
  10. 10. First Trans-Pacific Super High Definition Telepresence Meeting Over 1 Gbps Lambda SHD= 4x HD Sony NTT SGI Keio University President Anzai UCSD Chancellor Fox
  11. 11. Lambdas Enable First Remote Interactive High Definition Video Exploration of Deep Sea Vents Source John Delaney & Deborah Kelley, UWash Canadian-U.S. Collaboration Ginger Armbrust (Talk on Monday) was on VISIONS ’05 Voyage
  12. 12. A Near Future Metagenomics Lambda-Enabled Data Generator Source John Delaney, UWash
  13. 13. NSF’s Ocean Observatories Initiative (OOI) Envisions Global, Regional, and Coastal Scales LEO15 Inset Courtesy of Rutgers University, Institute of Marine and Coastal Sciences
  14. 14. Adding Web and Grid Services to Lambdas to Provide Real Time Control of Ocean Observatories <ul><li>Goal: </li></ul><ul><ul><li>Prototype Cyberinfrastructure for NSF’s Ocean Research Interactive Observatory Networks (ORION) Building on OptIPuter </li></ul></ul><ul><li>LOOKING NSF ITR with PIs: </li></ul><ul><ul><li>John Orcutt & Larry Smarr - UCSD </li></ul></ul><ul><ul><li>John Delaney & Ed Lazowska –UW </li></ul></ul><ul><ul><li>Mark Abbott – OSU </li></ul></ul><ul><li>Collaborators at: </li></ul><ul><ul><li>MBARI, WHOI, NCSA, UIC, CalPoly, UVic, CANARIE, Microsoft, NEPTUNE-Canarie </li></ul></ul>LOOKING: ( L aboratory for the O cean O bservatory K nowledge In tegration G rid) www.neptune.washington.edu http://lookingtosea.ucsd.edu/
  15. 15. Use SCCOOS As Prototype for Coastal Zone Data Assimilation Testbed www.sccoos.org Goal: Link SCCOOS Sites with LambdaGrid to Prototype Future Ocean and Earth Sciences Observing System Yellow—Proposed Initial Lambda Backbone
  16. 16. Use OptIPuter to Couple Data Assimilation Models to Remote Data Sources Including Biology Regional Ocean Modeling System (ROMS) http://ourocean.jpl.nasa.gov/ NASA MODIS Mean Primary Productivity for April 2001 in California Current System
  17. 17. The OptIPuter Project – Creating a LambdaGrid “Web” for Gigabyte Data Objects <ul><li>NSF Large Information Technology Research Proposal </li></ul><ul><ul><li>Calit2 (UCSD, UCI) and UIC Lead Campuses—Larry Smarr PI </li></ul></ul><ul><ul><li>Partnering Campuses: USC, SDSU, NW, TA&M, UvA, SARA, NASA </li></ul></ul><ul><li>Industrial Partners </li></ul><ul><ul><li>IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent </li></ul></ul><ul><li>$13.5 Million Over Five Years </li></ul><ul><li>Linking Global Scale Science Projects to User’s Linux Clusters </li></ul>NIH Biomedical Informatics NSF EarthScope and ORION Research Network
  18. 18. Calit2 Intends to Jump Beyond Traditional Web-Accessible Databases Data Backend (DB, Files) W E B PORTAL (pre-filtered, queries metadata) Response Request + many others Source: Phil Papadopoulos, SDSC, Calit2 BIRN PDB NCBI Genbank
  19. 19. Calit2’s Direct Access Core Architecture Creates Next Generation Metagenomics Server Traditional User Response Request Source: Phil Papadopoulos, SDSC, Calit2 Proposed System Joint with Venter Institute, SIO, and Moore Foundation TeraGrid: Cyberinfrastructure Backplane (scheduled activities, e.g. all by all comparison) (10000s of CPUs) Web (other service) Local Cluster Local Environment Direct Access Lambda Cnxns Campus Grid OptIPuter Campus Cloud Flat File Server Farm W E B PORTAL + Web Services Dedicated Compute Farm (100s of CPUs) Data- Base Farm 10 GigE Fabric
  20. 20. Vast Data Sets Will Require High Resolution Data Analysis Facilities SDSC SIO Newsday Photo Ira Schwarz Celera Control Room Cal-(IT) 2 Control Room Cox Communications Teraburst Networks Panoram Technologies From Smarr Talk 2000
  21. 21. Realizing the Dream: High Resolution Portals to Global Science Data 650 Mpixel 2-Photon Microscopy Montage of HeLa Cultured Cancer Cells Green: Actin Red: Microtubles Light Blue: DNA Source: Mark Ellisman, David Lee, Jason Leigh, Tom Deerinck
  22. 22. Scalable Displays Being Developed for Multi-Scale Biomedical Imaging Green: Purkinje Cells Red: Glial Cells Light Blue: Nuclear DNA Source: Mark Ellisman, David Lee, Jason Leigh Two-Photon Laser Confocal Microscope Montage of 40x36=1440 Images in 3 Channels of a Mid-Sagittal Section of Rat Cerebellum Acquired Over an 8-hour Period 300 MPixel Image!
  23. 23. Scalable Displays Allow Both Global Content and Fine Detail Source: Mark Ellisman, David Lee, Jason Leigh 30 MPixel SunScreen Display Driven by a 20-node Sun Opteron Visualization Cluster
  24. 24. Allows for Interactive Zooming from Cerebellum to Individual Neurons Source: Mark Ellisman, David Lee, Jason Leigh
  25. 25. Metagenomics “Extreme Assembly” Requires Large Amount of Pixel Real Estate Source: Karin Remington J. Craig Venter Institute Prochlorococcus Microbacterium Burkholderia Rhodobacter SAR-86 unknown unknown
  26. 26. Metagenomics Requires a Global View of Data and the Ability to Zoom Into Detail Interactively Overlay of Metagenomics Data onto Sequenced Reference Genomes (This Image: Prochloroccocus marinus MED4) Source: Karin Remington J. Craig Venter Institute
  27. 27. OptIPuter Scalable Adaptive Graphics Environment (SAGE) Allows Integration of HD Streams LambdaCam Used to Capture the Tiled Display on a Web Browser <ul><li>HD Video from BIRN Trailer </li></ul><ul><li>Macro View of Montage Data </li></ul><ul><li>Micro View of Montage Data </li></ul><ul><li>Live Streaming Video of the RTS-2000 Microscope </li></ul><ul><li>HD Video from the RTS Microscope Room </li></ul>Source: David Lee, NCMIR, UCSD SAGE Developed Under Jason Leigh, EVL
  28. 28. Extending Telepresence with Remote Interactive Analysis of Data Over NLR SIO/UCSD NASA Goddard www.calit2.net/articles/article.php?id=660 August 8, 2005 HDTV Over Lambda OptIPuter Visualized Data 25 Miles Venter Institute

×