"Brave New World" DiamondExchange
February 28 - March 3, 2009
Date: Sunday, March 1, 2009
Presenter: Larry Smarr
Presentation: Making Sense of Information Through Planetary Scale Computing
Coupling Australia’s Researchers to the Global Innovation EconomyLarry Smarr
08.10.14
Seventh Lecture in the
Australian American Leadership Dialogue Scholar Tour
University of New South Wales
Title: Coupling Australia’s Researchers to the Global Innovation Economy
Sydney, Australia
High Performance Cyberinfrastructure Enables Data-Driven Science in the Globa...Larry Smarr
10.10.28
Invited Speaker
Grand Challenges in Data-Intensive Discovery Conference
San Diego Supercomputer Center, UC San Diego
Title: High Performance Cyberinfrastructure Enables Data-Driven Science in the Globally Networked World
La Jolla, CA
How to Terminate the GLIF by Building a Campus Big Data Freeway SystemLarry Smarr
12.10.11
Keynote Lecture
12th Annual Global LambdaGrid Workshop
Title: How to Terminate the GLIF by Building a Campus Big Data Freeway System
Chicago, IL
Coupling Australia’s Researchers to the Global Innovation EconomyLarry Smarr
08.10.14
Seventh Lecture in the
Australian American Leadership Dialogue Scholar Tour
University of New South Wales
Title: Coupling Australia’s Researchers to the Global Innovation Economy
Sydney, Australia
High Performance Cyberinfrastructure Enables Data-Driven Science in the Globa...Larry Smarr
10.10.28
Invited Speaker
Grand Challenges in Data-Intensive Discovery Conference
San Diego Supercomputer Center, UC San Diego
Title: High Performance Cyberinfrastructure Enables Data-Driven Science in the Globally Networked World
La Jolla, CA
How to Terminate the GLIF by Building a Campus Big Data Freeway SystemLarry Smarr
12.10.11
Keynote Lecture
12th Annual Global LambdaGrid Workshop
Title: How to Terminate the GLIF by Building a Campus Big Data Freeway System
Chicago, IL
Lucene in the Cloud: Learn how GCE leveraged the power of search and Big Data...lucenerevolution
Presented by Seshu Simhadri | Global Computer Enterprises. See conference video - http://www.lucidimagination.com/devzone/events/conferences/lucene-revolution-2012
A leader in bringing innovative technologies to the Federal Government, GCE looks to open source tools to drive down cost and provide the foundation for building value-added services for its customers. This talk will discus GCE’s innovative use of Lucene/Solr combined with the GCE Big Data Cloud to open up access to Federal spending data. This data is in wide use across the Federal government, Federal contracting community, media and press, as well as Capitol Hill. GCE has utilized this toolset to deliver the type of capability that users typically only find in web consumer applications. This session will highlight the technical side of the challenge in implementing these tools across a large user community and data set in a Cloud environment.
David Ward's keynote from JavaOne 2011 on how networks are now programmable & intuitive, allowing application developers to access real-time data, geo-loc, and more information from the network through APIs and new protocols.
NVIDIA DEEP LEARNING INFERENCE PLATFORM PERFORMANCE STUDY
| TECHNICAL OVERVIEW
| 1
Introduction
Artificial intelligence (AI), the dream of computer scientists for over half
a century, is no longer science fiction—it is already transforming every
industry. AI is the use of computers to simulate human intelligence. AI
amplifies our cognitive abilities—letting us solve problems where the
complexity is too great, the information is incomplete, or the details are
too subtle and require expert training.
While the machine learning field has been active for decades, deep
learning (DL) has boomed over the last five years. In 2012, Alex
Krizhevsky of the University of Toronto won the ImageNet image
recognition competition using a deep neural network trained on NVIDIA
GPUs—beating all the human expert algorithms that had been honed
for decades. That same year, recognizing that larger networks can learn
more, Stanford’s Andrew Ng and NVIDIA Research teamed up to develop
a method for training networks using large-scale GPU computing
systems. These seminal papers sparked the “big bang” of modern AI,
setting off a string of “superhuman” achievements. In 2015, Google and
Microsoft both beat the best human score in the ImageNet challenge. In
2016, DeepMind’s AlphaGo recorded its historic win over Go champion
Lee Sedol and Microsoft achieved human parity in speech recognition.
GPUs have proven to be incredibly effective at solving some of the most
complex problems in deep learning, and while the NVIDIA deep learning
platform is the standard industry solution for training, its inferencing
capability is not as widely understood. Some of the world’s leading
enterprises from the data center to the edge have built their inferencing
solution on NVIDIA GPUs. Some examples include:
For the full video of this presentation, please visit:
http://www.embedded-vision.com/platinum-members/altera/embedded-vision-training/videos/pages/may-2016-embedded-vision-summit
For more information about embedded vision, please visit:
http://www.embedded-vision.com
Bill Jenkins, Senior Product Specialist for High Level Design Tools at Intel, presents the "Accelerating Deep Learning Using Altera FPGAs" tutorial at the May 2016 Embedded Vision Summit.
While large strides have recently been made in the development of high-performance systems for neural networks based on multi-core technology, significant challenges in power, cost and, performance scaling remain. Field-programmable gate arrays (FPGAs) are a natural choice for implementing neural networks because they can combine computing, logic, and memory resources in a single device. Intel's Programmable Solutions Group has developed a scalable convolutional neural network reference design for deep learning systems using the OpenCL programming language built with our SDK for OpenCL. The design performance is being benchmarked using several popular CNN benchmarks: CIFAR-10, ImageNet and KITTI.
Building the CNN with OpenCL kernels allows true scaling of the design from smaller to larger devices and from one device generation to the next. New designs can be sized using different numbers of kernels at each layer. Performance scaling from one generation to the next also benefits from architectural advancements, such as floating-point engines and frequency scaling. Thus, you achieve greater than linear performance and performance per watt scaling with each new series of devices.
Metacomputer Architecture of the Global LambdaGrid: How Personal Light Paths ...Larry Smarr
08.05.15
Departments of Computer Science / Physics and Astronomy
University of Missouri@Columbia
Title: Metacomputer Architecture of the Global LambdaGrid: How Personal Light Paths are Transforming e-Science
Columbia, MO
Shrinking the Planet: A New Global Research Platform –Dedicated 10Gbps Lightp...Larry Smarr
08.12.09
Presentation
TTI/Vanguard "NextGens Technologies" Conference
Title: Shrinking the Planet: A New Global Research Platform –Dedicated 10Gbps Lightpaths
Phoenix, AZ
Bringing 3D, Ultra-Resolution, and Virtual Reality into the Global LambaGrid ...Larry Smarr
07.11.07
Keynote
ACM Virtual Reality Software and Technology (VRST)
Title: Bringing 3D, Ultra-Resolution, and Virtual Reality into the Global LambaGrid Collaboratory
Newport, CA
How Global-Scale Personal Lightwaves are Transforming Scientific ResearchLarry Smarr
07.10.17
Speaker
University of Virginia Computational Science Speaker Series
University of Virginia Library
Title: How Global-Scale Personal Lightwaves are Transforming Scientific Research
Charlotte, VA
Lucene in the Cloud: Learn how GCE leveraged the power of search and Big Data...lucenerevolution
Presented by Seshu Simhadri | Global Computer Enterprises. See conference video - http://www.lucidimagination.com/devzone/events/conferences/lucene-revolution-2012
A leader in bringing innovative technologies to the Federal Government, GCE looks to open source tools to drive down cost and provide the foundation for building value-added services for its customers. This talk will discus GCE’s innovative use of Lucene/Solr combined with the GCE Big Data Cloud to open up access to Federal spending data. This data is in wide use across the Federal government, Federal contracting community, media and press, as well as Capitol Hill. GCE has utilized this toolset to deliver the type of capability that users typically only find in web consumer applications. This session will highlight the technical side of the challenge in implementing these tools across a large user community and data set in a Cloud environment.
David Ward's keynote from JavaOne 2011 on how networks are now programmable & intuitive, allowing application developers to access real-time data, geo-loc, and more information from the network through APIs and new protocols.
NVIDIA DEEP LEARNING INFERENCE PLATFORM PERFORMANCE STUDY
| TECHNICAL OVERVIEW
| 1
Introduction
Artificial intelligence (AI), the dream of computer scientists for over half
a century, is no longer science fiction—it is already transforming every
industry. AI is the use of computers to simulate human intelligence. AI
amplifies our cognitive abilities—letting us solve problems where the
complexity is too great, the information is incomplete, or the details are
too subtle and require expert training.
While the machine learning field has been active for decades, deep
learning (DL) has boomed over the last five years. In 2012, Alex
Krizhevsky of the University of Toronto won the ImageNet image
recognition competition using a deep neural network trained on NVIDIA
GPUs—beating all the human expert algorithms that had been honed
for decades. That same year, recognizing that larger networks can learn
more, Stanford’s Andrew Ng and NVIDIA Research teamed up to develop
a method for training networks using large-scale GPU computing
systems. These seminal papers sparked the “big bang” of modern AI,
setting off a string of “superhuman” achievements. In 2015, Google and
Microsoft both beat the best human score in the ImageNet challenge. In
2016, DeepMind’s AlphaGo recorded its historic win over Go champion
Lee Sedol and Microsoft achieved human parity in speech recognition.
GPUs have proven to be incredibly effective at solving some of the most
complex problems in deep learning, and while the NVIDIA deep learning
platform is the standard industry solution for training, its inferencing
capability is not as widely understood. Some of the world’s leading
enterprises from the data center to the edge have built their inferencing
solution on NVIDIA GPUs. Some examples include:
For the full video of this presentation, please visit:
http://www.embedded-vision.com/platinum-members/altera/embedded-vision-training/videos/pages/may-2016-embedded-vision-summit
For more information about embedded vision, please visit:
http://www.embedded-vision.com
Bill Jenkins, Senior Product Specialist for High Level Design Tools at Intel, presents the "Accelerating Deep Learning Using Altera FPGAs" tutorial at the May 2016 Embedded Vision Summit.
While large strides have recently been made in the development of high-performance systems for neural networks based on multi-core technology, significant challenges in power, cost and, performance scaling remain. Field-programmable gate arrays (FPGAs) are a natural choice for implementing neural networks because they can combine computing, logic, and memory resources in a single device. Intel's Programmable Solutions Group has developed a scalable convolutional neural network reference design for deep learning systems using the OpenCL programming language built with our SDK for OpenCL. The design performance is being benchmarked using several popular CNN benchmarks: CIFAR-10, ImageNet and KITTI.
Building the CNN with OpenCL kernels allows true scaling of the design from smaller to larger devices and from one device generation to the next. New designs can be sized using different numbers of kernels at each layer. Performance scaling from one generation to the next also benefits from architectural advancements, such as floating-point engines and frequency scaling. Thus, you achieve greater than linear performance and performance per watt scaling with each new series of devices.
Metacomputer Architecture of the Global LambdaGrid: How Personal Light Paths ...Larry Smarr
08.05.15
Departments of Computer Science / Physics and Astronomy
University of Missouri@Columbia
Title: Metacomputer Architecture of the Global LambdaGrid: How Personal Light Paths are Transforming e-Science
Columbia, MO
Shrinking the Planet: A New Global Research Platform –Dedicated 10Gbps Lightp...Larry Smarr
08.12.09
Presentation
TTI/Vanguard "NextGens Technologies" Conference
Title: Shrinking the Planet: A New Global Research Platform –Dedicated 10Gbps Lightpaths
Phoenix, AZ
Bringing 3D, Ultra-Resolution, and Virtual Reality into the Global LambaGrid ...Larry Smarr
07.11.07
Keynote
ACM Virtual Reality Software and Technology (VRST)
Title: Bringing 3D, Ultra-Resolution, and Virtual Reality into the Global LambaGrid Collaboratory
Newport, CA
How Global-Scale Personal Lightwaves are Transforming Scientific ResearchLarry Smarr
07.10.17
Speaker
University of Virginia Computational Science Speaker Series
University of Virginia Library
Title: How Global-Scale Personal Lightwaves are Transforming Scientific Research
Charlotte, VA
A New Global Research Platform – Dedicated 10Gbps LightpathsLarry Smarr
08.11.10
Panel
Symposium on “How Will the U.S. Elections Change US-China Cooperation?”
Tsinghua University
Title: A New Global Research Platform –Dedicated 10Gbps Lightpaths
Beijing, China
Coupling Australia’s Researchers to the Global Innovation EconomyLarry Smarr
08.10.17
Ninth Lecture in the
Australian American Leadership Dialogue Scholar Tour
University of Sydney
Title: Coupling Australia’s Researchers to the Global Innovation Economy
Sydney, Australia
Coupling Australia’s Researchers to the Global Innovation EconomyLarry Smarr
08.10.17
Ninth Lecture in the
Australian American Leadership Dialogue Scholar Tour
University of Sydney
Title: Coupling Australia’s Researchers to the Global Innovation Economy
Sydney, Australia
An End-to-End Campus-Scale High Performance Cyberinfrastructure for Data-Inte...Larry Smarr
12.04.19
The Annual Robert Stewart Distinguished Lecture
Iowa State University
Title: An End-to-End Campus-Scale High Performance Cyberinfrastructure for Data-Intensive Research
Ames, IA
The Missing Link: Dedicated End-to-End 10Gbps Optical Lightpaths for Clusters...Larry Smarr
11.05.24
Invited Keynote Presentation
11th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing
Title: The Missing Link: Dedicated End-to-End 10Gbps Optical Lightpaths for Clusters, Grids, and Clouds
Newport Beach, CA
Using Photonics to Prototype the Research Campus Infrastructure of the Future...Larry Smarr
08.02.21
Presentation
Philip Papadopoulos, Larry Smarr, Joseph Ford, Shaya Fainman, and Brian Dunne
University of California, San Diego
Title: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project
La Jolla, CA
End-to-end Optical Fiber Cyberinfrastructure for Data-Intensive Research: Imp...Larry Smarr
10.10.13
Featured Speaker EDUCAUSE 2010
Anaheim Convention Center
Title: End-to-end Optical Fiber Cyberinfrastructure for Data-Intensive Research: Implications for Your Campus
Anaheim, CA
UC Capabilities Supporting High-Performance Collaboration and Data-Intensive ...Larry Smarr
07.10.22
University of California Council of Research
UC Irvine
Title: UC Capabilities Supporting High-Performance Collaboration and Data-Intensive Sciences
Irvine, CA
Set My Data Free: High-Performance CI for Data-Intensive ResearchLarry Smarr
10.11.03
Keynote Speaker
Cyberinfrastructure Days
University of Michigan
Title: Set My Data Free: High-Performance CI for Data-Intensive Research
Ann Arbor, MI
High Performance Cyberinfrastructure Enabling Data-Driven Science in the Biom...Larry Smarr
11.04.06
Joint Presentation
UCSD School of Medicine Research Council
Larry Smarr, Calit2 & Phil Papadopoulos, SDSC/Calit2
Title: High Performance Cyberinfrastructure Enabling Data-Driven Science in the Biomedical Sciences
From the Shared Internet to Personal Lightwaves: How the OptIPuter is Transfo...Larry Smarr
08.04.03
Invited Talk
Cyberinfrastructure Colloquium
Clemson University
Title: From the Shared Internet to Personal Lightwaves: How the OptIPuter is Transforming Scientific Research
Clemson, SC
Coupling Australia’s Researchers to the Global Innovation EconomyLarry Smarr
08.10.02
First Lecture in the
Australian American Leadership Dialogue Scholar Tour
University of Adelaide
Title: Coupling Australia’s Researchers to the Global Innovation Economy
Adelaide, Australia
New Applications of SuperNetworks and the Implications for Campus NetworksLarry Smarr
07.10.09
Speaker
Fall 2007 Internet2 Member Meeting
Town and Country Resort and Convention Center
Title: New Applications of SuperNetworks and the Implications for Campus Networks
San Diego, CA
Similar to Larry Smarr - Making Sense of Information Through Planetary Scale Computing (20)
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
Larry Smarr - Making Sense of Information Through Planetary Scale Computing
1. Making Sense of Information Through
Planetary Scale Computing
Invited Presentation to the
DiamondExchange—Brave New World
Pebble Beach, CA
March 1, 2009
Dr. Larry Smarr
Director, California Institute for Telecommunications and
Information Technology
Harry E. Gruber Professor,
Dept. of Computer Science and Engineering
Jacobs School of Engineering, UCSD
2. Data Mining a Decade Ago -
NCSA Industrial Partner Projects
• Caterpillar • Sears
– – Transaction Management
Effluent Quality Control
– • Boeing
Smart Selling
– – Post-Flight Diagnostics
Warranty Claims Analysis
– Customer Value Analysis • Allstate
• Ford – Medical Claims
– Product Compatibility
– Harshness, Noise, Vibration
– Marketing
• Financial Impact May Be Greater Than $30 Million
Slide from NCSA 1998
3. JP Morgan Hero Risk Management Calculation
Using NCSA Supercomputer
• Extended JPM's Risk Management Capabilities After
Southeast Asia Meltdown
– Two Week Period in January 1998
– NCSA and SGI Doubled Memory in a Week
– Hundreds of Market Scenarios Simulated
• HPC Strategic Business Analysis
– Calculations Used 128-Processor SGI Origin
• NCSA, Strategic Vendor (SGI), Industrial Partner (JPM)
– Existing Relationships Facilitated Quick Startup
– Win-Win-Win Result
Slide from NCSA 1998
Andrew Abrahams, Jeff Saltz, JP Morgan
4. NCSA 1998
NCSA / Allstate
NT Cluster Data Refinery
1000 Gigabytes of Allstate Claims Data
Parallel
Visualization
Compute
Stations
Cluster
Terabyte
―Smart Bucket‖
Compaq Compaq
NT NT
Server Server
External
Networks
Data Mine on Cleaned Gigabyte Samples
Source: Allstate & Tilt Thompkins, NCSA
5. Academic Research ―OptIPlatform‖ Cyberinfrastructure:
A 10,000 Mbps (10Gbps) Lightpath Cloud
HD/4k Video Cams
HD/4k Telepresence
Instruments
HPC
End User
OptIPortal
10G
Lightpath
National LambdaRail
Campus
Optical
Switch
Data Repositories & Clusters HD/4k Video Images
6. Two New Calit2 Buildings Provide
Laboratories for ―Living in the Future‖
• ―Convergence‖ Laboratory Facilities
– Nanotech, BioMEMS, Chips, Radio, Photonics
– Virtual Reality, Digital Cinema, HDTV, Gaming
• Over 1000 Researchers in Two Buildings
– Linked via Dedicated Optical Networks
UC San Diego
www.calit2.net
Over 400 Federal Grants, 200 Companies
7. The Calit2 OptIPortals at UCSD and UCI
Are Now a 2 Gbit/s HD Collaboratory
NASA Ames Visit Feb. 29, 2008
Calit2@ UCI wall
Calit2@ UCSD wall
UCSD cluster: 15 x Quad core Dell XPS with Dual nVIDIA 5600s
UCI cluster: 25 x Dual Core Apple G5
9. The Shared Internet is Fine for Email and Web -
But It is Not Adequate for Data-Intensive Research
12 Minutes
10000
100-1000x
Stanford Server Limit
Normal
Computers In: 1000
UCSD Internet!
Time to Move
Australia a Terabyte
100
Canada
Outbound (Mbps)
Czech Rep.
Data Intensive
India 10 Days Sciences
10
Japan
Require
Korea
―Broadband Fast
Mexico 1
Internet‖ Predictable
Moorea
Netherlands Bandwidth
Poland 0.1
Taiwan
United States
0.01
0.01 0.1 1 10 100 1000 10000
Source: Larry Smarr and Friends
Inbound (Mbps)
Measured Bandwidth from User Computer
to Stanford Gigabit Server in Megabits/sec
http://netspeed.stanford.edu/
10. Dedicated Optical Fiber Channels Makes
High Performance Cyberinfrastructure Possible
(WDM)
c* f
WDM Enables 10Gbps Shared Internet on One Lambda
and a Personal 10Gbps Lambda on the Same Fiber!
11. Dedicated 10Gbps Lightpaths Tie Together
State and Regional Fiber Infrastructure
Interconnects
Two Dozen
State and Regional
Internet2 Dynamic Optical Networks
Circuit Network
Is Now Available
NLR 40 x 10Gb Wavelengths
Expanding with Darkstrand to 80
12. The OptIPuter Creates an OptIPlanet Collaboratory:
Enabling Data-Intensive e-Research
www.evl.uic.edu/cavern/sage
“OptIPlanet: The OptIPuter
Global Collaboratory” –
Special Section of
Future Generations
Computer Systems,
Volume 25, Issue 2,
February 2009
Calit2 (UCSD, UCI), SDSC, and UIC Leads—Larry Smarr PI
Univ. Partners: NCSA, USC, SDSU, NW, TA&M, UvA, SARA, KISTI, AIST
Industry: IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent
14. The Rapid Growth in Scalable Visualization
1997
1999 1999 2004
NCSA 4 MPixel ORNL 35Mpixel EVEREST
LLNL 20 Mpixel Wall
NSF Alliance PowerWall
2008
2005
2004
EVL 100 Mpixel LambdaVision Calit2@UCI 200 Mpixel HiPerWall
TACC 307 Mpixel Stallion
NSF MRI NSF MRI
NSF TeraGrid
A Decade of NSF Investment
Two Orders of Magnitude Growth!
15. My OptIPortalTM – Affordable
Termination Device for the OptIPuter Global Backplane
• 20 Dual CPU Nodes, 20 24‖ Monitors, ~$50,000
• 1/4 Teraflop, 5 Terabyte Storage, 45 Mega Pixels--Nice PC!
• Scalable Adaptive Graphics Environment ( SAGE) Jason Leigh, EVL-UIC
Source: Phil Papadopoulos SDSC, Calit2
16. Visual Analytics--Use of Tiled Display Wall OptIPortal
to Interactively View Microbial Genome (5 Million Bases)
Acidobacteria bacterium Ellin345 Soil
Bacterium 5.6 Mb; ~5000 Genes
Source: Raj Singh, UCSD
17. Use of Tiled Display Wall OptIPortal
to Interactively View Microbial Genome
Source: Raj Singh, UCSD
18. Use of Tiled Display Wall OptIPortal
to Interactively View Microbial Genome
Source: Raj Singh, UCSD
19. OptIPortals Scale to 1/3 Billion Pixels Enabling Viewing
of Very Large Images or Many Simultaneous Images
Spitzer Space Telescope (Infrared)
NASA Earth
Satellite Images
Bushfires
October 2007
San Diego
Source: Falko Kuester, Calit2@UCSD
20. Calit2/EVL Varrier --
60 Screen Panorama OptIPortal
Photo:
360 Degree Mars Landscape x 23,000 pixels
Mars Rendered at 46,000
Amy Bennion
Rover Spirit at McMurdo 2006
Dan Sandin, Greg Dawe, Tom Peterka, Tom DeFanti, Jason Leigh, Jinghua Ge, Javier
Girado, Bob Kooima, Todd Margolis, Lance Long, Alan Verlo, Maxine Brown,
Jurgen Schulze, Qianby 4096 pixels
16384 Liu, Ian Kaufman, Bryan Glogowski
21. Calit2 3D Immersive StarCAVE OptIPortal:
Enables Exploration of High Resolution Simulations
15 Meyer Sound
Connected at 50 Gb/s to Quartzite
Speakers +
Subwoofer
30 HD
Projectors!
Passive Polarization--
Optimized the
Polarization Separation
and Minimized Attenuation Source: Tom DeFanti, Greg Dawe, Calit2
Cluster with 30 Nvidia 5600 cards-60 GB Texture Memory
22. Calit2 VirtuLab-
Our Visual Skunkworks
4k VTC 4k on OptIPortal
3D TV
Autostereo
Source: Tom DeFanti, Calit2
24. Pattern Recognition Out of Massive Amounts
of Cultural Data
Software Studies
Initiative, Calti2@UCSD
Interface Designs for
Cultural Analytics
Research Environment
Jeremy Douglass (top)
& Lev Manovich
(bottom)
Calit2@UCI
200 Mpixel
Second Annual
HIPerWall
Meeting of the
Humanities, Arts,
Science, and
Technology
Advanced
Collaboratory
(HASTAC II)
UC Irvine May 23, 2008
25. Interactive Analysis of Time Evolving Cubes of Data:
Cosmological Supercomputer Simulations
Mike Norman, SDSC
October 10, 2008
Two 64K
Images
log of gas temperature log of gas density
From a
Cosmological
Simulation
of Galaxy
Cluster
Formation
26. The New Science of Metagenomics
―The emerging field
NRC Report:
of metagenomics,
where the DNA of entire
Metagenomi
communities of microbes
c data
is studied simultaneously,
should be
presents the greatest
made
opportunity -- perhaps since
publicly
the invention of the
available in
microscope –
international
to revolutionize
archives as
understanding of the
rapidly as
microbial world.‖ –
possible.
National Research Council
March 27, 2007
27. Calit2 Microbial Metagenomics Cluster-
Next Generation Optically Linked Science Data Server
Source: Phil Papadopoulos, SDSC, Calit2
512 Processors ~200TB
~5 Teraflops Sun
X4500
1GbE
~ 200 Terabytes Storage Storage
and
10GbE
Switched 10GbE
/ Routed
Core
29. OptIPuter Persistent Infrastructure Enables
Calit2 and U Washington CAMERA Collaboratory
Photo Credit: Alan Decker Feb. 29, 2008
Ginger
Armbrust’s
Diatoms:
Micrographs,
Chromosomes,
Genetic
Assembly
iHDTV: 1500 Mbits/sec Calit2 to
UW Research Channel Over NLR
30. Telepresence Meeting
Using Digital Cinema 4k Streams
4k = 4000x2000 Pixels = 4xHD Streaming 4k
with JPEG
100 Times
2000
the Resolution
Compression
of YouTube!
½ Gbit/sec
Lays
Technical
Basis for
Global
Digital
Keio University
President Anzai Cinema
Sony
UCSD NTT
Chancellor Fox SGI
Calit2@UCSD Auditorium
31. Rendering Supercomputer Data
at Digital Cinema Resolution
Source: Donna Cox, Robert Patterson, Bob Wilhelmson, NCSA
32. Cisco CWave for CineGrid: A New Cyberinfrastructure
for High Resolution Media Streaming*
Source: John (JJ) Jamison, Cisco
PacificWave
1000 Denny Way
(Westin Bldg.)
Seattle
StarLight
Northwestern Univ
Level3 Chicago
McLean
1360 Kifer Rd.
2007
Sunnyvale
Equinix
818 W. 7th St.
Cisco Has Built 10 GigE Waves on CENIC, PW,
CENIC Wave
Los Angeles
& NLR and Installed Large 6506 Switches for
Access Points in San Diego, Los Angeles,
Calit2
San Diego Sunnyvale, Seattle, Chicago and McLean
for CineGrid Members
CWave core PoP
Some of These Points are also GLIF GOLEs
10GE waves on NLR and CENIC (LA to SD)
* May 2007
33. Open Cloud OptIPuter Testbed--Manage and Compute
Large Datasets Over 10Gbps Lambdas
CENIC Dragon
NLR C-Wave
Open Source SW
HW Phase 1 (2008) Hadoop
• 4 racks Sector/Sphere
MREN
– 120 Nodes
Thrift, GPB
– 480 Cores
Eucalyptus
• 10+ Gb/s WAN
Benchmarks
Phase 2 (2009) will add additional racks
to current sites and increase number of sites
33
Source: Robert Grossman, UIC
34. Terasort on Open Cloud Testbed
Sorting 10 Billion Records (1.2 TB) at 4 Sites (120 Nodes)
Sustaining >5 Gbps--Only 5% Distance Penalty
37. Just in Time OptIPlanet Collaboratory:
Live Session with NASA Ames from Calit2
Feb 19, 2009 From Start to
This Image in
Less Than 2 Weeks!
View from NASA Ames
Lunar Science Institute
Mountain View, CA
Virtual Handshake
HD compressed 6:1
Visit Yesterday by
JPL’s Firouz Naderi
Source: Falko Kuester, Calit2; Michael Sims, NASA
38. Remote Control of Scientific Instruments:
Live Session with JPL and Mars Rover from Calit2
September 17, 2008
Source: Falko Kuester, Calit2; Michael Sims, NASA
39. EVL’s SAGE OptIPortal VisualCasting
Multi-Site OptIPuter Collaboratory
CENIC CalREN-XD Workshop Sept. 15, 2008
Total Aggregate VisualCasting Bandwidth for Nov. 18, 2008
EVL-UI Chicago Sustained 10,000-20,000 Mbps!
At Supercomputing 2008 Austin, Texas
November, 2008 Streaming 4k
SC08 Bandwidth Challenge Entry
Remote:
On site:
U of Michigan
SARA (Amsterdam) UIC/EVL
U Michigan
GIST / KISTI (Korea) U of Queensland
Osaka Univ. (Japan) Russian Academy of Science
Masaryk Univ. (CZ)
Requires 10 Gbps Lightpath to Each Site
Source: Jason Leigh, Luc Renambot, EVL, UI Chicago
40. U Michigan Virtual Space Interaction Testbed (VISIT)
Instrumenting OptIPortals for Social Science Research
• Using Cameras Embedded in
the Seams of Tiled Displays
and Computer Vision
Techniques, we can
Understand how People
Interact with OptIPortals
– Classify Attention, Expression,
Gaze
– Initial Implementation Based on
Attention Interaction Design
Toolkit (J. Lee, MIT)
• Close to Producing Usable
Eye/Nose Tracking Data using
OpenCV
Leading U.S.
Researchers on the
Social Aspects of
Collaboration
Source: Erik Hofer, UMich, School of Information
42. The Planet is Already Committed
to a Dangerous Level of Warming
90% of the Additional
Temperature Threshold Range
1.6 Degree Warming
that Initiates the Climate-Tipping
Will Occur in the 21st
Century
Additional Warming
over 1750 Level
V. Ramanathan and Y. Feng, Scripps Institution of Oceanography, UCSD
September 23, 2008
www.pnas.orgcgidoi10.1073pnas.0803838105
43. The IPCC Recommends
a 25-40% Reduction Below 1990 Levels by 2020
• On September 27, 2006, Governor Schwarzenegger signed
California the Global Warming Solutions Act of 2006
– Assembly Bill 32 (AB32)
– Requires Reduction of GHG by 2020 to 1990 Levels
– 15% Reduction from 2008 Levels
– 4 Tons of CO2-equiv. for Every Person in California
• The European Union Requires Reduction of GHG by 2020 to
20% Below 1990 Levels (12/12/2008)
• Australia has Pledged to Cut by 2020 its GHG Emissions 5%
from 2000 Levels via the World's Broadest Cap &Trade Scheme
(12/15/08) [~5% Below 1990 Levels]
• Neither the U.S. or Canada has an Official Target Yet
– President Elect Obama Has Endorsed the AB32 2020 Goal
44. ICT is a Critical Element in Achieving Countries
Greenhouse Gas Emission Reduction Targets
Applications of ICT
could enable emissions reductions
of 7.8 Gt CO2e in 2020,
or 15% of business as usual emissions.
But it must keep its own growing footprint in check
and overcome a number of hurdles
if it expects to deliver on this potential.
www.smart2020.org
45. The Global ICT Carbon Footprint
Roughly the Same as the Aviation Industry Today
www.smart2020.org
47. Electricity Usage by U.S. Data Centers:
Emission Reductions are Underway
Source: Silicon Valley Leadership Group Report July 29, 2008
https://microsite.accenture.com/svlgreport/Documents/pdf/SVLG_Report.pdf
48. The UCSD GreenLight Project:
Instrumenting the Energy Cost of Computational Science
• Focus on 5 Communities with At-Scale Computing Needs:
– Metagenomics
– Ocean Observing
– Microscopy
– Bioinformatics
– Digital Media
• Measure, Monitor, & Web Publish
Real-Time Sensor Outputs
– Instrument Eight Racks of Compute, Storage, Routers
– Outputs Available Via Service-oriented Architectures
– Allow Researchers Anywhere To Study Computing Energy Cost
• Develop Middleware that Automates Optimal Choice
of Compute/RAM Power Strategies for Desired Greenness
• Partnering With Minority-Serving Institutions
Cyberinfrastructure Empowerment Coalition
Source: Tom DeFanti, Calit2; GreenLight PI
49. Application of ICT Can Lead to a 5-Fold Greater
Decrease in GHGs Than its Own Carbon Footprint
While the sector plans to significantly step up
the energy efficiency of its products and services,
ICT’s largest influence will be by enabling
energy efficiencies in other sectors, an opportunity
that could deliver carbon savings five times larger than
the total emissions from the entire ICT sector in 2020.
--Smart 2020 Report
Major Opportunities for the United States*
– Smart Electrical Grids
– Smart Transportation Systems
– Smart Buildings
– Virtual Meetings
* Smart 2020 United States Report Addendum
www.smart2020.org
51. UCSD is Installing Zero Carbon Emission
Solar and Fuel Cell DC Electricity Generators
San Diego’s Point Loma Wastewater UCSD 2.8 Megawatt Available Late 2009
Treatment Plant Produces Waste Methane Fuel Cell Power Plant
Uses Methane
2 Megawatts of
Solar Power Cells
Being Installed
52. Launch of ZEVnet Fleet of Wireless Cars--
First Calit2 Testbed for Intelligent Transportation
April 18, 2002
Irvine, CA
www.zevnet.org
53. Reducing Traffic Congestion:
Calit2 California Peer-to -Peer Wireless Traffic Report
• Citizen to Citizen Accident Reports
20,000+ Users
• Real-Time Freeway Speeds
> 1000 Calls Per Day
• ―Leave Now‖ Paging Services
San Diego LA & OC Bay Area
(866) 500 0977 (888) 9 CALIT2 (888) 4 CALIT2
http://traffic.calit2.net
Source: Ganz Chockalingam, Calit2
54. Using High Definition to Link the Calit2 Buildings:
Living Greener
LifeSize System
June 2, 2008
55. UCSD is Becoming
a ―Living Laboratory of the Green Future
www.gogreentube.com/watch.php?v=NDc4OTQ1
58. California Energy Savings from
Annual Energy Savings from Efficiency Programs and Standards
Efficiency Programs and Standards
45,000
~15% of Annual Electricity Use in California in 2003
40,000
35,000
30,000
25,000 Utility Efficiency
GWh/year
Programs at a cost of
~1% of electric bill
20,000
15,000
Building Standards
10,000
5,000 Appliance Standards
0
1975
1976
1977
1978
1979
1980
1981
1982
1983
1984
1985
1986
1987
1988
1989
1990
1991
1992
1993
1994
1995
1996
1997
1998
1999
2000
2001
2002
2003