Future of Skills

Alison B. Lowndes
Alison B. LowndesAI DevRel | EMEA at NVIDIA
What AI brings to the table.
ALISON B. LOWNDES | SENIOR SCIENTIST | GLOBAL AI
Future of Skills
3
JOHAN ROCKSTRÖM,
MATTHIAS KLUM
STOCKHOLM
Climate Tipping Forecasting
https://arxiv.org/pdf/2308.08794.pdf
https://arxiv.org/abs/2307.15034
GINO
3D Geometry-informed neural operators
https://arxiv.org/pdf/2309.00583.pdf
Future of Skills
With NVIDIA DRIVE Sim features such as road
elevation, road markings, islands, traffic
signals, signs, and vertical posts are replicated
at centimeter-level accuracy. Autonomous
vehicles can drive millions of miles in a wide
range of simulated scenarios so they hit the
road running, safely.
NVIDIA DRIVE Sim™ Turbocharges
Developer Productivity to Get Self-
Driving Cars on the Road
Future of Skills
Scene reconstruction: Appearance
● Realism, viewpoint manipulation
NeRF
Mildenhall et al., 2020; Müller et al., 2022
https://developer.nvidia.com/blog/recreate-high-fidelity-digital-twins-with-neural-kernel-surface-reconstruction/
11
Character animation
12
More than 4000 Software Packages in the AI Development Stack
NVIDIA AI Enterprise provides enterprise-grade security and acceleration
DATA PROC
(RAPIDS)
TRAIN
(PyTorch)
OPTIMIZE
(TensorRT)
DEPLOY
(Triton)
NVIDIA CUDA
NVIDIA AI Enterprise
NVIDIA Dependency
3rd party & opensource
CVE Patching
14
NGC CONTAINERS ENABLE YOU TO FOCUS ON BUILDING
AI
PERFORMANCE
OPTIMIZED
DEPLOY
ANYWHERE
ENTERPRISE READY SOFTWARE
Scanned for CVEs, malware,
crypto
Tested for reliability
Backed by Enterprise support
Scalable
Updated monthly
Better performance on the same
system
Docker | cri-o | containerd | Singularity
Bare metal, VMs, Kubernetes
Multi-cloud, on-prem, hybrid, edge
https://catalog.ngc.nvidia.com/resources
80 Billion Transistors
4.9 TB/s Bandwidth
NVIDIA H100 TSMC 4N Process
Grace CPU
Future of Skills
INDUSTRIAL DIGITALIZATION
GENERATIVE AI
SUSTAINABILITY
Future of Skills
Far-Edge | Edge | Cloud
Synthetic Data
Omniverse Replicator
CNNs | Transformers
Pre-Trained Models
TAO
Edge | Workstation | Cloud
TAO
TRAIN DEPLOY
DATA
Build Models for any Platform with NVIDIA TAO
Fast-Track Data Generation, AI Model Creation and Deployment
Low-Code AI Model Pruning & Quantization Standard ONNX Output
Train and optimize using simple
web APIs and CLIs
Turnkey inference optimization to
reduce compute and memory
Compatible with other AI tools for
optimization & deployment
ONNX
Any Inference Platform
GPU CPU MCU DLA
Real Data
Data
Bring your own Model
21
SAILDRONE
Startup Charts Autonomous Oceanic Monitoring | NVIDIA Blog
CONVERGED ACCELERATORS
JETSON AGX XAVIER (industrial)
developer.nvidia.com/converged-accelerator-devkit
www.nvidia.com/en-gb/edge-computing/products/igx/
Orbital Sidekick’s GHOSt2
fleet now in orbit
Applications of NVIDIA Technology for
Climate Change Mitigation & Adaptation
Global Climate Strategies
Energy Industry Innovation
Climate Science Research NVIDIA Inception Partners
FourCastNet
Earth Digital Twin in Omniverse
U-FNO
Carbon Capture & Storage
Simulations
Powering the Energy
Transition
Utilidata
Accelerating Adoption
of Renewables
Zenotech
Improving Operational
Efficiency
Siemens Energy
Modeling New Energy
Sources
SGTC
NVIDIA AI Nations
Helping Governments Implement AI
UNOSAT Partnership
Accelerating Climate Disaster
Management
Detecting Leaks in
Water Infrastructure
ASTERRA
Protecting Wildlife
from Poaching
Rhions Lab
TrueOcean
Predicting Undersea
Carbon Capture &
Storage
Blue Sky Analytics
Harnessing Satellite
Data to Access Climate
Risk
10,000+ Startups
110 Countries
https://www.nvidia.com/en-us/high-performance-computing/earth-2/demo/
Future of Skills
torch-harmonics
A library for differentiable Spherical Harmonics Transforms (SHT)
• Open-Source library under MIT license:
https://github.com/NVIDIA/torch-harmonics
• Efficient calls for forward and inverse (vector)
spherical harmonic transformations
• Autograd support as differential layers in
PyTorch
• Distributed computation across many GPUs
• Easy to integrate into existing PyTorch code,
contains many examples, among them SFNO
OPTION 2
WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE
VIRTUAL WORLD
Rendering
OPTION 2
WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE
VIRTUAL WORLD
Physics
Rendering
WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE
VIRTUAL WORLD
Rendering
Physic
s
AI
SUPERCOMPUTING BRINGS WORLD SIMULATION TO AN INFLECTION POINT
VIRTUAL WORLD
Rendering
Physic
s
AI
Sensors
Controllers
Humans
PHYSICAL WORLD
Real-Time Data
Synchronization
Control Signal
DIGITAL TWINS ARE A NEW CLASS OF WORLD SIMULATION
VIRTUAL WORLD
Rendering
Physic
s
AI
OMNIVERSE LAUNCHER → LEARN
37
EXPLORE OMNIVERSE ENTERPRISE
SEE YOU IN OMNIVERSE
DOWNLOAD OMNIVERSE
nvidia.com/omniverse
DEVELOP ON OMNIVERSE
DOCUMENTATION
docs.omniverse.nvidia.com
FORUMS
omniverse.nvidia.com/forums
TUTORIALS AND
WEBINARS
omniverse.nvidia.com/tutorials
DISCORD
discord.gg/nvidiaomniverse
38
Industrial Metaverse Opportunities Exist at Every Scale
Every physical process will be software-defined
Product
Factory
City
Nation
Planetary
Galaxy
CHAT TO CARTER
https://docs.nvidia.com/isaac/archive/2020.2/doc/tutorials/carter_hardware.html
START YOUR DEVELOPMENT WITH JETSON ORIN TODAY
Two Devkits. Seven Options.
The Jetson AGX Orin Developer Kit is available with 64GB of memory. It can emulate the performance of the AGX Orin series, the Orin NX series, and the Orin Nano series.
NVIDIA recommends to use developer kts for only development purposes. For production, customers should leverage our production modules, have been tested for production environments.
JETSON AGX ORIN DEVELOPER KIT
5W - 60W
275 TOPS (INT8)
110mm x 110mm x 71.65mm
$1999
JETSON ORIN NANO DEVELOPER KIT
7W-15W
40 TOPS (INT8)
100mmX79mmX21mm
$499
World Record
Accuracy
2.96% Gap on
Gehring and
Homberger
Scalable to
1,000s
of Locations
3 Seconds
vs
5 Minutes
to Route 1,000
Packages
NVIDIA cuOPT
Re-Optimize Logistics and Supply Chain in Real-Time
Accelerated Solver for Vehicle Route, Warehouse
Picking, Fleet-Mix Optimization
Massively Parallel Algorithm Generates
Thousands of Solution Candidates and
Refinements
Dynamic Rerouting Reduces Travel Time – Save
Billions for a $10 Trillion Logistics Industry
Available Now
developer.nvidia.com/cuopt-logistics-
optimization
43
NVIDIA DEVELOPER PROGRAM
TOOLS
JOIN THE COMMUNITY THAT’S CHANGING THE WORLD
• Get exclusive access to an extensive library of NVIDIA software, spanning all of NVIDIA’s technology platforms.
• Save time with ready-to-run, GPU-optimized software, model scripts, and containerized apps from the NVIDIA NGC™ catalog.
• Participate in early access programs where you can be one of the first to experience the latest NVIDIA technology.
TRAINING
• Take advantage of research papers, technical documentation, developer blogs, and industry-specific resources.
• Choose from an extensive catalog of training options through the NVIDIA Deep Learning Institute (DLI).
• Get unlimited access to NVIDIA On-Demand, the home for NVIDIA resources from GTCs and other leading industry events.
COMMUNITY
• Network with like-minded developers, engage with GPU experts, and contribute to discussions in the developer forums.
• Attend exclusive meetups, GPU hackathons, and events.
• Connect with NVIDIA experts through developer-focused webinars and Instructor-led workshops.
Join the free program today developer.nvidia.com/join
HELPING YOU SOLVE YOUR
MOST CHALLENGING PROBLEMS
• Build and deploy end-to-end projects across a range
of technologies and domains.
• Gain hands-on experience with the most widely used,
industry-standard software, tools, and frameworks.
• Join live, instructor-led workshops and learn from DLI-certified
instructors who are experts in their fields.
• Take self-paced, online courses anytime, anywhere.
• Earn NVIDIA DLI certificates to demonstrate subject matter
competency and support career growth.
Hands-On Training in AI, Accelerated Computing,
Accelerated Data Science, Graphics and Simulation,
and More
Learn more: www.nvidia.com/dli
Deep Learning
Fundamentals
AI for Anomaly
Detection
AI for Industrial
Inspection
Conversational AI
AI for
Intelligent Video
Analytics
Accelerated Computing
Fundamentals
Recommender Systems
AI for
Predictive
Maintenance
Accelerated Data Science
Fundamentals
Graphics and
Simulation
Networking
AI in the Data
Center
NVIDIA H100 GPU
Fully Connected with
NVLink Switches
One Giant GPU
NVIDIA DGX H100
Future of Skills
NVIDIA Quantum-2
InfiniBand Networking
Scaling to Hundreds and
Thousands of DGX Nodes
DGX H100
AI Supercomputer
Future of Skills
1 of 50

More Related Content

Similar to Future of Skills(20)

More from Alison B. Lowndes(20)

MAXSS & NVIDIAMAXSS & NVIDIA
MAXSS & NVIDIA
Alison B. Lowndes14 views
Omniverse for the MetaverseOmniverse for the Metaverse
Omniverse for the Metaverse
Alison B. Lowndes188 views
Decision-ready climate dataDecision-ready climate data
Decision-ready climate data
Alison B. Lowndes95 views
GTC 2022 KeynoteGTC 2022 Keynote
GTC 2022 Keynote
Alison B. Lowndes642 views
Talk on commercialising space data Talk on commercialising space data
Talk on commercialising space data
Alison B. Lowndes330 views
NVIDIA Keynote #GTC21 NVIDIA Keynote #GTC21
NVIDIA Keynote #GTC21
Alison B. Lowndes598 views
Tales of AI agents saving the human race!Tales of AI agents saving the human race!
Tales of AI agents saving the human race!
Alison B. Lowndes209 views
Harnessing the virtual realmHarnessing the virtual realm
Harnessing the virtual realm
Alison B. Lowndes190 views
AI + E-commerceAI + E-commerce
AI + E-commerce
Alison B. Lowndes261 views
GTC Fall 2020 KeynoteGTC Fall 2020 Keynote
GTC Fall 2020 Keynote
Alison B. Lowndes194 views
Fuelling the AI Revolution with GamingFuelling the AI Revolution with Gaming
Fuelling the AI Revolution with Gaming
Alison B. Lowndes213 views
Possibilities of generative modelsPossibilities of generative models
Possibilities of generative models
Alison B. Lowndes468 views
Harnessing AI for the Benefit of All.Harnessing AI for the Benefit of All.
Harnessing AI for the Benefit of All.
Alison B. Lowndes205 views
AI in the Financial Services IndustryAI in the Financial Services Industry
AI in the Financial Services Industry
Alison B. Lowndes555 views
Nvidia at SEMICon, MunichNvidia at SEMICon, Munich
Nvidia at SEMICon, Munich
Alison B. Lowndes278 views
Deep learning customer storiesDeep learning customer stories
Deep learning customer stories
Alison B. Lowndes2.8K views
NVIDIA @ Infinite Conference, LondonNVIDIA @ Infinite Conference, London
NVIDIA @ Infinite Conference, London
Alison B. Lowndes593 views
AI talk at CogX 2018AI talk at CogX 2018
AI talk at CogX 2018
Alison B. Lowndes260 views
The What, Who & Why of NVIDIAThe What, Who & Why of NVIDIA
The What, Who & Why of NVIDIA
Alison B. Lowndes249 views

Future of Skills

  • 1. What AI brings to the table. ALISON B. LOWNDES | SENIOR SCIENTIST | GLOBAL AI
  • 5. GINO 3D Geometry-informed neural operators https://arxiv.org/pdf/2309.00583.pdf
  • 7. With NVIDIA DRIVE Sim features such as road elevation, road markings, islands, traffic signals, signs, and vertical posts are replicated at centimeter-level accuracy. Autonomous vehicles can drive millions of miles in a wide range of simulated scenarios so they hit the road running, safely. NVIDIA DRIVE Sim™ Turbocharges Developer Productivity to Get Self- Driving Cars on the Road
  • 9. Scene reconstruction: Appearance ● Realism, viewpoint manipulation NeRF Mildenhall et al., 2020; Müller et al., 2022
  • 12. 12
  • 13. More than 4000 Software Packages in the AI Development Stack NVIDIA AI Enterprise provides enterprise-grade security and acceleration DATA PROC (RAPIDS) TRAIN (PyTorch) OPTIMIZE (TensorRT) DEPLOY (Triton) NVIDIA CUDA NVIDIA AI Enterprise NVIDIA Dependency 3rd party & opensource CVE Patching
  • 14. 14 NGC CONTAINERS ENABLE YOU TO FOCUS ON BUILDING AI PERFORMANCE OPTIMIZED DEPLOY ANYWHERE ENTERPRISE READY SOFTWARE Scanned for CVEs, malware, crypto Tested for reliability Backed by Enterprise support Scalable Updated monthly Better performance on the same system Docker | cri-o | containerd | Singularity Bare metal, VMs, Kubernetes Multi-cloud, on-prem, hybrid, edge https://catalog.ngc.nvidia.com/resources
  • 15. 80 Billion Transistors 4.9 TB/s Bandwidth NVIDIA H100 TSMC 4N Process
  • 20. Far-Edge | Edge | Cloud Synthetic Data Omniverse Replicator CNNs | Transformers Pre-Trained Models TAO Edge | Workstation | Cloud TAO TRAIN DEPLOY DATA Build Models for any Platform with NVIDIA TAO Fast-Track Data Generation, AI Model Creation and Deployment Low-Code AI Model Pruning & Quantization Standard ONNX Output Train and optimize using simple web APIs and CLIs Turnkey inference optimization to reduce compute and memory Compatible with other AI tools for optimization & deployment ONNX Any Inference Platform GPU CPU MCU DLA Real Data Data Bring your own Model
  • 21. 21 SAILDRONE Startup Charts Autonomous Oceanic Monitoring | NVIDIA Blog
  • 22. CONVERGED ACCELERATORS JETSON AGX XAVIER (industrial) developer.nvidia.com/converged-accelerator-devkit www.nvidia.com/en-gb/edge-computing/products/igx/
  • 24. Applications of NVIDIA Technology for Climate Change Mitigation & Adaptation Global Climate Strategies Energy Industry Innovation Climate Science Research NVIDIA Inception Partners FourCastNet Earth Digital Twin in Omniverse U-FNO Carbon Capture & Storage Simulations Powering the Energy Transition Utilidata Accelerating Adoption of Renewables Zenotech Improving Operational Efficiency Siemens Energy Modeling New Energy Sources SGTC NVIDIA AI Nations Helping Governments Implement AI UNOSAT Partnership Accelerating Climate Disaster Management Detecting Leaks in Water Infrastructure ASTERRA Protecting Wildlife from Poaching Rhions Lab TrueOcean Predicting Undersea Carbon Capture & Storage Blue Sky Analytics Harnessing Satellite Data to Access Climate Risk 10,000+ Startups 110 Countries
  • 27. torch-harmonics A library for differentiable Spherical Harmonics Transforms (SHT) • Open-Source library under MIT license: https://github.com/NVIDIA/torch-harmonics • Efficient calls for forward and inverse (vector) spherical harmonic transformations • Autograd support as differential layers in PyTorch • Distributed computation across many GPUs • Easy to integrate into existing PyTorch code, contains many examples, among them SFNO
  • 28. OPTION 2 WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE VIRTUAL WORLD Rendering
  • 29. OPTION 2 WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE VIRTUAL WORLD Physics Rendering
  • 30. WORLD SIMULATION IS THE ULTIMATE COMPUTER SCIENCE CHALLENGE VIRTUAL WORLD Rendering Physic s AI
  • 31. SUPERCOMPUTING BRINGS WORLD SIMULATION TO AN INFLECTION POINT VIRTUAL WORLD Rendering Physic s AI
  • 32. Sensors Controllers Humans PHYSICAL WORLD Real-Time Data Synchronization Control Signal DIGITAL TWINS ARE A NEW CLASS OF WORLD SIMULATION VIRTUAL WORLD Rendering Physic s AI
  • 34. 37 EXPLORE OMNIVERSE ENTERPRISE SEE YOU IN OMNIVERSE DOWNLOAD OMNIVERSE nvidia.com/omniverse DEVELOP ON OMNIVERSE DOCUMENTATION docs.omniverse.nvidia.com FORUMS omniverse.nvidia.com/forums TUTORIALS AND WEBINARS omniverse.nvidia.com/tutorials DISCORD discord.gg/nvidiaomniverse
  • 35. 38
  • 36. Industrial Metaverse Opportunities Exist at Every Scale Every physical process will be software-defined Product Factory City Nation Planetary Galaxy
  • 38. START YOUR DEVELOPMENT WITH JETSON ORIN TODAY Two Devkits. Seven Options. The Jetson AGX Orin Developer Kit is available with 64GB of memory. It can emulate the performance of the AGX Orin series, the Orin NX series, and the Orin Nano series. NVIDIA recommends to use developer kts for only development purposes. For production, customers should leverage our production modules, have been tested for production environments. JETSON AGX ORIN DEVELOPER KIT 5W - 60W 275 TOPS (INT8) 110mm x 110mm x 71.65mm $1999 JETSON ORIN NANO DEVELOPER KIT 7W-15W 40 TOPS (INT8) 100mmX79mmX21mm $499
  • 39. World Record Accuracy 2.96% Gap on Gehring and Homberger Scalable to 1,000s of Locations 3 Seconds vs 5 Minutes to Route 1,000 Packages NVIDIA cuOPT Re-Optimize Logistics and Supply Chain in Real-Time Accelerated Solver for Vehicle Route, Warehouse Picking, Fleet-Mix Optimization Massively Parallel Algorithm Generates Thousands of Solution Candidates and Refinements Dynamic Rerouting Reduces Travel Time – Save Billions for a $10 Trillion Logistics Industry Available Now developer.nvidia.com/cuopt-logistics- optimization
  • 40. 43 NVIDIA DEVELOPER PROGRAM TOOLS JOIN THE COMMUNITY THAT’S CHANGING THE WORLD • Get exclusive access to an extensive library of NVIDIA software, spanning all of NVIDIA’s technology platforms. • Save time with ready-to-run, GPU-optimized software, model scripts, and containerized apps from the NVIDIA NGC™ catalog. • Participate in early access programs where you can be one of the first to experience the latest NVIDIA technology. TRAINING • Take advantage of research papers, technical documentation, developer blogs, and industry-specific resources. • Choose from an extensive catalog of training options through the NVIDIA Deep Learning Institute (DLI). • Get unlimited access to NVIDIA On-Demand, the home for NVIDIA resources from GTCs and other leading industry events. COMMUNITY • Network with like-minded developers, engage with GPU experts, and contribute to discussions in the developer forums. • Attend exclusive meetups, GPU hackathons, and events. • Connect with NVIDIA experts through developer-focused webinars and Instructor-led workshops. Join the free program today developer.nvidia.com/join
  • 41. HELPING YOU SOLVE YOUR MOST CHALLENGING PROBLEMS • Build and deploy end-to-end projects across a range of technologies and domains. • Gain hands-on experience with the most widely used, industry-standard software, tools, and frameworks. • Join live, instructor-led workshops and learn from DLI-certified instructors who are experts in their fields. • Take self-paced, online courses anytime, anywhere. • Earn NVIDIA DLI certificates to demonstrate subject matter competency and support career growth. Hands-On Training in AI, Accelerated Computing, Accelerated Data Science, Graphics and Simulation, and More Learn more: www.nvidia.com/dli Deep Learning Fundamentals AI for Anomaly Detection AI for Industrial Inspection Conversational AI AI for Intelligent Video Analytics Accelerated Computing Fundamentals Recommender Systems AI for Predictive Maintenance Accelerated Data Science Fundamentals Graphics and Simulation Networking AI in the Data Center
  • 48. Scaling to Hundreds and Thousands of DGX Nodes