Download to read offline
Uploaded byAlison B. Lowndes
DataArt
The document discusses NVIDIA's advancements in AI and synthetic data generation for various applications, including gaming and climate research. It highlights the efficiency and cost-effectiveness of using NVIDIA's AI models and infrastructure, such as the Omniverse platform and TAO toolkit, to accelerate development and deployment. Additionally, the document emphasizes the energy efficiency of GPU computing compared to CPUs and the importance of creating virtual worlds for various industries.
DataArt
- 1. Using bits &pixels to reduce costs ALISON B. LOWNDES | SENIOR SCIENTIST | GLOBAL AI @alisonblowndes
- 3. MODERN ERA OFGAMING SYNTHETIC WORLDS AND VISUAL COMPUTING
- 4.
- 6. End-to-End Vision AIDevelopment Fast-Track Data Generation, AI Model Creation, App Development, Inference and Scalability NVIDIA Fleet Command Metropolis Microservices NVIDIA Deepstream, TensorRT, and Triton NVIDIA TAO Toolkit NVIDIA Video Storage Toolkit NVIDIA Pre- Trained Models NVIDIA Omniverse Replicator Any Cloud Generate synthetic training data Use state of the art models out of the box Simplify and accelerate model tuning Easily manage cameras and storage Optimize inference throughput Build cloud-native applications Streamline edge deployment and app management Deploy on any public and private cloud Generate Train Build Deploy
- 7. Create Physically Accurate3D Synthetic Data to Accelerate Vision AI Model Development Build Highly Accurate Models Reduce Costs Prototype Faster NVIDIA TAO OMNIVERSE REPLICATOR
- 8.
- 9. Planning & Action Conversation Gesture RealisticGraphics Speech Vision Face Animation Body Animation HOW CAN I HELP? METAVERSE APPLICATION: AVATARS & DIGITAL HUMANS
- 10. ANNOUNCING NVIDIA RIVA2.0 World-Class Speech AI | Fully Customizable | Supported with Riva Enterprise developer.nvidia.com/riva UNLIMITED USAGE Scale to any cloud & on-premises ACCESS TO NVIDIA AI EXPERTS 8-5 local business hours Guidance on configurations, performance CONTROL MAINTENANCE & UPGRADE SCHEDULE Long-term support for up to 3 years TICKET PRIORITIZATION Latest security fixes and maintenance releases Automatic Speech Recognition Audio Text-To-Speech Audio
- 12.
- 13. DEPLOYMENT CHALLENGES Reduce Latency& Maximize Throughput Model Optimization Model Serving Triton Inference Server TensorRT FasterTransformer
- 14. AI INFERENCE ISHARD PROCESSORS AI Inference DEPLOYMENT PLATFORMS Cloud On-Prem Edge Embedde d T4 GPU Arm CPU A100 GPU V100 GPU x86 CPU FRAMEWORKS APP CONSTRAINTS Real Time Batch Streaming MODELS CNN GNN Decision Trees RNN Transformers
- 15. 15 TAO VISION TRANSFORMERMODELS ROBUST GENERALIZABLE REQUIRES LESS DATA TO FINE-TUNE DEFORMABLE DETR for Object Detection and SegFormer for Semantic Segmentation 1. Understanding Robustness in Vision Transformers - https://arxiv.org/pdf/2204.12451.pdf 2. Delving Deep into the Generalization of Vision Transformers under Distribution Shifts - https://arxiv.org/pdf/2106.07617v3.pdf 3. SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformer - https://arxiv.org/abs/2105.15203 Dataset: Linear 5-Shot ImageNet Snow SegFormer CNN Transformer Image Type
- 16. FAN @ ECCV2022 #1 for semantic segmentation https://arxiv.org/pdf/2204.12451.pdf http://www.robustvision.net/leaderboard.php?benchmark=semantic
- 18.
- 20.
- 21.
- 22.
- 23. 23 BUILDING AN ENTERPRISEAI PLATFORM AI Infrastructure AI Application Development Data Prep Training Inference Accelerated Computing High-Performance Storage and Networking Prototype IT infrastructure optimized for AI workloads speeds model development
- 25.
- 26. 26 Lockheed Martin andNVIDIA Selected by NOAA for Earth Observation Building a Climate Research Data Pipeline with NVIDIA Omniverse Anomaly Detection AI Algorithms Data Fusion Sensor Data Ground Data Satellite Data BUILD PHYSICAL WORLD DIGITAL TWIN DESIGN OPERATE SIMULATE SC22: https://youtu.be/m8baYkVrYIw
- 27. Earth 2 /DTE USE CASES Broad range across local -> global, short term -> long term scales for monitoring, modeling, mitigation, adaptation. EXTREME WEATHER Predict weather. Detect storms ENERGY Downscale. Predict energy. Optimize. WILDFIRE Satellite detection, fire prediction, smoke forecasting OCEAN AND ICE Predict ice-melt, sea-level, ecosystem changes
- 28. Why Accelerated Computingis Energy Efficient GPU Acceleration Moving Compute Intense Sections to the GPU GPUs Complete Jobs Faster Consume Less Overall Energy NVIDIA GPUs Energy Efficiency Over CPUs Potential Energy Savings Switching All CPUs to GPUs GP U Compute- Intensive Functions Application Code Rest of Sequential CPU Code CPU + NVIDIA GPUs are typically 20x more energy efficient for AI & HPC workloads than CPUs 20X 1.7M 12Twatt-hours GPUs typically have higher peak active power consumption than CPUs However, they complete workloads significantly faster Annual energy saved if all CPU-only servers switched to GPUs U.S. homes/year Equivalent to the energy used by Energy Used in a Typical AI Inference Job Server TDP (kW) C P U G P U
- 29. NVIDIA Liquid-Cooled GPUsfor Mainstream Servers A100 LIQUID COOLED H100 LIQUID COOLED H100 PCIe Early 2023 HGX H100 Q4 2022 HGX A100 Shipping A100 PCIe Q3 2022 30% 66% <1.2 PUE Lower Power Consumption Less Rack Space Meet Efficiency Targets * Energy & Space Efficiency Of A100 PCIe Liquid Cooled Vs Air Cooled A100 Liquid Cooled H100 Liquid Cooled
- 30. Improving Energy Efficiencyis a Core Goal Improving With Each New GPU Getting Faster & More Energy Efficient Leading AI Performance & Efficiency As Adoption of AI Accelerates, Our Focus is Shifting from Training to Inference NVIDIA Ampere Compared to Volta faster for AI training & inference 20X more energy efficient 7.5X faster for AI inference 30X more energy efficient 3.5X NVIDIA Hopper Compared to Ampere Embedded Automotive Data Center faster than CPU-only platforms during inference 36X TensorRT-Based Apps Speeding Up DL Inference MLPerf Inference Benchmarks Orin SOC Set New Records in AI Inference Led in 5 of 6 Performance Tests NVIDIA & Partners Lead in All MLPerf Inference Categories
- 31. A Blending ofPhysical and Virtual Worlds THE METAVERSE
- 32. NVIDIA MAXINE Early Accessat developer.nvidia.com/maxine
- 33. OPTION 2 WORLD SIMULATIONIS THE ULTIMATE COMPUTER SCIENCE CHALLENGE VIRTUAL WORLD
- 34. OPTION 2 WORLD SIMULATIONIS THE ULTIMATE COMPUTER SCIENCE CHALLENGE VIRTUAL WORLD Rendering
- 35. OPTION 2 WORLD SIMULATIONIS THE ULTIMATE COMPUTER SCIENCE CHALLENGE VIRTUAL WORLD Physics Rendering
- 36. WORLD SIMULATION ISTHE ULTIMATE COMPUTER SCIENCE CHALLENGE VIRTUAL WORLD Rendering Physics AI
- 37. SUPERCOMPUTING BRINGS WORLDSIMULATION TO AN INFLECTION POINT VIRTUAL WORLD Rendering Physics AI
- 38. Sensors Controllers Humans PHYSICAL WORLD Real-Time Data Synchronization ControlSignal DIGITAL TWINS ARE A NEW CLASS OF WORLD SIMULATION VIRTUAL WORLD Rendering Physic s AI
- 39. SYNC’ING THE REAL& THE VIRTUAL Sensors Controllers Humans PHYSICAL WORLD Real-Time Data Synchronization Control Signal VIRTUAL WORLD Rendering Physic s AI
- 40. 3 NVIDIA ConnectX-7400Gbps NICs 2 Intel Platinum 8362 CPUs 1 TB System Memory and 16 TB NVMe Storage 8 NVIDIA L40 GPUs NVIDIA OVX SERVER
- 43. 43 NVIDIA ROBOTICS RESEARCH LABSEATTLE Drive breakthrough robotics research to enable the next- generation of robots that safely work alongside humans, transforming industries such as manufacturing, logistics, healthcare, and more
- 44.
- 45. Jetson AGX Orin ISAACNOVA REFERENCE AMR ROBOT SYSTEM https://developer.nvidia.com/isaac/nova-orin
- 46.
- 47. NOVA ORIN Industrial RoboticsPlatform NVIDIA ISAAC NVIDIA AI NVIDIA OMNIVERSE
- 48. World Record Accuracy 2.96% Gapon Gehring and Homberger Scalable to 1,000s of Locations 3 Seconds vs 5 Minutes to Route 1,000 Packages NVIDIA CUOPT Re-Optimize Logistics and Supply Chain in Real-Time Accelerated Solver for Vehicle Route, Warehouse Picking, Fleet-Mix Optimization Massively Parallel Algorithm Generates Thousands of Solution Candidates and Refinements Dynamic Rerouting Reduces Travel Time – Save Billions for a $10 Trillion Logistics Industry Available Now developer.nvidia.com/cuopt-logistics- optimization
- 49.
- 50.
- 51. VIRTUAL WORLDS AREESSENTIAL FOR THE NEXT ERA OF INDUSTRIES & AI
- 52.
- 53.
- 54. 54 EXPLORE OMNIVERSE ENTERPRISE SEEYOU IN OMNIVERSE GET ACCESS TO A FREE TRIAL DEVELOP ON OMNIVERSE DOCUMENTATION docs.omniverse.nvidia.com FORUMS omniverse.nvidia.com/forums TUTORIALS AND WEBINARS omniverse.nvidia.com/tutorials DISCORD discord.gg/nvidiaomniverse
- 55. HELPING YOU SOLVEYOUR MOST CHALLENGING PROBLEMS • Build and deploy end-to-end projects across a range of technologies and domains. • Gain hands-on experience with the most widely used, industry-standard software, tools, and frameworks. • Join live, instructor-led workshops and learn from DLI-certified instructors who are experts in their fields. • Take self-paced, online courses anytime, anywhere. • Earn NVIDIA DLI certificates to demonstrate subject matter competency and support career growth. Hands-On Training in AI, Accelerated Computing, Accelerated Data Science, Graphics and Simulation, and More Learn more: www.nvidia.com/dli Deep Learning Fundamentals AI for Anomaly Detection AI for Industrial Inspection Conversational AI AI for Intelligent Video Analytics Accelerated Computing Fundamentals Recommender Systems AI for Predictive Maintenance Accelerated Data Science Fundamentals Graphics and Simulation Networking AI in the Data Center
- 56. NGC CATALOG The Hubof GPU-Optimized Software ACCELERATES DEVELOPMENT Focus on building, not setup FULLY TRANSPARENT Quickly identify and deploy the right software PERFORMANCE OPTIMIZED Tested across GPU-accelerated Platforms SOTA models Model resumes Develop once. Deploy anywhere w/ NVIDIA VMI ngc.nvidia.com Detailed security scan reports One click deploy from NGC Monthly sw container updates 0.9 1.4 1.9 Jun '20 Nov '20 Nov '21 Training Speedup Faster Training on the Same Stack* *8x NVIDIA A100 40GB. NVIDIA DGX. Resnet-50. Mixed Precision. 256 Batch size.
- 57. 57 NVIDIA DEVELOPER PROGRAM TOOLS JOINTHE COMMUNITY THAT’S CHANGING THE WORLD • Get exclusive access to an extensive library of NVIDIA software, spanning all of NVIDIA’s technology platforms. • Save time with ready-to-run, GPU-optimized software, model scripts, and containerized apps from the NVIDIA NGC™ catalog. • Participate in early access programs where you can be one of the first to experience the latest NVIDIA technology. TRAINING • Take advantage of research papers, technical documentation, developer blogs, and industry-specific resources. • Choose from an extensive catalog of training options through the NVIDIA Deep Learning Institute (DLI). • Get unlimited access to NVIDIA On-Demand, the home for NVIDIA resources from GTCs and other leading industry events. COMMUNIT Y • Network with like-minded developers, engage with GPU experts, and contribute to discussions in the developer forums. • Attend exclusive meetups, GPU hackathons, and events. • Connect with NVIDIA experts through developer-focused webinars and Instructor-led workshops. Join the free program today developer.nvidia.com/join
- 58. Silicon Valley Singapore Paris Washington, D.C. Dallas Amsterdam Frankfurt London Tokyo NVIDIALAUNCHPAD ACROSS THE GLOBE nvidia.com/try-ai
- 59.