A talk on reducing costs & increasing efficiencies by designing, testing & engineering in simulation first, plus examples of robotics & environmental capability.
NVIDIA compute GPUs and software toolkits are key drivers behind major advancements in machine learning. Of particular interest is a technique called "deep learning", which utilizes what are known as Convolution Neural Networks (CNNs) having landslide success in computer vision and widespread adoption in a variety of fields such as autonomous vehicles, cyber security, and healthcare. In this talk is presented a high level introduction to deep learning where we discuss core concepts, success stories, and relevant use cases. Additionally, we will provide an overview of essential frameworks and workflows for deep learning. Finally, we explore emerging domains for GPU computing such as large-scale graph analytics, in-memory databases.
https://tech.rakuten.co.jp/
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2021/08/streamlining-development-of-edge-ai-applications-a-presentation-from-nvidia/
Barrie Mullins, Director of Technical Product Marketing at NVIDIA, presents the “Streamlining Development of Edge AI Applications” tutorial at the May 2021 Embedded Vision Summit.
Edge AI provides benefits for cost, latency, privacy, and connectivity. Developing and deploying optimized, accurate and effect AI on edge-based systems is a time-consuming, challenging and complex process. In this session, you will learn how NVIDIA makes it easier for developers to build, deploy, maintain and manage embedded edge products.
NVIDIA Jetson brings accelerated AI performance to the edge in a power-efficient and compact module form factor. Together with NVIDIA pretrained models, Transfer Learning Toolkit, DeepStream and JetPack SDK, these Jetson modules open the door for you to develop and deploy innovative products across all industries.
NVIDIA compute GPUs and software toolkits are key drivers behind major advancements in machine learning. Of particular interest is a technique called "deep learning", which utilizes what are known as Convolution Neural Networks (CNNs) having landslide success in computer vision and widespread adoption in a variety of fields such as autonomous vehicles, cyber security, and healthcare. In this talk is presented a high level introduction to deep learning where we discuss core concepts, success stories, and relevant use cases. Additionally, we will provide an overview of essential frameworks and workflows for deep learning. Finally, we explore emerging domains for GPU computing such as large-scale graph analytics, in-memory databases.
https://tech.rakuten.co.jp/
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2021/08/streamlining-development-of-edge-ai-applications-a-presentation-from-nvidia/
Barrie Mullins, Director of Technical Product Marketing at NVIDIA, presents the “Streamlining Development of Edge AI Applications” tutorial at the May 2021 Embedded Vision Summit.
Edge AI provides benefits for cost, latency, privacy, and connectivity. Developing and deploying optimized, accurate and effect AI on edge-based systems is a time-consuming, challenging and complex process. In this session, you will learn how NVIDIA makes it easier for developers to build, deploy, maintain and manage embedded edge products.
NVIDIA Jetson brings accelerated AI performance to the edge in a power-efficient and compact module form factor. Together with NVIDIA pretrained models, Transfer Learning Toolkit, DeepStream and JetPack SDK, these Jetson modules open the door for you to develop and deploy innovative products across all industries.
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...apidays
Scalable LLM APIs for AI and Generative AI Application Development
Ettikan Karuppiah, Director/Technologist - NVIDIA
Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024)
------
Check out our conferences at https://www.apidays.global/
Do you want to sponsor or talk at one of our conferences?
https://apidays.typeform.com/to/ILJeAaV8
Learn more on APIscene, the global media made by the community for the community:
https://www.apiscene.io
Explore the API ecosystem with the API Landscape:
https://apilandscape.apiscene.io/
Palestra apresentada por Pedro Mário Cruz e Silva, Solution Architect da NVIDIA, como parte da programação da VIII Semana de Inverno de Geofísica, em 19/07/2017.
A late upload. This slide was presented on Aug 31, 2019, when I delivered a talk for AIoT seminar in University of Lambung Mangkurat, Banjarbaru. It's part of Republic of IoT 2019 event.
Harnessing the virtual realm for successful real world artificial intelligenceAlison B. Lowndes
Artificial Intelligence is impacting all areas of society, from healthcare and transportation to smart cities and energy. How NVIDIA invests both in internal pure research and accelerated computation to enable its diverse customer base, across gaming & extended reality, graphics, AI, robotics, simulation, high performance scientific computing, healthcare & more. You will be introduced to the GPU computing platform & shown real world successfully deployed applications as well as a glimpse into the current state of the art across academia, enterprise and startups.
Generative AI models, such as ChatGPT and Stable Diffusion, can create new and original content like text, images, video, audio, or other data from simple prompts, as well as handle complex dialogs and reason about problems with or without images. These models are disrupting traditional technologies, from search and content creation to automation and problem solving, and are fundamentally shaping the future user interface to computing devices. Generative AI can apply broadly across industries, providing significant enhancements for utility, productivity, and entertainment. As generative AI adoption grows at record-setting speeds and computing demands increase, on-device and hybrid processing are more important than ever. Just like traditional computing evolved from mainframes to today’s mix of cloud and edge devices, AI processing will be distributed between them for AI to scale and reach its full potential.
In this presentation you’ll learn about:
- Why on-device AI is key
- Full-stack AI optimizations to make on-device AI possible and efficient
- Advanced techniques like quantization, distillation, and speculative decoding
- How generative AI models can be run on device and examples of some running now
- Qualcomm Technologies’ role in scaling on-device generative AI
Enabling Artificial Intelligence - Alison B. LowndesWithTheBest
An overview and update of our hardware and software offering and support provided to the Machine & Deep Learning Community around the world.
Alison B. Lowndes, AI DevRel, EMEA
For the full video of this presentation, please visit:
https://www.embedded-vision.com/platinum-members/embedded-vision-alliance/embedded-vision-training/videos/pages/feb-2017-member-meeting-rowen
For more information about embedded vision, please visit:
http://www.embedded-vision.com
Chris Rowen of Cognite Ventures delivers the presentation "The Vision AI Start-ups That Matter Most" at the February 2017 Embedded Vision Alliance Member Meeting. Rowen shares his unique perspective on the vision AI start-ups that matter most.
Introducing the Vitis Unified Software Platform for Programming FPGAsinside-BigData.com
Since their beginnings, FPGA's have been notorious for being hard to program. That could be changing with the new Vitis Unified Software Platform from Xilinx. Five years in the making, the Vitis unified software platform is designed to allow a whole new user base of software engineers and AI scientists to take advantage of the power of hardware adaptability.
"The Vitis unified software platform automatically tailors the Xilinx hardware architecture to the software or algorithmic code without the need for hardware expertise. Rather than imposing a proprietary development environment, the Vitis platform plugs into common software developer tools and utilizes a rich set of optimized open source libraries, enabling developers to focus on their algorithms. Vitis is separate to the Vivado Design Suite, which will still be supported for those who want to program using hardware code, but Vitis can also boost the productivity of hardware developers by packaging hardware modules as software-callable functions.
With exponentially increasing compute needs, engineers and scientists are often limited by the fixed nature of silicon,” said Victor Peng, president and chief executive officer, Xilinx. “Xilinx has created a singular environment that enables programmers and engineers from all disciplines to co-develop and optimize both their hardware and software, using the tools and frameworks they already know and understand. This means that they can adapt their hardware architecture to their application without the need for new silicon.”
Learn more: https://www.xilinx.com/products/design-tools/vitis.html
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
Accelerate AI w/ Synthetic Data using GANsRenee Yao
Strata Data Conference in Sep 2018 Presentation
Description:
Synthetic data will drive the next wave of deployment and application of deep learning in the real world across a variety of problems involving speech recognition, image classification, object recognition and language. All industries and companies will benefit, as synthetic data can create conditions through simulation, instead of authentic situations (virtual worlds enable you to avoid the cost of damages, spare human injuries, and other factors that come into play); unparalleled ability to test products, and interactions with them in any environment.
Join us for this introductory session to learn more about how Generative Adversarial Networks (GAN) are successfully used to improve data generation. We will cover specific real-world examples where customers have deployed GAN to solve challenges in healthcare, space, transportation, and retail industries.
Renee Yao explains how generative adversarial networks (GAN) are successfully used to improve data generation and explores specific real-world examples where customers have deployed GANs to solve challenges in healthcare, space, transportation, and retail industries.
Opening Keynote at GTC 2015: Leaps in Visual ComputingNVIDIA
NVIDIA CEO and co-founder Jen-Hsun Huang took the stage for the GPU Technology Conference in the San Jose Convention Center to present some major announcements on March 17, 2015. You'll find out how NVIDIA is innovating in the field of deep learning, what NVIDIA DRIVE PX can do for automakers, and where Pascal, the next-generation GPU architecture, fits in the new performance roadmap.
To the Cloud and beyond (Nantes, Rebuild 2018)Alex Danvy
Une conférence en 2 temps :
1) A tous ceux qui voudrait voir dans le Cloud un univers clivant, opposant le nouveau monde à l'ancien, les développeurs aux opérateurs, les startups aux grandes entreprises. Je fais la démonstration ici, qu'aucontraire, il constitue un vecteur très fort de convergeance.
2) Le Cloud et ses évolutions à venir, du serverless au Quantum Computing.
Simplifying AI Infrastructure: Lessons in Scaling on DGX SystemsRenee Yao
Simplifying AI Infrastructure: Lessons in Scaling on DGX Systems, the world's most powerful AI Systems. This is a presentation I did at GTC Israel in 2018
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...apidays
Scalable LLM APIs for AI and Generative AI Application Development
Ettikan Karuppiah, Director/Technologist - NVIDIA
Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024)
------
Check out our conferences at https://www.apidays.global/
Do you want to sponsor or talk at one of our conferences?
https://apidays.typeform.com/to/ILJeAaV8
Learn more on APIscene, the global media made by the community for the community:
https://www.apiscene.io
Explore the API ecosystem with the API Landscape:
https://apilandscape.apiscene.io/
Palestra apresentada por Pedro Mário Cruz e Silva, Solution Architect da NVIDIA, como parte da programação da VIII Semana de Inverno de Geofísica, em 19/07/2017.
A late upload. This slide was presented on Aug 31, 2019, when I delivered a talk for AIoT seminar in University of Lambung Mangkurat, Banjarbaru. It's part of Republic of IoT 2019 event.
Harnessing the virtual realm for successful real world artificial intelligenceAlison B. Lowndes
Artificial Intelligence is impacting all areas of society, from healthcare and transportation to smart cities and energy. How NVIDIA invests both in internal pure research and accelerated computation to enable its diverse customer base, across gaming & extended reality, graphics, AI, robotics, simulation, high performance scientific computing, healthcare & more. You will be introduced to the GPU computing platform & shown real world successfully deployed applications as well as a glimpse into the current state of the art across academia, enterprise and startups.
Generative AI models, such as ChatGPT and Stable Diffusion, can create new and original content like text, images, video, audio, or other data from simple prompts, as well as handle complex dialogs and reason about problems with or without images. These models are disrupting traditional technologies, from search and content creation to automation and problem solving, and are fundamentally shaping the future user interface to computing devices. Generative AI can apply broadly across industries, providing significant enhancements for utility, productivity, and entertainment. As generative AI adoption grows at record-setting speeds and computing demands increase, on-device and hybrid processing are more important than ever. Just like traditional computing evolved from mainframes to today’s mix of cloud and edge devices, AI processing will be distributed between them for AI to scale and reach its full potential.
In this presentation you’ll learn about:
- Why on-device AI is key
- Full-stack AI optimizations to make on-device AI possible and efficient
- Advanced techniques like quantization, distillation, and speculative decoding
- How generative AI models can be run on device and examples of some running now
- Qualcomm Technologies’ role in scaling on-device generative AI
Enabling Artificial Intelligence - Alison B. LowndesWithTheBest
An overview and update of our hardware and software offering and support provided to the Machine & Deep Learning Community around the world.
Alison B. Lowndes, AI DevRel, EMEA
For the full video of this presentation, please visit:
https://www.embedded-vision.com/platinum-members/embedded-vision-alliance/embedded-vision-training/videos/pages/feb-2017-member-meeting-rowen
For more information about embedded vision, please visit:
http://www.embedded-vision.com
Chris Rowen of Cognite Ventures delivers the presentation "The Vision AI Start-ups That Matter Most" at the February 2017 Embedded Vision Alliance Member Meeting. Rowen shares his unique perspective on the vision AI start-ups that matter most.
Introducing the Vitis Unified Software Platform for Programming FPGAsinside-BigData.com
Since their beginnings, FPGA's have been notorious for being hard to program. That could be changing with the new Vitis Unified Software Platform from Xilinx. Five years in the making, the Vitis unified software platform is designed to allow a whole new user base of software engineers and AI scientists to take advantage of the power of hardware adaptability.
"The Vitis unified software platform automatically tailors the Xilinx hardware architecture to the software or algorithmic code without the need for hardware expertise. Rather than imposing a proprietary development environment, the Vitis platform plugs into common software developer tools and utilizes a rich set of optimized open source libraries, enabling developers to focus on their algorithms. Vitis is separate to the Vivado Design Suite, which will still be supported for those who want to program using hardware code, but Vitis can also boost the productivity of hardware developers by packaging hardware modules as software-callable functions.
With exponentially increasing compute needs, engineers and scientists are often limited by the fixed nature of silicon,” said Victor Peng, president and chief executive officer, Xilinx. “Xilinx has created a singular environment that enables programmers and engineers from all disciplines to co-develop and optimize both their hardware and software, using the tools and frameworks they already know and understand. This means that they can adapt their hardware architecture to their application without the need for new silicon.”
Learn more: https://www.xilinx.com/products/design-tools/vitis.html
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
Accelerate AI w/ Synthetic Data using GANsRenee Yao
Strata Data Conference in Sep 2018 Presentation
Description:
Synthetic data will drive the next wave of deployment and application of deep learning in the real world across a variety of problems involving speech recognition, image classification, object recognition and language. All industries and companies will benefit, as synthetic data can create conditions through simulation, instead of authentic situations (virtual worlds enable you to avoid the cost of damages, spare human injuries, and other factors that come into play); unparalleled ability to test products, and interactions with them in any environment.
Join us for this introductory session to learn more about how Generative Adversarial Networks (GAN) are successfully used to improve data generation. We will cover specific real-world examples where customers have deployed GAN to solve challenges in healthcare, space, transportation, and retail industries.
Renee Yao explains how generative adversarial networks (GAN) are successfully used to improve data generation and explores specific real-world examples where customers have deployed GANs to solve challenges in healthcare, space, transportation, and retail industries.
Opening Keynote at GTC 2015: Leaps in Visual ComputingNVIDIA
NVIDIA CEO and co-founder Jen-Hsun Huang took the stage for the GPU Technology Conference in the San Jose Convention Center to present some major announcements on March 17, 2015. You'll find out how NVIDIA is innovating in the field of deep learning, what NVIDIA DRIVE PX can do for automakers, and where Pascal, the next-generation GPU architecture, fits in the new performance roadmap.
To the Cloud and beyond (Nantes, Rebuild 2018)Alex Danvy
Une conférence en 2 temps :
1) A tous ceux qui voudrait voir dans le Cloud un univers clivant, opposant le nouveau monde à l'ancien, les développeurs aux opérateurs, les startups aux grandes entreprises. Je fais la démonstration ici, qu'aucontraire, il constitue un vecteur très fort de convergeance.
2) Le Cloud et ses évolutions à venir, du serverless au Quantum Computing.
Simplifying AI Infrastructure: Lessons in Scaling on DGX SystemsRenee Yao
Simplifying AI Infrastructure: Lessons in Scaling on DGX Systems, the world's most powerful AI Systems. This is a presentation I did at GTC Israel in 2018
Semiconductors are the driving force behind the AI evolution and enable its adoption across various application areas ranging from connected and automated driving to smart healthcare and wearables. Given that, electronics research, design and manufacturing communities around the world are increasingly investing in specialized AI chips providing less latency, greater processing power, higher bandwidth and faster performance. AI also attracts new technology players to invest in making their own specialized AI chips, changing the electronics manufacturing landscape and moving the AI technology towards machine learning, deep learning and neural networks.
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024Neo4j
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
6. End-to-End Vision AI Development
Fast-Track Data Generation, AI Model Creation, App Development, Inference and Scalability
NVIDIA Fleet
Command
Metropolis
Microservices
NVIDIA Deepstream,
TensorRT, and Triton
NVIDIA TAO
Toolkit
NVIDIA Video
Storage Toolkit
NVIDIA Pre-
Trained Models
NVIDIA Omniverse
Replicator
Any Cloud
Generate synthetic
training data
Use state of the art
models out of the box
Simplify and accelerate
model tuning
Easily manage
cameras and storage
Optimize inference
throughput
Build cloud-native
applications
Streamline edge
deployment and app
management
Deploy on any public
and private cloud
Generate Train Build Deploy
7. Create Physically Accurate 3D Synthetic Data to Accelerate Vision AI Model Development
Build Highly Accurate Models
Reduce Costs Prototype Faster
NVIDIA TAO
OMNIVERSE REPLICATOR
10. ANNOUNCING NVIDIA RIVA 2.0
World-Class Speech AI | Fully Customizable | Supported with Riva Enterprise
developer.nvidia.com/riva
UNLIMITED USAGE
Scale to any cloud & on-premises
ACCESS TO NVIDIA AI
EXPERTS
8-5 local business hours
Guidance on configurations,
performance
CONTROL MAINTENANCE
& UPGRADE SCHEDULE
Long-term support for up to 3
years
TICKET PRIORITIZATION
Latest security fixes and
maintenance releases
Automatic Speech Recognition
Audio
Text-To-Speech
Audio
14. AI INFERENCE IS HARD
PROCESSORS
AI Inference
DEPLOYMENT
PLATFORMS
Cloud On-Prem Edge
Embedde
d
T4 GPU Arm
CPU
A100
GPU
V100
GPU
x86 CPU
FRAMEWORKS APP CONSTRAINTS
Real Time Batch Streaming
MODELS
CNN
GNN Decision Trees
RNN Transformers
15. 15
TAO VISION TRANSFORMER MODELS
ROBUST GENERALIZABLE REQUIRES LESS DATA TO FINE-TUNE
DEFORMABLE DETR for Object Detection and SegFormer for Semantic Segmentation
1. Understanding Robustness in Vision Transformers - https://arxiv.org/pdf/2204.12451.pdf
2. Delving Deep into the Generalization of Vision Transformers under Distribution Shifts - https://arxiv.org/pdf/2106.07617v3.pdf
3. SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformer - https://arxiv.org/abs/2105.15203
Dataset: Linear 5-Shot ImageNet
Snow
SegFormer
CNN
Transformer
Image
Type
16. FAN @ ECCV 2022
#1 for semantic segmentation
https://arxiv.org/pdf/2204.12451.pdf
http://www.robustvision.net/leaderboard.php?benchmark=semantic
23. 23
BUILDING AN ENTERPRISE AI PLATFORM
AI
Infrastructure
AI Application
Development
Data Prep Training Inference
Accelerated Computing
High-Performance Storage
and Networking
Prototype
IT infrastructure optimized for AI workloads
speeds model development
26. 26
Lockheed Martin and NVIDIA Selected by NOAA for Earth Observation
Building a Climate Research Data Pipeline with NVIDIA Omniverse
Anomaly
Detection
AI
Algorithms
Data
Fusion
Sensor
Data
Ground
Data
Satellite
Data
BUILD
PHYSICAL WORLD
DIGITAL TWIN
DESIGN OPERATE
SIMULATE
SC22: https://youtu.be/m8baYkVrYIw
27. Earth 2 / DTE USE CASES
Broad range across local -> global, short term -> long term scales for monitoring, modeling, mitigation, adaptation.
EXTREME WEATHER
Predict weather. Detect storms
ENERGY
Downscale. Predict energy. Optimize.
WILDFIRE
Satellite detection, fire prediction,
smoke forecasting
OCEAN AND ICE
Predict ice-melt, sea-level, ecosystem
changes
28. Why Accelerated Computing is Energy
Efficient
GPU Acceleration
Moving Compute Intense Sections to the GPU
GPUs Complete Jobs Faster
Consume Less Overall Energy
NVIDIA GPUs
Energy Efficiency Over CPUs
Potential Energy Savings
Switching All CPUs to GPUs
GP
U
Compute-
Intensive
Functions
Application Code
Rest of
Sequential CPU
Code CPU
+
NVIDIA GPUs are typically 20x more
energy efficient for AI & HPC workloads
than CPUs
20X 1.7M
12Twatt-hours
GPUs typically have higher peak
active power consumption than
CPUs
However, they complete workloads
significantly faster
Annual energy saved if all
CPU-only servers switched
to GPUs
U.S. homes/year
Equivalent to the energy
used by
Energy Used in a Typical AI Inference Job
Server
TDP
(kW)
C
P
U
G
P
U
29. NVIDIA Liquid-Cooled GPUs for Mainstream Servers
A100 LIQUID COOLED H100 LIQUID COOLED
H100 PCIe
Early 2023
HGX H100
Q4 2022
HGX A100
Shipping
A100 PCIe
Q3 2022
30% 66% <1.2
PUE
Lower
Power Consumption
Less
Rack Space
Meet
Efficiency Targets
* Energy & Space Efficiency Of A100 PCIe Liquid Cooled Vs Air Cooled
A100 Liquid Cooled H100 Liquid Cooled
30. Improving Energy Efficiency is a Core Goal
Improving With Each New GPU
Getting Faster & More Energy Efficient
Leading AI Performance & Efficiency
As Adoption of AI Accelerates, Our Focus is Shifting from Training to Inference
NVIDIA Ampere
Compared to Volta
faster for AI
training &
inference
20X
more energy
efficient
7.5X
faster for AI
inference
30X
more energy
efficient
3.5X
NVIDIA Hopper
Compared to
Ampere
Embedded Automotive Data Center
faster than CPU-only
platforms during
inference
36X
TensorRT-Based Apps
Speeding Up DL Inference MLPerf Inference
Benchmarks
Orin SOC
Set New Records in AI Inference
Led in 5 of 6 Performance Tests
NVIDIA & Partners Lead in All MLPerf
Inference Categories
31. A Blending of Physical and Virtual Worlds
THE METAVERSE
39. SYNC’ING THE REAL & THE VIRTUAL
Sensors
Controllers
Humans
PHYSICAL WORLD
Real-Time Data
Synchronization
Control Signal
VIRTUAL WORLD
Rendering
Physic
s
AI
40. 3 NVIDIA ConnectX-7 400Gbps NICs
2 Intel Platinum 8362 CPUs
1 TB System Memory and 16 TB NVMe Storage
8 NVIDIA L40 GPUs
NVIDIA OVX SERVER
41.
42.
43. 43
NVIDIA ROBOTICS
RESEARCH LAB SEATTLE
Drive breakthrough robotics
research to enable the next-
generation of robots that safely
work alongside humans,
transforming industries such as
manufacturing, logistics, healthcare,
and more
48. World Record
Accuracy
2.96% Gap on
Gehring and
Homberger
Scalable to
1,000s
of Locations
3 Seconds
vs
5 Minutes
to Route 1,000
Packages
NVIDIA CUOPT
Re-Optimize Logistics and Supply Chain in Real-Time
Accelerated Solver for Vehicle Route, Warehouse
Picking, Fleet-Mix Optimization
Massively Parallel Algorithm Generates
Thousands of Solution Candidates and
Refinements
Dynamic Rerouting Reduces Travel Time – Save
Billions for a $10 Trillion Logistics Industry
Available Now
developer.nvidia.com/cuopt-logistics-
optimization
54. 54
EXPLORE OMNIVERSE ENTERPRISE
SEE YOU IN OMNIVERSE
GET ACCESS TO A FREE TRIAL DEVELOP ON OMNIVERSE
DOCUMENTATION
docs.omniverse.nvidia.com
FORUMS
omniverse.nvidia.com/forums
TUTORIALS AND
WEBINARS
omniverse.nvidia.com/tutorials
DISCORD
discord.gg/nvidiaomniverse
55. HELPING YOU SOLVE YOUR
MOST CHALLENGING PROBLEMS
• Build and deploy end-to-end projects across a range
of technologies and domains.
• Gain hands-on experience with the most widely used,
industry-standard software, tools, and frameworks.
• Join live, instructor-led workshops and learn from DLI-certified
instructors who are experts in their fields.
• Take self-paced, online courses anytime, anywhere.
• Earn NVIDIA DLI certificates to demonstrate subject matter
competency and support career growth.
Hands-On Training in AI, Accelerated Computing,
Accelerated Data Science, Graphics and Simulation,
and More
Learn more: www.nvidia.com/dli
Deep Learning
Fundamentals
AI for Anomaly
Detection
AI for Industrial
Inspection
Conversational AI
AI for
Intelligent Video
Analytics
Accelerated Computing
Fundamentals
Recommender Systems
AI for
Predictive
Maintenance
Accelerated Data Science
Fundamentals
Graphics and
Simulation
Networking
AI in the Data
Center
56. NGC CATALOG
The Hub of GPU-Optimized Software
ACCELERATES DEVELOPMENT
Focus on building, not setup
FULLY TRANSPARENT
Quickly identify and deploy the right software
PERFORMANCE OPTIMIZED
Tested across GPU-accelerated Platforms
SOTA models Model resumes Develop once. Deploy anywhere w/ NVIDIA VMI
ngc.nvidia.com
Detailed security scan reports One click deploy from NGC
Monthly sw container updates
0.9
1.4
1.9
Jun '20 Nov '20 Nov '21
Training
Speedup
Faster Training on the Same
Stack*
*8x NVIDIA A100 40GB. NVIDIA DGX. Resnet-50. Mixed Precision. 256 Batch size.
57. 57
NVIDIA DEVELOPER PROGRAM
TOOLS
JOIN THE COMMUNITY THAT’S CHANGING THE WORLD
• Get exclusive access to an extensive library of NVIDIA software, spanning all of NVIDIA’s technology platforms.
• Save time with ready-to-run, GPU-optimized software, model scripts, and containerized apps from the NVIDIA NGC™ catalog.
• Participate in early access programs where you can be one of the first to experience the latest NVIDIA technology.
TRAINING
• Take advantage of research papers, technical documentation, developer blogs, and industry-specific resources.
• Choose from an extensive catalog of training options through the NVIDIA Deep Learning Institute (DLI).
• Get unlimited access to NVIDIA On-Demand, the home for NVIDIA resources from GTCs and other leading industry events.
COMMUNIT
Y
• Network with like-minded developers, engage with GPU experts, and contribute to discussions in the developer forums.
• Attend exclusive meetups, GPU hackathons, and events.
• Connect with NVIDIA experts through developer-focused webinars and Instructor-led workshops.
Join the free program today developer.nvidia.com/join