SlideShare a Scribd company logo
Building and Scaling AI
Applications with the Nx AI
Manager
Robin van Emden
Senior Director of Data Science
Network Optix
2
© 2024 Network Optix
Network Optix
● Founded in 2010 with the aim of
creating a platform for enterprise
video management.
● Offices in Los Angeles, Portland,
London, Taipei, Adelaide, Belgrade.
● Over 4 million connected video
streaming devices in more than 150
countries
● Recently acquired Scailable AI,
which adds Amsterdam 
3
© 2024 Network Optix
Network Optix
● Founded in 2010 with the aim of
creating a platform for enterprise
video management.
● Offices in Los Angeles, Portland,
London, Taipei, Adelaide, Belgrade.
● Over 4 million connected video
streaming devices in more than 150
countries
● Recently acquired Scailable AI,
which adds Amsterdam 
4
© 2024 Network Optix
Hard Problem: Video
Nx Toolkit Makes Video Solutions at Scale Easy
5
© 2024 Network Optix
Network Optix Toolkit is a solution that handles the complexities of
edge video, allowing you to concentrate on building your application.
Device / Stream
Discovery
Storage
Management
Decoding /
Visualization
System
Scalability
Enterprise
Scalability
Cyber
Security
Video / Metadata
Capture
OS / Hardware
Support
Platform
Extensibility
Usability / User
Experience
Nx Toolkit Makes Video Solutions at Scale Easy
6
© 2024 Network Optix
Network Optix Toolkit offers partially open-source
tools and libraries to build custom video solutions.
It provides server, desktop, mobile applications, and
cloud services.
Nx Toolkit Makes Video Solutions at Scale Easy
7
© 2024 Network Optix
Network Optix Toolkit offers partially open-source
tools and libraries to build custom video solutions.
It provides server, desktop, mobile applications, and
cloud services.
8
© 2024 Network Optix
Hard Problem: AI
Creating AI applications at Scale Is Hard
9
© 2024 Network Optix
These days, there are numerous user-
friendly tools available for training AI
models…
Data scientists use their preferred tools to
train AI models on laptops, in data centers,
and in the cloud.
... but building an AI solution
for edge devices still takes a lot of time and
effort.
• Diverse edge AI accelerators: GPU, NPU, DPU.
• Input and output interfacing, edge video.
• Data pre- and post-processing.
• Embedded engineering.
Nx AI Manager Makes AI Solutions at Scale Easy
10
© 2024 Network Optix
Train AI model Upload to
Nx Cloud
Deploy AI model to
Device(s) with
Nx AI Manager
Nx Client,
Nx Mobile,
Nx Web
Nx Meta Server
Nx AI manager
Nx AI Manager Makes AI Solutions at Scale Easy
11
© 2024 Network Optix
Train AI model Upload to
Nx Cloud
Deploy AI model to
Device(s) with
Nx AI Manager
Nx Client,
Nx Mobile,
Nx Web
Nx Meta Server
Nx AI manager
Nx AI Manager Makes AI Solutions at Scale Easy
12
© 2024 Network Optix
Train AI model Upload to
Nx Cloud
Deploy AI model to
Device(s) with
Nx AI Manager
Nx Client,
Nx Mobile,
Nx Web
Nx Meta Server
Nx AI manager
Nx AI Manager Makes AI Solutions at Scale Easy
13
© 2024 Network Optix
Train AI model Upload to
Nx Cloud
Deploy AI model to
Device(s) with
Nx AI Manager
Nx Client,
Nx Mobile,
Nx Web
Nx Meta Server
Nx AI manager
Nx AI Manager -> Open Ai Accelerator eXchange
[OAAX]
14
© 2024 Network Optix
NX Cloud
AI Model
Inference Engine
Using OAAX you can use
any hardware accelerator
effortlessly to deploy your
edge AI models.
Convert models in cloud
Standardized interface
to
native accelerator
library
https://github.com/OAAX-standard/OAAX
Nx AI Manager -> Open Ai Accelerator eXchange
[OAAX]
15
© 2024 Network Optix
NX Cloud
AI Model
Inference Engine
Using OAAX you can use
any hardware accelerator
effortlessly to deploy your
edge AI models.
Convert models in cloud
Standardized interface
to
native accelerator
library
https://github.com/OAAX-standard/OAAX
Nx AI Manager Allows for Custom Pipelines
16
© 2024 Network Optix
Preprocessing Inference Engine Postprocessing
https://github.com/scailable/sclbl-integration-sdk
Custom postprocessors
Preprocessors Custom inference engine
https://nx.docs.scailable.net/oaax-implementation
17
© 2024 Network Optix
Deploying AI Models to Heterogeneous Devices
Step 1: Edge Devices, IP Cameras, and a Client Device
18
© 2024 Network Optix
CPU AARCH64 X86_64 AARCH64 X86_64
XPU
ACCELERATOR
CPU SIMD CPU SIMD NVIDIA ORIN HAILO-8
Step 2: Install an Nx Client and Register in the Nx Cloud
19
© 2024 Network Optix
> sudo apt install -y ./metavms-client-6.x.x.x-linux_x.deb
(1) https://meta.nxvms.com/download
(2) https://meta.nxvms.com
Step 3: Install Nx Server with NX AI Manager
20
© 2024 Network Optix
> sudo apt install -y ./metavms-server-6.x.x.x-linux_x.deb
(1) https://meta.nxvms.com/download
CPU AARCH64 X86_64 AARCH64 X86_64
XPU
ACCELERATOR
CPU SIMD CPU SIMD NVIDIA ORIN HAILO-8
INFERENCE
RUNTIME
LIBRARY
ONNXRuntime
with ACL
ONNXRuntime
with oneDNN,
Intel OpenVINO
NVIDIA CUDA
NVIDIA TensorRT
HAILORT
Step 4: Train, Convert, Deploy and Run an AI Model
21
© 2024 Network Optix
For instance:
https://nx.docs.scailable.net/for-data-scientists/importing-models/from-teachable-machine
Step 4: Train, Convert, Deploy and Run an AI Model
22
© 2024 Network Optix
Nx AI Cloud
https://admin.sclbl.nxvms.com/
Step 4: Train, Convert, Deploy and Run an AI Model
23
© 2024 Network Optix
Nx AI Cloud
https://admin.sclbl.nxvms.com/
Step 4: Train, Convert, Deploy and Run an AI Model
24
© 2024 Network Optix
Nx Client
https://github.com/networkoptix
25
© 2024 Network Optix
Let Me Show You How: Live Coding Session
Step 4: Live Coding Sessions at Our Booth
26
© 2024 Network Optix
Booth #304
27
© 2024 Network Optix
Takeaway
28
© 2024 Network Optix
Building an AI + Video Application? Build on Nx EVOS
• Simplified AI Deployment and Management: Network Optix streamlines the
implementation, deployment, and management of AI models across edge devices,
allowing developers to focus on creating innovative Vision AI solutions.
• Comprehensive Nx Meta Platform: Nx Meta offers a full suite of tools through the Nx
Toolkit, addressing video development challenges, empowering efficient and effective
distributed video application development.
• Versatile AI Model Integration: The Nx AI Manager supports the entire AI model
lifecycle, from training to real-time inference enabling seamless integration of custom
AI models and real-time visualization within the Nx Client.
Thank you!
2024 Embedded Vision Summit
Scaling Vision-Based Edge AI Solutions: From
Prototype to Global Deployment
Maurits Kaptein
General Session — Wed, May 22 at 10:00 am
Nx EVOS: A New Enterprise Operating System for
Video and Visual AI
Nathan Wheeler
Exhibit Hall—ET-2 Thur, May 23 at 12:00 pm
Visit us at our booth — Booth #304
29
© 2024 Network Optix
Continue exploring Nx Meta and more
Nx AI Plugin Documentation
https://nx.docs.scailable.net/
Nx Meta Developer Portal
https://meta.nxvms.com/
Nx tools:
https://www.networkoptix.com/nx-meta
OAAX github
https://github.com/oaax-standard

More Related Content

Similar to “Building and Scaling AI Applications with the Nx AI Manager,” a Presentation from Network Optix

AWS IoT Lab Introduction
AWS IoT Lab IntroductionAWS IoT Lab Introduction
AWS IoT Lab Introduction
Amazon Web Services
 
8.cncf en
8.cncf  en8.cncf  en
8.cncf en
Juraj Hantak
 
Cisco Connect Toronto 2018 DevNet Overview
Cisco Connect Toronto 2018  DevNet OverviewCisco Connect Toronto 2018  DevNet Overview
Cisco Connect Toronto 2018 DevNet Overview
Cisco Canada
 
The Evolution of Industrial Visualization
The Evolution of Industrial VisualizationThe Evolution of Industrial Visualization
The Evolution of Industrial Visualization
Inductive Automation
 
Ansible Tower | Docker | Cisco ACI
Ansible Tower | Docker | Cisco ACIAnsible Tower | Docker | Cisco ACI
Ansible Tower | Docker | Cisco ACI
Joel W. King
 
"Current and Planned Standards for Computer Vision and Machine Learning," a P...
"Current and Planned Standards for Computer Vision and Machine Learning," a P..."Current and Planned Standards for Computer Vision and Machine Learning," a P...
"Current and Planned Standards for Computer Vision and Machine Learning," a P...
Edge AI and Vision Alliance
 
Accelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with PlatformlessAccelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with Platformless
WSO2
 
“Vitis and Vitis AI: Application Acceleration from Cloud to Edge,” a Presenta...
“Vitis and Vitis AI: Application Acceleration from Cloud to Edge,” a Presenta...“Vitis and Vitis AI: Application Acceleration from Cloud to Edge,” a Presenta...
“Vitis and Vitis AI: Application Acceleration from Cloud to Edge,” a Presenta...
Edge AI and Vision Alliance
 
[2017년 5월 정기세미나] IBM에서 바라보는 OpenStack 이야기
[2017년 5월 정기세미나] IBM에서 바라보는 OpenStack 이야기[2017년 5월 정기세미나] IBM에서 바라보는 OpenStack 이야기
[2017년 5월 정기세미나] IBM에서 바라보는 OpenStack 이야기
OpenStack Korea Community
 
Rapid Prototyping for IoT
Rapid Prototyping for IoT Rapid Prototyping for IoT
Rapid Prototyping for IoT
M2M Alliance e.V.
 
Why Automate the Network?
Why Automate the Network?Why Automate the Network?
Why Automate the Network?
Hank Preston
 
Infrastructure as Code in Large Scale Organizations
Infrastructure as Code in Large Scale OrganizationsInfrastructure as Code in Large Scale Organizations
Infrastructure as Code in Large Scale Organizations
XebiaLabs
 
[Oracle Webcast] Discover the Oracle Blockchain Platform through the eyes of ...
[Oracle Webcast] Discover the Oracle Blockchain Platform through the eyes of ...[Oracle Webcast] Discover the Oracle Blockchain Platform through the eyes of ...
[Oracle Webcast] Discover the Oracle Blockchain Platform through the eyes of ...
Sanae BEKKAR
 
.NetKS Catalogue
.NetKS Catalogue.NetKS Catalogue
.NetKS Catalogue
Przemysław Ładyński
 
Red Hat Forum Poland 2019 - Red Hat Open Hybrid Cloud (keynote)
Red Hat Forum Poland 2019 - Red Hat Open Hybrid Cloud (keynote)Red Hat Forum Poland 2019 - Red Hat Open Hybrid Cloud (keynote)
Red Hat Forum Poland 2019 - Red Hat Open Hybrid Cloud (keynote)
Eric D. Schabell
 
Continuous Everything in a Multi-cloud and Multi-platform Environment
Continuous Everything in a Multi-cloud and Multi-platform EnvironmentContinuous Everything in a Multi-cloud and Multi-platform Environment
Continuous Everything in a Multi-cloud and Multi-platform Environment
VMware Tanzu
 
Nimbus Concept
Nimbus ConceptNimbus Concept
Nimbus Concept
Nimbus Concept
 
wisecloud based open cloud implementation guide
wisecloud based open cloud implementation guidewisecloud based open cloud implementation guide
wisecloud based open cloud implementation guide
bizmerce
 
"The Cloud Native Enterprise is Coming"
"The Cloud Native Enterprise is Coming" "The Cloud Native Enterprise is Coming"
"The Cloud Native Enterprise is Coming"
James Watters
 
Deploying IBM WebSphere Application Server to the Cloud_GWC_3-24-2015
Deploying IBM WebSphere Application Server to the Cloud_GWC_3-24-2015Deploying IBM WebSphere Application Server to the Cloud_GWC_3-24-2015
Deploying IBM WebSphere Application Server to the Cloud_GWC_3-24-2015
Yakura Coffee
 

Similar to “Building and Scaling AI Applications with the Nx AI Manager,” a Presentation from Network Optix (20)

AWS IoT Lab Introduction
AWS IoT Lab IntroductionAWS IoT Lab Introduction
AWS IoT Lab Introduction
 
8.cncf en
8.cncf  en8.cncf  en
8.cncf en
 
Cisco Connect Toronto 2018 DevNet Overview
Cisco Connect Toronto 2018  DevNet OverviewCisco Connect Toronto 2018  DevNet Overview
Cisco Connect Toronto 2018 DevNet Overview
 
The Evolution of Industrial Visualization
The Evolution of Industrial VisualizationThe Evolution of Industrial Visualization
The Evolution of Industrial Visualization
 
Ansible Tower | Docker | Cisco ACI
Ansible Tower | Docker | Cisco ACIAnsible Tower | Docker | Cisco ACI
Ansible Tower | Docker | Cisco ACI
 
"Current and Planned Standards for Computer Vision and Machine Learning," a P...
"Current and Planned Standards for Computer Vision and Machine Learning," a P..."Current and Planned Standards for Computer Vision and Machine Learning," a P...
"Current and Planned Standards for Computer Vision and Machine Learning," a P...
 
Accelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with PlatformlessAccelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with Platformless
 
“Vitis and Vitis AI: Application Acceleration from Cloud to Edge,” a Presenta...
“Vitis and Vitis AI: Application Acceleration from Cloud to Edge,” a Presenta...“Vitis and Vitis AI: Application Acceleration from Cloud to Edge,” a Presenta...
“Vitis and Vitis AI: Application Acceleration from Cloud to Edge,” a Presenta...
 
[2017년 5월 정기세미나] IBM에서 바라보는 OpenStack 이야기
[2017년 5월 정기세미나] IBM에서 바라보는 OpenStack 이야기[2017년 5월 정기세미나] IBM에서 바라보는 OpenStack 이야기
[2017년 5월 정기세미나] IBM에서 바라보는 OpenStack 이야기
 
Rapid Prototyping for IoT
Rapid Prototyping for IoT Rapid Prototyping for IoT
Rapid Prototyping for IoT
 
Why Automate the Network?
Why Automate the Network?Why Automate the Network?
Why Automate the Network?
 
Infrastructure as Code in Large Scale Organizations
Infrastructure as Code in Large Scale OrganizationsInfrastructure as Code in Large Scale Organizations
Infrastructure as Code in Large Scale Organizations
 
[Oracle Webcast] Discover the Oracle Blockchain Platform through the eyes of ...
[Oracle Webcast] Discover the Oracle Blockchain Platform through the eyes of ...[Oracle Webcast] Discover the Oracle Blockchain Platform through the eyes of ...
[Oracle Webcast] Discover the Oracle Blockchain Platform through the eyes of ...
 
.NetKS Catalogue
.NetKS Catalogue.NetKS Catalogue
.NetKS Catalogue
 
Red Hat Forum Poland 2019 - Red Hat Open Hybrid Cloud (keynote)
Red Hat Forum Poland 2019 - Red Hat Open Hybrid Cloud (keynote)Red Hat Forum Poland 2019 - Red Hat Open Hybrid Cloud (keynote)
Red Hat Forum Poland 2019 - Red Hat Open Hybrid Cloud (keynote)
 
Continuous Everything in a Multi-cloud and Multi-platform Environment
Continuous Everything in a Multi-cloud and Multi-platform EnvironmentContinuous Everything in a Multi-cloud and Multi-platform Environment
Continuous Everything in a Multi-cloud and Multi-platform Environment
 
Nimbus Concept
Nimbus ConceptNimbus Concept
Nimbus Concept
 
wisecloud based open cloud implementation guide
wisecloud based open cloud implementation guidewisecloud based open cloud implementation guide
wisecloud based open cloud implementation guide
 
"The Cloud Native Enterprise is Coming"
"The Cloud Native Enterprise is Coming" "The Cloud Native Enterprise is Coming"
"The Cloud Native Enterprise is Coming"
 
Deploying IBM WebSphere Application Server to the Cloud_GWC_3-24-2015
Deploying IBM WebSphere Application Server to the Cloud_GWC_3-24-2015Deploying IBM WebSphere Application Server to the Cloud_GWC_3-24-2015
Deploying IBM WebSphere Application Server to the Cloud_GWC_3-24-2015
 

More from Edge AI and Vision Alliance

“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
Edge AI and Vision Alliance
 
“How to Run Audio and Vision AI Algorithms at Ultra-low Power,” a Presentatio...
“How to Run Audio and Vision AI Algorithms at Ultra-low Power,” a Presentatio...“How to Run Audio and Vision AI Algorithms at Ultra-low Power,” a Presentatio...
“How to Run Audio and Vision AI Algorithms at Ultra-low Power,” a Presentatio...
Edge AI and Vision Alliance
 
“Meeting the Critical Needs of Accuracy, Performance and Adaptability in Embe...
“Meeting the Critical Needs of Accuracy, Performance and Adaptability in Embe...“Meeting the Critical Needs of Accuracy, Performance and Adaptability in Embe...
“Meeting the Critical Needs of Accuracy, Performance and Adaptability in Embe...
Edge AI and Vision Alliance
 
“Build a Tiny Vision Application in Minutes with the Edge App SDK,” a Present...
“Build a Tiny Vision Application in Minutes with the Edge App SDK,” a Present...“Build a Tiny Vision Application in Minutes with the Edge App SDK,” a Present...
“Build a Tiny Vision Application in Minutes with the Edge App SDK,” a Present...
Edge AI and Vision Alliance
 
“The Importance of Memory for Breaking the Edge AI Performance Bottleneck,” a...
“The Importance of Memory for Breaking the Edge AI Performance Bottleneck,” a...“The Importance of Memory for Breaking the Edge AI Performance Bottleneck,” a...
“The Importance of Memory for Breaking the Edge AI Performance Bottleneck,” a...
Edge AI and Vision Alliance
 
“Intel’s Approach to Operationalizing AI in the Manufacturing Sector,” a Pres...
“Intel’s Approach to Operationalizing AI in the Manufacturing Sector,” a Pres...“Intel’s Approach to Operationalizing AI in the Manufacturing Sector,” a Pres...
“Intel’s Approach to Operationalizing AI in the Manufacturing Sector,” a Pres...
Edge AI and Vision Alliance
 
“Transforming Enterprise Intelligence: The Power of Computer Vision and Gen A...
“Transforming Enterprise Intelligence: The Power of Computer Vision and Gen A...“Transforming Enterprise Intelligence: The Power of Computer Vision and Gen A...
“Transforming Enterprise Intelligence: The Power of Computer Vision and Gen A...
Edge AI and Vision Alliance
 
“Challenges and Solutions of Moving Vision LLMs to the Edge,” a Presentation ...
“Challenges and Solutions of Moving Vision LLMs to the Edge,” a Presentation ...“Challenges and Solutions of Moving Vision LLMs to the Edge,” a Presentation ...
“Challenges and Solutions of Moving Vision LLMs to the Edge,” a Presentation ...
Edge AI and Vision Alliance
 
“Implementing Transformer Neural Networks for Visual Perception on Embedded D...
“Implementing Transformer Neural Networks for Visual Perception on Embedded D...“Implementing Transformer Neural Networks for Visual Perception on Embedded D...
“Implementing Transformer Neural Networks for Visual Perception on Embedded D...
Edge AI and Vision Alliance
 
“A Cutting-edge Memory Optimization Method for Embedded AI Accelerators,” a P...
“A Cutting-edge Memory Optimization Method for Embedded AI Accelerators,” a P...“A Cutting-edge Memory Optimization Method for Embedded AI Accelerators,” a P...
“A Cutting-edge Memory Optimization Method for Embedded AI Accelerators,” a P...
Edge AI and Vision Alliance
 
“Efficiency Unleashed: The Next-gen NXP i.MX 95 Applications Processor for Em...
“Efficiency Unleashed: The Next-gen NXP i.MX 95 Applications Processor for Em...“Efficiency Unleashed: The Next-gen NXP i.MX 95 Applications Processor for Em...
“Efficiency Unleashed: The Next-gen NXP i.MX 95 Applications Processor for Em...
Edge AI and Vision Alliance
 
“Optimized Vision Language Models for Intelligent Transportation System Appli...
“Optimized Vision Language Models for Intelligent Transportation System Appli...“Optimized Vision Language Models for Intelligent Transportation System Appli...
“Optimized Vision Language Models for Intelligent Transportation System Appli...
Edge AI and Vision Alliance
 
“Image Signal Processing Optimization for Object Detection,” a Presentation f...
“Image Signal Processing Optimization for Object Detection,” a Presentation f...“Image Signal Processing Optimization for Object Detection,” a Presentation f...
“Image Signal Processing Optimization for Object Detection,” a Presentation f...
Edge AI and Vision Alliance
 
“Squeezing the Last Milliwatt and Cubic Millimeter from Smart Cameras Using t...
“Squeezing the Last Milliwatt and Cubic Millimeter from Smart Cameras Using t...“Squeezing the Last Milliwatt and Cubic Millimeter from Smart Cameras Using t...
“Squeezing the Last Milliwatt and Cubic Millimeter from Smart Cameras Using t...
Edge AI and Vision Alliance
 
"Maximize Your AI Compatibility with Flexible Pre- and Post-processing," a Pr...
"Maximize Your AI Compatibility with Flexible Pre- and Post-processing," a Pr..."Maximize Your AI Compatibility with Flexible Pre- and Post-processing," a Pr...
"Maximize Your AI Compatibility with Flexible Pre- and Post-processing," a Pr...
Edge AI and Vision Alliance
 
“Addressing Tomorrow’s Sensor Fusion and Processing Needs with Cadence’s Newe...
“Addressing Tomorrow’s Sensor Fusion and Processing Needs with Cadence’s Newe...“Addressing Tomorrow’s Sensor Fusion and Processing Needs with Cadence’s Newe...
“Addressing Tomorrow’s Sensor Fusion and Processing Needs with Cadence’s Newe...
Edge AI and Vision Alliance
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
Edge AI and Vision Alliance
 
“Silicon Slip-ups: The Ten Most Common Errors Processor Suppliers Make (Numbe...
“Silicon Slip-ups: The Ten Most Common Errors Processor Suppliers Make (Numbe...“Silicon Slip-ups: The Ten Most Common Errors Processor Suppliers Make (Numbe...
“Silicon Slip-ups: The Ten Most Common Errors Processor Suppliers Make (Numbe...
Edge AI and Vision Alliance
 
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
Edge AI and Vision Alliance
 
“How Arm’s Machine Learning Solution Enables Vision Transformers at the Edge,...
“How Arm’s Machine Learning Solution Enables Vision Transformers at the Edge,...“How Arm’s Machine Learning Solution Enables Vision Transformers at the Edge,...
“How Arm’s Machine Learning Solution Enables Vision Transformers at the Edge,...
Edge AI and Vision Alliance
 

More from Edge AI and Vision Alliance (20)

“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
 
“How to Run Audio and Vision AI Algorithms at Ultra-low Power,” a Presentatio...
“How to Run Audio and Vision AI Algorithms at Ultra-low Power,” a Presentatio...“How to Run Audio and Vision AI Algorithms at Ultra-low Power,” a Presentatio...
“How to Run Audio and Vision AI Algorithms at Ultra-low Power,” a Presentatio...
 
“Meeting the Critical Needs of Accuracy, Performance and Adaptability in Embe...
“Meeting the Critical Needs of Accuracy, Performance and Adaptability in Embe...“Meeting the Critical Needs of Accuracy, Performance and Adaptability in Embe...
“Meeting the Critical Needs of Accuracy, Performance and Adaptability in Embe...
 
“Build a Tiny Vision Application in Minutes with the Edge App SDK,” a Present...
“Build a Tiny Vision Application in Minutes with the Edge App SDK,” a Present...“Build a Tiny Vision Application in Minutes with the Edge App SDK,” a Present...
“Build a Tiny Vision Application in Minutes with the Edge App SDK,” a Present...
 
“The Importance of Memory for Breaking the Edge AI Performance Bottleneck,” a...
“The Importance of Memory for Breaking the Edge AI Performance Bottleneck,” a...“The Importance of Memory for Breaking the Edge AI Performance Bottleneck,” a...
“The Importance of Memory for Breaking the Edge AI Performance Bottleneck,” a...
 
“Intel’s Approach to Operationalizing AI in the Manufacturing Sector,” a Pres...
“Intel’s Approach to Operationalizing AI in the Manufacturing Sector,” a Pres...“Intel’s Approach to Operationalizing AI in the Manufacturing Sector,” a Pres...
“Intel’s Approach to Operationalizing AI in the Manufacturing Sector,” a Pres...
 
“Transforming Enterprise Intelligence: The Power of Computer Vision and Gen A...
“Transforming Enterprise Intelligence: The Power of Computer Vision and Gen A...“Transforming Enterprise Intelligence: The Power of Computer Vision and Gen A...
“Transforming Enterprise Intelligence: The Power of Computer Vision and Gen A...
 
“Challenges and Solutions of Moving Vision LLMs to the Edge,” a Presentation ...
“Challenges and Solutions of Moving Vision LLMs to the Edge,” a Presentation ...“Challenges and Solutions of Moving Vision LLMs to the Edge,” a Presentation ...
“Challenges and Solutions of Moving Vision LLMs to the Edge,” a Presentation ...
 
“Implementing Transformer Neural Networks for Visual Perception on Embedded D...
“Implementing Transformer Neural Networks for Visual Perception on Embedded D...“Implementing Transformer Neural Networks for Visual Perception on Embedded D...
“Implementing Transformer Neural Networks for Visual Perception on Embedded D...
 
“A Cutting-edge Memory Optimization Method for Embedded AI Accelerators,” a P...
“A Cutting-edge Memory Optimization Method for Embedded AI Accelerators,” a P...“A Cutting-edge Memory Optimization Method for Embedded AI Accelerators,” a P...
“A Cutting-edge Memory Optimization Method for Embedded AI Accelerators,” a P...
 
“Efficiency Unleashed: The Next-gen NXP i.MX 95 Applications Processor for Em...
“Efficiency Unleashed: The Next-gen NXP i.MX 95 Applications Processor for Em...“Efficiency Unleashed: The Next-gen NXP i.MX 95 Applications Processor for Em...
“Efficiency Unleashed: The Next-gen NXP i.MX 95 Applications Processor for Em...
 
“Optimized Vision Language Models for Intelligent Transportation System Appli...
“Optimized Vision Language Models for Intelligent Transportation System Appli...“Optimized Vision Language Models for Intelligent Transportation System Appli...
“Optimized Vision Language Models for Intelligent Transportation System Appli...
 
“Image Signal Processing Optimization for Object Detection,” a Presentation f...
“Image Signal Processing Optimization for Object Detection,” a Presentation f...“Image Signal Processing Optimization for Object Detection,” a Presentation f...
“Image Signal Processing Optimization for Object Detection,” a Presentation f...
 
“Squeezing the Last Milliwatt and Cubic Millimeter from Smart Cameras Using t...
“Squeezing the Last Milliwatt and Cubic Millimeter from Smart Cameras Using t...“Squeezing the Last Milliwatt and Cubic Millimeter from Smart Cameras Using t...
“Squeezing the Last Milliwatt and Cubic Millimeter from Smart Cameras Using t...
 
"Maximize Your AI Compatibility with Flexible Pre- and Post-processing," a Pr...
"Maximize Your AI Compatibility with Flexible Pre- and Post-processing," a Pr..."Maximize Your AI Compatibility with Flexible Pre- and Post-processing," a Pr...
"Maximize Your AI Compatibility with Flexible Pre- and Post-processing," a Pr...
 
“Addressing Tomorrow’s Sensor Fusion and Processing Needs with Cadence’s Newe...
“Addressing Tomorrow’s Sensor Fusion and Processing Needs with Cadence’s Newe...“Addressing Tomorrow’s Sensor Fusion and Processing Needs with Cadence’s Newe...
“Addressing Tomorrow’s Sensor Fusion and Processing Needs with Cadence’s Newe...
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
 
“Silicon Slip-ups: The Ten Most Common Errors Processor Suppliers Make (Numbe...
“Silicon Slip-ups: The Ten Most Common Errors Processor Suppliers Make (Numbe...“Silicon Slip-ups: The Ten Most Common Errors Processor Suppliers Make (Numbe...
“Silicon Slip-ups: The Ten Most Common Errors Processor Suppliers Make (Numbe...
 
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
 
“How Arm’s Machine Learning Solution Enables Vision Transformers at the Edge,...
“How Arm’s Machine Learning Solution Enables Vision Transformers at the Edge,...“How Arm’s Machine Learning Solution Enables Vision Transformers at the Edge,...
“How Arm’s Machine Learning Solution Enables Vision Transformers at the Edge,...
 

Recently uploaded

[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
Kief Morris
 
(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...
(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...
(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...
Priyanka Aash
 
Introduction-to-the-IAM-Platform-Implementation-Plan.pptx
Introduction-to-the-IAM-Platform-Implementation-Plan.pptxIntroduction-to-the-IAM-Platform-Implementation-Plan.pptx
Introduction-to-the-IAM-Platform-Implementation-Plan.pptx
313mohammedarshad
 
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Muhammad Ali
 
EuroPython 2024 - Streamlining Testing in a Large Python Codebase
EuroPython 2024 - Streamlining Testing in a Large Python CodebaseEuroPython 2024 - Streamlining Testing in a Large Python Codebase
EuroPython 2024 - Streamlining Testing in a Large Python Codebase
Jimmy Lai
 
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptxDublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Kunal Gupta
 
Salesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot WorkshopSalesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot Workshop
CEPTES Software Inc
 
Three New Criminal Laws in India 1 July 2024
Three New Criminal Laws in India 1 July 2024Three New Criminal Laws in India 1 July 2024
Three New Criminal Laws in India 1 July 2024
aakash malhotra
 
leewayhertz.com-AI agents for healthcare Applications benefits and implementa...
leewayhertz.com-AI agents for healthcare Applications benefits and implementa...leewayhertz.com-AI agents for healthcare Applications benefits and implementa...
leewayhertz.com-AI agents for healthcare Applications benefits and implementa...
alexjohnson7307
 
Calgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptxCalgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptx
ishalveerrandhawa1
 
Choose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presenceChoose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presence
rajancomputerfbd
 
How to build a generative AI solution A step-by-step guide (2).pdf
How to build a generative AI solution A step-by-step guide (2).pdfHow to build a generative AI solution A step-by-step guide (2).pdf
How to build a generative AI solution A step-by-step guide (2).pdf
ChristopherTHyatt
 
Acumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdf
Acumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdfAcumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdf
Acumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdf
BrainSell Technologies
 
find out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challengesfind out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challenges
huseindihon
 
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
Priyanka Aash
 
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
maigasapphire
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 
Google I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged SlidesGoogle I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged Slides
Google Developer Group - Harare
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
Emerging Tech
 
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc
 

Recently uploaded (20)

[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
 
(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...
(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...
(CISOPlatform Summit & SACON 2024) Keynote _ Power Digital Identities With AI...
 
Introduction-to-the-IAM-Platform-Implementation-Plan.pptx
Introduction-to-the-IAM-Platform-Implementation-Plan.pptxIntroduction-to-the-IAM-Platform-Implementation-Plan.pptx
Introduction-to-the-IAM-Platform-Implementation-Plan.pptx
 
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
 
EuroPython 2024 - Streamlining Testing in a Large Python Codebase
EuroPython 2024 - Streamlining Testing in a Large Python CodebaseEuroPython 2024 - Streamlining Testing in a Large Python Codebase
EuroPython 2024 - Streamlining Testing in a Large Python Codebase
 
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptxDublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
 
Salesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot WorkshopSalesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot Workshop
 
Three New Criminal Laws in India 1 July 2024
Three New Criminal Laws in India 1 July 2024Three New Criminal Laws in India 1 July 2024
Three New Criminal Laws in India 1 July 2024
 
leewayhertz.com-AI agents for healthcare Applications benefits and implementa...
leewayhertz.com-AI agents for healthcare Applications benefits and implementa...leewayhertz.com-AI agents for healthcare Applications benefits and implementa...
leewayhertz.com-AI agents for healthcare Applications benefits and implementa...
 
Calgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptxCalgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptx
 
Choose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presenceChoose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presence
 
How to build a generative AI solution A step-by-step guide (2).pdf
How to build a generative AI solution A step-by-step guide (2).pdfHow to build a generative AI solution A step-by-step guide (2).pdf
How to build a generative AI solution A step-by-step guide (2).pdf
 
Acumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdf
Acumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdfAcumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdf
Acumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdf
 
find out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challengesfind out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challenges
 
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
 
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 
Google I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged SlidesGoogle I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged Slides
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
 
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
 

“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation from Network Optix

  • 1. Building and Scaling AI Applications with the Nx AI Manager Robin van Emden Senior Director of Data Science Network Optix
  • 2. 2 © 2024 Network Optix Network Optix ● Founded in 2010 with the aim of creating a platform for enterprise video management. ● Offices in Los Angeles, Portland, London, Taipei, Adelaide, Belgrade. ● Over 4 million connected video streaming devices in more than 150 countries ● Recently acquired Scailable AI, which adds Amsterdam 
  • 3. 3 © 2024 Network Optix Network Optix ● Founded in 2010 with the aim of creating a platform for enterprise video management. ● Offices in Los Angeles, Portland, London, Taipei, Adelaide, Belgrade. ● Over 4 million connected video streaming devices in more than 150 countries ● Recently acquired Scailable AI, which adds Amsterdam 
  • 4. 4 © 2024 Network Optix Hard Problem: Video
  • 5. Nx Toolkit Makes Video Solutions at Scale Easy 5 © 2024 Network Optix Network Optix Toolkit is a solution that handles the complexities of edge video, allowing you to concentrate on building your application. Device / Stream Discovery Storage Management Decoding / Visualization System Scalability Enterprise Scalability Cyber Security Video / Metadata Capture OS / Hardware Support Platform Extensibility Usability / User Experience
  • 6. Nx Toolkit Makes Video Solutions at Scale Easy 6 © 2024 Network Optix Network Optix Toolkit offers partially open-source tools and libraries to build custom video solutions. It provides server, desktop, mobile applications, and cloud services.
  • 7. Nx Toolkit Makes Video Solutions at Scale Easy 7 © 2024 Network Optix Network Optix Toolkit offers partially open-source tools and libraries to build custom video solutions. It provides server, desktop, mobile applications, and cloud services.
  • 8. 8 © 2024 Network Optix Hard Problem: AI
  • 9. Creating AI applications at Scale Is Hard 9 © 2024 Network Optix These days, there are numerous user- friendly tools available for training AI models… Data scientists use their preferred tools to train AI models on laptops, in data centers, and in the cloud. ... but building an AI solution for edge devices still takes a lot of time and effort. • Diverse edge AI accelerators: GPU, NPU, DPU. • Input and output interfacing, edge video. • Data pre- and post-processing. • Embedded engineering.
  • 10. Nx AI Manager Makes AI Solutions at Scale Easy 10 © 2024 Network Optix Train AI model Upload to Nx Cloud Deploy AI model to Device(s) with Nx AI Manager Nx Client, Nx Mobile, Nx Web Nx Meta Server Nx AI manager
  • 11. Nx AI Manager Makes AI Solutions at Scale Easy 11 © 2024 Network Optix Train AI model Upload to Nx Cloud Deploy AI model to Device(s) with Nx AI Manager Nx Client, Nx Mobile, Nx Web Nx Meta Server Nx AI manager
  • 12. Nx AI Manager Makes AI Solutions at Scale Easy 12 © 2024 Network Optix Train AI model Upload to Nx Cloud Deploy AI model to Device(s) with Nx AI Manager Nx Client, Nx Mobile, Nx Web Nx Meta Server Nx AI manager
  • 13. Nx AI Manager Makes AI Solutions at Scale Easy 13 © 2024 Network Optix Train AI model Upload to Nx Cloud Deploy AI model to Device(s) with Nx AI Manager Nx Client, Nx Mobile, Nx Web Nx Meta Server Nx AI manager
  • 14. Nx AI Manager -> Open Ai Accelerator eXchange [OAAX] 14 © 2024 Network Optix NX Cloud AI Model Inference Engine Using OAAX you can use any hardware accelerator effortlessly to deploy your edge AI models. Convert models in cloud Standardized interface to native accelerator library https://github.com/OAAX-standard/OAAX
  • 15. Nx AI Manager -> Open Ai Accelerator eXchange [OAAX] 15 © 2024 Network Optix NX Cloud AI Model Inference Engine Using OAAX you can use any hardware accelerator effortlessly to deploy your edge AI models. Convert models in cloud Standardized interface to native accelerator library https://github.com/OAAX-standard/OAAX
  • 16. Nx AI Manager Allows for Custom Pipelines 16 © 2024 Network Optix Preprocessing Inference Engine Postprocessing https://github.com/scailable/sclbl-integration-sdk Custom postprocessors Preprocessors Custom inference engine https://nx.docs.scailable.net/oaax-implementation
  • 17. 17 © 2024 Network Optix Deploying AI Models to Heterogeneous Devices
  • 18. Step 1: Edge Devices, IP Cameras, and a Client Device 18 © 2024 Network Optix CPU AARCH64 X86_64 AARCH64 X86_64 XPU ACCELERATOR CPU SIMD CPU SIMD NVIDIA ORIN HAILO-8
  • 19. Step 2: Install an Nx Client and Register in the Nx Cloud 19 © 2024 Network Optix > sudo apt install -y ./metavms-client-6.x.x.x-linux_x.deb (1) https://meta.nxvms.com/download (2) https://meta.nxvms.com
  • 20. Step 3: Install Nx Server with NX AI Manager 20 © 2024 Network Optix > sudo apt install -y ./metavms-server-6.x.x.x-linux_x.deb (1) https://meta.nxvms.com/download CPU AARCH64 X86_64 AARCH64 X86_64 XPU ACCELERATOR CPU SIMD CPU SIMD NVIDIA ORIN HAILO-8 INFERENCE RUNTIME LIBRARY ONNXRuntime with ACL ONNXRuntime with oneDNN, Intel OpenVINO NVIDIA CUDA NVIDIA TensorRT HAILORT
  • 21. Step 4: Train, Convert, Deploy and Run an AI Model 21 © 2024 Network Optix For instance: https://nx.docs.scailable.net/for-data-scientists/importing-models/from-teachable-machine
  • 22. Step 4: Train, Convert, Deploy and Run an AI Model 22 © 2024 Network Optix Nx AI Cloud https://admin.sclbl.nxvms.com/
  • 23. Step 4: Train, Convert, Deploy and Run an AI Model 23 © 2024 Network Optix Nx AI Cloud https://admin.sclbl.nxvms.com/
  • 24. Step 4: Train, Convert, Deploy and Run an AI Model 24 © 2024 Network Optix Nx Client https://github.com/networkoptix
  • 25. 25 © 2024 Network Optix Let Me Show You How: Live Coding Session
  • 26. Step 4: Live Coding Sessions at Our Booth 26 © 2024 Network Optix Booth #304
  • 27. 27 © 2024 Network Optix Takeaway
  • 28. 28 © 2024 Network Optix Building an AI + Video Application? Build on Nx EVOS • Simplified AI Deployment and Management: Network Optix streamlines the implementation, deployment, and management of AI models across edge devices, allowing developers to focus on creating innovative Vision AI solutions. • Comprehensive Nx Meta Platform: Nx Meta offers a full suite of tools through the Nx Toolkit, addressing video development challenges, empowering efficient and effective distributed video application development. • Versatile AI Model Integration: The Nx AI Manager supports the entire AI model lifecycle, from training to real-time inference enabling seamless integration of custom AI models and real-time visualization within the Nx Client.
  • 29. Thank you! 2024 Embedded Vision Summit Scaling Vision-Based Edge AI Solutions: From Prototype to Global Deployment Maurits Kaptein General Session — Wed, May 22 at 10:00 am Nx EVOS: A New Enterprise Operating System for Video and Visual AI Nathan Wheeler Exhibit Hall—ET-2 Thur, May 23 at 12:00 pm Visit us at our booth — Booth #304 29 © 2024 Network Optix Continue exploring Nx Meta and more Nx AI Plugin Documentation https://nx.docs.scailable.net/ Nx Meta Developer Portal https://meta.nxvms.com/ Nx tools: https://www.networkoptix.com/nx-meta OAAX github https://github.com/oaax-standard