For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2020/11/how-to-create-your-own-ai-enabled-camera-solution-in-days-a-presentation-from-ids-imaging-development-systems/ For more information about edge AI and computer vision, please visit: https://www.edge-ai-vision.com Carsten Traupe, Director of Product Management at IDS Imaging Development Systems, presents the “How to Create Your Own AI-Enabled Camera Solution in Days” tutorial at the September 2020 Embedded Vision Summit. Cameras coupled with AI can solve numerous real-world problems. But developing an AI camera solution can be a complex and time-consuming undertaking, especially for teams that lack experience in topics like training deep neural networks. IDS Imaging Development Systems, a leader in imaging for over 20 years, has developed the IDS NXT ocean system to empower teams to quickly and easily create custom AI camera solutions for specific applications. One key element of the IDS NXT ocean system is a streamlined cloud-based training system called IDS NXT lighthouse. With IDS NXT lighthouse, your first fully trained CNN solution is ready within a few hours, with no need to select, purchase or install training hardware or software. In this presentation, Traupe presents the key elements of the IDS NXT ocean system and the associated workflow, which together provide everything you need to quickly and easily create your own inference camera.

1. © 2020 IDS Imaging Systems Development
How to Create Your Own AI-Enabled
Camera Solution in Days
Carsten Traupe
Director Product Management
September 2020

2. © 2020 IDS Imaging Systems Development
IDS
2
„It‘s so easy!“
Simplicity means efficiency.
ABOUT US
PHILOSOPHY

3. © 2020 IDS Imaging Systems Development 3
What do
a car and a smartphone
have in common?
Everybody can operate one,
but very few people can develop one!

4. © 2020 IDS Imaging Systems Development
Agenda
➢ NXT ocean at a glance
➢ Why? “AI everywhere”
➢ What? Easy-to-use Edge AI Vision System
➢ Inside? Technical Information
➢ Examples? Case studies
➢ Outlook? Roadmap
➢ How? Design-in-Kit for Trials
4

5. © 2020 IDS Imaging Systems Development
NXT ocean … at a glance
5
Capture Annotation Training CNNs Inference
IDS NXT crawler
Image Capturing
Software
IDS NXT lighthouse
Cloud-based Annotation & Training System
IDS NXT inference cameras
Edge AI Vision Sensor
NXT rio
NXT rome
NXT ocean
Complete
Edge AI Vision
Solution

6. © 2020 IDS Imaging Systems Development
AI everywhere: Edge AI Computer Vision
6
AI - Why?
• Extend Computer Vision beyond
traditional algorithms
Edge - Why?
• Bandwidth
• Latency
• Privacy
Embedded Vision - Why?
• Compact
• Cost effective
• Vision Sensor paradigm
ATTRACTIVE MARKET OPPORTUNITIES
• Overall market of AI in computer vision at USD 3.62 billion in
2018 and expected for USD 25.32 billion by 2023 at a CAGR of
47.54%
• Launches, partnerships and collaborations by large firms, such
as NVIDIA Corporation (US) and Qualcomm Technologies, Inc.
(US), provide key opportunities in the AI in computer vision
market
• The market growth is attributed to the growing demand for
edge computing in mobile devices
• Development of machine learning in vision technology creates
several opportunities for the AI in computer vision market
Source: Expert Interviews and MarketsandMarkets Analysis
382 – Image Analysis
705 – Data processing: financial, business practice, management,
or cost/price determination
704 – Data processing: Speech, Linguistics, Language Translation,
Auto (de)compression
706 – Data processing: Artificial Intelligence
348 – Television
702 – Data processing: Vehicles, Navigation and Relative Location
600 – Surgery
123 – Internal Combustion Engines
AI Patents by Patent Class
10000
0

7. © 2020 IDS Imaging Systems Development
• Integration Factory Automation/ IIoT
• Pre-/ Post-processing traditional
Algorithms
• Simple Annotation
• CNN Quality Control
• Augmentation
• AI optimization (Pruning)
• Single Device Image Capture & Inference
• In-Camera CNN Simulation
• Industrial Vision equipment (lighting, trigger)
Additional
benefits
✓
Features
Easy-to-Use Edge AI
7
Cloud-based
CNN training &
annotation
Edge-AI
Embedded Vision
Sensor
✓ No Hardware Selection Hassle
✓ No Investment in Hardware
✓ No IT Admin/ Maintenance costs
✓ No Hardware Obsolescence
✓ In-/ At-line capable Form Factor
✓ Consistent for Training & Inference
✓ Direct Interface to SPS, no Vision PC
✓ Complementary Algorithms complete
Image Evaluation Pipeline
✓ Hardware tailored CNN Acceleration
Benefits

8. © 2020 IDS Imaging Systems Development
Easy-to-Use Edge AI
8
Turnkey System
AI Engineer ONNX
3rd party AI toolchain
Capture Annotation Training CNNs Inference
IDS NXT rio/ rome
Edge AI Vision Sensor
IDS NXT lighthouse
Cloud-based Annotation & Training system
IDS NXT crawler
Image Capturing Software
NXT ocean
Complete
Edge AI Vision
Solution
CNNImages

9. © 2020 IDS Imaging Systems Development
Technical Background Information
9
DL functions
• MobileNet V1/2
SqueezeNet
MnasNet V1
• CNN input resolution
224 x 224 Px, color & mono
• Classifier & Object Detector
up to 1000 results
• Live-switchable CNN models from RAM
• Built-in Pruning & Augmentation
• HW-optimized “Deep Ocean Core”
NXT inference cameras
• Industrial C-Mount Lens
• 1.6/ 3.1/ 5.0/ 6.4 MPx color & mono
(IMX273/ 265/264/ 178)
• IP30 (NXT rio)
IP67 (NXT rome)
• REST/ OPC UA interface
• Up to 25fps (incl. inference)
• GenICam-like Camera Control

10. © 2020 IDS Imaging Systems Development
Case Studies
10
Food Inspection Packaging Inspection Horticulture Automation

11. © 2020 IDS Imaging Systems Development
Availability
11
IDS Next ocean 1.0
launched 2019
IDS Next ocean 1.1
launches Q4 2020
IDS Next ocean 2.0
in preparation
DL/ CNN functions • Classification Single-RoI
• Classification Multi-RoI
• Object Detection
• Heatmaps
• Anomaly Detection
• ONNX interface
• Auto Labeling
• Continuous Training
Workflow
Solution Integration
Factory Automation,
IIOT
• REST
• Digital I/Os
• RS232
• OPC UA
• Customer App
Development C++
• ProfiNet
• Customer App
Development Python
Others
• Languages: English,
German
• Languages: French,
Japanese
• Team Collaboration in IDS
lighthouse

12. © 2020 IDS Imaging Systems Development
For trials … NXT ocean Design-In Kit
12
Ships from stock, includes
• 1.6MP NXT rio inference camera (IMX265)
incl. lens
• 3 month trial license for NXT lighthouse cloud based
trainings system
• All required accessories (PSU, cables, mounting plate)
• Software (e.g. NXT Crawler) downloadable from Website
• Article No. AS00029 @ 4100€/ 4920$

13. © 2020 IDS Imaging Systems Development
Summary & Take-away
NXT ocean … Edge-AI-Vision solution – “Easy-to-Use“
➢ Compact industry-camera like housing
mount, interface, IP rating
➢ Seamlessly integrated system components
friction less AI end-to-end workflow,
ready for first inference within one hour
➢ Cloud-based training system
no hardware selection, -cost, -obsolescence
use case tailored GUI, optimized CNNs
➢ Integration into Factory Automation systems
REST , OPC UA, ProfiNet
➢ Interface for 3rd party CNNs
ONNX
13

14. © 2020 IDS Imaging Systems Development
Thank you! … Questions?
14
Carsten Traupe
Director Product Management
IDS Imaging Development Systems GmbH
Dimbacher Str. 6-8, D-74182 Obersulm, Germany
Email: c.traupe@ids-imaging.de
Web: www.ids-imaging.com
For further details:
https://en.ids-imaging.com/ids-nxt-ocean.html