Presentation from NET New Electronic Technology GmbH on machine vision at the UKIVA Machine Vision Conference 2018.

1. New potentials of
embedded vision
systems in industrial
inspection through
smart architectures
T. Miller | May 16, 2018

2. Copyright © 2018 NET New Electronic Technology GmbH
• Develop and offer smart vision solutions:
industrial & medical applications
• Consultancy: application-specific demand
• Growing demand for embedded vision
• Sustainable technological &
market trends
• Product strategy:
Bringing visual intelligence to cameras
Radar-aided 1D vision
In-camera distortion
correction
360° analysis in single
image
Custom MIPIM interface
andmore…
NET New Electronic Technology since 1996

3. Copyright © 2018 NET New Electronic Technology GmbH
Agenda
TOPICS
• Developments: from PC-based systems to embedded vision
• Matching vision solution and strategy
• Successful approaches of solution providers
• Key findings and potentials of embedded solutions

4. Copyright © 2018 NET New Electronic Technology GmbH
Classes of Vision Architectures
• PC-centered, 1:x
• Conventional Image Processing Chain
• The PC does the job
• Decentralized
• Modular
• Stand-alone, networks x:x
• Change of image processing chain
COMPUTER VISION
PC-based Vision Systems
EMBEDDED VISION
Dedicated image processing units
for Vision Systems

5. Copyright © 2018 NET New Electronic Technology GmbH
• Digital transformation
• Communication standards
• Image processing units
• IP functions
• Image sensors
• Form factors
• Custom vs. standard
• Automation
• Buy or make
• Market strategy
• Product cycles
Learning from Developments
TECHNOLOGY MARKET DECISION VARIABLES
• Standards
• Size
• Adaption
• Image processing
• Performance
• Price & availability
• Compliancy

6. Copyright © 2018 NET New Electronic Technology GmbH
TECHNOLOGY
R&D
Engineering, IT
Learning from Developments
MATCH STRATEGY & DECISION VARIABLES
Market offering/demand
Solution approach
Competitive advantages
First mover / innovator
• Standards
• Size
• Adaption
• Image processing
• Performance
• Price & availability
• Compliancy

7. Copyright © 2018 NET New Electronic Technology GmbH
The Image Processing Value Chain as Analytic Tool
Meet complexity with „services“
→ optimal image processing value chain
• Market demand
• Competitive advantages
• Solution approach
• First mover / innovator

8. Copyright © 2018 NET New Electronic Technology GmbH
PART INSPECTION WEB INSPECTION
Solution Approaches
Meet complexity with „services“
→ optimal image processing value chain
• Market demand
• Competitive advantages
• Solution approach
• First mover / innovator
INLINE INSPECTION CHECKOUT SYSTEMS

9. Copyright © 2018 NET New Electronic Technology GmbH
PART INSPECTION PC-based Vision
• Inline and random inspection of connectors
• Process reliability, product quality
• Geometry, order, positioning, orientation
Evaluation
• From era with low performing embedded IP units
• Architecture solves task without drawbacks
• Market: advanced entry inspection
• Solution: camera-embedded functions possible
with running system
Never change a running System – Really?

10. Copyright © 2018 NET New Electronic Technology GmbH
Efficiency on the spot
INLINE INSPECTION Embedded Vision
Hybrid detection of both data matrix code
and labels on cans for maximal reliability
→ decentralized IP: machine control
Evaluation
• Compact solution for inspection of more
than 800 completely different labels
• High frame rates possible
• Real-time without additional computer

11. Copyright © 2018 NET New Electronic Technology GmbH
CHECKOUT SYSTEMS (CONCEPT)
Deep Learning for max. Recognition
COMPUTER
alternative: compact camera(s) + PC
CORSIGHT • weight
• product information
Embedded Vision
• Checkout system for fruit and vegetables
• Recognition of ever changing object
characteristics
Evaluation
• freely-configurable by solution provider
• maximum recognition in comparison..
• only one training station required
• quick software distribution via safe
company network

12. Copyright © 2018 NET New Electronic Technology GmbH
WEB INSPECTION
(3D LASER TRIANGULATION )
Focus on Core Competencies
Embedded Vision
• Textile cutting machines, print inspection
• Quality finishing, surface control, 2D /3D
• 2D /3D, markings, color, position, orientation, height
Evaluation
• Decentralized IP solves effectively data processing
of real-time multi-camera application
• Protection of IP cores, cost-effective
• Market: maximal application flexibility
→ adaption of own functions, scalability

13. Copyright © 2018 NET New Electronic Technology GmbH
3D Laser Triangulation with GigEPRO
Before: ROI: 100 x 1600 Pixel
Frame rate: 500 fps
Dynamic Range: 8 bit (RGB)
→ 0,64 Gb/s
After: ROI: 2 x 1600 (two lines)
Frame rate: 500 fps
Dynamic Range: 8 bit (RGB)
→ 0,0128 Gb/s

14. Copyright © 2018 NET New Electronic Technology GmbH
The Open Camera Concept
METHOD & TOOLBOX FOR SOLUTION PROVIDERS
• Application-specific functionality can be expanded and adapted
• Application solution remains owner
• Solution approach: toolbox that enables to configure and adapt
image processing functions (Open Camera Concept)
• Solution provider can design the workflow by himself
• Result: application advantages lead to new benefits for target market

15. Copyright © 2018 NET New Electronic Technology GmbH
IMAGING
IMAGING
CORE COMPETENCE OF NET
CUSTOM
MODULE
GIGE
VISION
HOST PC &
CUSTOM APP
MACHINE
ERP
CUSTOM
MODULE
CUSTOM APPLICATION
MACHINE
ERP
ALL-IN-ONECOMPACT
CAMERA
Vision Workflow - Open Camera Concept

16. Copyright © 2018 NET New Electronic Technology GmbH
The running system
• The PC does the job
• Application-wise sufficient
• +EV: market potentials
Efficiency on the Spot
• Compact solution: custom
recognition, machine
control
• Hi-speed + real-time
without additional
resources
Core Competencies
• Decentralized IP as
solution: multi-camera
application with high
bandwidth, protection
of IP cores, cost-effective
• Maximal flexibility
Breakdown of Solution Approaches
PART INSPECTION WEB INSPECTION INLINE INSPECTION CHECKOUT SYSTEMS
Deep Learning: max. Recognition
• Freely-configurable by solution
provider
• Maximum recognition in
comparison to non-AI
• Only one training station
required + quick distribution

17. Copyright © 2018 NET New Electronic Technology GmbH
Implications for the Optimal Vision Architecture
KEY FINDINGS AND POTENTIALS OF EMBEDDED SOLUTIONS
• Knowledge of decision variables as necessary condition for assessment
• Consulting important part of the solution as standard would not do (here)
• Image processing value chain: analytic tool to lift competitive advantages
• Existing IP cores with EV: market development as to improved positioning
• Vision follows Strategy: the right vision system to be individually answered
→ existing tool: Open Camera Concept