SlideShare a Scribd company logo
1 of 32
Download to read offline
© 2020 XIMEA Corp
High-Bandwidth
Multicamera Systems
with PCIe Backbone:
Snapshot and Outlook to
Technologies and Applications
Kevin Toerne
XIMEA Corp
September 2020
© 2020 XIMEA Corp
Content
• XIMEA Company Overview
• Cameras & Embedded Systems
• Challenges & Applications
• Existing imager interfaces
• PCIe does it all
© 2020 XIMEA Corp
XIMEA: SRO, GmbH, Corp
XIMEA GmbH
Germany, Münster
Management, Marketing, International
Sales
XIMEA s.r.o.
Slovakia, Marianka
Research and Development,
Production
XIMEA Corp.
USA, Denver
Sales South and North America
© 2020 XIMEA Corp
Company facts - What we do
• Development, manufacturing and support for ultimate imaging and vision products
• All tooling capabilities in-house
• Standard products and custom designs
• Increasing general success through sustainable partnerships
© 2020 XIMEA Corp
•Company Products
xiD xiRAY xiC
xiSPECxiQxiJ xiMU
xiXxiB
xiB-64
© 2020 XIMEA Corp
•Customers
© 2020 XIMEA Corp
Embedded & Multi-Camera
Systems
© 2020 XIMEA Corp
Applications
© 2020 XIMEA Corp
Aerial/orbitalStreet Level
© Cyclomedia
Mapping/Survey – Autonomous Vehicles
• High resolution
• High speed
• Real time processing
or saving
• Multi-camera
• Small components
© 2020 XIMEA Corp
Facebook Surround 360Nokia Ozo XIMEA 360° Demo
Augmented & Virtual Reality
• High resolution
• High speed
• Multi-camera
• Small components
• Power consumption
and dissipation
© 2020 XIMEA Corp
Face CaptureMotion Capture
© USC, Institute for Creative Technologies
Performance Capture
• High resolution
• High speed
• Multi-camera
• Small components
• Long cables
© 2020 XIMEA Corp
Wearables
• High speed
• Multi-camera
• NIR + color
• XDR
• Small components
• Real time processing
© 2020 XIMEA Corp
• Bandwidth
• Multi camera systems
• High resolution, high frame rate
• Cabling
• Long distances
• Size
• Smaller is always better
• Synchronization
• Processing
• Real time
• Saving
Challenges
© 2020 XIMEA Corp
Existing Interfaces
© 2020 XIMEA Corp
Existing camera interfaces
• Ethernet
• USB
• Camera Link / CoaXPress
• PCI Express
© 2020 XIMEA Corp 16
Ethernet
• Pros
• Industry standard cables &
software (GigE)
• Hubs & switches easily
available
• Long cable lengths
• Inexpensive
• Cons
• Bandwidth is low
© 2020 XIMEA Corp 17
USB
• Pros
• Industry standard cables
• Hubs easily available
• Better-ish bandwidth
• Long-ish cable lengths
• Inexpensive
• Cons
• Multi-camera systems require
multiple controllers
• Not all controllers compatible
with all cameras
© 2020 XIMEA Corp 18
• Pros
• Simple cables
• Long cable lengths
• High bandwidth
• Expandable to achieve
higher bandwidth
Camera Link & CoaXPress
• Cons
• Cameras require interface
cards
• Price
© 2020 XIMEA Corp 19
• Pros
• Interface card is simply a cable
adapter – nearly all computers
have a PCIe backbone in place
• Highest bandwidth
• Single cable up to 64Gbps
• No latency
• Direct to RAM
• Long cable lengths
• Cons
• Price
• Cabling is non standard
Peripheral Component Interconnect Express (PCIe)
© 2020 XIMEA Corp
Computing
20
© 2020 XIMEA Corp 21
• Must be small
• Real time processing
• AI
• Saving data at high data rates is often
non-trivial in execution
Processing/Saving
© 2020 XIMEA Corp 22
• NUC platform
• Often limited in PCIe connectivity
• COM Express
• Much better for custom developments
Intel products
© 2020 XIMEA Corp 23
• High processing capability
• Variable PCIe bus input
• Nano has only 2 lanes exposed
• Jetson has 4
• Xavier has 16
• Already a new one on the way
Nvidia computing
© 2020 XIMEA Corp 24
• Allow custom implementation of
computing platforms
• PCIe, USB interfaces
• XIMEA + 3rd party suppliers
Carrier boards
© 2020 XIMEA Corp
PCIe
25
© 2020 XIMEA Corp 26
• Allows multiple cameras to input data
through one cable/connection
PCIe Switch for multi-camera systems
© 2020 XIMEA Corp 27
PCIe Switch
XIMEA Standard switches
XIMEA 360 switch
© 2020 XIMEA Corp 28
• Features
• Multiple camera connections
• PCIe (with switch)
• USB
• Peripheral interfaces
• HDMI
• USB (2&3)
• Wifi
• GPIO
• IMU
XIMEA XEC2 Jetson Carrier board
© 2020 XIMEA Corp
• Minimizes latency and CPU overhead
• Seamlessly delivers image data directly to the
host memory via Scatter/Gather DMA
• Supports distances from millimeters to
hundreds of meters
• Aggregation of multiple imagers into one
wire/fiber
• Upcoming PCIe generation(s) for still higher
speeds
• Ultimate Camera Interface for high throughput
sensors and multi camera systems
29
PCIe does it all!
© 2020 XIMEA Corp
• Gen4 is readily available in PCs
• 16Gbps per lane
• Faster sensors always coming out
• New cabling utilizing Firefly
30
Future directions
© 2020 XIMEA Corp 31
• xiX infographics
https://www.ximea.com/files/brochures/xiX%20Infographic.pdf
• xiX brochure
https://www.ximea.com/files/brochures/xiX-OEM-cameras-for-integration-2017-brochure-
HQ.pdf
• xiSwitch infographics
https://www.ximea.com/files/brochures/xiSWITCH%20Infographic.pdf
• XIMEA Embedded vision home
https://www.ximea.com/embedded-vision/systems
Further information
© 2020 XIMEA Corp 32
Thanks for your attention!
Kevin Toerne
Kevin.Toerne@ximea.com

More Related Content

Similar to “High-Bandwidth Multicamera Systems with PCIe Backbone: Snapshot and Outlook on Technologies and Applications,” a Presentation from XIMEA

MIPI DevCon 2021: Meeting the Needs of Next-Generation Displays with a High-P...
MIPI DevCon 2021: Meeting the Needs of Next-Generation Displays with a High-P...MIPI DevCon 2021: Meeting the Needs of Next-Generation Displays with a High-P...
MIPI DevCon 2021: Meeting the Needs of Next-Generation Displays with a High-P...MIPI Alliance
 
"Developing Real-time Video Applications with CoaXPress," A Presentation from...
"Developing Real-time Video Applications with CoaXPress," A Presentation from..."Developing Real-time Video Applications with CoaXPress," A Presentation from...
"Developing Real-time Video Applications with CoaXPress," A Presentation from...Edge AI and Vision Alliance
 
Sloc product brief
Sloc product briefSloc product brief
Sloc product briefmilarisaumil
 
NXP FRDM-K64F Platform with ARM mbed Demo - Edinburgh 2016 Workshop
NXP FRDM-K64F Platform with ARM mbed Demo - Edinburgh 2016 WorkshopNXP FRDM-K64F Platform with ARM mbed Demo - Edinburgh 2016 Workshop
NXP FRDM-K64F Platform with ARM mbed Demo - Edinburgh 2016 WorkshopOpen Mobile Alliance
 
Overview of Remoting Protocols - By VDIworks
Overview of Remoting Protocols - By VDIworksOverview of Remoting Protocols - By VDIworks
Overview of Remoting Protocols - By VDIworksvdiworks
 
Mirasys Product Portfolio Summary - En.pptx
Mirasys Product Portfolio Summary - En.pptxMirasys Product Portfolio Summary - En.pptx
Mirasys Product Portfolio Summary - En.pptxPawachMetharattanara
 
Radiumboards- Complete Solution for Digital Security and Surveillance (DSS) I...
Radiumboards- Complete Solution for Digital Security and Surveillance (DSS) I...Radiumboards- Complete Solution for Digital Security and Surveillance (DSS) I...
Radiumboards- Complete Solution for Digital Security and Surveillance (DSS) I...RadiumBoards
 
Cisco IOS™ Software
Cisco IOS™ SoftwareCisco IOS™ Software
Cisco IOS™ Softwaresathish sak
 
Making the Home Gateway an Operator Control Point - Andreas Sayegh, Deutsche ...
Making the Home Gateway an Operator Control Point - Andreas Sayegh, Deutsche ...Making the Home Gateway an Operator Control Point - Andreas Sayegh, Deutsche ...
Making the Home Gateway an Operator Control Point - Andreas Sayegh, Deutsche ...mfrancis
 
REICOM PRODUCTS - POSSIBLE SCENARIOS
REICOM PRODUCTS - POSSIBLE SCENARIOSREICOM PRODUCTS - POSSIBLE SCENARIOS
REICOM PRODUCTS - POSSIBLE SCENARIOSREICOM SRL
 
MIPI DevCon Seoul 2018: High-Performance VR Applications Drive High-Resolutio...
MIPI DevCon Seoul 2018: High-Performance VR Applications Drive High-Resolutio...MIPI DevCon Seoul 2018: High-Performance VR Applications Drive High-Resolutio...
MIPI DevCon Seoul 2018: High-Performance VR Applications Drive High-Resolutio...MIPI Alliance
 
“Vision and AI DSPs for Ultra-High-End and Always-On Applications,” a Present...
“Vision and AI DSPs for Ultra-High-End and Always-On Applications,” a Present...“Vision and AI DSPs for Ultra-High-End and Always-On Applications,” a Present...
“Vision and AI DSPs for Ultra-High-End and Always-On Applications,” a Present...Edge AI and Vision Alliance
 
MIPI DevCon Taipei 2019: Next-Generation Mobile, AR/VR, & Automotive Displays...
MIPI DevCon Taipei 2019: Next-Generation Mobile, AR/VR, & Automotive Displays...MIPI DevCon Taipei 2019: Next-Generation Mobile, AR/VR, & Automotive Displays...
MIPI DevCon Taipei 2019: Next-Generation Mobile, AR/VR, & Automotive Displays...MIPI Alliance
 
“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...
“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...
“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...Edge AI and Vision Alliance
 
Its All About 10 GigE Vision!
Its All About 10 GigE Vision!Its All About 10 GigE Vision!
Its All About 10 GigE Vision!marrysmithevt
 
2016-Automation-Summit_PA_SIMIT.pdf
2016-Automation-Summit_PA_SIMIT.pdf2016-Automation-Summit_PA_SIMIT.pdf
2016-Automation-Summit_PA_SIMIT.pdfLuisJonathanBahamaca
 
Kordik fundamental guidtoindustrialnetworking -v_imp
Kordik fundamental guidtoindustrialnetworking -v_impKordik fundamental guidtoindustrialnetworking -v_imp
Kordik fundamental guidtoindustrialnetworking -v_impamsubramanyam
 
A Practical Guide to WebRTC
A Practical Guide to WebRTCA Practical Guide to WebRTC
A Practical Guide to WebRTCvline
 

Similar to “High-Bandwidth Multicamera Systems with PCIe Backbone: Snapshot and Outlook on Technologies and Applications,” a Presentation from XIMEA (20)

MIPI DevCon 2021: Meeting the Needs of Next-Generation Displays with a High-P...
MIPI DevCon 2021: Meeting the Needs of Next-Generation Displays with a High-P...MIPI DevCon 2021: Meeting the Needs of Next-Generation Displays with a High-P...
MIPI DevCon 2021: Meeting the Needs of Next-Generation Displays with a High-P...
 
"Developing Real-time Video Applications with CoaXPress," A Presentation from...
"Developing Real-time Video Applications with CoaXPress," A Presentation from..."Developing Real-time Video Applications with CoaXPress," A Presentation from...
"Developing Real-time Video Applications with CoaXPress," A Presentation from...
 
Sloc product brief
Sloc product briefSloc product brief
Sloc product brief
 
NXP FRDM-K64F Platform with ARM mbed Demo - Edinburgh 2016 Workshop
NXP FRDM-K64F Platform with ARM mbed Demo - Edinburgh 2016 WorkshopNXP FRDM-K64F Platform with ARM mbed Demo - Edinburgh 2016 Workshop
NXP FRDM-K64F Platform with ARM mbed Demo - Edinburgh 2016 Workshop
 
Overview of Remoting Protocols - By VDIworks
Overview of Remoting Protocols - By VDIworksOverview of Remoting Protocols - By VDIworks
Overview of Remoting Protocols - By VDIworks
 
Mirasys Product Portfolio Summary - En.pptx
Mirasys Product Portfolio Summary - En.pptxMirasys Product Portfolio Summary - En.pptx
Mirasys Product Portfolio Summary - En.pptx
 
Radiumboards- Complete Solution for Digital Security and Surveillance (DSS) I...
Radiumboards- Complete Solution for Digital Security and Surveillance (DSS) I...Radiumboards- Complete Solution for Digital Security and Surveillance (DSS) I...
Radiumboards- Complete Solution for Digital Security and Surveillance (DSS) I...
 
Cisco IOS™ Software
Cisco IOS™ SoftwareCisco IOS™ Software
Cisco IOS™ Software
 
Making the Home Gateway an Operator Control Point - Andreas Sayegh, Deutsche ...
Making the Home Gateway an Operator Control Point - Andreas Sayegh, Deutsche ...Making the Home Gateway an Operator Control Point - Andreas Sayegh, Deutsche ...
Making the Home Gateway an Operator Control Point - Andreas Sayegh, Deutsche ...
 
REICOM PRODUCTS - POSSIBLE SCENARIOS
REICOM PRODUCTS - POSSIBLE SCENARIOSREICOM PRODUCTS - POSSIBLE SCENARIOS
REICOM PRODUCTS - POSSIBLE SCENARIOS
 
MIPI DevCon Seoul 2018: High-Performance VR Applications Drive High-Resolutio...
MIPI DevCon Seoul 2018: High-Performance VR Applications Drive High-Resolutio...MIPI DevCon Seoul 2018: High-Performance VR Applications Drive High-Resolutio...
MIPI DevCon Seoul 2018: High-Performance VR Applications Drive High-Resolutio...
 
“Vision and AI DSPs for Ultra-High-End and Always-On Applications,” a Present...
“Vision and AI DSPs for Ultra-High-End and Always-On Applications,” a Present...“Vision and AI DSPs for Ultra-High-End and Always-On Applications,” a Present...
“Vision and AI DSPs for Ultra-High-End and Always-On Applications,” a Present...
 
MIPI DevCon Taipei 2019: Next-Generation Mobile, AR/VR, & Automotive Displays...
MIPI DevCon Taipei 2019: Next-Generation Mobile, AR/VR, & Automotive Displays...MIPI DevCon Taipei 2019: Next-Generation Mobile, AR/VR, & Automotive Displays...
MIPI DevCon Taipei 2019: Next-Generation Mobile, AR/VR, & Automotive Displays...
 
“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...
“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...
“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...
 
Mx Presentation En 2008
Mx Presentation En 2008Mx Presentation En 2008
Mx Presentation En 2008
 
Its All About 10 GigE Vision!
Its All About 10 GigE Vision!Its All About 10 GigE Vision!
Its All About 10 GigE Vision!
 
HD CCTV -Arecont Exacq Pivot3.ppt
HD CCTV -Arecont Exacq Pivot3.pptHD CCTV -Arecont Exacq Pivot3.ppt
HD CCTV -Arecont Exacq Pivot3.ppt
 
2016-Automation-Summit_PA_SIMIT.pdf
2016-Automation-Summit_PA_SIMIT.pdf2016-Automation-Summit_PA_SIMIT.pdf
2016-Automation-Summit_PA_SIMIT.pdf
 
Kordik fundamental guidtoindustrialnetworking -v_imp
Kordik fundamental guidtoindustrialnetworking -v_impKordik fundamental guidtoindustrialnetworking -v_imp
Kordik fundamental guidtoindustrialnetworking -v_imp
 
A Practical Guide to WebRTC
A Practical Guide to WebRTCA Practical Guide to WebRTC
A Practical Guide to WebRTC
 

More from Edge AI and Vision Alliance

“Learning Compact DNN Models for Embedded Vision,” a Presentation from the Un...
“Learning Compact DNN Models for Embedded Vision,” a Presentation from the Un...“Learning Compact DNN Models for Embedded Vision,” a Presentation from the Un...
“Learning Compact DNN Models for Embedded Vision,” a Presentation from the Un...Edge AI and Vision Alliance
 
“Introduction to Computer Vision with CNNs,” a Presentation from Mohammad Hag...
“Introduction to Computer Vision with CNNs,” a Presentation from Mohammad Hag...“Introduction to Computer Vision with CNNs,” a Presentation from Mohammad Hag...
“Introduction to Computer Vision with CNNs,” a Presentation from Mohammad Hag...Edge AI and Vision Alliance
 
“Selecting Tools for Developing, Monitoring and Maintaining ML Models,” a Pre...
“Selecting Tools for Developing, Monitoring and Maintaining ML Models,” a Pre...“Selecting Tools for Developing, Monitoring and Maintaining ML Models,” a Pre...
“Selecting Tools for Developing, Monitoring and Maintaining ML Models,” a Pre...Edge AI and Vision Alliance
 
“Building Accelerated GStreamer Applications for Video and Audio AI,” a Prese...
“Building Accelerated GStreamer Applications for Video and Audio AI,” a Prese...“Building Accelerated GStreamer Applications for Video and Audio AI,” a Prese...
“Building Accelerated GStreamer Applications for Video and Audio AI,” a Prese...Edge AI and Vision Alliance
 
“Understanding, Selecting and Optimizing Object Detectors for Edge Applicatio...
“Understanding, Selecting and Optimizing Object Detectors for Edge Applicatio...“Understanding, Selecting and Optimizing Object Detectors for Edge Applicatio...
“Understanding, Selecting and Optimizing Object Detectors for Edge Applicatio...Edge AI and Vision Alliance
 
“Introduction to Modern LiDAR for Machine Perception,” a Presentation from th...
“Introduction to Modern LiDAR for Machine Perception,” a Presentation from th...“Introduction to Modern LiDAR for Machine Perception,” a Presentation from th...
“Introduction to Modern LiDAR for Machine Perception,” a Presentation from th...Edge AI and Vision Alliance
 
“Vision-language Representations for Robotics,” a Presentation from the Unive...
“Vision-language Representations for Robotics,” a Presentation from the Unive...“Vision-language Representations for Robotics,” a Presentation from the Unive...
“Vision-language Representations for Robotics,” a Presentation from the Unive...Edge AI and Vision Alliance
 
“ADAS and AV Sensors: What’s Winning and Why?,” a Presentation from TechInsights
“ADAS and AV Sensors: What’s Winning and Why?,” a Presentation from TechInsights“ADAS and AV Sensors: What’s Winning and Why?,” a Presentation from TechInsights
“ADAS and AV Sensors: What’s Winning and Why?,” a Presentation from TechInsightsEdge AI and Vision Alliance
 
“Computer Vision in Sports: Scalable Solutions for Downmarkets,” a Presentati...
“Computer Vision in Sports: Scalable Solutions for Downmarkets,” a Presentati...“Computer Vision in Sports: Scalable Solutions for Downmarkets,” a Presentati...
“Computer Vision in Sports: Scalable Solutions for Downmarkets,” a Presentati...Edge AI and Vision Alliance
 
“Detecting Data Drift in Image Classification Neural Networks,” a Presentatio...
“Detecting Data Drift in Image Classification Neural Networks,” a Presentatio...“Detecting Data Drift in Image Classification Neural Networks,” a Presentatio...
“Detecting Data Drift in Image Classification Neural Networks,” a Presentatio...Edge AI and Vision Alliance
 
“Deep Neural Network Training: Diagnosing Problems and Implementing Solutions...
“Deep Neural Network Training: Diagnosing Problems and Implementing Solutions...“Deep Neural Network Training: Diagnosing Problems and Implementing Solutions...
“Deep Neural Network Training: Diagnosing Problems and Implementing Solutions...Edge AI and Vision Alliance
 
“AI Start-ups: The Perils of Fishing for Whales (War Stories from the Entrepr...
“AI Start-ups: The Perils of Fishing for Whales (War Stories from the Entrepr...“AI Start-ups: The Perils of Fishing for Whales (War Stories from the Entrepr...
“AI Start-ups: The Perils of Fishing for Whales (War Stories from the Entrepr...Edge AI and Vision Alliance
 
“A Computer Vision System for Autonomous Satellite Maneuvering,” a Presentati...
“A Computer Vision System for Autonomous Satellite Maneuvering,” a Presentati...“A Computer Vision System for Autonomous Satellite Maneuvering,” a Presentati...
“A Computer Vision System for Autonomous Satellite Maneuvering,” a Presentati...Edge AI and Vision Alliance
 
“Bias in Computer Vision—It’s Bigger Than Facial Recognition!,” a Presentatio...
“Bias in Computer Vision—It’s Bigger Than Facial Recognition!,” a Presentatio...“Bias in Computer Vision—It’s Bigger Than Facial Recognition!,” a Presentatio...
“Bias in Computer Vision—It’s Bigger Than Facial Recognition!,” a Presentatio...Edge AI and Vision Alliance
 
“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...
“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...
“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...Edge AI and Vision Alliance
 
“Updating the Edge ML Development Process,” a Presentation from Samsara
“Updating the Edge ML Development Process,” a Presentation from Samsara“Updating the Edge ML Development Process,” a Presentation from Samsara
“Updating the Edge ML Development Process,” a Presentation from SamsaraEdge AI and Vision Alliance
 
“Combating Bias in Production Computer Vision Systems,” a Presentation from R...
“Combating Bias in Production Computer Vision Systems,” a Presentation from R...“Combating Bias in Production Computer Vision Systems,” a Presentation from R...
“Combating Bias in Production Computer Vision Systems,” a Presentation from R...Edge AI and Vision Alliance
 
“Developing an Embedded Vision AI-powered Fitness System,” a Presentation fro...
“Developing an Embedded Vision AI-powered Fitness System,” a Presentation fro...“Developing an Embedded Vision AI-powered Fitness System,” a Presentation fro...
“Developing an Embedded Vision AI-powered Fitness System,” a Presentation fro...Edge AI and Vision Alliance
 
“Navigating the Evolving Venture Capital Landscape for Edge AI Start-ups,” a ...
“Navigating the Evolving Venture Capital Landscape for Edge AI Start-ups,” a ...“Navigating the Evolving Venture Capital Landscape for Edge AI Start-ups,” a ...
“Navigating the Evolving Venture Capital Landscape for Edge AI Start-ups,” a ...Edge AI and Vision Alliance
 
“Advanced Presence Sensing: What It Means for the Smart Home,” a Presentation...
“Advanced Presence Sensing: What It Means for the Smart Home,” a Presentation...“Advanced Presence Sensing: What It Means for the Smart Home,” a Presentation...
“Advanced Presence Sensing: What It Means for the Smart Home,” a Presentation...Edge AI and Vision Alliance
 

More from Edge AI and Vision Alliance (20)

“Learning Compact DNN Models for Embedded Vision,” a Presentation from the Un...
“Learning Compact DNN Models for Embedded Vision,” a Presentation from the Un...“Learning Compact DNN Models for Embedded Vision,” a Presentation from the Un...
“Learning Compact DNN Models for Embedded Vision,” a Presentation from the Un...
 
“Introduction to Computer Vision with CNNs,” a Presentation from Mohammad Hag...
“Introduction to Computer Vision with CNNs,” a Presentation from Mohammad Hag...“Introduction to Computer Vision with CNNs,” a Presentation from Mohammad Hag...
“Introduction to Computer Vision with CNNs,” a Presentation from Mohammad Hag...
 
“Selecting Tools for Developing, Monitoring and Maintaining ML Models,” a Pre...
“Selecting Tools for Developing, Monitoring and Maintaining ML Models,” a Pre...“Selecting Tools for Developing, Monitoring and Maintaining ML Models,” a Pre...
“Selecting Tools for Developing, Monitoring and Maintaining ML Models,” a Pre...
 
“Building Accelerated GStreamer Applications for Video and Audio AI,” a Prese...
“Building Accelerated GStreamer Applications for Video and Audio AI,” a Prese...“Building Accelerated GStreamer Applications for Video and Audio AI,” a Prese...
“Building Accelerated GStreamer Applications for Video and Audio AI,” a Prese...
 
“Understanding, Selecting and Optimizing Object Detectors for Edge Applicatio...
“Understanding, Selecting and Optimizing Object Detectors for Edge Applicatio...“Understanding, Selecting and Optimizing Object Detectors for Edge Applicatio...
“Understanding, Selecting and Optimizing Object Detectors for Edge Applicatio...
 
“Introduction to Modern LiDAR for Machine Perception,” a Presentation from th...
“Introduction to Modern LiDAR for Machine Perception,” a Presentation from th...“Introduction to Modern LiDAR for Machine Perception,” a Presentation from th...
“Introduction to Modern LiDAR for Machine Perception,” a Presentation from th...
 
“Vision-language Representations for Robotics,” a Presentation from the Unive...
“Vision-language Representations for Robotics,” a Presentation from the Unive...“Vision-language Representations for Robotics,” a Presentation from the Unive...
“Vision-language Representations for Robotics,” a Presentation from the Unive...
 
“ADAS and AV Sensors: What’s Winning and Why?,” a Presentation from TechInsights
“ADAS and AV Sensors: What’s Winning and Why?,” a Presentation from TechInsights“ADAS and AV Sensors: What’s Winning and Why?,” a Presentation from TechInsights
“ADAS and AV Sensors: What’s Winning and Why?,” a Presentation from TechInsights
 
“Computer Vision in Sports: Scalable Solutions for Downmarkets,” a Presentati...
“Computer Vision in Sports: Scalable Solutions for Downmarkets,” a Presentati...“Computer Vision in Sports: Scalable Solutions for Downmarkets,” a Presentati...
“Computer Vision in Sports: Scalable Solutions for Downmarkets,” a Presentati...
 
“Detecting Data Drift in Image Classification Neural Networks,” a Presentatio...
“Detecting Data Drift in Image Classification Neural Networks,” a Presentatio...“Detecting Data Drift in Image Classification Neural Networks,” a Presentatio...
“Detecting Data Drift in Image Classification Neural Networks,” a Presentatio...
 
“Deep Neural Network Training: Diagnosing Problems and Implementing Solutions...
“Deep Neural Network Training: Diagnosing Problems and Implementing Solutions...“Deep Neural Network Training: Diagnosing Problems and Implementing Solutions...
“Deep Neural Network Training: Diagnosing Problems and Implementing Solutions...
 
“AI Start-ups: The Perils of Fishing for Whales (War Stories from the Entrepr...
“AI Start-ups: The Perils of Fishing for Whales (War Stories from the Entrepr...“AI Start-ups: The Perils of Fishing for Whales (War Stories from the Entrepr...
“AI Start-ups: The Perils of Fishing for Whales (War Stories from the Entrepr...
 
“A Computer Vision System for Autonomous Satellite Maneuvering,” a Presentati...
“A Computer Vision System for Autonomous Satellite Maneuvering,” a Presentati...“A Computer Vision System for Autonomous Satellite Maneuvering,” a Presentati...
“A Computer Vision System for Autonomous Satellite Maneuvering,” a Presentati...
 
“Bias in Computer Vision—It’s Bigger Than Facial Recognition!,” a Presentatio...
“Bias in Computer Vision—It’s Bigger Than Facial Recognition!,” a Presentatio...“Bias in Computer Vision—It’s Bigger Than Facial Recognition!,” a Presentatio...
“Bias in Computer Vision—It’s Bigger Than Facial Recognition!,” a Presentatio...
 
“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...
“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...
“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...
 
“Updating the Edge ML Development Process,” a Presentation from Samsara
“Updating the Edge ML Development Process,” a Presentation from Samsara“Updating the Edge ML Development Process,” a Presentation from Samsara
“Updating the Edge ML Development Process,” a Presentation from Samsara
 
“Combating Bias in Production Computer Vision Systems,” a Presentation from R...
“Combating Bias in Production Computer Vision Systems,” a Presentation from R...“Combating Bias in Production Computer Vision Systems,” a Presentation from R...
“Combating Bias in Production Computer Vision Systems,” a Presentation from R...
 
“Developing an Embedded Vision AI-powered Fitness System,” a Presentation fro...
“Developing an Embedded Vision AI-powered Fitness System,” a Presentation fro...“Developing an Embedded Vision AI-powered Fitness System,” a Presentation fro...
“Developing an Embedded Vision AI-powered Fitness System,” a Presentation fro...
 
“Navigating the Evolving Venture Capital Landscape for Edge AI Start-ups,” a ...
“Navigating the Evolving Venture Capital Landscape for Edge AI Start-ups,” a ...“Navigating the Evolving Venture Capital Landscape for Edge AI Start-ups,” a ...
“Navigating the Evolving Venture Capital Landscape for Edge AI Start-ups,” a ...
 
“Advanced Presence Sensing: What It Means for the Smart Home,” a Presentation...
“Advanced Presence Sensing: What It Means for the Smart Home,” a Presentation...“Advanced Presence Sensing: What It Means for the Smart Home,” a Presentation...
“Advanced Presence Sensing: What It Means for the Smart Home,” a Presentation...
 

Recently uploaded

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Victor Rentea
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdfSandro Moreira
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)Samir Dash
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMKumar Satyam
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAnitaRaj43
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontologyjohnbeverley2021
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 

Recently uploaded (20)

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 

“High-Bandwidth Multicamera Systems with PCIe Backbone: Snapshot and Outlook on Technologies and Applications,” a Presentation from XIMEA

  • 1. © 2020 XIMEA Corp High-Bandwidth Multicamera Systems with PCIe Backbone: Snapshot and Outlook to Technologies and Applications Kevin Toerne XIMEA Corp September 2020
  • 2. © 2020 XIMEA Corp Content • XIMEA Company Overview • Cameras & Embedded Systems • Challenges & Applications • Existing imager interfaces • PCIe does it all
  • 3. © 2020 XIMEA Corp XIMEA: SRO, GmbH, Corp XIMEA GmbH Germany, Münster Management, Marketing, International Sales XIMEA s.r.o. Slovakia, Marianka Research and Development, Production XIMEA Corp. USA, Denver Sales South and North America
  • 4. © 2020 XIMEA Corp Company facts - What we do • Development, manufacturing and support for ultimate imaging and vision products • All tooling capabilities in-house • Standard products and custom designs • Increasing general success through sustainable partnerships
  • 5. © 2020 XIMEA Corp •Company Products xiD xiRAY xiC xiSPECxiQxiJ xiMU xiXxiB xiB-64
  • 6. © 2020 XIMEA Corp •Customers
  • 7. © 2020 XIMEA Corp Embedded & Multi-Camera Systems
  • 8. © 2020 XIMEA Corp Applications
  • 9. © 2020 XIMEA Corp Aerial/orbitalStreet Level © Cyclomedia Mapping/Survey – Autonomous Vehicles • High resolution • High speed • Real time processing or saving • Multi-camera • Small components
  • 10. © 2020 XIMEA Corp Facebook Surround 360Nokia Ozo XIMEA 360° Demo Augmented & Virtual Reality • High resolution • High speed • Multi-camera • Small components • Power consumption and dissipation
  • 11. © 2020 XIMEA Corp Face CaptureMotion Capture © USC, Institute for Creative Technologies Performance Capture • High resolution • High speed • Multi-camera • Small components • Long cables
  • 12. © 2020 XIMEA Corp Wearables • High speed • Multi-camera • NIR + color • XDR • Small components • Real time processing
  • 13. © 2020 XIMEA Corp • Bandwidth • Multi camera systems • High resolution, high frame rate • Cabling • Long distances • Size • Smaller is always better • Synchronization • Processing • Real time • Saving Challenges
  • 14. © 2020 XIMEA Corp Existing Interfaces
  • 15. © 2020 XIMEA Corp Existing camera interfaces • Ethernet • USB • Camera Link / CoaXPress • PCI Express
  • 16. © 2020 XIMEA Corp 16 Ethernet • Pros • Industry standard cables & software (GigE) • Hubs & switches easily available • Long cable lengths • Inexpensive • Cons • Bandwidth is low
  • 17. © 2020 XIMEA Corp 17 USB • Pros • Industry standard cables • Hubs easily available • Better-ish bandwidth • Long-ish cable lengths • Inexpensive • Cons • Multi-camera systems require multiple controllers • Not all controllers compatible with all cameras
  • 18. © 2020 XIMEA Corp 18 • Pros • Simple cables • Long cable lengths • High bandwidth • Expandable to achieve higher bandwidth Camera Link & CoaXPress • Cons • Cameras require interface cards • Price
  • 19. © 2020 XIMEA Corp 19 • Pros • Interface card is simply a cable adapter – nearly all computers have a PCIe backbone in place • Highest bandwidth • Single cable up to 64Gbps • No latency • Direct to RAM • Long cable lengths • Cons • Price • Cabling is non standard Peripheral Component Interconnect Express (PCIe)
  • 20. © 2020 XIMEA Corp Computing 20
  • 21. © 2020 XIMEA Corp 21 • Must be small • Real time processing • AI • Saving data at high data rates is often non-trivial in execution Processing/Saving
  • 22. © 2020 XIMEA Corp 22 • NUC platform • Often limited in PCIe connectivity • COM Express • Much better for custom developments Intel products
  • 23. © 2020 XIMEA Corp 23 • High processing capability • Variable PCIe bus input • Nano has only 2 lanes exposed • Jetson has 4 • Xavier has 16 • Already a new one on the way Nvidia computing
  • 24. © 2020 XIMEA Corp 24 • Allow custom implementation of computing platforms • PCIe, USB interfaces • XIMEA + 3rd party suppliers Carrier boards
  • 25. © 2020 XIMEA Corp PCIe 25
  • 26. © 2020 XIMEA Corp 26 • Allows multiple cameras to input data through one cable/connection PCIe Switch for multi-camera systems
  • 27. © 2020 XIMEA Corp 27 PCIe Switch XIMEA Standard switches XIMEA 360 switch
  • 28. © 2020 XIMEA Corp 28 • Features • Multiple camera connections • PCIe (with switch) • USB • Peripheral interfaces • HDMI • USB (2&3) • Wifi • GPIO • IMU XIMEA XEC2 Jetson Carrier board
  • 29. © 2020 XIMEA Corp • Minimizes latency and CPU overhead • Seamlessly delivers image data directly to the host memory via Scatter/Gather DMA • Supports distances from millimeters to hundreds of meters • Aggregation of multiple imagers into one wire/fiber • Upcoming PCIe generation(s) for still higher speeds • Ultimate Camera Interface for high throughput sensors and multi camera systems 29 PCIe does it all!
  • 30. © 2020 XIMEA Corp • Gen4 is readily available in PCs • 16Gbps per lane • Faster sensors always coming out • New cabling utilizing Firefly 30 Future directions
  • 31. © 2020 XIMEA Corp 31 • xiX infographics https://www.ximea.com/files/brochures/xiX%20Infographic.pdf • xiX brochure https://www.ximea.com/files/brochures/xiX-OEM-cameras-for-integration-2017-brochure- HQ.pdf • xiSwitch infographics https://www.ximea.com/files/brochures/xiSWITCH%20Infographic.pdf • XIMEA Embedded vision home https://www.ximea.com/embedded-vision/systems Further information
  • 32. © 2020 XIMEA Corp 32 Thanks for your attention! Kevin Toerne Kevin.Toerne@ximea.com