SlideShare a Scribd company logo

System-on-Chip Programmable Retina

•Download as PPTX, PDF•
•
Vanya Valindria
Vanya Valindria

The document discusses a system-on-chip (SoC) and programmable retina that aims to mimic the functions of the human retina in a single integrated circuit. The SoC retina combines image sensing and processing to acquire and analyze images in real-time with low power consumption. It consists of a CMOS sensor, cellular processor, and digital processing units. The SoC retina can perform tasks like target tracking, image recognition and industrial machine vision with applications in areas like retinal prosthesis and autonomous systems.

TechnologyBusiness
1 of 20
SOC (SYSTEM-ON-CHIP) AND PROGRAMMABLE RETINA By: Vanya Vabrina Valindria Vega Valentine Eng Wei Yong -VIBOT-
Outline 1. Human Retina 2. What is SoC and Programmable Retina? 3. SoC and Programmable Retina Architecture 4. SoC and Programmable Retina System 5. Applications 6. Conclusion
Human Retina Photoreceptors: 126 millions Task: Convert light  electrical impulse  optic nerve  brain
Retina Disease What happened when some photoreceptors degraded in the retina?  Unable to perceive the light completely
Retina Prosthesis Other application: Industrial – robotics, vehicle, etc.
How to implement this excellent functions of human retina in a single chip?
SoC and Programmable Retina Task: Image acquisition and low-to-medium-level image processing Main Challenge: Other Integrate Sensor and Processing  Challenges: Real time different from conventional approach  highly parallel processing (separated CCD + Processing Units) Programmable  functional flexibility Fast, low cost and lower power
Image Processing inside the SoC Retina Gray-scale Morphology Target Tracking Binary Morphology
Retina Chip- Basic Architecture 1 PE (Processing Element) + 1 photo-detector= 1 pixel Mimic Human Retina? Photo detector ~ Photo-receptor (in human retina) • Doorway to SoC chip • Large dynamic range CMOS technology ~ Synapses (in human retina) Photo- Block diagram of detecto the retina chip • High connectivity r • Ease integration with PE on the same chip
How does it work?
SoC & Programmable Retina System  The circuit: combining image acquisition and processing function, consists of:  CMOS sensor  Cellular SIMD (Single Instruction Multiple Data) machine  Digital processor (very small)
SoC & Programmable Retina System • Four components of Retina Circuit: – Phototransduction obtain analog value of the image – Analog Processing spatio-temporal filtering – A/D Coding • NISP (Near Image Sensor Processing) • Digitize the analog value through multiple thresholding – Digital Processing • The SIMD machine, made of digital processor meshes • Process Boolean planes (binary image) data
Comparison
SoC & Programmable Retina (specification) Specification 1000 FPS Vision Chip PVLSAR 2.2 SCAMP-3 Technology 0.18 μm 1P6M CMOS 0.8μm digital CMOS 0.35 μm CMOS Std Chip Size 3.5 mm x 1.5 mm 76 mm2 50 mm2 Array Size 64x64 pixels 128x128 pixels 128x128 pixels Pixel Size 9.5 μm × 9.5 μm 60 μm x 60 μm 50 μm x 50 μm Clock 40 MHz 150 KHz 1.25 MHz frequency Power 1.8 V & 3.3V 3.3 V & 2.2V 240mW Supply, 82.5mW (@, 1,000 fps) 1W Consumption
Application  Retinal prosthesis  Intelligent security and surveillance systems (high speed target tracking)  Image recognition  Motion detection  Industrial machine vision (rapid inspection)
Application  Retinal prosthesis  http://www.io.mei.titech.ac.jp/research/retina/index.html
Application  An embedded system for autonomous collision avoidance & objects tracking
Application  Interactive Game
Conclusion  Power Consumption, Size, Cost, Real-time efficiency are main issues in this field  SOC programmable retina integrate parallel processing with sensing  reduce size and cost  Low power dissipation  Autonomous decision making from real-time analysis  Promising application in various areas
References  Paillet, D.Mercier, T.M.Bernard and E. Senn, "Low power issues in a Programmable Artificial Retina", Proc. IEEE Workshop on Low. Power Design, pp.153-161, 1999.  Lin Q, Miau.W,, et al. A 1,000 Frames/s Programmable Vision Chip with Variable Resolution and Row-Pixel-Mixed Parallel Image Processors. 2009. ISSN 1424-8220  Elouardi A, Bouaziz S, Dupret A, Klein J O and Reynaud R. 2004. On chip vision system architecture using a CMOS retina Proceeding.  A. Manzanera. Morpholigical Segmentation on the Programmable Retina: Towards Mixed Synchronous/Asynchrounous Algorithms. in ACM ISMM Conference.  K Kyuma, Y.Nitta, Artifical Retina Chips for Image Processing. 1997. Artif Life Robotis 1: 79 – 87.

Recommended

System On Chip
System On ChipSystem On Chip
System On Chip
A B Shinde
 
Soc lect1
Soc lect1Soc lect1
Soc lect1ecemaster
 
System On Chip
System On ChipSystem On Chip
System On Chipanishgoel
 
System on Chip (SoC) for mobile phones
System on Chip (SoC) for mobile phonesSystem on Chip (SoC) for mobile phones
System on Chip (SoC) for mobile phones
Jeffrey Funk
 
System-on-Chip Design, Embedded System Design Challenges
System-on-Chip Design, Embedded System Design ChallengesSystem-on-Chip Design, Embedded System Design Challenges
System-on-Chip Design, Embedded System Design Challenges
pboulet
 
System on Chip (SoC)
System on Chip (SoC)System on Chip (SoC)
System on Chip (SoC)
Dimas Ruliandi
 
SoC Design
SoC DesignSoC Design
SoC Design
VinChip Systems - VinTrain VLSI Academy
 
Soc - Intro, Design Aspects, HLS, TLM
Soc - Intro, Design Aspects, HLS, TLMSoc - Intro, Design Aspects, HLS, TLM
Soc - Intro, Design Aspects, HLS, TLMSubhash Iyer
 

Recommended

System On Chip
System On ChipSystem On Chip
System On Chip
A B Shinde
 
Soc lect1
Soc lect1Soc lect1
Soc lect1ecemaster
 
System On Chip
System On ChipSystem On Chip
System On Chipanishgoel
 
System on Chip (SoC) for mobile phones
System on Chip (SoC) for mobile phonesSystem on Chip (SoC) for mobile phones
System on Chip (SoC) for mobile phones
Jeffrey Funk
 
System-on-Chip Design, Embedded System Design Challenges
System-on-Chip Design, Embedded System Design ChallengesSystem-on-Chip Design, Embedded System Design Challenges
System-on-Chip Design, Embedded System Design Challenges
pboulet
 
System on Chip (SoC)
System on Chip (SoC)System on Chip (SoC)
System on Chip (SoC)
Dimas Ruliandi
 
SoC Design
SoC DesignSoC Design
SoC Design
VinChip Systems - VinTrain VLSI Academy
 
Soc - Intro, Design Aspects, HLS, TLM
Soc - Intro, Design Aspects, HLS, TLMSoc - Intro, Design Aspects, HLS, TLM
Soc - Intro, Design Aspects, HLS, TLMSubhash Iyer
 
SoC: System On Chip
SoC: System On ChipSoC: System On Chip
SoC: System On Chip
Santosh Verma
 
SOC design
SOC design SOC design
SOC design Vinchipsytm Vlsitraining
 
An Overview on Programmable System on Chip: PSoC-5
An Overview on Programmable System on Chip: PSoC-5An Overview on Programmable System on Chip: PSoC-5
An Overview on Programmable System on Chip: PSoC-5
Premier Farnell
 
SOC - system on a chip
SOC - system on a chipSOC - system on a chip
SOC - system on a chip
Parth Kavi
 
What is system on chip (1)
What is system on chip (1)What is system on chip (1)
What is system on chip (1)
Jagadeshgoud
 
System on chip approach
System on chip approachSystem on chip approach
System on chip approach
Hamdy Fouad
 
soc design for dsp applications
soc design for dsp applicationssoc design for dsp applications
soc design for dsp applications
P V Krishna Mohan Gupta
 
System on chip architectures
System on chip architecturesSystem on chip architectures
System on chip architectures
A B Shinde
 
Hard ip based SoC design
Hard ip based SoC designHard ip based SoC design
Hard ip based SoC design
Vinchipsytm Vlsitraining
 
SOC Design Challenges and Practices
SOC Design Challenges and PracticesSOC Design Challenges and Practices
SOC Design Challenges and Practices
Dr. Shivananda Koteshwar
 
Soc architecture and design
Soc architecture and designSoc architecture and design
Soc architecture and design
Satya Harish
 
System On Chip (SOC)
System On Chip (SOC)System On Chip (SOC)
System On Chip (SOC)Shivam Gupta
 
System on chip buses
System on chip busesSystem on chip buses
System on chip buses
A B Shinde
 
SOC Interconnects: AMBA & CoreConnect
SOC Interconnects: AMBA & CoreConnectSOC Interconnects: AMBA & CoreConnect
SOC Interconnects: AMBA & CoreConnect
A B Shinde
 
System-on-Chip
System-on-ChipSystem-on-Chip
System-on-Chip
Lars Jacobs
 
Performance and Flexibility for Mmultiple-Processor SoC Design
Performance and Flexibility for Mmultiple-Processor SoC DesignPerformance and Flexibility for Mmultiple-Processor SoC Design
Performance and Flexibility for Mmultiple-Processor SoC Design
Yalagoud Patil
 
SOC Application Studies: Image Compression
SOC Application Studies: Image CompressionSOC Application Studies: Image Compression
SOC Application Studies: Image Compression
A B Shinde
 
Assic 28th Lecture
Assic 28th LectureAssic 28th Lecture
Assic 28th Lecture
babak danyal
 
SOC Chip Basics
SOC Chip BasicsSOC Chip Basics
SOC Chip Basics
A B Shinde
 
Ayar Labs TeraPHY: A Chiplet Technology for Low-Power, High-Bandwidth In-Pack...
Ayar Labs TeraPHY: A Chiplet Technology for Low-Power, High-Bandwidth In-Pack...Ayar Labs TeraPHY: A Chiplet Technology for Low-Power, High-Bandwidth In-Pack...
Ayar Labs TeraPHY: A Chiplet Technology for Low-Power, High-Bandwidth In-Pack...
inside-BigData.com
 
“Enabling Ultra-low Power Edge Inference and On-device Learning with Akida,” ...
“Enabling Ultra-low Power Edge Inference and On-device Learning with Akida,” ...“Enabling Ultra-low Power Edge Inference and On-device Learning with Akida,” ...
“Enabling Ultra-low Power Edge Inference and On-device Learning with Akida,” ...
Edge AI and Vision Alliance
 
Combining out - of - band monitoring with AI and big data for datacenter aut...
Combining out - of - band monitoring with AI and big data for datacenter aut...Combining out - of - band monitoring with AI and big data for datacenter aut...
Combining out - of - band monitoring with AI and big data for datacenter aut...
Ganesan Narayanasamy
 

More Related Content

What's hot

SoC: System On Chip
SoC: System On ChipSoC: System On Chip
SoC: System On Chip
Santosh Verma
 
An Overview on Programmable System on Chip: PSoC-5
An Overview on Programmable System on Chip: PSoC-5An Overview on Programmable System on Chip: PSoC-5
An Overview on Programmable System on Chip: PSoC-5
Premier Farnell
 
SOC - system on a chip
SOC - system on a chipSOC - system on a chip
SOC - system on a chip
Parth Kavi
 
What is system on chip (1)
What is system on chip (1)What is system on chip (1)
What is system on chip (1)
Jagadeshgoud
 
System on chip approach
System on chip approachSystem on chip approach
System on chip approach
Hamdy Fouad
 
soc design for dsp applications
soc design for dsp applicationssoc design for dsp applications
soc design for dsp applications
P V Krishna Mohan Gupta
 
System on chip architectures
System on chip architecturesSystem on chip architectures
System on chip architectures
A B Shinde
 
Hard ip based SoC design
Hard ip based SoC designHard ip based SoC design
Hard ip based SoC design
Vinchipsytm Vlsitraining
 
SOC Design Challenges and Practices
SOC Design Challenges and PracticesSOC Design Challenges and Practices
SOC Design Challenges and Practices
Dr. Shivananda Koteshwar
 
Soc architecture and design
Soc architecture and designSoc architecture and design
Soc architecture and design
Satya Harish
 
System On Chip (SOC)
System On Chip (SOC)System On Chip (SOC)
System On Chip (SOC)Shivam Gupta
 
System on chip buses
System on chip busesSystem on chip buses
System on chip buses
A B Shinde
 
SOC Interconnects: AMBA & CoreConnect
SOC Interconnects: AMBA & CoreConnectSOC Interconnects: AMBA & CoreConnect
SOC Interconnects: AMBA & CoreConnect
A B Shinde
 
System-on-Chip
System-on-ChipSystem-on-Chip
System-on-Chip
Lars Jacobs
 
Performance and Flexibility for Mmultiple-Processor SoC Design
Performance and Flexibility for Mmultiple-Processor SoC DesignPerformance and Flexibility for Mmultiple-Processor SoC Design
Performance and Flexibility for Mmultiple-Processor SoC Design
Yalagoud Patil
 
SOC Application Studies: Image Compression
SOC Application Studies: Image CompressionSOC Application Studies: Image Compression
SOC Application Studies: Image Compression
A B Shinde
 
Assic 28th Lecture
Assic 28th LectureAssic 28th Lecture
Assic 28th Lecture
babak danyal
 
SOC Chip Basics
SOC Chip BasicsSOC Chip Basics
SOC Chip Basics
A B Shinde
 
Ayar Labs TeraPHY: A Chiplet Technology for Low-Power, High-Bandwidth In-Pack...
Ayar Labs TeraPHY: A Chiplet Technology for Low-Power, High-Bandwidth In-Pack...Ayar Labs TeraPHY: A Chiplet Technology for Low-Power, High-Bandwidth In-Pack...
Ayar Labs TeraPHY: A Chiplet Technology for Low-Power, High-Bandwidth In-Pack...
inside-BigData.com
 

What's hot (20)

SoC: System On Chip
SoC: System On ChipSoC: System On Chip
SoC: System On Chip
 
SOC design
SOC design SOC design
SOC design
 
An Overview on Programmable System on Chip: PSoC-5
An Overview on Programmable System on Chip: PSoC-5An Overview on Programmable System on Chip: PSoC-5
An Overview on Programmable System on Chip: PSoC-5
 
SOC - system on a chip
SOC - system on a chipSOC - system on a chip
SOC - system on a chip
 
What is system on chip (1)
What is system on chip (1)What is system on chip (1)
What is system on chip (1)
 
System on chip approach
System on chip approachSystem on chip approach
System on chip approach
 
soc design for dsp applications
soc design for dsp applicationssoc design for dsp applications
soc design for dsp applications
 
System on chip architectures
System on chip architecturesSystem on chip architectures
System on chip architectures
 
Hard ip based SoC design
Hard ip based SoC designHard ip based SoC design
Hard ip based SoC design
 
SOC Design Challenges and Practices
SOC Design Challenges and PracticesSOC Design Challenges and Practices
SOC Design Challenges and Practices
 
Soc architecture and design
Soc architecture and designSoc architecture and design
Soc architecture and design
 
System On Chip (SOC)
System On Chip (SOC)System On Chip (SOC)
System On Chip (SOC)
 
System on chip buses
System on chip busesSystem on chip buses
System on chip buses
 
SOC Interconnects: AMBA & CoreConnect
SOC Interconnects: AMBA & CoreConnectSOC Interconnects: AMBA & CoreConnect
SOC Interconnects: AMBA & CoreConnect
 
System-on-Chip
System-on-ChipSystem-on-Chip
System-on-Chip
 
Performance and Flexibility for Mmultiple-Processor SoC Design
Performance and Flexibility for Mmultiple-Processor SoC DesignPerformance and Flexibility for Mmultiple-Processor SoC Design
Performance and Flexibility for Mmultiple-Processor SoC Design
 
SOC Application Studies: Image Compression
SOC Application Studies: Image CompressionSOC Application Studies: Image Compression
SOC Application Studies: Image Compression
 
Assic 28th Lecture
Assic 28th LectureAssic 28th Lecture
Assic 28th Lecture
 
SOC Chip Basics
SOC Chip BasicsSOC Chip Basics
SOC Chip Basics
 
Ayar Labs TeraPHY: A Chiplet Technology for Low-Power, High-Bandwidth In-Pack...
Ayar Labs TeraPHY: A Chiplet Technology for Low-Power, High-Bandwidth In-Pack...Ayar Labs TeraPHY: A Chiplet Technology for Low-Power, High-Bandwidth In-Pack...
Ayar Labs TeraPHY: A Chiplet Technology for Low-Power, High-Bandwidth In-Pack...
 

Similar to System-on-Chip Programmable Retina

“Enabling Ultra-low Power Edge Inference and On-device Learning with Akida,” ...
“Enabling Ultra-low Power Edge Inference and On-device Learning with Akida,” ...“Enabling Ultra-low Power Edge Inference and On-device Learning with Akida,” ...
“Enabling Ultra-low Power Edge Inference and On-device Learning with Akida,” ...
Edge AI and Vision Alliance
 
Combining out - of - band monitoring with AI and big data for datacenter aut...
Combining out - of - band monitoring with AI and big data for datacenter aut...Combining out - of - band monitoring with AI and big data for datacenter aut...
Combining out - of - band monitoring with AI and big data for datacenter aut...
Ganesan Narayanasamy
 
Neuro vision: Prof. Conradt @ Digital Product School of UnternehmerTUM
Neuro vision: Prof. Conradt @ Digital Product School of UnternehmerTUMNeuro vision: Prof. Conradt @ Digital Product School of UnternehmerTUM
Neuro vision: Prof. Conradt @ Digital Product School of UnternehmerTUM
Afsaneh Asaei
 
Dr,system abhishek
Dr,system abhishekDr,system abhishek
Dr,system abhishek
DrAbhishek Gowda
 
MIPI DevCon 2016: MIPI CSI-2 Application for Vision and Sensor Fusion Systems
MIPI DevCon 2016: MIPI CSI-2 Application for Vision and Sensor Fusion SystemsMIPI DevCon 2016: MIPI CSI-2 Application for Vision and Sensor Fusion Systems
MIPI DevCon 2016: MIPI CSI-2 Application for Vision and Sensor Fusion Systems
MIPI Alliance
 
Defying Nyquist in Analog to Digital Conversion
Defying Nyquist in Analog to Digital ConversionDefying Nyquist in Analog to Digital Conversion
Defying Nyquist in Analog to Digital Conversion
Distinguished Lecturer Series - Leon The Mathematician
 
Adaptive Neuro-Fuzzy Inference System (ANFIS) for segmentation of image ROI a...
Adaptive Neuro-Fuzzy Inference System (ANFIS) for segmentation of image ROI a...Adaptive Neuro-Fuzzy Inference System (ANFIS) for segmentation of image ROI a...
Adaptive Neuro-Fuzzy Inference System (ANFIS) for segmentation of image ROI a...
IRJET Journal
 
"High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro...
"High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro..."High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro...
"High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro...
Edge AI and Vision Alliance
 
Multimodel Operation for Visually1.docx
Multimodel Operation for Visually1.docxMultimodel Operation for Visually1.docx
Multimodel Operation for Visually1.docx
AROCKIAJAYAIECW
 
Machine Learning with New Hardware Challegens
Machine Learning with New Hardware ChallegensMachine Learning with New Hardware Challegens
Machine Learning with New Hardware Challegens
Oscar Law
 
A Smart Camera Processing Pipeline for Image Applications Utilizing Marching ...
A Smart Camera Processing Pipeline for Image Applications Utilizing Marching ...A Smart Camera Processing Pipeline for Image Applications Utilizing Marching ...
A Smart Camera Processing Pipeline for Image Applications Utilizing Marching ...
sipij
 
Development of wearable object detection system & blind stick for visuall...
Development of wearable object detection system & blind stick for visuall...Development of wearable object detection system & blind stick for visuall...
Development of wearable object detection system & blind stick for visuall...
Arkadev Kundu
 
IRJET- A Review Paper on Object Detection using Zynq-7000 FPGA for an Embedde...
IRJET- A Review Paper on Object Detection using Zynq-7000 FPGA for an Embedde...IRJET- A Review Paper on Object Detection using Zynq-7000 FPGA for an Embedde...
IRJET- A Review Paper on Object Detection using Zynq-7000 FPGA for an Embedde...
IRJET Journal
 
Iaetsd a low power and high throughput re-configurable bip for multipurpose a...
Iaetsd a low power and high throughput re-configurable bip for multipurpose a...Iaetsd a low power and high throughput re-configurable bip for multipurpose a...
Iaetsd a low power and high throughput re-configurable bip for multipurpose a...
Iaetsd Iaetsd
 
IoT Tech Expo 2023_Micha vor dem Berge presentation
IoT Tech Expo 2023_Micha vor dem Berge presentationIoT Tech Expo 2023_Micha vor dem Berge presentation
IoT Tech Expo 2023_Micha vor dem Berge presentation
VEDLIoT Project
 
Klony Lieberman (Sixdof Space): Ultra Fast 6DOF Tracking
Klony Lieberman (Sixdof Space): Ultra Fast 6DOF TrackingKlony Lieberman (Sixdof Space): Ultra Fast 6DOF Tracking
Klony Lieberman (Sixdof Space): Ultra Fast 6DOF Tracking
AugmentedWorldExpo
 
Unit 3 machine vision
Unit 3 machine vision Unit 3 machine vision
Unit 3 machine vision
Dr.G.Saravanan
 
Unit 3 machine vision
Unit 3 machine vision Unit 3 machine vision
Unit 3 machine vision
rknatarajan
 
Dip sdit 7
Dip sdit 7Dip sdit 7
Dip sdit 7
Karan Joshi
 

Similar to System-on-Chip Programmable Retina (20)

“Enabling Ultra-low Power Edge Inference and On-device Learning with Akida,” ...
“Enabling Ultra-low Power Edge Inference and On-device Learning with Akida,” ...“Enabling Ultra-low Power Edge Inference and On-device Learning with Akida,” ...
“Enabling Ultra-low Power Edge Inference and On-device Learning with Akida,” ...
 
Combining out - of - band monitoring with AI and big data for datacenter aut...
Combining out - of - band monitoring with AI and big data for datacenter aut...Combining out - of - band monitoring with AI and big data for datacenter aut...
Combining out - of - band monitoring with AI and big data for datacenter aut...
 
Neuro vision: Prof. Conradt @ Digital Product School of UnternehmerTUM
Neuro vision: Prof. Conradt @ Digital Product School of UnternehmerTUMNeuro vision: Prof. Conradt @ Digital Product School of UnternehmerTUM
Neuro vision: Prof. Conradt @ Digital Product School of UnternehmerTUM
 
Dr,system abhishek
Dr,system abhishekDr,system abhishek
Dr,system abhishek
 
MIPI DevCon 2016: MIPI CSI-2 Application for Vision and Sensor Fusion Systems
MIPI DevCon 2016: MIPI CSI-2 Application for Vision and Sensor Fusion SystemsMIPI DevCon 2016: MIPI CSI-2 Application for Vision and Sensor Fusion Systems
MIPI DevCon 2016: MIPI CSI-2 Application for Vision and Sensor Fusion Systems
 
Defying Nyquist in Analog to Digital Conversion
Defying Nyquist in Analog to Digital ConversionDefying Nyquist in Analog to Digital Conversion
Defying Nyquist in Analog to Digital Conversion
 
Adaptive Neuro-Fuzzy Inference System (ANFIS) for segmentation of image ROI a...
Adaptive Neuro-Fuzzy Inference System (ANFIS) for segmentation of image ROI a...Adaptive Neuro-Fuzzy Inference System (ANFIS) for segmentation of image ROI a...
Adaptive Neuro-Fuzzy Inference System (ANFIS) for segmentation of image ROI a...
 
TARDEC Presentation 2
TARDEC Presentation 2TARDEC Presentation 2
TARDEC Presentation 2
 
"High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro...
"High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro..."High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro...
"High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro...
 
Multimodel Operation for Visually1.docx
Multimodel Operation for Visually1.docxMultimodel Operation for Visually1.docx
Multimodel Operation for Visually1.docx
 
Machine Learning with New Hardware Challegens
Machine Learning with New Hardware ChallegensMachine Learning with New Hardware Challegens
Machine Learning with New Hardware Challegens
 
A Smart Camera Processing Pipeline for Image Applications Utilizing Marching ...
A Smart Camera Processing Pipeline for Image Applications Utilizing Marching ...A Smart Camera Processing Pipeline for Image Applications Utilizing Marching ...
A Smart Camera Processing Pipeline for Image Applications Utilizing Marching ...
 
Development of wearable object detection system & blind stick for visuall...
Development of wearable object detection system & blind stick for visuall...Development of wearable object detection system & blind stick for visuall...
Development of wearable object detection system & blind stick for visuall...
 
IRJET- A Review Paper on Object Detection using Zynq-7000 FPGA for an Embedde...
IRJET- A Review Paper on Object Detection using Zynq-7000 FPGA for an Embedde...IRJET- A Review Paper on Object Detection using Zynq-7000 FPGA for an Embedde...
IRJET- A Review Paper on Object Detection using Zynq-7000 FPGA for an Embedde...
 
Iaetsd a low power and high throughput re-configurable bip for multipurpose a...
Iaetsd a low power and high throughput re-configurable bip for multipurpose a...Iaetsd a low power and high throughput re-configurable bip for multipurpose a...
Iaetsd a low power and high throughput re-configurable bip for multipurpose a...
 
IoT Tech Expo 2023_Micha vor dem Berge presentation
IoT Tech Expo 2023_Micha vor dem Berge presentationIoT Tech Expo 2023_Micha vor dem Berge presentation
IoT Tech Expo 2023_Micha vor dem Berge presentation
 
Klony Lieberman (Sixdof Space): Ultra Fast 6DOF Tracking
Klony Lieberman (Sixdof Space): Ultra Fast 6DOF TrackingKlony Lieberman (Sixdof Space): Ultra Fast 6DOF Tracking
Klony Lieberman (Sixdof Space): Ultra Fast 6DOF Tracking
 
Unit 3 machine vision
Unit 3 machine vision Unit 3 machine vision
Unit 3 machine vision
 
Unit 3 machine vision
Unit 3 machine vision Unit 3 machine vision
Unit 3 machine vision
 
Dip sdit 7
Dip sdit 7Dip sdit 7
Dip sdit 7
 

More from Vanya Valindria

Heart attack diagnosis from DE-MRI images
Heart attack diagnosis from DE-MRI imagesHeart attack diagnosis from DE-MRI images
Heart attack diagnosis from DE-MRI images
Vanya Valindria
 
Myocardial Infraction diagnosis using CT-Scan & MRI
Myocardial Infraction diagnosis using CT-Scan & MRIMyocardial Infraction diagnosis using CT-Scan & MRI
Myocardial Infraction diagnosis using CT-Scan & MRI
Vanya Valindria
 
Post-Processing of Prostate Perfusion MRI
Post-Processing of Prostate Perfusion MRIPost-Processing of Prostate Perfusion MRI
Post-Processing of Prostate Perfusion MRI
Vanya Valindria
 
Radon Transform - image analysis
Radon Transform - image analysisRadon Transform - image analysis
Radon Transform - image analysis
Vanya Valindria
 
Feature Hierarchies for Object Classification
Feature Hierarchies for Object Classification Feature Hierarchies for Object Classification
Feature Hierarchies for Object Classification
Vanya Valindria
 
Shape from Distortion - 3D Digitization
Shape from Distortion - 3D DigitizationShape from Distortion - 3D Digitization
Shape from Distortion - 3D Digitization
Vanya Valindria
 
Shape context
Shape context Shape context
Shape context
Vanya Valindria
 
Interlaced and progressive Camera
Interlaced and progressive CameraInterlaced and progressive Camera
Interlaced and progressive Camera
Vanya Valindria
 
Real Time Object Tracking
Real Time Object TrackingReal Time Object Tracking
Real Time Object Tracking
Vanya Valindria
 
Bagpipe as the Scotland National Instrument
Bagpipe as the Scotland National InstrumentBagpipe as the Scotland National Instrument
Bagpipe as the Scotland National Instrument
Vanya Valindria
 
Indonesia - A Culture Overview
Indonesia - A Culture OverviewIndonesia - A Culture Overview
Indonesia - A Culture Overview
Vanya Valindria
 

More from Vanya Valindria (13)

Bottle-in-Hangers
Bottle-in-HangersBottle-in-Hangers
Bottle-in-Hangers
 
Supermarket obesrvation
Supermarket obesrvationSupermarket obesrvation
Supermarket obesrvation
 
Heart attack diagnosis from DE-MRI images
Heart attack diagnosis from DE-MRI imagesHeart attack diagnosis from DE-MRI images
Heart attack diagnosis from DE-MRI images
 
Myocardial Infraction diagnosis using CT-Scan & MRI
Myocardial Infraction diagnosis using CT-Scan & MRIMyocardial Infraction diagnosis using CT-Scan & MRI
Myocardial Infraction diagnosis using CT-Scan & MRI
 
Post-Processing of Prostate Perfusion MRI
Post-Processing of Prostate Perfusion MRIPost-Processing of Prostate Perfusion MRI
Post-Processing of Prostate Perfusion MRI
 
Radon Transform - image analysis
Radon Transform - image analysisRadon Transform - image analysis
Radon Transform - image analysis
 
Feature Hierarchies for Object Classification
Feature Hierarchies for Object Classification Feature Hierarchies for Object Classification
Feature Hierarchies for Object Classification
 
Shape from Distortion - 3D Digitization
Shape from Distortion - 3D DigitizationShape from Distortion - 3D Digitization
Shape from Distortion - 3D Digitization
 
Shape context
Shape context Shape context
Shape context
 
Interlaced and progressive Camera
Interlaced and progressive CameraInterlaced and progressive Camera
Interlaced and progressive Camera
 
Real Time Object Tracking
Real Time Object TrackingReal Time Object Tracking
Real Time Object Tracking
 
Bagpipe as the Scotland National Instrument
Bagpipe as the Scotland National InstrumentBagpipe as the Scotland National Instrument
Bagpipe as the Scotland National Instrument
 
Indonesia - A Culture Overview
Indonesia - A Culture OverviewIndonesia - A Culture Overview
Indonesia - A Culture Overview
 

Recently uploaded

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 

Recently uploaded (20)

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 

System-on-Chip Programmable Retina

  • 1. SOC (SYSTEM-ON-CHIP) AND PROGRAMMABLE RETINA By: Vanya Vabrina Valindria Vega Valentine Eng Wei Yong -VIBOT-
  • 2. Outline 1. Human Retina 2. What is SoC and Programmable Retina? 3. SoC and Programmable Retina Architecture 4. SoC and Programmable Retina System 5. Applications 6. Conclusion
  • 3. Human Retina Photoreceptors: 126 millions Task: Convert light  electrical impulse  optic nerve  brain
  • 4. Retina Disease What happened when some photoreceptors degraded in the retina?  Unable to perceive the light completely
  • 6. How to implement this excellent functions of human retina in a single chip?
  • 7. SoC and Programmable Retina Task: Image acquisition and low-to-medium-level image processing Main Challenge: Other Integrate Sensor and Processing  Challenges: Real time different from conventional approach  highly parallel processing (separated CCD + Processing Units) Programmable  functional flexibility Fast, low cost and lower power
  • 8. Image Processing inside the SoC Retina Gray-scale Morphology Target Tracking Binary Morphology
  • 9. Retina Chip- Basic Architecture 1 PE (Processing Element) + 1 photo-detector= 1 pixel Mimic Human Retina? Photo detector ~ Photo-receptor (in human retina) • Doorway to SoC chip • Large dynamic range CMOS technology ~ Synapses (in human retina) Photo- Block diagram of detecto the retina chip • High connectivity r • Ease integration with PE on the same chip
  • 10. How does it work?
  • 11. SoC & Programmable Retina System  The circuit: combining image acquisition and processing function, consists of:  CMOS sensor  Cellular SIMD (Single Instruction Multiple Data) machine  Digital processor (very small)
  • 12. SoC & Programmable Retina System • Four components of Retina Circuit: – Phototransduction obtain analog value of the image – Analog Processing spatio-temporal filtering – A/D Coding • NISP (Near Image Sensor Processing) • Digitize the analog value through multiple thresholding – Digital Processing • The SIMD machine, made of digital processor meshes • Process Boolean planes (binary image) data
  • 14. SoC & Programmable Retina (specification) Specification 1000 FPS Vision Chip PVLSAR 2.2 SCAMP-3 Technology 0.18 μm 1P6M CMOS 0.8μm digital CMOS 0.35 μm CMOS Std Chip Size 3.5 mm x 1.5 mm 76 mm2 50 mm2 Array Size 64x64 pixels 128x128 pixels 128x128 pixels Pixel Size 9.5 μm × 9.5 μm 60 μm x 60 μm 50 μm x 50 μm Clock 40 MHz 150 KHz 1.25 MHz frequency Power 1.8 V & 3.3V 3.3 V & 2.2V 240mW Supply, 82.5mW (@, 1,000 fps) 1W Consumption
  • 15. Application  Retinal prosthesis  Intelligent security and surveillance systems (high speed target tracking)  Image recognition  Motion detection  Industrial machine vision (rapid inspection)
  • 16. Application  Retinal prosthesis  http://www.io.mei.titech.ac.jp/research/retina/index.html
  • 17. Application  An embedded system for autonomous collision avoidance & objects tracking
  • 18. Application  Interactive Game
  • 19. Conclusion  Power Consumption, Size, Cost, Real-time efficiency are main issues in this field  SOC programmable retina integrate parallel processing with sensing  reduce size and cost  Low power dissipation  Autonomous decision making from real-time analysis  Promising application in various areas
  • 20. References  Paillet, D.Mercier, T.M.Bernard and E. Senn, "Low power issues in a Programmable Artificial Retina", Proc. IEEE Workshop on Low. Power Design, pp.153-161, 1999.  Lin Q, Miau.W,, et al. A 1,000 Frames/s Programmable Vision Chip with Variable Resolution and Row-Pixel-Mixed Parallel Image Processors. 2009. ISSN 1424-8220  Elouardi A, Bouaziz S, Dupret A, Klein J O and Reynaud R. 2004. On chip vision system architecture using a CMOS retina Proceeding.  A. Manzanera. Morpholigical Segmentation on the Programmable Retina: Towards Mixed Synchronous/Asynchrounous Algorithms. in ACM ISMM Conference.  K Kyuma, Y.Nitta, Artifical Retina Chips for Image Processing. 1997. Artif Life Robotis 1: 79 – 87.

Editor's Notes

  1. The main part of our eye is Retina, which is located here..If we look at the structure closely, inside the retina, we can find 126 million photoreceptors: consists of Rod and Cones cells.Photoreceptors plays an important part, since its task is to converts light that enters our eye into neural electrical signals – and bring it to optic nerve transport to the visual cortex of the brain to be interpreted.
  2. We can see in this picture that the people is ….So, photoreceptors in retina is very..very.. crucialTherefore, we should come up with the solution to help this people by implementing a complete vision system in a single chip…
  3. In the latest development, retina prosthesis is implanted to the retina. With this device, the light information can be converted to electrical signal and trigger the ganglion cells to bring the pulse to the brain. Then, the patients learn how to interpret these visual patterns. This is only an example of the retina chip application. Nowadays, the Retina SoC is widely used in industrial sector, such as vehicles, robotics, etc.
  4. now we understood that the task of the System on chip retina is for image….Thus, the main challenge of SoC Retina is to integrate in the same circuit the acquisition photo-sensors and some processing elements. Also, the process must be in highly parallel to achieve real-time image processing.Programmable means, the chip can perform various vision function
  5. As we know, Retina chip only does the Low and Medium Image processing..Here is some results of those process from inside the retina..First, Grayscale Morphology.. To smooth this letter ‘A’ and fix some disconnect in the image, using opening and closing operation. Which only takes 80.2 micro seconds.Next, the Binary Morphology.. Which is performed by the Processing Element array in pixel-parellel, with thining operation until it results the ‘skeleton’ of this letter.After that, the chip can perform 1,000 frame per second target tracking.. The skeleton of the object is used for calculation the coordinates. So from these 3 samples, the chip can track the moving targets and provide its centroid coordinates.Indeed, these kind of process may be useful in robotic vision application.
  6. This is one example of the basic diagram block of the retina chipOne pixel contains of one processing element with one photodetector inside of it.… doorway: since its function is to convert the light into electrical signals.Photo detector ~ like photo receptor in retinaThese circuit is fabricated using CMOS technologyCommonly, the SoC Retina is fabricated using CMOS technologySince it can mime the synapses for having the high connectivity .Low cost and high resolution
  7. How does this retina chip work?The image is focused on the chip through the lens. The chip consists of array of pixel. In a single pixel, photodetectors detect the sensitivity. Then there it performs a readout mechanism to be processed by the processor circuit, to perform a low-level image processing. Then, it outputs processed images.
  8. There are various application of SoC programmable retina. 1. It can be used in retinal prosthesis to help certain blind people to partially regain their vision, especially for those people who lose their vision in accident rather than those born blind. (visual implant 2006)2. It can also be used in the Intelligent security and surveillance systems. It can track target in high speed. 3. Besides, it is used in industrial machine vision and robotics for rapid inspection of a product.
  9. A visual prosthesis is an artificial organ to restore the sight of blind patients with electrical stimulation to the visual nervous system. The video shows the image which the patient perceived while observing his hand with visual prosthesis . This visual prosthesis consists of an extra-ocular and an intra-ocular device which contains various technologies such as image capture and processing, wireless data & power transmissionon a singleIC. According to the visual information captured by a video camera in the extra-ocular device, the information is coded, then sent to the intra-ocular device through an infrared (IR) communication unit. After the intra-ocular device receives the IR data, it generates adequate electric pulses for stimulating the retina. (2004)
  10. Another interesting application of the SoC programmable retina is in the intelligent car system. The artificial retina cards are placed in front of the car integrating in the complicated system of a intelligent car. With its fast response, it could prevent collision by sensing approaching car and obstacles.
  11. Another application of SoC Programmable Retina is human/multimedia interface, such as interactive game. As an artificial retina module and the game screenis placed in front of a player. Artificial retina module detects body movement from the player & translate them into the character’s action on the screen instead of getting user input from conventional joystick or keyboard. The required time for image detection, recognition and feedback to the game character is less than 16 msec. (1997)Algorithm based on optical flow model.