SlideShare a Scribd company logo
Smart Cameras as Embedded
Systems
B. Swarnalatha
M.Tech VLSI
12651D5710
Adams Engineering College
Paloncha.
ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
Overview of Seminar


Image



Video



Digital Camera & Smart Camera



Detection and recognition algorithms
Low level processing
High level processing



Towards and Embedded System
Requirements
Components



Core Processor TriMedia



Advancements in VLSI required to implement
Embedded Smart camera
ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
IMAGE
An image may be defined as a two-dimensional function f(x, y) where x
and y are spatial (plane) coordinates, and the amplitude of f at any pair of
coordinates (x, y) is called the intensity or gray level of the image at that
point. A small region in the image is shown in matrix.

10 12 35 54 34 23 201 2

10 12

4

5

6

7

8

9

9

9

0

87 6

8

0

7

68 8

9

09 6

5

87 88 7

9

9

8

8

8

8

8

8

0

8

8

89 9

90 0

0

5

00

8

54 4

55 6

76 7

4

6

99

3

65 7

7

89 7

6

7

6

6

6

78 9

166 6

4

44 4

5

55 43 2

45 6

54 67 45 7

ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710

3

8

77 6

54 87 5
7

98 54
ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
Digital Camera and Smart Camera
Digital Cameras capture only images as digital files that users can upload to their
Computer , manipulate with software and distribute electronically. Eg. Nikon

Smart Cameras capture high-level descriptions of the scene and analyze
What they see.
These devices could support a wide variety of applications including

human and animal detection,
surveillance,
motion analysis, and
facial identification

Eg. Windows for KINECT

Digital Camera
ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710

SMART Digital Camera
Detection and Recognition Algorithms
Low Level Processing
•Region Extraction

•Contour Following
•Ellipse fitting
•Graph Matching
High Level Processing
• Hidden Markov Models
•Classifiers

ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
DETECTION
AND RECOGNITION
ALGORITHMS
Low level processing
 Region Extraction
The subject to be identified for gesture
recognition in the video frames are
extracted. Fig2. (b)
• Contour following
Grouping of pixels into contours that
geometrically define the regions.
Fig2. (c)
• Ellipse fitting
To correct for deformations in image
processing caused by clothing, objects
in the frame, or some body parts
blocking others, an algorithm fits
ellipses to the pixel regions to provide
simplified part attributes. Fig2. (d)
• Graph matching
Meaningful feature vectors are
extracted from the modeled body
parts with ellipses.

Figure2
ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
High level Processing
The high level processing component , which can be adopted to different

Applications, compares the motion pattern of each body part.

Example, a pointing gesture could be recognized as a command
to “go to the next slide” in a smart meeting room

or “open the window” in a smart car ,
Where as a smart security camera might interpret the
gesture as suspicious or threatening.

ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
Human Detection and Activity
Recognition Algorithm

ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
Towards an Embedded
Smart Camera
Requirements
Frame rate: The embedded smart
camera system must process a certain
amount of frames per second to
properly analyze motion and provide
useful results
Latency: The amount of time takes to
produce a result from the processed
frames

Components
• 100 MHz Philips TriMedia TM-1000
as video processor.
• Hi8 Cameras
• Shared memory interface
• Host computer
• Debugging algorithms and programs
• Networked system for connecting
multiple cameras

Smart Meeting Room

ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
TriMedia
Processor TM-1000
The
Philips
TriMedia
TM1000 family of devices
have a higher performance
Very Long Instruction word
(VLIW ) core.

ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
TriMedia
Processor TM-1000

Features

•

a 5-issue VLIW architecture with a 32-bit word size;

•

27 functional units, offering a choice of operation types
in each slot in the instruction;

•

any operation can be guarded to provide conditional
execution without branching;

•

instruction set and functional units optimized with

respect to media processing;
•

a single multi-ported register file with bypass network,
allowing 1-cycle latency operations;

•

32 kB, 8-way instruction cache;

•

16kB, 8-way, quasi-dual ported, data cache;

•

a variable-length (compressed) instruction set design
ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
Advancements in VLSI required to implement
a smart camera embedded system
Algorithmic challenges
Choosing best computationally efficient algorithm with minimum
memory usage.

Library Functions
The library function of the processor should provide special
function to provide Instruction level-parallelism
Eg1. INONZERO: This instruction takes two input operands. If the
first is non zero, the destination is set to the value of the second
operand; otherwise it is set to zero.
Eg2. IABS: This instruction can provide absolute values

ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
Advancements in VLSI required to implement
a smart camera embedded system
Control-to-data transformation
The data transformation can be controlled using a processor with
more functional units.
Designing SINGLE-INSTRUCTION MULTIPLE-DATA (SIMD) Processors to
achieve real time performance.
 Existing processors like (80xx, INTEL ) are pixel plane processors.
These processor can perform arithmetic and logical operations with
limited no of operands.
 Embedding single-instruction multiple-data (SIMD) processors into
sensors is critical to improve the real time performance.
 Processor architectures are to be designed to take multiple data in
one instruction to increase the computation power required to meet the
real time challenges.
ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
Reference: Wayne Wolf, Burak Ozer, Tiehan Lv “Smart Camera as Embedded
Systems”. IEEE Trans. Vol. 45, 2002.
Copy right IEEE

ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710
THANK YOU

ADAMS ENGINEERING COLLEGE;
M.Tech VLSI; 12651D5710

More Related Content

What's hot

Home automation using android mobiles
Home automation using android mobilesHome automation using android mobiles
Home automation using android mobiles
Durairaja
 
Wireless charging ppt
Wireless charging pptWireless charging ppt
Wireless charging ppt
Manjunath Kareppagoudr
 
BATTERY LESS PHONE
BATTERY LESS PHONE BATTERY LESS PHONE
BATTERY LESS PHONE
MuhammedAslam77
 
Seminar on Home Automation Using Raspberry Pi
Seminar on Home Automation Using Raspberry PiSeminar on Home Automation Using Raspberry Pi
Seminar on Home Automation Using Raspberry Pi
Bittu Kumar
 
Underwater Wireless Communication
Underwater Wireless CommunicationUnderwater Wireless Communication
Underwater Wireless Communication
Shubham Srivastava
 
Aeronautical communication seminar presentation
Aeronautical communication seminar presentationAeronautical communication seminar presentation
Aeronautical communication seminar presentation
Arun Kc
 
Medical mirror
Medical mirror Medical mirror
Medical mirror
Apoorva k
 
ELECTRONIC PROTECTION FOR EXAM PAPER LEAKAGE
ELECTRONIC PROTECTION FOR EXAM PAPER LEAKAGEELECTRONIC PROTECTION FOR EXAM PAPER LEAKAGE
ELECTRONIC PROTECTION FOR EXAM PAPER LEAKAGE
muhammed jassim k
 
Eye directive wheel chair
Eye directive wheel chairEye directive wheel chair
Eye directive wheel chair
Sivajyothi paramsivam
 
Embedded System in Automobiles
Embedded System in Automobiles Embedded System in Automobiles
Embedded System in Automobiles
Seminar Links
 
Wi-max Technology PPT
Wi-max Technology PPTWi-max Technology PPT
Wi-max Technology PPT
Vinay Krishna
 
IBOC TECHNOLOGY
IBOC TECHNOLOGYIBOC TECHNOLOGY
IBOC TECHNOLOGYDj Tibi
 
SMART NOTE TAKER
SMART NOTE TAKERSMART NOTE TAKER
SMART NOTE TAKER
suresh8500472367
 
Ppt on six month training on embedded system & IOT
Ppt on six month training on embedded system & IOTPpt on six month training on embedded system & IOT
Ppt on six month training on embedded system & IOT
preetigill309
 
Ppt presentation
Ppt presentationPpt presentation
Ppt presentation
vishal4799
 
Image Sensor PPT
Image Sensor PPTImage Sensor PPT
Image Sensor PPT
JaydeepBhayani773
 
inter vehicle communication
inter vehicle communicationinter vehicle communication
inter vehicle communicationNitish Tanwar
 
Women Safety Night Patrolling Robot Using IOT
Women Safety Night Patrolling Robot Using IOTWomen Safety Night Patrolling Robot Using IOT
Women Safety Night Patrolling Robot Using IOT
Dr. Amarjeet Singh
 
Microelectronic pill
Microelectronic pillMicroelectronic pill
Microelectronic pill
nirmalk1503
 

What's hot (20)

Home automation using android mobiles
Home automation using android mobilesHome automation using android mobiles
Home automation using android mobiles
 
Wireless charging ppt
Wireless charging pptWireless charging ppt
Wireless charging ppt
 
BATTERY LESS PHONE
BATTERY LESS PHONE BATTERY LESS PHONE
BATTERY LESS PHONE
 
Seminar on Home Automation Using Raspberry Pi
Seminar on Home Automation Using Raspberry PiSeminar on Home Automation Using Raspberry Pi
Seminar on Home Automation Using Raspberry Pi
 
Underwater Wireless Communication
Underwater Wireless CommunicationUnderwater Wireless Communication
Underwater Wireless Communication
 
Aeronautical communication seminar presentation
Aeronautical communication seminar presentationAeronautical communication seminar presentation
Aeronautical communication seminar presentation
 
Medical mirror
Medical mirror Medical mirror
Medical mirror
 
ELECTRONIC PROTECTION FOR EXAM PAPER LEAKAGE
ELECTRONIC PROTECTION FOR EXAM PAPER LEAKAGEELECTRONIC PROTECTION FOR EXAM PAPER LEAKAGE
ELECTRONIC PROTECTION FOR EXAM PAPER LEAKAGE
 
Eye directive wheel chair
Eye directive wheel chairEye directive wheel chair
Eye directive wheel chair
 
Embedded System in Automobiles
Embedded System in Automobiles Embedded System in Automobiles
Embedded System in Automobiles
 
Wi-max Technology PPT
Wi-max Technology PPTWi-max Technology PPT
Wi-max Technology PPT
 
IBOC TECHNOLOGY
IBOC TECHNOLOGYIBOC TECHNOLOGY
IBOC TECHNOLOGY
 
SMART NOTE TAKER
SMART NOTE TAKERSMART NOTE TAKER
SMART NOTE TAKER
 
Ppt on six month training on embedded system & IOT
Ppt on six month training on embedded system & IOTPpt on six month training on embedded system & IOT
Ppt on six month training on embedded system & IOT
 
Ppt presentation
Ppt presentationPpt presentation
Ppt presentation
 
Smart note-taker
Smart note-takerSmart note-taker
Smart note-taker
 
Image Sensor PPT
Image Sensor PPTImage Sensor PPT
Image Sensor PPT
 
inter vehicle communication
inter vehicle communicationinter vehicle communication
inter vehicle communication
 
Women Safety Night Patrolling Robot Using IOT
Women Safety Night Patrolling Robot Using IOTWomen Safety Night Patrolling Robot Using IOT
Women Safety Night Patrolling Robot Using IOT
 
Microelectronic pill
Microelectronic pillMicroelectronic pill
Microelectronic pill
 

Viewers also liked

Mobile phone embedded system
Mobile phone embedded systemMobile phone embedded system
Mobile phone embedded system
Ashutosh Jaiswal
 
CASE STUDY OF DIGITAL CAMERA HARDWARE AND SOFT WARE ARCHITECTURECASE STUDY OF...
CASE STUDY OF DIGITAL CAMERAHARDWARE AND SOFT WAREARCHITECTURECASE STUDY OF...CASE STUDY OF DIGITAL CAMERAHARDWARE AND SOFT WAREARCHITECTURECASE STUDY OF...
CASE STUDY OF DIGITAL CAMERA HARDWARE AND SOFT WARE ARCHITECTURECASE STUDY OF...
JOLLUSUDARSHANREDDY
 
ppt on embedded system
ppt on embedded systemppt on embedded system
ppt on embedded systemmanish katara
 
Embedded System Basics
Embedded System BasicsEmbedded System Basics
Embedded System Basics
Dr M Muruganandam Masilamani
 
Embedded Systems in Automobile
Embedded Systems in AutomobileEmbedded Systems in Automobile
Embedded Systems in AutomobileAbhishek Sutrave
 
Smart card
Smart cardSmart card
Smart card
Santosh Khadsare
 
Embedded System Case Study
Embedded System Case StudyEmbedded System Case Study
Embedded System Case Study
JCT COLLEGE OF ENGINEERING AND TECHNOLOGY
 
Embedded System
Embedded System Embedded System
Embedded System
Sonali Parab
 
robotics and embedded system ppt
robotics and embedded system pptrobotics and embedded system ppt
robotics and embedded system ppt
Nilgiri publicity
 
Introduction To Embedded Systems
Introduction To Embedded SystemsIntroduction To Embedded Systems
Introduction To Embedded Systems
Vishwa Mohan
 
Wireless charging ppt
Wireless charging pptWireless charging ppt
Wireless charging ppt
M.k. Aio Lord Shiva
 
Smart card system ppt
Smart card system ppt Smart card system ppt
Smart card system ppt
Dewanshu Haswani
 
Unit 1 embedded systems and applications
Unit 1 embedded systems and applicationsUnit 1 embedded systems and applications
Unit 1 embedded systems and applications
Dr.YNM
 
Wireless charging of mobile PPT.
Wireless charging of mobile PPT.Wireless charging of mobile PPT.
Wireless charging of mobile PPT.
Krishna Teja
 

Viewers also liked (20)

Mobile phone embedded system
Mobile phone embedded systemMobile phone embedded system
Mobile phone embedded system
 
CASE STUDY OF DIGITAL CAMERA HARDWARE AND SOFT WARE ARCHITECTURECASE STUDY OF...
CASE STUDY OF DIGITAL CAMERAHARDWARE AND SOFT WAREARCHITECTURECASE STUDY OF...CASE STUDY OF DIGITAL CAMERAHARDWARE AND SOFT WAREARCHITECTURECASE STUDY OF...
CASE STUDY OF DIGITAL CAMERA HARDWARE AND SOFT WARE ARCHITECTURECASE STUDY OF...
 
Case study of digital camera
Case study of digital cameraCase study of digital camera
Case study of digital camera
 
Embedded system ppt
Embedded system pptEmbedded system ppt
Embedded system ppt
 
ppt on embedded system
ppt on embedded systemppt on embedded system
ppt on embedded system
 
Embedded System Basics
Embedded System BasicsEmbedded System Basics
Embedded System Basics
 
Embedded Systems in Automobile
Embedded Systems in AutomobileEmbedded Systems in Automobile
Embedded Systems in Automobile
 
Slideshare ppt
Slideshare pptSlideshare ppt
Slideshare ppt
 
Paper battery
Paper batteryPaper battery
Paper battery
 
Smart card
Smart cardSmart card
Smart card
 
Embedded System Case Study
Embedded System Case StudyEmbedded System Case Study
Embedded System Case Study
 
Embedded System
Embedded System Embedded System
Embedded System
 
robotics and embedded system ppt
robotics and embedded system pptrobotics and embedded system ppt
robotics and embedded system ppt
 
Introduction To Embedded Systems
Introduction To Embedded SystemsIntroduction To Embedded Systems
Introduction To Embedded Systems
 
Brain chips
Brain chipsBrain chips
Brain chips
 
Wireless charging ppt
Wireless charging pptWireless charging ppt
Wireless charging ppt
 
Plasmonics
PlasmonicsPlasmonics
Plasmonics
 
Smart card system ppt
Smart card system ppt Smart card system ppt
Smart card system ppt
 
Unit 1 embedded systems and applications
Unit 1 embedded systems and applicationsUnit 1 embedded systems and applications
Unit 1 embedded systems and applications
 
Wireless charging of mobile PPT.
Wireless charging of mobile PPT.Wireless charging of mobile PPT.
Wireless charging of mobile PPT.
 

Similar to Smart Camera as Embedded System

imagefiltervhdl.pptx
imagefiltervhdl.pptximagefiltervhdl.pptx
imagefiltervhdl.pptx
Akbarali206563
 
Car Steering Angle Prediction Using Deep Learning
Car Steering Angle Prediction Using Deep LearningCar Steering Angle Prediction Using Deep Learning
Car Steering Angle Prediction Using Deep Learning
IRJET Journal
 
Multi Processor Architecture for image processing
Multi Processor Architecture for image processingMulti Processor Architecture for image processing
Multi Processor Architecture for image processingideas2ignite
 
Kassem2009
Kassem2009Kassem2009
Kassem2009
lazchi
 
IRJET- Self Driving RC Car using Behavioral Cloning
IRJET-  	  Self Driving RC Car using Behavioral CloningIRJET-  	  Self Driving RC Car using Behavioral Cloning
IRJET- Self Driving RC Car using Behavioral Cloning
IRJET Journal
 
FPGA IMPLEMENTATION OF APPROXIMATE SOFTMAX FUNCTION FOR EFFICIENT CNN INFERENCE
FPGA IMPLEMENTATION OF APPROXIMATE SOFTMAX FUNCTION FOR EFFICIENT CNN INFERENCEFPGA IMPLEMENTATION OF APPROXIMATE SOFTMAX FUNCTION FOR EFFICIENT CNN INFERENCE
FPGA IMPLEMENTATION OF APPROXIMATE SOFTMAX FUNCTION FOR EFFICIENT CNN INFERENCE
International Research Journal of Modernization in Engineering Technology and Science
 
Wireless Multimedia Sensor Network: A Survey on Multimedia Sensors
Wireless Multimedia Sensor Network: A Survey on Multimedia SensorsWireless Multimedia Sensor Network: A Survey on Multimedia Sensors
Wireless Multimedia Sensor Network: A Survey on Multimedia Sensors
idescitation
 
Kq3518291832
Kq3518291832Kq3518291832
Kq3518291832
IJERA Editor
 
IRJET - Positioning and Tracking of a Person using Embedded Controller in a D...
IRJET - Positioning and Tracking of a Person using Embedded Controller in a D...IRJET - Positioning and Tracking of a Person using Embedded Controller in a D...
IRJET - Positioning and Tracking of a Person using Embedded Controller in a D...
IRJET Journal
 
IoT-based Autonomously Driven Vehicle by using Machine Learning & Image Proce...
IoT-based Autonomously Driven Vehicle by using Machine Learning & Image Proce...IoT-based Autonomously Driven Vehicle by using Machine Learning & Image Proce...
IoT-based Autonomously Driven Vehicle by using Machine Learning & Image Proce...
IRJET Journal
 
Math of Explaining SAM
Math of Explaining SAMMath of Explaining SAM
Math of Explaining SAM
Lian Sabella Castillo
 
Imaging automotive 2015 addfor v002
Imaging automotive 2015   addfor v002Imaging automotive 2015   addfor v002
Imaging automotive 2015 addfor v002
Enrico Busto
 
Imaging automotive 2015 addfor v002
Imaging automotive 2015   addfor v002Imaging automotive 2015   addfor v002
Imaging automotive 2015 addfor v002
Enrico Busto
 
Ku3419461949
Ku3419461949Ku3419461949
Ku3419461949
IJERA Editor
 
IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application
 IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application
IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application
IRJET Journal
 
Biomedical image transmission based on Modified feistal algorithm
Biomedical image transmission based on Modified feistal algorithmBiomedical image transmission based on Modified feistal algorithm
Biomedical image transmission based on Modified feistal algorithm
ijcsit
 
CAD STANDARDS - SMART MANUFACTURING MECH
CAD STANDARDS - SMART MANUFACTURING MECHCAD STANDARDS - SMART MANUFACTURING MECH
CAD STANDARDS - SMART MANUFACTURING MECH
RAJESHS631800
 
Design the implementation of CDEx Robust DC Motor.
Design the implementation of CDEx Robust DC Motor.Design the implementation of CDEx Robust DC Motor.
Design the implementation of CDEx Robust DC Motor.
Ankita Tiwari
 
LSB & DWT BASED DIGITAL WATERMARKING SYSTEM FOR VIDEO AUTHENTICATION.
LSB & DWT BASED DIGITAL WATERMARKING SYSTEM FOR VIDEO AUTHENTICATION.LSB & DWT BASED DIGITAL WATERMARKING SYSTEM FOR VIDEO AUTHENTICATION.
LSB & DWT BASED DIGITAL WATERMARKING SYSTEM FOR VIDEO AUTHENTICATION.
International Journal of Technical Research & Application
 
Dataset creation for Deep Learning-based Geometric Computer Vision problems
Dataset creation for Deep Learning-based Geometric Computer Vision problemsDataset creation for Deep Learning-based Geometric Computer Vision problems
Dataset creation for Deep Learning-based Geometric Computer Vision problems
PetteriTeikariPhD
 

Similar to Smart Camera as Embedded System (20)

imagefiltervhdl.pptx
imagefiltervhdl.pptximagefiltervhdl.pptx
imagefiltervhdl.pptx
 
Car Steering Angle Prediction Using Deep Learning
Car Steering Angle Prediction Using Deep LearningCar Steering Angle Prediction Using Deep Learning
Car Steering Angle Prediction Using Deep Learning
 
Multi Processor Architecture for image processing
Multi Processor Architecture for image processingMulti Processor Architecture for image processing
Multi Processor Architecture for image processing
 
Kassem2009
Kassem2009Kassem2009
Kassem2009
 
IRJET- Self Driving RC Car using Behavioral Cloning
IRJET-  	  Self Driving RC Car using Behavioral CloningIRJET-  	  Self Driving RC Car using Behavioral Cloning
IRJET- Self Driving RC Car using Behavioral Cloning
 
FPGA IMPLEMENTATION OF APPROXIMATE SOFTMAX FUNCTION FOR EFFICIENT CNN INFERENCE
FPGA IMPLEMENTATION OF APPROXIMATE SOFTMAX FUNCTION FOR EFFICIENT CNN INFERENCEFPGA IMPLEMENTATION OF APPROXIMATE SOFTMAX FUNCTION FOR EFFICIENT CNN INFERENCE
FPGA IMPLEMENTATION OF APPROXIMATE SOFTMAX FUNCTION FOR EFFICIENT CNN INFERENCE
 
Wireless Multimedia Sensor Network: A Survey on Multimedia Sensors
Wireless Multimedia Sensor Network: A Survey on Multimedia SensorsWireless Multimedia Sensor Network: A Survey on Multimedia Sensors
Wireless Multimedia Sensor Network: A Survey on Multimedia Sensors
 
Kq3518291832
Kq3518291832Kq3518291832
Kq3518291832
 
IRJET - Positioning and Tracking of a Person using Embedded Controller in a D...
IRJET - Positioning and Tracking of a Person using Embedded Controller in a D...IRJET - Positioning and Tracking of a Person using Embedded Controller in a D...
IRJET - Positioning and Tracking of a Person using Embedded Controller in a D...
 
IoT-based Autonomously Driven Vehicle by using Machine Learning & Image Proce...
IoT-based Autonomously Driven Vehicle by using Machine Learning & Image Proce...IoT-based Autonomously Driven Vehicle by using Machine Learning & Image Proce...
IoT-based Autonomously Driven Vehicle by using Machine Learning & Image Proce...
 
Math of Explaining SAM
Math of Explaining SAMMath of Explaining SAM
Math of Explaining SAM
 
Imaging automotive 2015 addfor v002
Imaging automotive 2015   addfor v002Imaging automotive 2015   addfor v002
Imaging automotive 2015 addfor v002
 
Imaging automotive 2015 addfor v002
Imaging automotive 2015   addfor v002Imaging automotive 2015   addfor v002
Imaging automotive 2015 addfor v002
 
Ku3419461949
Ku3419461949Ku3419461949
Ku3419461949
 
IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application
 IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application
IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application
 
Biomedical image transmission based on Modified feistal algorithm
Biomedical image transmission based on Modified feistal algorithmBiomedical image transmission based on Modified feistal algorithm
Biomedical image transmission based on Modified feistal algorithm
 
CAD STANDARDS - SMART MANUFACTURING MECH
CAD STANDARDS - SMART MANUFACTURING MECHCAD STANDARDS - SMART MANUFACTURING MECH
CAD STANDARDS - SMART MANUFACTURING MECH
 
Design the implementation of CDEx Robust DC Motor.
Design the implementation of CDEx Robust DC Motor.Design the implementation of CDEx Robust DC Motor.
Design the implementation of CDEx Robust DC Motor.
 
LSB & DWT BASED DIGITAL WATERMARKING SYSTEM FOR VIDEO AUTHENTICATION.
LSB & DWT BASED DIGITAL WATERMARKING SYSTEM FOR VIDEO AUTHENTICATION.LSB & DWT BASED DIGITAL WATERMARKING SYSTEM FOR VIDEO AUTHENTICATION.
LSB & DWT BASED DIGITAL WATERMARKING SYSTEM FOR VIDEO AUTHENTICATION.
 
Dataset creation for Deep Learning-based Geometric Computer Vision problems
Dataset creation for Deep Learning-based Geometric Computer Vision problemsDataset creation for Deep Learning-based Geometric Computer Vision problems
Dataset creation for Deep Learning-based Geometric Computer Vision problems
 

Recently uploaded

Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
Jisc
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
TechSoup
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
GeoBlogs
 
Polish students' mobility in the Czech Republic
Polish students' mobility in the Czech RepublicPolish students' mobility in the Czech Republic
Polish students' mobility in the Czech Republic
Anna Sz.
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
Celine George
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
Jheel Barad
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
Col Mukteshwar Prasad
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
Balvir Singh
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
JosvitaDsouza2
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
Excellence Foundation for South Sudan
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
Jisc
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
beazzy04
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
MIRIAMSALINAS13
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
RaedMohamed3
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
BhavyaRajput3
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
MysoreMuleSoftMeetup
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
Tamralipta Mahavidyalaya
 
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdfESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
Fundacja Rozwoju Społeczeństwa Przedsiębiorczego
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 

Recently uploaded (20)

Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
 
Polish students' mobility in the Czech Republic
Polish students' mobility in the Czech RepublicPolish students' mobility in the Czech Republic
Polish students' mobility in the Czech Republic
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
 
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdfESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 

Smart Camera as Embedded System

  • 1. Smart Cameras as Embedded Systems B. Swarnalatha M.Tech VLSI 12651D5710 Adams Engineering College Paloncha. ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710
  • 2. Overview of Seminar  Image  Video  Digital Camera & Smart Camera  Detection and recognition algorithms Low level processing High level processing  Towards and Embedded System Requirements Components  Core Processor TriMedia  Advancements in VLSI required to implement Embedded Smart camera ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710
  • 3. IMAGE An image may be defined as a two-dimensional function f(x, y) where x and y are spatial (plane) coordinates, and the amplitude of f at any pair of coordinates (x, y) is called the intensity or gray level of the image at that point. A small region in the image is shown in matrix. 10 12 35 54 34 23 201 2 10 12 4 5 6 7 8 9 9 9 0 87 6 8 0 7 68 8 9 09 6 5 87 88 7 9 9 8 8 8 8 8 8 0 8 8 89 9 90 0 0 5 00 8 54 4 55 6 76 7 4 6 99 3 65 7 7 89 7 6 7 6 6 6 78 9 166 6 4 44 4 5 55 43 2 45 6 54 67 45 7 ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710 3 8 77 6 54 87 5 7 98 54
  • 5. Digital Camera and Smart Camera Digital Cameras capture only images as digital files that users can upload to their Computer , manipulate with software and distribute electronically. Eg. Nikon Smart Cameras capture high-level descriptions of the scene and analyze What they see. These devices could support a wide variety of applications including human and animal detection, surveillance, motion analysis, and facial identification Eg. Windows for KINECT Digital Camera ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710 SMART Digital Camera
  • 6. Detection and Recognition Algorithms Low Level Processing •Region Extraction •Contour Following •Ellipse fitting •Graph Matching High Level Processing • Hidden Markov Models •Classifiers ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710
  • 7. DETECTION AND RECOGNITION ALGORITHMS Low level processing  Region Extraction The subject to be identified for gesture recognition in the video frames are extracted. Fig2. (b) • Contour following Grouping of pixels into contours that geometrically define the regions. Fig2. (c) • Ellipse fitting To correct for deformations in image processing caused by clothing, objects in the frame, or some body parts blocking others, an algorithm fits ellipses to the pixel regions to provide simplified part attributes. Fig2. (d) • Graph matching Meaningful feature vectors are extracted from the modeled body parts with ellipses. Figure2 ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710
  • 8. High level Processing The high level processing component , which can be adopted to different Applications, compares the motion pattern of each body part. Example, a pointing gesture could be recognized as a command to “go to the next slide” in a smart meeting room or “open the window” in a smart car , Where as a smart security camera might interpret the gesture as suspicious or threatening. ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710
  • 9. Human Detection and Activity Recognition Algorithm ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710
  • 10. Towards an Embedded Smart Camera Requirements Frame rate: The embedded smart camera system must process a certain amount of frames per second to properly analyze motion and provide useful results Latency: The amount of time takes to produce a result from the processed frames Components • 100 MHz Philips TriMedia TM-1000 as video processor. • Hi8 Cameras • Shared memory interface • Host computer • Debugging algorithms and programs • Networked system for connecting multiple cameras Smart Meeting Room ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710
  • 11. TriMedia Processor TM-1000 The Philips TriMedia TM1000 family of devices have a higher performance Very Long Instruction word (VLIW ) core. ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710
  • 12. TriMedia Processor TM-1000 Features • a 5-issue VLIW architecture with a 32-bit word size; • 27 functional units, offering a choice of operation types in each slot in the instruction; • any operation can be guarded to provide conditional execution without branching; • instruction set and functional units optimized with respect to media processing; • a single multi-ported register file with bypass network, allowing 1-cycle latency operations; • 32 kB, 8-way instruction cache; • 16kB, 8-way, quasi-dual ported, data cache; • a variable-length (compressed) instruction set design ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710
  • 13. Advancements in VLSI required to implement a smart camera embedded system Algorithmic challenges Choosing best computationally efficient algorithm with minimum memory usage. Library Functions The library function of the processor should provide special function to provide Instruction level-parallelism Eg1. INONZERO: This instruction takes two input operands. If the first is non zero, the destination is set to the value of the second operand; otherwise it is set to zero. Eg2. IABS: This instruction can provide absolute values ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710
  • 14. Advancements in VLSI required to implement a smart camera embedded system Control-to-data transformation The data transformation can be controlled using a processor with more functional units. Designing SINGLE-INSTRUCTION MULTIPLE-DATA (SIMD) Processors to achieve real time performance.  Existing processors like (80xx, INTEL ) are pixel plane processors. These processor can perform arithmetic and logical operations with limited no of operands.  Embedding single-instruction multiple-data (SIMD) processors into sensors is critical to improve the real time performance.  Processor architectures are to be designed to take multiple data in one instruction to increase the computation power required to meet the real time challenges. ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710
  • 15. Reference: Wayne Wolf, Burak Ozer, Tiehan Lv “Smart Camera as Embedded Systems”. IEEE Trans. Vol. 45, 2002. Copy right IEEE ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710
  • 16. THANK YOU ADAMS ENGINEERING COLLEGE; M.Tech VLSI; 12651D5710