SlideShare a Scribd company logo
1 of 23
CIDER
enabling robustness-power
tradeoffs on a computational
eyeglass
B00902069 傅蕎
Demo Video
• https://www.youtube.com/watch?v=SSigFWX8mkY
2
CIDER
• Wearable eye tracker
• Power-robustness tradeoff
3
Related work
4
Tradeoffs
• Power
• Sensing
• Computation
• Communication
• Robustness
• Estimation accuracy
• Different illumination conditions (indoor / outdoor)
• Zero affect from users
5
System design
6
System design
• Search-refine controller
• Indoor-outdoor model switching
• Zero-effort model training
7
System design
• Search-refine controller
• Indoor-outdoor model switching
• Zero-effort model training
8
Search-refine controller - search
• Artificial neural network (ANN)
• Input image, output pupil center coordinate and radius
• Objective: minimize sampled pixels
minimize error in pupil center prediction
• Optimization solved offline in advanced
9
Search-refine controller - refine
• Tracking pupil center and size
• Refine the estimation of ANN
10
Search-refine controller - switching
• Only fail when
blinks, specular reflections, shadows, or other artifacts
11
Search-refine controller - NIR
• Near infrared LED
• Key enabler of rapid switching
• High power consumption
• Duty-cycle
• Reduce voltage
• From 180mW to milliwatt
12
System design
• Search-refine controller
• Indoor-outdoor model switching
• Zero-effort model training
13
Indoor-outdoor model switching
• NIR photodiode
• Indoor
• NIR useful
• more power-saving
• Outdoor
• NIR unuseful, too much ambient IR
• more computation
• Negligible switching power and time cost
14
System design
• Search-refine controller
• Indoor-outdoor model switching
• Zero-effort model training
15
Zero-effort model training
• Robust offline method for generating labels from noisy images
• Challenge
• Specular reflection of NIR LED
• Sun cause glasses shadow when outdoor
16
Evaluation
• 4 data set
• Indoor-stable, indoor-variable, outdoor, switching
• Cost metrics
• Sensing, computation, NIR
• Accuracy metrics
• Pupil center, pupil radius
17
Evaluation
• Sensing, computation and NIR cost
18
Evaluation
• Energy saving
19
Evaluation
• Power VS tracking rate
• Estimation accuracy
• CIDER under variable conditions
• Variable pupil dilation
• Outdoor dateset
• Indoor-outdoor switching
• Up to 250 ~ 350 Hz eye tracking frame rate
20
Future work
• Dynamics in glasses position
• Dynamics in environment
• Form-factor
• E.g. face shape
• Embed the camera in glass frame
21
Question?
22
Thank you!:D
23

More Related Content

Similar to Cider: Enabling Robustness Power Tradeoffs on a Computational Eyeglass

Virtual Retinal Display: their falling cost and rising performance
Virtual Retinal Display: their falling cost and rising performanceVirtual Retinal Display: their falling cost and rising performance
Virtual Retinal Display: their falling cost and rising performanceJeffrey Funk
 
“Selecting the Right Camera for Your Embedded Computer Vision Project,” a Pre...
“Selecting the Right Camera for Your Embedded Computer Vision Project,” a Pre...“Selecting the Right Camera for Your Embedded Computer Vision Project,” a Pre...
“Selecting the Right Camera for Your Embedded Computer Vision Project,” a Pre...Edge AI and Vision Alliance
 
Spectacle for computer use
Spectacle  for  computer  useSpectacle  for  computer  use
Spectacle for computer useVishakh Nair
 
Digital photography /certified fixed orthodontic courses by Indian dental aca...
Digital photography /certified fixed orthodontic courses by Indian dental aca...Digital photography /certified fixed orthodontic courses by Indian dental aca...
Digital photography /certified fixed orthodontic courses by Indian dental aca...Indian dental academy
 
MicroStrategy World 2014: Scaling MicroStrategy at eBay
MicroStrategy World 2014: Scaling MicroStrategy at eBayMicroStrategy World 2014: Scaling MicroStrategy at eBay
MicroStrategy World 2014: Scaling MicroStrategy at eBayTim Case
 
Eduroam everywhere - by David Biron
Eduroam everywhere - by David BironEduroam everywhere - by David Biron
Eduroam everywhere - by David BironJisc
 
The Solar Labs presentation for Drones in Large scale analysis
The Solar Labs presentation for Drones in Large scale analysisThe Solar Labs presentation for Drones in Large scale analysis
The Solar Labs presentation for Drones in Large scale analysisRishi Singhal
 
Catalogo dialux ro beu-part1-2
Catalogo dialux ro beu-part1-2Catalogo dialux ro beu-part1-2
Catalogo dialux ro beu-part1-2Jose Suarez
 
Practical Process Control
Practical Process ControlPractical Process Control
Practical Process ControlLiving Online
 
Introduction to MHA Lighting
Introduction to MHA LightingIntroduction to MHA Lighting
Introduction to MHA Lightingadele101
 
BrainTrust IPPD Final Presentation
BrainTrust IPPD Final PresentationBrainTrust IPPD Final Presentation
BrainTrust IPPD Final PresentationMatt Thrush
 
Milliscope ii 2012
Milliscope ii 2012Milliscope ii 2012
Milliscope ii 2012aitproducts
 

Similar to Cider: Enabling Robustness Power Tradeoffs on a Computational Eyeglass (20)

Virtual Retinal Display: their falling cost and rising performance
Virtual Retinal Display: their falling cost and rising performanceVirtual Retinal Display: their falling cost and rising performance
Virtual Retinal Display: their falling cost and rising performance
 
CONDOR @ NGCLE@e-Novia 15.11.2017
CONDOR @ NGCLE@e-Novia 15.11.2017CONDOR @ NGCLE@e-Novia 15.11.2017
CONDOR @ NGCLE@e-Novia 15.11.2017
 
“Selecting the Right Camera for Your Embedded Computer Vision Project,” a Pre...
“Selecting the Right Camera for Your Embedded Computer Vision Project,” a Pre...“Selecting the Right Camera for Your Embedded Computer Vision Project,” a Pre...
“Selecting the Right Camera for Your Embedded Computer Vision Project,” a Pre...
 
Spectacle for computer use
Spectacle  for  computer  useSpectacle  for  computer  use
Spectacle for computer use
 
Evaluation of 3D-Projection Image Capture
Evaluation of 3D-Projection Image CaptureEvaluation of 3D-Projection Image Capture
Evaluation of 3D-Projection Image Capture
 
Digital photography /certified fixed orthodontic courses by Indian dental aca...
Digital photography /certified fixed orthodontic courses by Indian dental aca...Digital photography /certified fixed orthodontic courses by Indian dental aca...
Digital photography /certified fixed orthodontic courses by Indian dental aca...
 
MicroStrategy World 2014: Scaling MicroStrategy at eBay
MicroStrategy World 2014: Scaling MicroStrategy at eBayMicroStrategy World 2014: Scaling MicroStrategy at eBay
MicroStrategy World 2014: Scaling MicroStrategy at eBay
 
Eduroam everywhere - by David Biron
Eduroam everywhere - by David BironEduroam everywhere - by David Biron
Eduroam everywhere - by David Biron
 
The Solar Labs presentation for Drones in Large scale analysis
The Solar Labs presentation for Drones in Large scale analysisThe Solar Labs presentation for Drones in Large scale analysis
The Solar Labs presentation for Drones in Large scale analysis
 
2011 ISLPED: Backlight scaling service
2011 ISLPED: Backlight scaling service2011 ISLPED: Backlight scaling service
2011 ISLPED: Backlight scaling service
 
Catalogo dialux ro beu-part1-2
Catalogo dialux ro beu-part1-2Catalogo dialux ro beu-part1-2
Catalogo dialux ro beu-part1-2
 
Practical Process Control
Practical Process ControlPractical Process Control
Practical Process Control
 
Getting Real about AR
Getting Real about ARGetting Real about AR
Getting Real about AR
 
Introduction to MHA Lighting
Introduction to MHA LightingIntroduction to MHA Lighting
Introduction to MHA Lighting
 
BrainTrust IPPD Final Presentation
BrainTrust IPPD Final PresentationBrainTrust IPPD Final Presentation
BrainTrust IPPD Final Presentation
 
Digtal radiography and imaging
Digtal radiography and imagingDigtal radiography and imaging
Digtal radiography and imaging
 
Milliscope ii 2012
Milliscope ii 2012Milliscope ii 2012
Milliscope ii 2012
 
Digital photography
Digital photographyDigital photography
Digital photography
 
PMF_AAT.pptx
PMF_AAT.pptxPMF_AAT.pptx
PMF_AAT.pptx
 
SUNBIRD LED COMPANY PROFILE
SUNBIRD LED COMPANY PROFILESUNBIRD LED COMPANY PROFILE
SUNBIRD LED COMPANY PROFILE
 

Recently uploaded

(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...ranjana rawat
 
Microscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxMicroscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxpurnimasatapathy1234
 
Introduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptxIntroduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptxupamatechverse
 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130Suhani Kapoor
 
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Dr.Costas Sachpazis
 
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...srsj9000
 
MANUFACTURING PROCESS-II UNIT-2 LATHE MACHINE
MANUFACTURING PROCESS-II UNIT-2 LATHE MACHINEMANUFACTURING PROCESS-II UNIT-2 LATHE MACHINE
MANUFACTURING PROCESS-II UNIT-2 LATHE MACHINESIVASHANKAR N
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxpranjaldaimarysona
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSSIVASHANKAR N
 
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
 
the ladakh protest in leh ladakh 2024 sonam wangchuk.pptx
the ladakh protest in leh ladakh 2024 sonam wangchuk.pptxthe ladakh protest in leh ladakh 2024 sonam wangchuk.pptx
the ladakh protest in leh ladakh 2024 sonam wangchuk.pptxhumanexperienceaaa
 
Extrusion Processes and Their Limitations
Extrusion Processes and Their LimitationsExtrusion Processes and Their Limitations
Extrusion Processes and Their Limitations120cr0395
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )Tsuyoshi Horigome
 
GDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSCAESB
 
Porous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writingPorous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writingrakeshbaidya232001
 
Software Development Life Cycle By Team Orange (Dept. of Pharmacy)
Software Development Life Cycle By  Team Orange (Dept. of Pharmacy)Software Development Life Cycle By  Team Orange (Dept. of Pharmacy)
Software Development Life Cycle By Team Orange (Dept. of Pharmacy)Suman Mia
 

Recently uploaded (20)

(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
 
Microscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxMicroscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptx
 
Call Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCR
Call Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCRCall Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCR
Call Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCR
 
DJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINE
DJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINEDJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINE
DJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINE
 
Introduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptxIntroduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptx
 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
 
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
 
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
 
MANUFACTURING PROCESS-II UNIT-2 LATHE MACHINE
MANUFACTURING PROCESS-II UNIT-2 LATHE MACHINEMANUFACTURING PROCESS-II UNIT-2 LATHE MACHINE
MANUFACTURING PROCESS-II UNIT-2 LATHE MACHINE
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptx
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
 
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
the ladakh protest in leh ladakh 2024 sonam wangchuk.pptx
the ladakh protest in leh ladakh 2024 sonam wangchuk.pptxthe ladakh protest in leh ladakh 2024 sonam wangchuk.pptx
the ladakh protest in leh ladakh 2024 sonam wangchuk.pptx
 
Extrusion Processes and Their Limitations
Extrusion Processes and Their LimitationsExtrusion Processes and Their Limitations
Extrusion Processes and Their Limitations
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )
 
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
 
GDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentation
 
Porous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writingPorous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writing
 
Software Development Life Cycle By Team Orange (Dept. of Pharmacy)
Software Development Life Cycle By  Team Orange (Dept. of Pharmacy)Software Development Life Cycle By  Team Orange (Dept. of Pharmacy)
Software Development Life Cycle By Team Orange (Dept. of Pharmacy)
 

Cider: Enabling Robustness Power Tradeoffs on a Computational Eyeglass

Editor's Notes

  1. Sensing pixel/image, high frame rate consume more power -> subsampling, reduce resolution, fewer frame Computation process image to find eye pupil center and dilation -> trim computational requirement VS robustness Communication offload the computation always on-radio consume power, data rate No need train user neural network model automatically retrain when needed
  2. 2 stage eye tracking controller: search / refine Indoor-outdoor switching model
  3. 1. Search pixels near pupil center 3. Edge detection to find different part of eye 5. Assume pupil is circle
  4. Help tracking pupil too Reduce V will cause increased noise
  5. Camera and ANN parameters need to be adjusted Negligible switching power and time cost
  6. Challenge Fill the hole, reflection < pupil Find roundest segment