SlideShare a Scribd company logo
1 of 45
Unsupervised learning of visual representations and their use in object & face recognition Gary Cottrell Chris Kanan  Honghao Shan Lingyun Zhang  Matthew Tong Tim Marks
Collaborators Honghao Shan Chris Kanan
Collaborators Tim Marks Matt Tong Lingyun Zhang
Efficient Encoding of the world ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Efficient Encoding of the world leads to magno- and parvo-cellular response properties… This suggests that these cell types exist  because  they  are  useful for efficiently encoding the temporal dynamics of the world. Trained on grayscale images Trained on color images Spatial extent Temporal extent Trained on video cubes Midget? Parasol? Persistent, small Transient, large
Efficient Encoding of the world leads to gammatone filters as in auditory nerves: ,[object Object]
Efficient Encoding of the world ,[object Object],[object Object],[object Object],[object Object]
Unsupervised Learning of Hierarchical Representations  (RICA 2.0; cf. Shan et al., NIPS 19) ,[object Object],[object Object],[object Object],[object Object]
Unsupervised Learning of Hierarchical Representations  (RICA 2.0; cf. Shan et al., NIPS 19) ,[object Object],[object Object],[object Object],[object Object]
Unsupervised Learning of Hierarchical Representations  (RICA 2.0; cf. Shan et al., NIPS 19) ,[object Object]
Unsupervised Learning of Hierarchical Representations  (RICA 2.0; cf. Shan et al., NIPS 19) ,[object Object],[object Object],SPCA SPCA
Unsupervised Learning of Hierarchical Representations  (RICA 2.0; cf. Shan et al., NIPS 19) ,[object Object],[object Object],[object Object],[object Object],[object Object]
Unsupervised Learning of Hierarchical Representations  (RICA 2.0; cf. Shan et al., NIPS 19) ,[object Object],[object Object],[object Object],[object Object],[object Object],The left two columns are consistent with Anzen, Peng, & Van Essen 2007. The right hand column is a prediction
Unsupervised Learning of Hierarchical Representations  (RICA 2.0; cf. Shan et al., NIPS 19) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],Nice, but is it useful?
[object Object],[object Object],[object Object],One reason why this might be a good idea…
[object Object],[object Object],[object Object],Main Idea
[object Object],[object Object],[object Object],Main Idea
Stored memories of Bob Stored memories of Alice New fragments Result: 7 votes for Alice, only 3 for Bob. It’s Alice!
Voting ,[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],Overview of the system
[object Object],[object Object],NIMBLE vs. Computer Vision Image Global Features Global Classifier Decision
 
Belief After 1 Fixation Belief After 10 Fixations
[object Object],[object Object],[object Object],Robust Vision
Cal Tech 101: 101 Different Categories AR dataset: 120 Different People with different  lighting, expression, and accessories
[object Object]
[object Object]
[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object]
[object Object],[object Object]
 
Again, best for single feature-type systems and for 1 training instance better than all systems
[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],This work was supported by the NSF (grant #SBE-0542013) to the Temporal Dynamics of Learning Center.
Thanks!
Sparse Principal Components Analysis ,[object Object],[object Object]
The SPCA model as a neural net… It is A T  that is mostly  0 …
Results ,[object Object]
Results ,[object Object],[object Object]
Results ,[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object]
 

More Related Content

What's hot

Face recognition using neural network
Face recognition using neural networkFace recognition using neural network
Face recognition using neural network
Indira Nayak
 
Soft Computing-173101
Soft Computing-173101Soft Computing-173101
Soft Computing-173101
AMIT KUMAR
 
soft-computing
 soft-computing soft-computing
soft-computing
student
 

What's hot (16)

Face recognition using neural network
Face recognition using neural networkFace recognition using neural network
Face recognition using neural network
 
Face Identification Project Abstract 2017
Face Identification Project Abstract 2017Face Identification Project Abstract 2017
Face Identification Project Abstract 2017
 
Soft Computing-173101
Soft Computing-173101Soft Computing-173101
Soft Computing-173101
 
Neural Networks for Pattern Recognition
Neural Networks for Pattern RecognitionNeural Networks for Pattern Recognition
Neural Networks for Pattern Recognition
 
Introduction to Soft Computing
Introduction to Soft Computing Introduction to Soft Computing
Introduction to Soft Computing
 
intelligent system
intelligent systemintelligent system
intelligent system
 
Deep Learning aplicado al diagnostico de Alzheimer | BioInformaticsGRX
Deep Learning aplicado al diagnostico de Alzheimer | BioInformaticsGRXDeep Learning aplicado al diagnostico de Alzheimer | BioInformaticsGRX
Deep Learning aplicado al diagnostico de Alzheimer | BioInformaticsGRX
 
Neural networks
Neural networksNeural networks
Neural networks
 
Soft Computing
Soft ComputingSoft Computing
Soft Computing
 
SoftComputing1
SoftComputing1SoftComputing1
SoftComputing1
 
Facebook Deep face
Facebook Deep faceFacebook Deep face
Facebook Deep face
 
KaoNet: Face Recognition and Generation App using Deep Learning
KaoNet: Face Recognition and Generation App using Deep LearningKaoNet: Face Recognition and Generation App using Deep Learning
KaoNet: Face Recognition and Generation App using Deep Learning
 
soft-computing
 soft-computing soft-computing
soft-computing
 
Emotion detection using cnn.pptx
Emotion detection using cnn.pptxEmotion detection using cnn.pptx
Emotion detection using cnn.pptx
 
Rupesh-ibPRIA final
Rupesh-ibPRIA finalRupesh-ibPRIA final
Rupesh-ibPRIA final
 
Neural networks and deep learning
Neural networks and deep learningNeural networks and deep learning
Neural networks and deep learning
 

Viewers also liked (7)

Getting the Most Out of Your Website
Getting the Most Out of Your WebsiteGetting the Most Out of Your Website
Getting the Most Out of Your Website
 
75162 unit-g325-critical-perspectives-in-media-specimen
75162 unit-g325-critical-perspectives-in-media-specimen75162 unit-g325-critical-perspectives-in-media-specimen
75162 unit-g325-critical-perspectives-in-media-specimen
 
G325 section a january 2011 i
G325 section a january 2011 iG325 section a january 2011 i
G325 section a january 2011 i
 
El grano de café
El grano de caféEl grano de café
El grano de café
 
Power grup experts 2
Power grup experts 2Power grup experts 2
Power grup experts 2
 
Words open evening
Words open eveningWords open evening
Words open evening
 
179236 example-candidate-answers-from-june-2013
179236 example-candidate-answers-from-june-2013179236 example-candidate-answers-from-june-2013
179236 example-candidate-answers-from-june-2013
 

Similar to Fcv bio cv_cottrell

19 3 sep17 21may 6657 t269 revised (edit ndit)
19 3 sep17 21may 6657 t269 revised (edit ndit)19 3 sep17 21may 6657 t269 revised (edit ndit)
19 3 sep17 21may 6657 t269 revised (edit ndit)
IAESIJEECS
 
20141003.journal club
20141003.journal club20141003.journal club
20141003.journal club
Hayaru SHOUNO
 
NIPS2007: deep belief nets
NIPS2007: deep belief netsNIPS2007: deep belief nets
NIPS2007: deep belief nets
zukun
 
Integrated Hidden Markov Model and Kalman Filter for Online Object Tracking
Integrated Hidden Markov Model and Kalman Filter for Online Object TrackingIntegrated Hidden Markov Model and Kalman Filter for Online Object Tracking
Integrated Hidden Markov Model and Kalman Filter for Online Object Tracking
ijsrd.com
 
Fuzzy Logic Final Report
Fuzzy Logic Final ReportFuzzy Logic Final Report
Fuzzy Logic Final Report
Shikhar Agarwal
 
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
Chris Rackauckas
 
Summary Of Thesis
Summary Of ThesisSummary Of Thesis
Summary Of Thesis
guestb452d6
 

Similar to Fcv bio cv_cottrell (20)

Dynamic Routing Between Capsules
Dynamic Routing Between CapsulesDynamic Routing Between Capsules
Dynamic Routing Between Capsules
 
19 3 sep17 21may 6657 t269 revised (edit ndit)
19 3 sep17 21may 6657 t269 revised (edit ndit)19 3 sep17 21may 6657 t269 revised (edit ndit)
19 3 sep17 21may 6657 t269 revised (edit ndit)
 
Machine learning in science and industry — day 4
Machine learning in science and industry — day 4Machine learning in science and industry — day 4
Machine learning in science and industry — day 4
 
Deborah_Sandoval
Deborah_SandovalDeborah_Sandoval
Deborah_Sandoval
 
Face recognition using laplacianfaces
Face recognition using laplacianfaces Face recognition using laplacianfaces
Face recognition using laplacianfaces
 
20141003.journal club
20141003.journal club20141003.journal club
20141003.journal club
 
Standard Statistical Feature analysis of Image Features for Facial Images usi...
Standard Statistical Feature analysis of Image Features for Facial Images usi...Standard Statistical Feature analysis of Image Features for Facial Images usi...
Standard Statistical Feature analysis of Image Features for Facial Images usi...
 
fuzzy LBP for face recognition ppt
fuzzy LBP for face recognition pptfuzzy LBP for face recognition ppt
fuzzy LBP for face recognition ppt
 
NIPS2007: deep belief nets
NIPS2007: deep belief netsNIPS2007: deep belief nets
NIPS2007: deep belief nets
 
Recent advances of AI for medical imaging : Engineering perspectives
Recent advances of AI for medical imaging : Engineering perspectivesRecent advances of AI for medical imaging : Engineering perspectives
Recent advances of AI for medical imaging : Engineering perspectives
 
H0334749
H0334749H0334749
H0334749
 
Integrated Hidden Markov Model and Kalman Filter for Online Object Tracking
Integrated Hidden Markov Model and Kalman Filter for Online Object TrackingIntegrated Hidden Markov Model and Kalman Filter for Online Object Tracking
Integrated Hidden Markov Model and Kalman Filter for Online Object Tracking
 
ANN.ppt[1].pptx
ANN.ppt[1].pptxANN.ppt[1].pptx
ANN.ppt[1].pptx
 
Artifical neural networks
Artifical neural networksArtifical neural networks
Artifical neural networks
 
D017322027
D017322027D017322027
D017322027
 
Pose Invariant Face Recognition using Neuro-Fuzzy Approach
Pose Invariant Face Recognition using Neuro-Fuzzy ApproachPose Invariant Face Recognition using Neuro-Fuzzy Approach
Pose Invariant Face Recognition using Neuro-Fuzzy Approach
 
Fuzzy Logic Final Report
Fuzzy Logic Final ReportFuzzy Logic Final Report
Fuzzy Logic Final Report
 
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
 
IEEE Fuzzy system Title and Abstract 2016
IEEE Fuzzy system Title and Abstract 2016 IEEE Fuzzy system Title and Abstract 2016
IEEE Fuzzy system Title and Abstract 2016
 
Summary Of Thesis
Summary Of ThesisSummary Of Thesis
Summary Of Thesis
 

More from zukun

My lyn tutorial 2009
My lyn tutorial 2009My lyn tutorial 2009
My lyn tutorial 2009
zukun
 
ETHZ CV2012: Tutorial openCV
ETHZ CV2012: Tutorial openCVETHZ CV2012: Tutorial openCV
ETHZ CV2012: Tutorial openCV
zukun
 
ETHZ CV2012: Information
ETHZ CV2012: InformationETHZ CV2012: Information
ETHZ CV2012: Information
zukun
 
Siwei lyu: natural image statistics
Siwei lyu: natural image statisticsSiwei lyu: natural image statistics
Siwei lyu: natural image statistics
zukun
 
Lecture9 camera calibration
Lecture9 camera calibrationLecture9 camera calibration
Lecture9 camera calibration
zukun
 
Brunelli 2008: template matching techniques in computer vision
Brunelli 2008: template matching techniques in computer visionBrunelli 2008: template matching techniques in computer vision
Brunelli 2008: template matching techniques in computer vision
zukun
 
Modern features-part-4-evaluation
Modern features-part-4-evaluationModern features-part-4-evaluation
Modern features-part-4-evaluation
zukun
 
Modern features-part-3-software
Modern features-part-3-softwareModern features-part-3-software
Modern features-part-3-software
zukun
 
Modern features-part-2-descriptors
Modern features-part-2-descriptorsModern features-part-2-descriptors
Modern features-part-2-descriptors
zukun
 
Modern features-part-1-detectors
Modern features-part-1-detectorsModern features-part-1-detectors
Modern features-part-1-detectors
zukun
 
Modern features-part-0-intro
Modern features-part-0-introModern features-part-0-intro
Modern features-part-0-intro
zukun
 
Lecture 02 internet video search
Lecture 02 internet video searchLecture 02 internet video search
Lecture 02 internet video search
zukun
 
Lecture 01 internet video search
Lecture 01 internet video searchLecture 01 internet video search
Lecture 01 internet video search
zukun
 
Lecture 03 internet video search
Lecture 03 internet video searchLecture 03 internet video search
Lecture 03 internet video search
zukun
 
Icml2012 tutorial representation_learning
Icml2012 tutorial representation_learningIcml2012 tutorial representation_learning
Icml2012 tutorial representation_learning
zukun
 
Advances in discrete energy minimisation for computer vision
Advances in discrete energy minimisation for computer visionAdvances in discrete energy minimisation for computer vision
Advances in discrete energy minimisation for computer vision
zukun
 
Gephi tutorial: quick start
Gephi tutorial: quick startGephi tutorial: quick start
Gephi tutorial: quick start
zukun
 
EM algorithm and its application in probabilistic latent semantic analysis
EM algorithm and its application in probabilistic latent semantic analysisEM algorithm and its application in probabilistic latent semantic analysis
EM algorithm and its application in probabilistic latent semantic analysis
zukun
 
Object recognition with pictorial structures
Object recognition with pictorial structuresObject recognition with pictorial structures
Object recognition with pictorial structures
zukun
 
Iccv2011 learning spatiotemporal graphs of human activities
Iccv2011 learning spatiotemporal graphs of human activities Iccv2011 learning spatiotemporal graphs of human activities
Iccv2011 learning spatiotemporal graphs of human activities
zukun
 

More from zukun (20)

My lyn tutorial 2009
My lyn tutorial 2009My lyn tutorial 2009
My lyn tutorial 2009
 
ETHZ CV2012: Tutorial openCV
ETHZ CV2012: Tutorial openCVETHZ CV2012: Tutorial openCV
ETHZ CV2012: Tutorial openCV
 
ETHZ CV2012: Information
ETHZ CV2012: InformationETHZ CV2012: Information
ETHZ CV2012: Information
 
Siwei lyu: natural image statistics
Siwei lyu: natural image statisticsSiwei lyu: natural image statistics
Siwei lyu: natural image statistics
 
Lecture9 camera calibration
Lecture9 camera calibrationLecture9 camera calibration
Lecture9 camera calibration
 
Brunelli 2008: template matching techniques in computer vision
Brunelli 2008: template matching techniques in computer visionBrunelli 2008: template matching techniques in computer vision
Brunelli 2008: template matching techniques in computer vision
 
Modern features-part-4-evaluation
Modern features-part-4-evaluationModern features-part-4-evaluation
Modern features-part-4-evaluation
 
Modern features-part-3-software
Modern features-part-3-softwareModern features-part-3-software
Modern features-part-3-software
 
Modern features-part-2-descriptors
Modern features-part-2-descriptorsModern features-part-2-descriptors
Modern features-part-2-descriptors
 
Modern features-part-1-detectors
Modern features-part-1-detectorsModern features-part-1-detectors
Modern features-part-1-detectors
 
Modern features-part-0-intro
Modern features-part-0-introModern features-part-0-intro
Modern features-part-0-intro
 
Lecture 02 internet video search
Lecture 02 internet video searchLecture 02 internet video search
Lecture 02 internet video search
 
Lecture 01 internet video search
Lecture 01 internet video searchLecture 01 internet video search
Lecture 01 internet video search
 
Lecture 03 internet video search
Lecture 03 internet video searchLecture 03 internet video search
Lecture 03 internet video search
 
Icml2012 tutorial representation_learning
Icml2012 tutorial representation_learningIcml2012 tutorial representation_learning
Icml2012 tutorial representation_learning
 
Advances in discrete energy minimisation for computer vision
Advances in discrete energy minimisation for computer visionAdvances in discrete energy minimisation for computer vision
Advances in discrete energy minimisation for computer vision
 
Gephi tutorial: quick start
Gephi tutorial: quick startGephi tutorial: quick start
Gephi tutorial: quick start
 
EM algorithm and its application in probabilistic latent semantic analysis
EM algorithm and its application in probabilistic latent semantic analysisEM algorithm and its application in probabilistic latent semantic analysis
EM algorithm and its application in probabilistic latent semantic analysis
 
Object recognition with pictorial structures
Object recognition with pictorial structuresObject recognition with pictorial structures
Object recognition with pictorial structures
 
Iccv2011 learning spatiotemporal graphs of human activities
Iccv2011 learning spatiotemporal graphs of human activities Iccv2011 learning spatiotemporal graphs of human activities
Iccv2011 learning spatiotemporal graphs of human activities
 

Recently uploaded

Recently uploaded (20)

Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 

Fcv bio cv_cottrell

  • 1. Unsupervised learning of visual representations and their use in object & face recognition Gary Cottrell Chris Kanan Honghao Shan Lingyun Zhang Matthew Tong Tim Marks
  • 3. Collaborators Tim Marks Matt Tong Lingyun Zhang
  • 4.
  • 5. Efficient Encoding of the world leads to magno- and parvo-cellular response properties… This suggests that these cell types exist because they are useful for efficiently encoding the temporal dynamics of the world. Trained on grayscale images Trained on color images Spatial extent Temporal extent Trained on video cubes Midget? Parasol? Persistent, small Transient, large
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19. Stored memories of Bob Stored memories of Alice New fragments Result: 7 votes for Alice, only 3 for Bob. It’s Alice!
  • 20.
  • 21.
  • 22.
  • 23.  
  • 24. Belief After 1 Fixation Belief After 10 Fixations
  • 25.
  • 26. Cal Tech 101: 101 Different Categories AR dataset: 120 Different People with different lighting, expression, and accessories
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.  
  • 34. Again, best for single feature-type systems and for 1 training instance better than all systems
  • 35.
  • 36.
  • 37.
  • 39.
  • 40. The SPCA model as a neural net… It is A T that is mostly 0 …
  • 41.
  • 42.
  • 43.
  • 44.
  • 45.  

Editor's Notes

  1. 12/30/11 8:40 -
  2. 12/30/11 This is in stark contrast to the predominant methods used in computer vision, and even many models in computational neurosciece Line 1: one-shot system Line 2: active vision Note that the bottom approach is primate-like (although pretty dumbed down) Note that I’m leaving out most of the details
  3. 12/30/11 Humans make ~170,000 saccades each day
  4. 12/30/11 Explain how it uses a saliency map to acquire information and how as it serially acquires more information over time NIMBLE becomes more confident about the correct category.
  5. 12/30/11 ~64 fixations required to achieve 99% of maximum accuracy Averaged over 10 cross validation runs
  6. 12/30/11 Note that this is a comparison versus the best results using a single feature type and looks at percent improvement in performance (not absolute improvement, so it is 1 - (Nimble Perf / Best One-Desc Perf) Mention training instances on X-axis
  7. 12/30/11 Note again that NIMBLE performs very well using few training images even when dealing with disguises
  8. 12/30/11 We showed that NIMBLE is not a toy cognitive model, but one with real-world applicability This work was supported by the NSF (grant #SBE-0542013) to the Temporal Dynamics of Learning Center., G.W. Cottrell, PI.
  9. Include in the overview information on the purpose and mission of the SLC, the strategic concept and milestones, achievements, new directions; the organization of the research thrusts (or equivalent); value of the Center mode; and the integrative nature and relationship of all following presentations (scientific and other) to research and overall vision of Center. The Center’s vision should address each of the SLC program goals: advancing the frontiers of the science of learning through integrated research; connecting this research to specific scientific, technological, educational, and workforce challenges; and enabling research communities that can capitalize on new opportunities and discoveries and respond to new challenges.
  10. Include in the overview information on the purpose and mission of the SLC, the strategic concept and milestones, achievements, new directions; the organization of the research thrusts (or equivalent); value of the Center mode; and the integrative nature and relationship of all following presentations (scientific and other) to research and overall vision of Center. The Center’s vision should address each of the SLC program goals: advancing the frontiers of the science of learning through integrated research; connecting this research to specific scientific, technological, educational, and workforce challenges; and enabling research communities that can capitalize on new opportunities and discoveries and respond to new challenges.