Fcv taxo perona

260 views
203 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
260
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Fcv taxo perona

  1. 1. Hilbert problems and challenges Pietro Perona California Institute of Technology NSF Frontiers in Vision Workshop Cambridge - 21-23 Aug. 2011Friday, August 26, 2011
  2. 2. Scene understandingFriday, August 26, 2011
  3. 3. Scene understanding 1 x= X X Z O xFriday, August 26, 2011
  4. 4. Vision in control loopFriday, August 26, 2011
  5. 5. Other sensors...Friday, August 26, 2011
  6. 6. scene vision in the loop understandingease of experimentation goal representation decision/action active perception other sensorsFriday, August 26, 2011
  7. 7. Visual recognitionFriday, August 26, 2011
  8. 8. Recognizing.. Materials Objects Actions ScenesFriday, August 26, 2011
  9. 9. Recognizing.. Materials Objects Actions ScenesFriday, August 26, 2011
  10. 10. Recognizing.. Materials Objects Actions ScenesFriday, August 26, 2011
  11. 11. Recognizing.. Materials Objects Actions ScenesFriday, August 26, 2011
  12. 12. Recognizing.. Materials Objects Actions ScenesFriday, August 26, 2011
  13. 13. Recognizing.. Materials Objects Actions ScenesFriday, August 26, 2011
  14. 14. Recognizing.. Materials Objects Actions ScenesFriday, August 26, 2011
  15. 15. Recognizing.. Materials Objects Actions ScenesFriday, August 26, 2011
  16. 16. Recognizing.. Materials Objects Actions ScenesFriday, August 26, 2011
  17. 17. Geometry and materialsFriday, August 26, 2011
  18. 18. How many?Friday, August 26, 2011
  19. 19. Weakly supervised learning Transfer learningFriday, August 26, 2011
  20. 20. Incremental learning ...Friday, August 26, 2011
  21. 21. Subordinate categorizationFriday, August 26, 2011
  22. 22. Organizing visual knowledgeFriday, August 26, 2011
  23. 23. Intentions, causes, consequences, ...Friday, August 26, 2011
  24. 24. Behavior, eventsFriday, August 26, 2011
  25. 25. Friday, August 26, 2011
  26. 26. Friday, August 26, 2011
  27. 27. Perception PSYCHOLOGY interaction, cooperation, competition plans, goals, behavior, relationships ... pose, movemes, actions, activities, objects, scenes SENSORY images, trajectories WorldFriday, August 26, 2011
  28. 28. Action Perception PSYCHOLOGY interaction, cooperation, PLANNING group-level goals and plans competition SOCIAL NETWORK THEORY OF SOCIOLOGY INDIVIDUAL plans, goals, behavior, individual goals and plans relationships ... PREFRONTAL CORTEX THEORY OF PSYCHOLOGY pose, movemes, actions, MOTOR motor programs activities, objects, scenes SENSORY MOTOR CORTEX RECOGNITION sensor-based control images, trajectories SPINAL CORD IMAGING,TRACKING WorldFriday, August 26, 2011
  29. 29. Behavior • Hiearchical representation • Interactions • Beyond description: intentions, plans, consequences,Friday, August 26, 2011
  30. 30. Sharing visual representations with humansFriday, August 26, 2011
  31. 31. Friday, August 26, 2011
  32. 32. Friday, August 26, 2011
  33. 33. Grand challengesFriday, August 26, 2011
  34. 34. Drosophila behavior [Dankert et al., Nature Methods, April 2009]Friday, August 26, 2011
  35. 35. Drosophila behavior [Dankert et al., Nature Methods, April 2009]Friday, August 26, 2011
  36. 36. VISIPEDIA Users Images, segments annotations, links, GUIs, diagnostics ExpertsImage databases Annotators Automata Vision scientistsFriday, August 26, 2011
  37. 37. Autonomous driving <<show movie of traffic in India>>Friday, August 26, 2011
  38. 38. Grand challenges • Recognition -> Visipedia • Behavior -> Fly behavior (mouse, ...human) • Scene understanding -> ??? • Vision for action -> Autonomous driving (how about manipulation?) • Sustainable economy -> ???Friday, August 26, 2011
  39. 39. Summary • Scene understanding vs vision-for-action • Recognition: just started, much to be done • Behavior: ditto • Sharing visual knowledge with humans?? • Grand challenges: many, fun and worthwhileFriday, August 26, 2011

×