Your SlideShare is downloading. ×
0
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Fcv appli science_perona
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Fcv appli science_perona

145

Published on

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
145
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Applications to Science Pietro Perona California Institute of Technology NSF Workshop - Frontiers in Vision Cambridge, 23 Aug 2011Friday, August 26, 2011
  • 2. Goals • A few examples • Implications for machine vision • Lessons learned • NSF’s roleFriday, August 26, 2011
  • 3. Plan • Intro (5’) • Sketch of a few success stories (50’) • Discussion (10’)Friday, August 26, 2011
  • 4. ‘Lunging’ (view from top)Friday, August 26, 2011
  • 5. Why measure behaviorFriday, August 26, 2011
  • 6. Why measure behavior • Genes <<>> Brains <<>> BehaviorFriday, August 26, 2011
  • 7. Why measure behavior • Genes <<>> Brains <<>> Behavior • EthologyFriday, August 26, 2011
  • 8. Why measure behavior • Genes <<>> Brains <<>> Behavior • Ethology • What is behavior?Friday, August 26, 2011
  • 9. Fly behavior (as we understand it today) Adapted from: Kravitz et al. PNAS April 16, 2002 vol. 99 no. 8 5664–5668Friday, August 26, 2011
  • 10. Friday, August 26, 2011
  • 11. Friday, August 26, 2011
  • 12. Detection performance [Dankert et al., Nature Methods, April 2009]Friday, August 26, 2011
  • 13. Phenotyping [Dankert et al., Nature Methods, 2009]Friday, August 26, 2011
  • 14. Ethograms [Dankert et al., Nature Methods, April 2009]Friday, August 26, 2011
  • 15. Perception PSYCHOLOGY interaction, cooperation, competition plans, goals, behavior, relationships ... pose, movemes, actions, activities, objects, scenes SENSORY images, trajectories WorldFriday, August 26, 2011
  • 16. Action Perception PSYCHOLOGY interaction, cooperation, PLANNING group-level goals and plans competition SOCIAL NETWORK THEORY OF SOCIOLOGY INDIVIDUAL plans, goals, behavior, individual goals and plans relationships ... PREFRONTAL CORTEX THEORY OF PSYCHOLOGY pose, movemes, actions, MOTOR motor programs activities, objects, scenes SENSORY MOTOR CORTEX RECOGNITION sensor-based control images, trajectories SPINAL CORD IMAGING,TRACKING WorldFriday, August 26, 2011
  • 17. Lessons learned • Image deluge in science • Doing better than the scientists • Payoffs in science, not in MV (short term) ‣ Must work as scientist ‣ Students must be interested in science too ‣ Publish in unfamiliar venues ‣ CV publications are suspicious • Benefit to MV: new challenges and datasets • Benefit to PI: fun, learningFriday, August 26, 2011
  • 18. Basic research needed • Tracking, detection and identification • Parts and pose • Hierarchical models (for time series) • Unsupervised discovery of categories • Weakly supervised learningFriday, August 26, 2011

×