Fcv appli science_perona
Upcoming SlideShare
Loading in...5
×
 

Fcv appli science_perona

on

  • 212 views

 

Statistics

Views

Total Views
212
Views on SlideShare
212
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-ShareAlike LicenseCC Attribution-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Fcv appli science_perona Fcv appli science_perona Presentation Transcript

    • Applications to Science Pietro Perona California Institute of Technology NSF Workshop - Frontiers in Vision Cambridge, 23 Aug 2011Friday, August 26, 2011
    • Goals • A few examples • Implications for machine vision • Lessons learned • NSF’s roleFriday, August 26, 2011
    • Plan • Intro (5’) • Sketch of a few success stories (50’) • Discussion (10’)Friday, August 26, 2011
    • ‘Lunging’ (view from top)Friday, August 26, 2011
    • Why measure behaviorFriday, August 26, 2011
    • Why measure behavior • Genes <<>> Brains <<>> BehaviorFriday, August 26, 2011
    • Why measure behavior • Genes <<>> Brains <<>> Behavior • EthologyFriday, August 26, 2011
    • Why measure behavior • Genes <<>> Brains <<>> Behavior • Ethology • What is behavior?Friday, August 26, 2011
    • Fly behavior (as we understand it today) Adapted from: Kravitz et al. PNAS April 16, 2002 vol. 99 no. 8 5664–5668Friday, August 26, 2011
    • Friday, August 26, 2011
    • Friday, August 26, 2011
    • Detection performance [Dankert et al., Nature Methods, April 2009]Friday, August 26, 2011
    • Phenotyping [Dankert et al., Nature Methods, 2009]Friday, August 26, 2011
    • Ethograms [Dankert et al., Nature Methods, April 2009]Friday, August 26, 2011
    • Perception PSYCHOLOGY interaction, cooperation, competition plans, goals, behavior, relationships ... pose, movemes, actions, activities, objects, scenes SENSORY images, trajectories WorldFriday, August 26, 2011
    • Action Perception PSYCHOLOGY interaction, cooperation, PLANNING group-level goals and plans competition SOCIAL NETWORK THEORY OF SOCIOLOGY INDIVIDUAL plans, goals, behavior, individual goals and plans relationships ... PREFRONTAL CORTEX THEORY OF PSYCHOLOGY pose, movemes, actions, MOTOR motor programs activities, objects, scenes SENSORY MOTOR CORTEX RECOGNITION sensor-based control images, trajectories SPINAL CORD IMAGING,TRACKING WorldFriday, August 26, 2011
    • Lessons learned • Image deluge in science • Doing better than the scientists • Payoffs in science, not in MV (short term) ‣ Must work as scientist ‣ Students must be interested in science too ‣ Publish in unfamiliar venues ‣ CV publications are suspicious • Benefit to MV: new challenges and datasets • Benefit to PI: fun, learningFriday, August 26, 2011
    • Basic research needed • Tracking, detection and identification • Parts and pose • Hierarchical models (for time series) • Unsupervised discovery of categories • Weakly supervised learningFriday, August 26, 2011