Critical Features for Recognition of Biological Motion

Dimitris Agorastos
Dimitris AgorastosPsychologist
Critical features for the recognition of
biological motion
Casile & Giese (2005)
                                                 Your Name
                                                   Your Title
                                   Your Organization (Line #1)
2005-12-31                         Your Organization (Line #2)
Introduction

Point-light stimuli experiments
  Perception of complex biological movements
  (Johansson, 1973)
  Not impaired
      By adding noise
      (Cutting et al. 1988)
      By changing the contrast polarity of the dots
      Ahlström et al.1997)
      If only a subset of dots is visible
      If the dots are displaced on the skeleton in every frame




                 Stimulus               Perception

                                                                 2
Introduction

Different Hypotheses



  Hypothesis 1: Computational mechanisms reconstruct
  the missing information from impoverished stimuli by
  fitting a skeleton model to the stimuli (dots)
        most of the existing algorithms are computationally
        expensive and have no obvious neural implementation

  Hypothesis 2: Generalization from normal to point-light
  stimuli is based on specific features that are shared by
  both stimulus classes.
      The nature of such features is largely unknown
      It has been discussed whether they are based on
      form or motion information                             Motion Form




                                                                           3
Method

  Two movies
             Stickman walking   Moving dots
Stimulus
Optic Flow




                                              4
Analysis and Results

  Two movies
                Stickman walking   Moving dots
Stimulus




                                                                        r=0.09




                                                 PCA
Optic Flow




                                                                       r=0.93




             The dominant motion features are very similar for both stimuli, but the
                           dominant form features are different.


                                                                                       5
Psychophysical experiments

                     CFS Stimulus




                                                   Object 1




                                            Direction




                                    Motion Information

                                    Random Dots


                                                              6
Motion Information
Experiment 1
                                                     Random Dots


1A                                                              Arrangement
  Asymmetric CFS Stimulus
  Written report about their perceptual impression
      13/17: “Human walking”
      4/17: “jumping dots” or “nothing”                             direction
1B
  Symmetric CFS Stimulus
  2/9: “Human Walking”
  4/9: “Human performing actions”
  3/9 “Nothing” or “The Number 8”
1C
  Random dots
  2/10: “Human Performing actions”
  8/10: “Nothing”



                                                                                7
Experiment 1

Results
  Opponent motion seems to be critical for generating the impression of a
  walking human. The presence of moving dots within the same four
  regions is not sufficient.

  Skeleton model hypothesis seems to be wrong
     Coarse position information is not sufficient to fit
     this model
     The random dots' positions do not comply with
     the kinematics of a moving human body


  Alternative hypothesis: We use fuzzy templates for the human body
  shape that fit the CFS in a sub-optimal way




                                                                            8
Experiment 2

Method
  If reconstruction of the human body shape from point positions is critical for the recognition of
  point-light walkers, then a stimulus that complies with kinematics should be easier recognized
  than the CFS stimulus
                              SPS                                                 CFS
                  (Sequential Position Stimulus)                      (Critical Features Stimulus)



                ....            ...
                                ..                  ..
                                                   ..
                  ...            ..
                                 .                           VS
                ..                                 . .
              Frame 1          Frame 2             Frame 3
                                  t


  SPS does not affect body shape and matches exactly the human body kinematics
  1,2,4 dots      1 frame




                                                                                                      9
Experiment 2

Results
 SPS                 CFS

   ..
 . . VS
 .....
7 Subjects
Task: Recognition of direction of walking




No differences between the two stimuli
      No precise information about the body shape is needed
      Both stimuli might be processed by a common mechanism
      Asymmetry of the stimulus seems to be an important factor



                                                                  10
Neural Model




I. Local Motion Detectors (LMD): small receptive fields, direction preference
II. Opponent motion detectors: Respond if LMD -within two adjacent subfields- with oposite
     direction preference are active
III. Detectors for complex global optic flow patterns: Larger receptive fields than the whole
     point-light stimulus, selectivity established by training, each frame has an optic flow pattern that
     is encoded by a radial basis function
IV. Motion Pattern Neurons: Sum and temporally smooth the activities of optic flow pattern
    detectors that belong to the same human action




                                                                                                            11
Neural Model

                                                                               Psychophysical experiment
Results




  Recognition performances for both types of stimuli are very similar.
  Recognition performance increases with the number of dots in the stimulus
  Recognition rates for 8 and 4 dots are close to the values obtained in the psychophysical experiment
  The recognition rates for 2 dots are lower than human performance
  This model is not able to analyze stimuli with a single dot
  No strong increase of performance with the lifetime of dots


  High recognition rates can be accomplished solely based on the proposed critical
  motion feature
  High performance rates for degraded stimuli can be accomplished without complex
  computational mechanisms

                                                                                                           12
Discussion

  Normal and point-light stimuli share very similar dominant mid-level optic flow features


                                                r=0.93




  The appropriate spatial arrangement of these features induces the percept of a person
  walking, even though the stimuli do not comply with the kinematics of the human body



  The detailed form information provided by the SPS does not seem to improve the recognition of
  walking direction




  A neural model that exploits these critical features achieves substantial recognition rates, even for
  degraded point-light stimuli




                                                                                                          13
Discussion


      Physiological studies support this computational model (neural detectors for opponent motion)
      Simple neural circuit. Not complex computational mechanism.




     The local motion information can be used for
    other discrimination tasks (e.g. identification of gait)

                                                      Fast




                                                               Slow




http://www.biomotionlab.ca/Demos/BMLwalker.html

                                                                                                      14
Discussion


      Physiological studies support this computational model (neural detectors for opponent motion)
      Simple neural circuit. Not complex computational mechanism.




     The local motion information can be used for
    other discrimination tasks (e.g. identification of gait)




      For more difficult tasks, more information might be required.

                                                         Female




                                                                  Male
http://www.biomotionlab.ca/Demos/BMLwalker.html

                                                                                                      15
Thank you!




             16
1 of 16

Recommended

One critic, two actors, one decision by
One critic, two actors, one decisionOne critic, two actors, one decision
One critic, two actors, one decisionNicolas Rougier
196 views38 slides
Neural fields, a cognitive approach by
Neural fields, a cognitive approachNeural fields, a cognitive approach
Neural fields, a cognitive approachNicolas Rougier
405 views98 slides
Grounded Cognition: Mirror Neurons by
Grounded Cognition: Mirror NeuronsGrounded Cognition: Mirror Neurons
Grounded Cognition: Mirror NeuronsKristina Rebrova
2K views20 slides
Kc3118711875 by
Kc3118711875Kc3118711875
Kc3118711875IJERA Editor
376 views5 slides
Fcv learn sudderth by
Fcv learn sudderthFcv learn sudderth
Fcv learn sudderthzukun
349 views26 slides
2007 112 by
2007 1122007 112
2007 112guest987b6
258 views4 slides

More Related Content

Viewers also liked

Psychiatric Disorders: History. Classification. Prevalence. Comorbidity. Epid... by
Psychiatric Disorders: History. Classification. Prevalence. Comorbidity. Epid...Psychiatric Disorders: History. Classification. Prevalence. Comorbidity. Epid...
Psychiatric Disorders: History. Classification. Prevalence. Comorbidity. Epid...Dimitris Agorastos
10K views22 slides
P3 K by
P3 KP3 K
P3 KCynthia D
200 views7 slides
Spain by
SpainSpain
SpainTheresaB
291 views15 slides
Anoche SoñE Contigo by
Anoche SoñE ContigoAnoche SoñE Contigo
Anoche SoñE Contigoguest817abe
791 views2 slides
France by
FranceFrance
FranceTheresaB
260 views20 slides
Grace Is The Gospel - Creation by
Grace Is The Gospel - CreationGrace Is The Gospel - Creation
Grace Is The Gospel - CreationEric Wallace
496 views24 slides

Viewers also liked(20)

Psychiatric Disorders: History. Classification. Prevalence. Comorbidity. Epid... by Dimitris Agorastos
Psychiatric Disorders: History. Classification. Prevalence. Comorbidity. Epid...Psychiatric Disorders: History. Classification. Prevalence. Comorbidity. Epid...
Psychiatric Disorders: History. Classification. Prevalence. Comorbidity. Epid...
Dimitris Agorastos10K views
Spain by TheresaB
SpainSpain
Spain
TheresaB291 views
Anoche SoñE Contigo by guest817abe
Anoche SoñE ContigoAnoche SoñE Contigo
Anoche SoñE Contigo
guest817abe791 views
France by TheresaB
FranceFrance
France
TheresaB260 views
Grace Is The Gospel - Creation by Eric Wallace
Grace Is The Gospel - CreationGrace Is The Gospel - Creation
Grace Is The Gospel - Creation
Eric Wallace496 views
Vandorgy.Krimin.2008 by NetBandita
Vandorgy.Krimin.2008Vandorgy.Krimin.2008
Vandorgy.Krimin.2008
NetBandita168 views
October 21st photos by wwf_brasil
October 21st photosOctober 21st photos
October 21st photos
wwf_brasil153 views
Penanganan Serangan Jantung Untuk Diri Sendiri Self Cpr by Cynthia D
Penanganan Serangan Jantung Untuk Diri Sendiri    Self CprPenanganan Serangan Jantung Untuk Diri Sendiri    Self Cpr
Penanganan Serangan Jantung Untuk Diri Sendiri Self Cpr
Cynthia D650 views
油畫 恬淡的鄉村風情 by honan4108
油畫  恬淡的鄉村風情油畫  恬淡的鄉村風情
油畫 恬淡的鄉村風情
honan4108118 views
Algoparaquesonrias by guest872bd
AlgoparaquesonriasAlgoparaquesonrias
Algoparaquesonrias
guest872bd176 views
CS4344 Lecture 8: Hybrid Architecture by Wei Tsang Ooi
CS4344 Lecture 8: Hybrid ArchitectureCS4344 Lecture 8: Hybrid Architecture
CS4344 Lecture 8: Hybrid Architecture
Wei Tsang Ooi331 views
Cinta Perkawinan by Cynthia D
Cinta PerkawinanCinta Perkawinan
Cinta Perkawinan
Cynthia D231 views
Mentira Y Orgullo by guest817abe
Mentira Y OrgulloMentira Y Orgullo
Mentira Y Orgullo
guest817abe335 views

Similar to Critical Features for Recognition of Biological Motion

Fcv bio cv_cottrell by
Fcv bio cv_cottrellFcv bio cv_cottrell
Fcv bio cv_cottrellzukun
288 views45 slides
Fcv bio cv_cottrell by
Fcv bio cv_cottrellFcv bio cv_cottrell
Fcv bio cv_cottrellzukun
298 views45 slides
Computational approaches for mapping the human connectome by
Computational approaches for mapping the human connectomeComputational approaches for mapping the human connectome
Computational approaches for mapping the human connectomeCameron Craddock
1.2K views51 slides
Positron-emission tomography studies of cross-modality inhibition in selectiv... by
Positron-emission tomography studies of cross-modality inhibition in selectiv...Positron-emission tomography studies of cross-modality inhibition in selectiv...
Positron-emission tomography studies of cross-modality inhibition in selectiv...Dr Brendan O'Sullivan
514 views4 slides
The theory and practice of computational cognitive neuroscience by
The theory and practice of computational cognitive neuroscienceThe theory and practice of computational cognitive neuroscience
The theory and practice of computational cognitive neuroscienceBrian Spiering
815 views49 slides
Games in humans and non-human primates - the prospects for game theoretical a... by
Games in humans and non-human primates - the prospects for game theoretical a...Games in humans and non-human primates - the prospects for game theoretical a...
Games in humans and non-human primates - the prospects for game theoretical a...Kyongsik Yun
5.4K views44 slides

Similar to Critical Features for Recognition of Biological Motion(20)

Fcv bio cv_cottrell by zukun
Fcv bio cv_cottrellFcv bio cv_cottrell
Fcv bio cv_cottrell
zukun288 views
Fcv bio cv_cottrell by zukun
Fcv bio cv_cottrellFcv bio cv_cottrell
Fcv bio cv_cottrell
zukun298 views
Computational approaches for mapping the human connectome by Cameron Craddock
Computational approaches for mapping the human connectomeComputational approaches for mapping the human connectome
Computational approaches for mapping the human connectome
Cameron Craddock1.2K views
Positron-emission tomography studies of cross-modality inhibition in selectiv... by Dr Brendan O'Sullivan
Positron-emission tomography studies of cross-modality inhibition in selectiv...Positron-emission tomography studies of cross-modality inhibition in selectiv...
Positron-emission tomography studies of cross-modality inhibition in selectiv...
The theory and practice of computational cognitive neuroscience by Brian Spiering
The theory and practice of computational cognitive neuroscienceThe theory and practice of computational cognitive neuroscience
The theory and practice of computational cognitive neuroscience
Brian Spiering815 views
Games in humans and non-human primates - the prospects for game theoretical a... by Kyongsik Yun
Games in humans and non-human primates - the prospects for game theoretical a...Games in humans and non-human primates - the prospects for game theoretical a...
Games in humans and non-human primates - the prospects for game theoretical a...
Kyongsik Yun5.4K views
Neuroeconomic Class by tkvaran
Neuroeconomic ClassNeuroeconomic Class
Neuroeconomic Class
tkvaran513 views
研究方法&工具 by 景淳 許
研究方法&工具研究方法&工具
研究方法&工具
景淳 許1.4K views
Alz forum webinar_4-10-12_raj by Alzforum
Alz forum webinar_4-10-12_rajAlz forum webinar_4-10-12_raj
Alz forum webinar_4-10-12_raj
Alzforum849 views
Subtask Of Daily Activities To Evaluate Dementia by Jessica Reed
Subtask Of Daily Activities To Evaluate DementiaSubtask Of Daily Activities To Evaluate Dementia
Subtask Of Daily Activities To Evaluate Dementia
Jessica Reed2 views
METHODS IN INVESTIGATING COGNITION PPT by NiveditaMenonC
METHODS IN INVESTIGATING COGNITION PPTMETHODS IN INVESTIGATING COGNITION PPT
METHODS IN INVESTIGATING COGNITION PPT
NiveditaMenonC408 views
Does Event Related Desynchronization reveal anticipatory attention in the som... by Onno Romijn
Does Event Related Desynchronization reveal anticipatory attention in the som...Does Event Related Desynchronization reveal anticipatory attention in the som...
Does Event Related Desynchronization reveal anticipatory attention in the som...
Onno Romijn876 views
International Journal of Engineering Research and Development (IJERD) by IJERD Editor
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)
IJERD Editor468 views

More from Dimitris Agorastos

Αναβλητικότητα by
ΑναβλητικότηταΑναβλητικότητα
ΑναβλητικότηταDimitris Agorastos
12 views1 slide
Ενδείξεις δυσλεξίας ανά ηλικία by
Ενδείξεις δυσλεξίας ανά ηλικίαΕνδείξεις δυσλεξίας ανά ηλικία
Ενδείξεις δυσλεξίας ανά ηλικίαDimitris Agorastos
28 views1 slide
Μαθησιακές Δυσκολίες και ΔΕΠΥ: Υποστήριξη στο σχολικό πλαίσιο by
Μαθησιακές Δυσκολίες και ΔΕΠΥ: Υποστήριξη στο σχολικό πλαίσιοΜαθησιακές Δυσκολίες και ΔΕΠΥ: Υποστήριξη στο σχολικό πλαίσιο
Μαθησιακές Δυσκολίες και ΔΕΠΥ: Υποστήριξη στο σχολικό πλαίσιοDimitris Agorastos
93 views34 slides
Έφηβοι και Πανδημία: 2 χρόνια μετά... by
Έφηβοι και Πανδημία: 2 χρόνια μετά...Έφηβοι και Πανδημία: 2 χρόνια μετά...
Έφηβοι και Πανδημία: 2 χρόνια μετά...Dimitris Agorastos
109 views8 slides
Ψυχική Ανθεκτικότητα - Infographic by
Ψυχική Ανθεκτικότητα - InfographicΨυχική Ανθεκτικότητα - Infographic
Ψυχική Ανθεκτικότητα - InfographicDimitris Agorastos
140 views1 slide
Infographic: Οδηγός επιτυχίας και διαχείρισης του άγχους για μαθητές by
Infographic: Οδηγός επιτυχίας και διαχείρισης του άγχους για μαθητέςInfographic: Οδηγός επιτυχίας και διαχείρισης του άγχους για μαθητές
Infographic: Οδηγός επιτυχίας και διαχείρισης του άγχους για μαθητέςDimitris Agorastos
61 views1 slide

More from Dimitris Agorastos(20)

Ενδείξεις δυσλεξίας ανά ηλικία by Dimitris Agorastos
Ενδείξεις δυσλεξίας ανά ηλικίαΕνδείξεις δυσλεξίας ανά ηλικία
Ενδείξεις δυσλεξίας ανά ηλικία
Μαθησιακές Δυσκολίες και ΔΕΠΥ: Υποστήριξη στο σχολικό πλαίσιο by Dimitris Agorastos
Μαθησιακές Δυσκολίες και ΔΕΠΥ: Υποστήριξη στο σχολικό πλαίσιοΜαθησιακές Δυσκολίες και ΔΕΠΥ: Υποστήριξη στο σχολικό πλαίσιο
Μαθησιακές Δυσκολίες και ΔΕΠΥ: Υποστήριξη στο σχολικό πλαίσιο
Έφηβοι και Πανδημία: 2 χρόνια μετά... by Dimitris Agorastos
Έφηβοι και Πανδημία: 2 χρόνια μετά...Έφηβοι και Πανδημία: 2 χρόνια μετά...
Έφηβοι και Πανδημία: 2 χρόνια μετά...
Dimitris Agorastos109 views
Ψυχική Ανθεκτικότητα - Infographic by Dimitris Agorastos
Ψυχική Ανθεκτικότητα - InfographicΨυχική Ανθεκτικότητα - Infographic
Ψυχική Ανθεκτικότητα - Infographic
Dimitris Agorastos140 views
Infographic: Οδηγός επιτυχίας και διαχείρισης του άγχους για μαθητές by Dimitris Agorastos
Infographic: Οδηγός επιτυχίας και διαχείρισης του άγχους για μαθητέςInfographic: Οδηγός επιτυχίας και διαχείρισης του άγχους για μαθητές
Infographic: Οδηγός επιτυχίας και διαχείρισης του άγχους για μαθητές
Θυμός: Τι είναι και πως τον διαχειρίζομαι; by Dimitris Agorastos
Θυμός: Τι είναι και πως τον διαχειρίζομαι;Θυμός: Τι είναι και πως τον διαχειρίζομαι;
Θυμός: Τι είναι και πως τον διαχειρίζομαι;
Διαχείριση δύσκολων συμπεριφορών στο σχολικό πλαίσιο by Dimitris Agorastos
Διαχείριση δύσκολων συμπεριφορών στο σχολικό πλαίσιοΔιαχείριση δύσκολων συμπεριφορών στο σχολικό πλαίσιο
Διαχείριση δύσκολων συμπεριφορών στο σχολικό πλαίσιο
Dimitris Agorastos194 views
Βασικός οδηγός υποστήριξης παιδιών εν μέσω πανδημίας COVID-19 by Dimitris Agorastos
Βασικός οδηγός υποστήριξης παιδιών εν μέσω πανδημίας COVID-19Βασικός οδηγός υποστήριξης παιδιών εν μέσω πανδημίας COVID-19
Βασικός οδηγός υποστήριξης παιδιών εν μέσω πανδημίας COVID-19
Dimitris Agorastos118 views
Η βία στη σύγχρονη κοινωνία: από το άτομο στο σύνολο by Dimitris Agorastos
Η βία στη σύγχρονη κοινωνία: από το άτομο στο σύνολοΗ βία στη σύγχρονη κοινωνία: από το άτομο στο σύνολο
Η βία στη σύγχρονη κοινωνία: από το άτομο στο σύνολο
Dimitris Agorastos113 views
Διαχείριση δύσκολων συμπεριφορών και ανάπτυξη εσωτερικών κινήτρων by Dimitris Agorastos
Διαχείριση δύσκολων συμπεριφορών και ανάπτυξη εσωτερικών κινήτρωνΔιαχείριση δύσκολων συμπεριφορών και ανάπτυξη εσωτερικών κινήτρων
Διαχείριση δύσκολων συμπεριφορών και ανάπτυξη εσωτερικών κινήτρων
Dimitris Agorastos170 views
ΔΕΠΥ: Υποστήριξη στο οικογενειακό περιβάλλον by Dimitris Agorastos
ΔΕΠΥ: Υποστήριξη στο οικογενειακό περιβάλλονΔΕΠΥ: Υποστήριξη στο οικογενειακό περιβάλλον
ΔΕΠΥ: Υποστήριξη στο οικογενειακό περιβάλλον
Dimitris Agorastos151 views
Μαθησιακές Διαταραχές: Ψυχοσυναισθηματικές Διαστάσεις by Dimitris Agorastos
Μαθησιακές Διαταραχές: Ψυχοσυναισθηματικές ΔιαστάσειςΜαθησιακές Διαταραχές: Ψυχοσυναισθηματικές Διαστάσεις
Μαθησιακές Διαταραχές: Ψυχοσυναισθηματικές Διαστάσεις
Dimitris Agorastos185 views
John Bowlby: Η θεωρία του δεσμού by Dimitris Agorastos
John Bowlby: Η θεωρία του δεσμούJohn Bowlby: Η θεωρία του δεσμού
John Bowlby: Η θεωρία του δεσμού
Dimitris Agorastos2.6K views
Οριοθετηση και διαπαιδαγωγηση: Από το Νηπιαγωγείο έως την Εφηβεία by Dimitris Agorastos
Οριοθετηση και διαπαιδαγωγηση: Από το Νηπιαγωγείο έως την ΕφηβείαΟριοθετηση και διαπαιδαγωγηση: Από το Νηπιαγωγείο έως την Εφηβεία
Οριοθετηση και διαπαιδαγωγηση: Από το Νηπιαγωγείο έως την Εφηβεία
Dimitris Agorastos978 views

Recently uploaded

HTTP headers that make your website go faster - devs.gent November 2023 by
HTTP headers that make your website go faster - devs.gent November 2023HTTP headers that make your website go faster - devs.gent November 2023
HTTP headers that make your website go faster - devs.gent November 2023Thijs Feryn
28 views151 slides
State of the Union - Rohit Yadav - Apache CloudStack by
State of the Union - Rohit Yadav - Apache CloudStackState of the Union - Rohit Yadav - Apache CloudStack
State of the Union - Rohit Yadav - Apache CloudStackShapeBlue
145 views53 slides
NTGapps NTG LowCode Platform by
NTGapps NTG LowCode Platform NTGapps NTG LowCode Platform
NTGapps NTG LowCode Platform Mustafa Kuğu
141 views30 slides
Network Source of Truth and Infrastructure as Code revisited by
Network Source of Truth and Infrastructure as Code revisitedNetwork Source of Truth and Infrastructure as Code revisited
Network Source of Truth and Infrastructure as Code revisitedNetwork Automation Forum
42 views45 slides
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveNetwork Automation Forum
46 views35 slides
DRBD Deep Dive - Philipp Reisner - LINBIT by
DRBD Deep Dive - Philipp Reisner - LINBITDRBD Deep Dive - Philipp Reisner - LINBIT
DRBD Deep Dive - Philipp Reisner - LINBITShapeBlue
62 views21 slides

Recently uploaded(20)

HTTP headers that make your website go faster - devs.gent November 2023 by Thijs Feryn
HTTP headers that make your website go faster - devs.gent November 2023HTTP headers that make your website go faster - devs.gent November 2023
HTTP headers that make your website go faster - devs.gent November 2023
Thijs Feryn28 views
State of the Union - Rohit Yadav - Apache CloudStack by ShapeBlue
State of the Union - Rohit Yadav - Apache CloudStackState of the Union - Rohit Yadav - Apache CloudStack
State of the Union - Rohit Yadav - Apache CloudStack
ShapeBlue145 views
NTGapps NTG LowCode Platform by Mustafa Kuğu
NTGapps NTG LowCode Platform NTGapps NTG LowCode Platform
NTGapps NTG LowCode Platform
Mustafa Kuğu141 views
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by Network Automation Forum
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive
DRBD Deep Dive - Philipp Reisner - LINBIT by ShapeBlue
DRBD Deep Dive - Philipp Reisner - LINBITDRBD Deep Dive - Philipp Reisner - LINBIT
DRBD Deep Dive - Philipp Reisner - LINBIT
ShapeBlue62 views
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ... by ShapeBlue
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
ShapeBlue83 views
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue by ShapeBlue
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue
ShapeBlue50 views
Igniting Next Level Productivity with AI-Infused Data Integration Workflows by Safe Software
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software344 views
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas... by Bernd Ruecker
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
Bernd Ruecker50 views
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or... by ShapeBlue
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...
ShapeBlue88 views
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava... by ShapeBlue
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
ShapeBlue48 views
"Surviving highload with Node.js", Andrii Shumada by Fwdays
"Surviving highload with Node.js", Andrii Shumada "Surviving highload with Node.js", Andrii Shumada
"Surviving highload with Node.js", Andrii Shumada
Fwdays40 views
Setting Up Your First CloudStack Environment with Beginners Challenges - MD R... by ShapeBlue
Setting Up Your First CloudStack Environment with Beginners Challenges - MD R...Setting Up Your First CloudStack Environment with Beginners Challenges - MD R...
Setting Up Your First CloudStack Environment with Beginners Challenges - MD R...
ShapeBlue54 views
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue by ShapeBlue
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlueCloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue
ShapeBlue46 views
Business Analyst Series 2023 - Week 3 Session 5 by DianaGray10
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5
DianaGray10369 views
Migrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlue by ShapeBlue
Migrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlueMigrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlue
Migrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlue
ShapeBlue96 views

Critical Features for Recognition of Biological Motion

  • 1. Critical features for the recognition of biological motion Casile & Giese (2005) Your Name Your Title Your Organization (Line #1) 2005-12-31 Your Organization (Line #2)
  • 2. Introduction Point-light stimuli experiments Perception of complex biological movements (Johansson, 1973) Not impaired By adding noise (Cutting et al. 1988) By changing the contrast polarity of the dots Ahlström et al.1997) If only a subset of dots is visible If the dots are displaced on the skeleton in every frame Stimulus Perception 2
  • 3. Introduction Different Hypotheses Hypothesis 1: Computational mechanisms reconstruct the missing information from impoverished stimuli by fitting a skeleton model to the stimuli (dots) most of the existing algorithms are computationally expensive and have no obvious neural implementation Hypothesis 2: Generalization from normal to point-light stimuli is based on specific features that are shared by both stimulus classes. The nature of such features is largely unknown It has been discussed whether they are based on form or motion information Motion Form 3
  • 4. Method Two movies Stickman walking Moving dots Stimulus Optic Flow 4
  • 5. Analysis and Results Two movies Stickman walking Moving dots Stimulus r=0.09 PCA Optic Flow r=0.93 The dominant motion features are very similar for both stimuli, but the dominant form features are different. 5
  • 6. Psychophysical experiments CFS Stimulus Object 1 Direction Motion Information Random Dots 6
  • 7. Motion Information Experiment 1 Random Dots 1A Arrangement Asymmetric CFS Stimulus Written report about their perceptual impression 13/17: “Human walking” 4/17: “jumping dots” or “nothing” direction 1B Symmetric CFS Stimulus 2/9: “Human Walking” 4/9: “Human performing actions” 3/9 “Nothing” or “The Number 8” 1C Random dots 2/10: “Human Performing actions” 8/10: “Nothing” 7
  • 8. Experiment 1 Results Opponent motion seems to be critical for generating the impression of a walking human. The presence of moving dots within the same four regions is not sufficient. Skeleton model hypothesis seems to be wrong Coarse position information is not sufficient to fit this model The random dots' positions do not comply with the kinematics of a moving human body Alternative hypothesis: We use fuzzy templates for the human body shape that fit the CFS in a sub-optimal way 8
  • 9. Experiment 2 Method If reconstruction of the human body shape from point positions is critical for the recognition of point-light walkers, then a stimulus that complies with kinematics should be easier recognized than the CFS stimulus SPS CFS (Sequential Position Stimulus) (Critical Features Stimulus) .... ... .. .. .. ... .. . VS .. . . Frame 1 Frame 2 Frame 3 t SPS does not affect body shape and matches exactly the human body kinematics 1,2,4 dots 1 frame 9
  • 10. Experiment 2 Results SPS CFS .. . . VS ..... 7 Subjects Task: Recognition of direction of walking No differences between the two stimuli No precise information about the body shape is needed Both stimuli might be processed by a common mechanism Asymmetry of the stimulus seems to be an important factor 10
  • 11. Neural Model I. Local Motion Detectors (LMD): small receptive fields, direction preference II. Opponent motion detectors: Respond if LMD -within two adjacent subfields- with oposite direction preference are active III. Detectors for complex global optic flow patterns: Larger receptive fields than the whole point-light stimulus, selectivity established by training, each frame has an optic flow pattern that is encoded by a radial basis function IV. Motion Pattern Neurons: Sum and temporally smooth the activities of optic flow pattern detectors that belong to the same human action 11
  • 12. Neural Model Psychophysical experiment Results Recognition performances for both types of stimuli are very similar. Recognition performance increases with the number of dots in the stimulus Recognition rates for 8 and 4 dots are close to the values obtained in the psychophysical experiment The recognition rates for 2 dots are lower than human performance This model is not able to analyze stimuli with a single dot No strong increase of performance with the lifetime of dots High recognition rates can be accomplished solely based on the proposed critical motion feature High performance rates for degraded stimuli can be accomplished without complex computational mechanisms 12
  • 13. Discussion Normal and point-light stimuli share very similar dominant mid-level optic flow features r=0.93 The appropriate spatial arrangement of these features induces the percept of a person walking, even though the stimuli do not comply with the kinematics of the human body The detailed form information provided by the SPS does not seem to improve the recognition of walking direction A neural model that exploits these critical features achieves substantial recognition rates, even for degraded point-light stimuli 13
  • 14. Discussion Physiological studies support this computational model (neural detectors for opponent motion) Simple neural circuit. Not complex computational mechanism. The local motion information can be used for other discrimination tasks (e.g. identification of gait) Fast Slow http://www.biomotionlab.ca/Demos/BMLwalker.html 14
  • 15. Discussion Physiological studies support this computational model (neural detectors for opponent motion) Simple neural circuit. Not complex computational mechanism. The local motion information can be used for other discrimination tasks (e.g. identification of gait) For more difficult tasks, more information might be required. Female Male http://www.biomotionlab.ca/Demos/BMLwalker.html 15