SlideShare a Scribd company logo
Measurement, analysis, and sharing


          Daniel Messinger, Ph.D.
           University of Miami


           September 15, 2011
   From openshapa to open data sharing
Overview
            Problem: Lack of sharing
   Continuous measurement
       Objective—automated
       Subjective
       Analysis tools
   Categorical measurement
       Analysis tools
     Solution? Share behavioral databases…
                         http://measurement.psy.miami.edu/
Measurement problems
plague the behavioral sciences

 Investigator-specific systems

   Each lab re-invents the wheel
         in its own image
      hampering replication

         http://measurement.psy.miami.edu/
Broader systems have emerged
   Facial Action Coding System (FACS)
Require substantial training & implementation




     Instantiate with automated
           measurement
              http://measurement.psy.miami.edu/
Computer Vision




  http://measurement.psy.miami.edu/
Parent-Infant Interaction
    Infant Smile, Mother Smile




        http://measurement.psy.miami.edu/
                                            Messinger, et al., 2009
Variability at Every Level

                            5
                            4




                                                                                                                       Dyad A
                            3
Facial Actions & Tickling




                            2
                            1
                            0


                                    .35              .50                 .36                        .21
                                0    10   20   30   40   50   60   70   80    90 100 110 120 130 140 150 160 170 180


                            5
                            4




                                                                                                                       Dyad B
                            3
                            2
                            1
                            0

                                    .47         .42                     .28                        .58

                                                               http://measurement.psy.miami.edu/
Tools for continuous data




       http://measurement.psy.miami.edu/
Tools for continuous data




       http://measurement.psy.miami.edu/
Rating Constructs Directly




      http://measurement.psy.miami.edu/
                                          Baker et al., 2010;
                                          Chow et al., 2010
Rationale
Human beings are
   expert at the
continuous, intutive
evaluation of others

 The wisdom of
crowds….aggregate
   independent
   observations
            http://measurement.psy.miami.edu/
Time-series                                                                                                                               Mean
                                                                                                            Object of Measurement: 11.10

                                                                                                                                                         Parent
                            140.00                                                                                                                       Infant


                            120.00




                            100.00
Emotional Valence Ratings




                             80.00




                             60.00




                             40.00




                             20.00




                              0.00


                                     .00   10.00   20.00   30.00   40.00   50.00   60.00   70.00   80.00   90.00 100.00 110.00 120.00 130.00 140.00 150.00 160.00 170.00 180.00

                                                                                                     Seconds




                                                                                                                                                              http://measurement.psy.miami.edu/
                                                                                                                                                                                                    Baker et al., 2010a
Data analysis tools
                                  (responsivity varies in time)
Interactive Influence




                                                      it                              it  1  2   0  i ,t 1    ,it 
                                                                                           1 0                             
                        Infant it  1 0 Parent it  i ,t 1                         i ,t 1        0  i ,t  2    0 
                                                                                                           
                                                              
                                                     Bit 
                                                                                      Bit   0 0
                                                                                                       1  Bi ,t 1   B ,it 
                                                                                                                               
                          Chow et al., 2010
                                                            http://measurement.psy.miami.edu/
                                                                                                                      Chow et al., 2010
Reliability with expert measurement




                                                                        Expert Family Conflict
                                                                                                 Non-Expert Family Conflict
Expert Sensitive Structuring




                                 Non-Expert Sensitivity

                                                          http://measurement.psy.miami.edu/
                                                                                                                       Baker et al., 2010b
http://measurement.psy.miami.edu/cms.phtml




              http://measurement.psy.miami.edu/
Coding tool


                                    Easy Interface

                                    Frame-by-frame
                                       procession

                                     User-defined
                                        codes

http://measurement.psy.miami.edu/
Categorical data enable
identification of patterns




       http://measurement.psy.miami.edu/
Finding Temporal Patterns




       http://measurement.psy.miami.edu/
                                           Yale et al., 1999;
                                           Yale et al., 2003
Document the existence of patterns
              Observed Behaviors
                             Gazes                    Gazes
    No Smiles Smiles          Away                   at Mom
               SM

                SM

            To Create Simulated Pattern

    Smile                 SM                        SM

    Gaze

                Time
                psy.miami.edu/faculty/dmessinger/
Finding Temporal Patterns in Data

                     Smile                         SM            SM
Observed Pattern                            Smile in Gaze!

                     Gaze
                                                      Subtract

                     Smile                           SM          SM
  Simulated
Random Pattern
                     Gaze
Repeat 2000 times.                         Time

          Z = (Observed – Simulated)/SDS
                       psy.miami.edu/faculty/dmessinger/
The problem:
Studying a common phenomenon…
 Neonatal imitation                                     or not…

     Meltzoff



                 Google search…. macaques




                    http://measurement.psy.miami.edu/
Sharing Behavioral Data




      http://measurement.psy.miami.edu/
Automated measurement is
  collaborative research
                                    The Computer Expression
                                      Recognition Toolbox
                              http://mplab.ucsd.edu/~marni/Pro
                                       jects/CERT.htm




                                  http://www.pitt.edu/~jeffcohn/

                           http://www.ri.cmu.edu/research_lab_group
                             _detail.html?lab_id=51&menu_id=263



 Commercial software…http://www.noldus.com/news/new-facereader-30
                 http://measurement.psy.miami.edu/
Computer vision models




      http://measurement.psy.miami.edu/
The IRB issue…




Surmountable…
  http://measurement.psy.miami.edu/
Thanks!




Mohammad Mahoor, Lisa Ibanez, Jeffrey
  Cohn, Alan Fogel, & Sy-Miin Chow
    http://measurement.psy.miami.edu/

More Related Content

More from Jesse Lingeman

Its About Time: Analyzing Temporal MicroLevel Behavioral Patterns
Its About Time: Analyzing Temporal MicroLevel Behavioral PatternsIts About Time: Analyzing Temporal MicroLevel Behavioral Patterns
Its About Time: Analyzing Temporal MicroLevel Behavioral PatternsJesse Lingeman
 
Supporting Emergence: Interaction Design for Visual Analytics Approach to ESDA
Supporting Emergence: Interaction Design for Visual Analytics Approach to ESDASupporting Emergence: Interaction Design for Visual Analytics Approach to ESDA
Supporting Emergence: Interaction Design for Visual Analytics Approach to ESDAJesse Lingeman
 
Alibali mult data streams a
Alibali mult data streams aAlibali mult data streams a
Alibali mult data streams aJesse Lingeman
 

More from Jesse Lingeman (11)

Its About Time: Analyzing Temporal MicroLevel Behavioral Patterns
Its About Time: Analyzing Temporal MicroLevel Behavioral PatternsIts About Time: Analyzing Temporal MicroLevel Behavioral Patterns
Its About Time: Analyzing Temporal MicroLevel Behavioral Patterns
 
Supporting Emergence: Interaction Design for Visual Analytics Approach to ESDA
Supporting Emergence: Interaction Design for Visual Analytics Approach to ESDASupporting Emergence: Interaction Design for Visual Analytics Approach to ESDA
Supporting Emergence: Interaction Design for Visual Analytics Approach to ESDA
 
Mac whinney macw
Mac whinney macwMac whinney macw
Mac whinney macw
 
Gray 110916 ns-fwkshp
Gray 110916 ns-fwkshpGray 110916 ns-fwkshp
Gray 110916 ns-fwkshp
 
Davis kean.open shapa
Davis kean.open shapaDavis kean.open shapa
Davis kean.open shapa
 
Borner links
Borner linksBorner links
Borner links
 
Altman links
Altman linksAltman links
Altman links
 
Alibali mult data streams a
Alibali mult data streams aAlibali mult data streams a
Alibali mult data streams a
 
Bertenthal
BertenthalBertenthal
Bertenthal
 
Test1
Test1Test1
Test1
 
Test2
Test2Test2
Test2
 

Recently uploaded

Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
Pierluigi Pugliese
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 

Recently uploaded (20)

Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 

Messinger.openshapa.091511

  • 1. Measurement, analysis, and sharing Daniel Messinger, Ph.D. University of Miami September 15, 2011 From openshapa to open data sharing
  • 2. Overview Problem: Lack of sharing  Continuous measurement  Objective—automated  Subjective  Analysis tools  Categorical measurement  Analysis tools Solution? Share behavioral databases… http://measurement.psy.miami.edu/
  • 3. Measurement problems plague the behavioral sciences Investigator-specific systems Each lab re-invents the wheel in its own image hampering replication http://measurement.psy.miami.edu/
  • 4. Broader systems have emerged Facial Action Coding System (FACS) Require substantial training & implementation Instantiate with automated measurement http://measurement.psy.miami.edu/
  • 5. Computer Vision http://measurement.psy.miami.edu/
  • 6. Parent-Infant Interaction Infant Smile, Mother Smile http://measurement.psy.miami.edu/ Messinger, et al., 2009
  • 7. Variability at Every Level 5 4 Dyad A 3 Facial Actions & Tickling 2 1 0 .35 .50 .36 .21 0 10 20 30 40 50 60 70 80 90 100 110 120 130 140 150 160 170 180 5 4 Dyad B 3 2 1 0 .47 .42 .28 .58 http://measurement.psy.miami.edu/
  • 8. Tools for continuous data http://measurement.psy.miami.edu/
  • 9. Tools for continuous data http://measurement.psy.miami.edu/
  • 10. Rating Constructs Directly http://measurement.psy.miami.edu/ Baker et al., 2010; Chow et al., 2010
  • 11. Rationale Human beings are expert at the continuous, intutive evaluation of others The wisdom of crowds….aggregate independent observations http://measurement.psy.miami.edu/
  • 12. Time-series Mean Object of Measurement: 11.10 Parent 140.00 Infant 120.00 100.00 Emotional Valence Ratings 80.00 60.00 40.00 20.00 0.00 .00 10.00 20.00 30.00 40.00 50.00 60.00 70.00 80.00 90.00 100.00 110.00 120.00 130.00 140.00 150.00 160.00 170.00 180.00 Seconds http://measurement.psy.miami.edu/ Baker et al., 2010a
  • 13. Data analysis tools (responsivity varies in time) Interactive Influence   it    it  1  2 0  i ,t 1    ,it      1 0     Infant it  1 0 Parent it  i ,t 1   i ,t 1   0  i ,t  2    0      Bit     Bit   0 0    1  Bi ,t 1   B ,it      Chow et al., 2010 http://measurement.psy.miami.edu/ Chow et al., 2010
  • 14. Reliability with expert measurement Expert Family Conflict Non-Expert Family Conflict Expert Sensitive Structuring Non-Expert Sensitivity http://measurement.psy.miami.edu/ Baker et al., 2010b
  • 15. http://measurement.psy.miami.edu/cms.phtml http://measurement.psy.miami.edu/
  • 16. Coding tool Easy Interface Frame-by-frame procession User-defined codes http://measurement.psy.miami.edu/
  • 17. Categorical data enable identification of patterns http://measurement.psy.miami.edu/
  • 18. Finding Temporal Patterns http://measurement.psy.miami.edu/ Yale et al., 1999; Yale et al., 2003
  • 19. Document the existence of patterns Observed Behaviors Gazes Gazes No Smiles Smiles Away at Mom SM SM To Create Simulated Pattern Smile SM SM Gaze Time psy.miami.edu/faculty/dmessinger/
  • 20. Finding Temporal Patterns in Data Smile SM SM Observed Pattern Smile in Gaze! Gaze Subtract Smile SM SM Simulated Random Pattern Gaze Repeat 2000 times. Time Z = (Observed – Simulated)/SDS psy.miami.edu/faculty/dmessinger/
  • 21. The problem: Studying a common phenomenon… Neonatal imitation or not…  Meltzoff Google search…. macaques http://measurement.psy.miami.edu/
  • 22. Sharing Behavioral Data http://measurement.psy.miami.edu/
  • 23. Automated measurement is collaborative research The Computer Expression Recognition Toolbox http://mplab.ucsd.edu/~marni/Pro jects/CERT.htm http://www.pitt.edu/~jeffcohn/ http://www.ri.cmu.edu/research_lab_group _detail.html?lab_id=51&menu_id=263 Commercial software…http://www.noldus.com/news/new-facereader-30 http://measurement.psy.miami.edu/
  • 24. Computer vision models http://measurement.psy.miami.edu/
  • 25. The IRB issue… Surmountable… http://measurement.psy.miami.edu/
  • 26. Thanks! Mohammad Mahoor, Lisa Ibanez, Jeffrey Cohn, Alan Fogel, & Sy-Miin Chow http://measurement.psy.miami.edu/