SlideShare a Scribd company logo
1 of 23
Download to read offline
Students changing their answers, based on what
their friends say
Sameer Bhatnagar 1 Michel Desmarais 1
C. Whittaker 2 N. Lasry 3 M. Dugdale 3 K. Lenton 4 E. Charles 2
1Polytechnique Montreal
2Dawson College
3John Abbott College
4Vanier College
June 25, 2015
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 1 / 22
What is this all about?
Introducing a new data set
Demonstrating its potential for EDM
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 2 / 22
Outline
1 Glossary
2 Data
3 Results
Answer Changes
Gender Differences
Peer Voting
4 Future Work
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 3 / 22
Glossary
Peer Instruction
Classroom Activity popularized by Eric Mazur of Harvard
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 4 / 22
Glossary
Peer Instruction
Classroom Activity popularized by Eric Mazur of Harvard
DALITE
Web Based Learning Environment for Peer Instruction at Home
Let’s give the system a try!
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 4 / 22
Outline
1 Glossary
2 Data
3 Results
Answer Changes
Gender Differences
Peer Voting
4 Future Work
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 5 / 22
The Data Set: from the classroom
118 students from three different colleges
Four different teachers, five different groups
Final Grade for the course (Freshman Year Physics)
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 6 / 22
The Data Set: from DALITE
7100 Student-item pairs
Each student item pair includes
First Answer
Rationale
Second Answer
How many votes the rationale received
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 7 / 22
Outline
1 Glossary
2 Data
3 Results
Answer Changes
Gender Differences
Peer Voting
4 Future Work
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 8 / 22
Strong students as likely to go the wrong way
0.0
0.1
0.2
0.3
0.4
bottom top
Final grade partitioned at median
P(Right−−>Wrong)
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 9 / 22
Weak students as likely to go the right way
0.0
0.2
0.4
0.6
0.8
bottom top
Final grade partitioned at median
P(Wrong−−>Right)
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 10 / 22
Don’t Use the Tool Alone!
Which group never talked about DALITE in class?
0.0
0.2
0.4
0.6
cw09 cw10 KJL MD NL
Different Groups
P(SwitchingAnswer)
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 11 / 22
Gender Gap in Physics
0.4
0.6
0.8
1.0
f m
Gender
P(RightAnsweronFIRSTAttempt)
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 12 / 22
Gender Gap in Physics except if you let them
change their minds
0.4
0.6
0.8
1.0
f m
Gender
P(RightAnsweronSECONDattempt)
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 13 / 22
No Gender Gap in Votes Earned
0.0
0.2
0.4
0.6
f m
Gender
AverageNumberofVotesEarned
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 14 / 22
Strong students do earn more votes
0.0
0.1
0.2
0.3
bottom top
Final grade partitioned at median
AverageVotesearnedoverthesemester
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 15 / 22
Strong, even when Wrong
0.0
0.2
0.4
0.6
bottom top
Final grade partitioned at median
AverageVotesearnedoverthesemester
forWRONGANSWER
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 16 / 22
Outline
1 Glossary
2 Data
3 Results
Answer Changes
Gender Differences
Peer Voting
4 Future Work
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 17 / 22
Future Work
NLP on Rationales
Automated Essay Scoring
Topic Modeling
Collaborative Filtering with voting data
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 18 / 22
Welcome to The Big Leagues
License to HarvardX
Next Step: Your edX MOOC!
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 19 / 22
What is this all about?
Introducing a new data set
Demonstrating its potential for EDM
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 20 / 22
Acknowledgements
Michel Desmarais
SALTISE research
group
PAREA
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 21 / 22
Thank you!
Any Questions?
Contact Info
website: sameerbhatnagar.github.io
S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 22 / 22

More Related Content

Viewers also liked (6)

Alice power point
Alice power pointAlice power point
Alice power point
 
Propaganda
PropagandaPropaganda
Propaganda
 
Welfare state in france
Welfare state in franceWelfare state in france
Welfare state in france
 
Proposal air minum
Proposal air minumProposal air minum
Proposal air minum
 
SUNDAR CV.
SUNDAR CV.SUNDAR CV.
SUNDAR CV.
 
Future pain management in pediatric dentistry
Future pain management in pediatric dentistryFuture pain management in pediatric dentistry
Future pain management in pediatric dentistry
 

Recently uploaded

Diamond Harbour \ Russian Call Girls Kolkata | Book 8005736733 Extreme Naught...
Diamond Harbour \ Russian Call Girls Kolkata | Book 8005736733 Extreme Naught...Diamond Harbour \ Russian Call Girls Kolkata | Book 8005736733 Extreme Naught...
Diamond Harbour \ Russian Call Girls Kolkata | Book 8005736733 Extreme Naught...
HyderabadDolls
 
Call Girls in G.T.B. Nagar (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in G.T.B. Nagar  (delhi) call me [🔝9953056974🔝] escort service 24X7Call Girls in G.T.B. Nagar  (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in G.T.B. Nagar (delhi) call me [🔝9953056974🔝] escort service 24X7
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
gajnagarg
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...
Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...
Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...
HyderabadDolls
 
Belur $ Female Escorts Service in Kolkata (Adult Only) 8005736733 Escort Serv...
Belur $ Female Escorts Service in Kolkata (Adult Only) 8005736733 Escort Serv...Belur $ Female Escorts Service in Kolkata (Adult Only) 8005736733 Escort Serv...
Belur $ Female Escorts Service in Kolkata (Adult Only) 8005736733 Escort Serv...
HyderabadDolls
 
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
nirzagarg
 

Recently uploaded (20)

Giridih Escorts Service Girl ^ 9332606886, WhatsApp Anytime Giridih
Giridih Escorts Service Girl ^ 9332606886, WhatsApp Anytime GiridihGiridih Escorts Service Girl ^ 9332606886, WhatsApp Anytime Giridih
Giridih Escorts Service Girl ^ 9332606886, WhatsApp Anytime Giridih
 
Dubai Call Girls Peeing O525547819 Call Girls Dubai
Dubai Call Girls Peeing O525547819 Call Girls DubaiDubai Call Girls Peeing O525547819 Call Girls Dubai
Dubai Call Girls Peeing O525547819 Call Girls Dubai
 
Ranking and Scoring Exercises for Research
Ranking and Scoring Exercises for ResearchRanking and Scoring Exercises for Research
Ranking and Scoring Exercises for Research
 
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
 
Digital Transformation Playbook by Graham Ware
Digital Transformation Playbook by Graham WareDigital Transformation Playbook by Graham Ware
Digital Transformation Playbook by Graham Ware
 
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24  Building Real-Time Pipelines With FLaNKDATA SUMMIT 24  Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
 
Diamond Harbour \ Russian Call Girls Kolkata | Book 8005736733 Extreme Naught...
Diamond Harbour \ Russian Call Girls Kolkata | Book 8005736733 Extreme Naught...Diamond Harbour \ Russian Call Girls Kolkata | Book 8005736733 Extreme Naught...
Diamond Harbour \ Russian Call Girls Kolkata | Book 8005736733 Extreme Naught...
 
Call Girls in G.T.B. Nagar (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in G.T.B. Nagar  (delhi) call me [🔝9953056974🔝] escort service 24X7Call Girls in G.T.B. Nagar  (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in G.T.B. Nagar (delhi) call me [🔝9953056974🔝] escort service 24X7
 
Identify Customer Segments to Create Customer Offers for Each Segment - Appli...
Identify Customer Segments to Create Customer Offers for Each Segment - Appli...Identify Customer Segments to Create Customer Offers for Each Segment - Appli...
Identify Customer Segments to Create Customer Offers for Each Segment - Appli...
 
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book nowVadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
 
Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...
Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...
Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...
 
Case Study 4 Where the cry of rebellion happen?
Case Study 4 Where the cry of rebellion happen?Case Study 4 Where the cry of rebellion happen?
Case Study 4 Where the cry of rebellion happen?
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
 
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
 
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
 
Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...
Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...
Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...
 
Introduction to Statistics Presentation.pptx
Introduction to Statistics Presentation.pptxIntroduction to Statistics Presentation.pptx
Introduction to Statistics Presentation.pptx
 
Belur $ Female Escorts Service in Kolkata (Adult Only) 8005736733 Escort Serv...
Belur $ Female Escorts Service in Kolkata (Adult Only) 8005736733 Escort Serv...Belur $ Female Escorts Service in Kolkata (Adult Only) 8005736733 Escort Serv...
Belur $ Female Escorts Service in Kolkata (Adult Only) 8005736733 Escort Serv...
 
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
 

Edm2015presentation

  • 1. Students changing their answers, based on what their friends say Sameer Bhatnagar 1 Michel Desmarais 1 C. Whittaker 2 N. Lasry 3 M. Dugdale 3 K. Lenton 4 E. Charles 2 1Polytechnique Montreal 2Dawson College 3John Abbott College 4Vanier College June 25, 2015 S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 1 / 22
  • 2. What is this all about? Introducing a new data set Demonstrating its potential for EDM S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 2 / 22
  • 3. Outline 1 Glossary 2 Data 3 Results Answer Changes Gender Differences Peer Voting 4 Future Work S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 3 / 22
  • 4. Glossary Peer Instruction Classroom Activity popularized by Eric Mazur of Harvard S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 4 / 22
  • 5. Glossary Peer Instruction Classroom Activity popularized by Eric Mazur of Harvard DALITE Web Based Learning Environment for Peer Instruction at Home Let’s give the system a try! S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 4 / 22
  • 6. Outline 1 Glossary 2 Data 3 Results Answer Changes Gender Differences Peer Voting 4 Future Work S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 5 / 22
  • 7. The Data Set: from the classroom 118 students from three different colleges Four different teachers, five different groups Final Grade for the course (Freshman Year Physics) S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 6 / 22
  • 8. The Data Set: from DALITE 7100 Student-item pairs Each student item pair includes First Answer Rationale Second Answer How many votes the rationale received S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 7 / 22
  • 9. Outline 1 Glossary 2 Data 3 Results Answer Changes Gender Differences Peer Voting 4 Future Work S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 8 / 22
  • 10. Strong students as likely to go the wrong way 0.0 0.1 0.2 0.3 0.4 bottom top Final grade partitioned at median P(Right−−>Wrong) S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 9 / 22
  • 11. Weak students as likely to go the right way 0.0 0.2 0.4 0.6 0.8 bottom top Final grade partitioned at median P(Wrong−−>Right) S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 10 / 22
  • 12. Don’t Use the Tool Alone! Which group never talked about DALITE in class? 0.0 0.2 0.4 0.6 cw09 cw10 KJL MD NL Different Groups P(SwitchingAnswer) S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 11 / 22
  • 13. Gender Gap in Physics 0.4 0.6 0.8 1.0 f m Gender P(RightAnsweronFIRSTAttempt) S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 12 / 22
  • 14. Gender Gap in Physics except if you let them change their minds 0.4 0.6 0.8 1.0 f m Gender P(RightAnsweronSECONDattempt) S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 13 / 22
  • 15. No Gender Gap in Votes Earned 0.0 0.2 0.4 0.6 f m Gender AverageNumberofVotesEarned S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 14 / 22
  • 16. Strong students do earn more votes 0.0 0.1 0.2 0.3 bottom top Final grade partitioned at median AverageVotesearnedoverthesemester S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 15 / 22
  • 17. Strong, even when Wrong 0.0 0.2 0.4 0.6 bottom top Final grade partitioned at median AverageVotesearnedoverthesemester forWRONGANSWER S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 16 / 22
  • 18. Outline 1 Glossary 2 Data 3 Results Answer Changes Gender Differences Peer Voting 4 Future Work S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 17 / 22
  • 19. Future Work NLP on Rationales Automated Essay Scoring Topic Modeling Collaborative Filtering with voting data S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 18 / 22
  • 20. Welcome to The Big Leagues License to HarvardX Next Step: Your edX MOOC! S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 19 / 22
  • 21. What is this all about? Introducing a new data set Demonstrating its potential for EDM S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 20 / 22
  • 22. Acknowledgements Michel Desmarais SALTISE research group PAREA S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 21 / 22
  • 23. Thank you! Any Questions? Contact Info website: sameerbhatnagar.github.io S.Bhatnagar, M. Desmarais (Polytechnique Montreal) DALITE 22 / 22