r2hoxFlickr
Analytics to understand learning
environments
Chai Seminar, 14 April 2014
Dr Abelardo Pardo (@abelardopardo)
S...
Abelardo Pardo Analytics to understand learning environments 2
Abelardo Pardo Analytics to understand learning environments 3
StateRecordsNSWFlickr
Lecturer at School of EIE
Two courses...
Abelardo Pardo Analytics to understand learning environments 4
dianetellFlickr
Pragmatic
approach
Dogfooding!
Maximize imp...
Abelardo Pardo Analytics to understand learning environments 5
VanessaOflickr.com
“Historically, humanity has made sense of...
Abelardo Pardo Analytics to understand learning environments 6
QuinnAnyaflickr.com
Learning
Analytics
Observe and
Collect
V...
Abelardo Pardo Analytics to understand learning environments 7
QuinnAnyaflickr.com
Learning
Analytics
Abelardo Pardo Analytics to understand learning environments 8
UnhinderedbyTalentflickr.com
Many colleges and universities ...
WSJ 19/07/12
Abelardo Pardo Analytics to understand learning environments 9
How do you read?
NY Times 24/11/12
Abelardo Pardo Analytics to understand learning environments 10
Humans are Subjective
Abelardo Pardo Analytics to understand learning environments 11
Mind Sights: Original Visual Illusio...
Abelardo Pardo Analytics to understand learning environments 12
apasciutoflickr.com
Tools, technology,
algorithms
Education...
Abelardo Pardo Analytics to understand learning environments 13
Kurafireflickr.com
Feedback as a dialogue
Abelardo Pardo Analytics to understand learning environments 14
TanakaJuuyohflickr.com
Tight feedback loop
“We need better evaluation
to acknowledge and esteem
excellence when it occurs,
as it does.”
Abelardo Pardo Analytics to u...
Abelardo Pardo Analytics to understand learning environments 16
QuinnAnyaflickr.com
Learning
Analytics
Observe and
Collect
Abelardo Pardo Analytics to understand learning environments 17
ChefCookeFlickr.com
Observe while
working on
course
activi...
A clearly identified
environment within
your computer
Abelardo Pardo Analytics to understand learning environments 18
Kevin...
Instrumentation
Personal Computer
Computer
Tool 1
Computer
Tool 2
Computer
Tool 3
Computer
Tool 4
Authenticated
Virtual Co...
Abelardo Pardo Analytics to understand learning environments 20
HoriaVarlanflickr.com
Tool usage vs academic performance
(R...
Abelardo Pardo Analytics to understand learning environments 21
Chiot’sRunFlickr.com
Collect URLs Compare with
course note...
Abelardo Pardo Analytics to understand learning environments 22
AdventuresinLibrarianshipflickr.com
Detect engagement
while...
Facial expressions
Detect emotions
Abelardo Pardo Analytics to understand learning environments 23
(Monkaresi et al., 2012)
Abelardo Pardo Analytics to understand learning environments 24
QuinnAnyaflickr.com
Learning
Analytics
Observe and
Collect
...
Learning glass
Abelardo Pardo Analytics to understand learning environments 25
(Crespo et al. 2012, Leony et al., 2012)
Abelardo Pardo Analytics to understand learning environments 26
Show
question
Show
correct
Show
incorrect
Show
solutions
again
again
Abelardo Pardo Analytics to understand learning envir...
Abelardo Pardo Analytics to understand learning environments 28
Just in time teaching
Abelardo Pardo Analytics to understand learning environments 29
Browser add-in
Abelardo Pardo Analytics to understand learning environments 30
QuinnAnyaflickr.com
Learning
Analytics
Observe and
Collect
...
“Transition” for patients with a chronic illness
Abelardo Pardo Analytics to understand learning environments 31
(Calvo et...
Self-determination theory and types of
motivation
Abelardo Pardo Analytics to understand learning environments 32
(Ryan an...
Explore the most adequate channels to dialogue
with the patient.
Abelardo Pardo Analytics to understand learning environme...
Abelardo Pardo Analytics to understand learning environments 34
MathesonLearningCommonsflickr.com
First-year transition
Abelardo Pardo Analytics to understand learning environments 35
KeoniCabralflickr.com
Tech for high stakes finite time perio...
Abelardo Pardo Analytics to understand learning environments 36
QuinnAnyaflickr.com
Learning
Analytics
Observe and
Collect
...
Increasing use of videos
Abelardo Pardo Analytics to understand learning environments 37
What is missing?
Annotation
Highlight areas of importance
Collaboration
Integration in learning environment
Abelardo Pardo...
Students “comment” on video with some
guidance
Abelardo Pardo Analytics to understand learning environments 39
(OLT Projec...
Abelardo Pardo Analytics to understand learning environments 40
KreativeKewlflickr.com
Flipped Classroom
does not exist!
(B...
Abelardo Pardo Analytics to understand learning environments 41
MITCHELLflickr.com
Old idea, but revived due to two reasons
Abelardo Pardo Analytics to understand learning environments 42
Krugazorflickr.com
(Mazur, 2009)
Simple transfer of informa...
Abelardo Pardo Analytics to understand learning environments 43
JuantanKwonflickr.com
Resources
everywhere!
Abelardo Pardo Analytics to understand learning environments 44
Fellmanniaflickr.com
Face-to-face time
is very valuable!
Abelardo Pardo Analytics to understand learning environments 45
-NACH-flickr.com
Remember
Understand
Apply
Analyze
Evaluate...
Abelardo Pardo Analytics to understand learning environments 46
-NACH-flickr.com
Remember
Understand
Apply
Analyze
Evaluate...
Abelardo Pardo Analytics to understand learning environments 47
p_a_hflickr.com
A) Previous activities (Be prepared!)
Abelardo Pardo Analytics to understand learning environments 48
Hijukalflickr.com
B) Activities face-to-face
Abelardo Pardo Analytics to understand learning environments 49
Flyinggflickr.com
Great case for data
supported decisions!
Weekly activities
Abelardo Pardo Analytics to understand learning environments 50
Previous and
in-class activities
for each session
Abelardo Pardo Analytics to understand learning environments 51
Detecting when blocks of text are visualized
Abelardo Pardo Analytics to understand learning environments 52
Interactions with videos
Abelardo Pardo Analytics to understand learning environments 53
Questions embedded in text
Abelardo Pardo Analytics to understand learning environments 54
Problem Sequences
Abelardo Pardo Analytics to understand learning environments 55
Data back to the students
Abelardo Pardo Analytics to understand learning environments 56
Your activity with respect to the rest of the class
Abelardo Pardo Analytics to understand learning environments 57
Abelardo Pardo Analytics to understand learning environments 58
Eleafflickr.com
• Will students use data
about their events...
Abelardo Pardo Analytics to understand learning environments 59
(OLT Project, Radical transformation: re-imagining enginee...
r2hoxFlickr
Analytics to understand learning
environments
Chai Seminar, 14 April 2014
Dr Abelardo Pardo (@abelardopardo)
S...
References
Bichsel, J. (2012).
Analytics in Higher Education Benefits, Barriers, Progress, and Recommendations.
EDUCAUSE Ce...
References II
Liu M., Calvo, R.; Pardo, A., 2013
Visualizing the effect of actions in personal informatics systems
Worksho...
References III
Calvo, R. A., Pardo, A., Zhao, Y., Klineberg, E., Lam, M., and Steinbeck, K. 2013.
TransitionMate: a mobile...
Upcoming SlideShare
Loading in...5
×

Analytics to understand learning environments

846

Published on

Seminar for the CHAI Group at The University of Sydney. A summary of the initiatives I have worked on in the past years plus a brief account of my current work.

Published in: Education, Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
846
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
22
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Analytics to understand learning environments

  1. 1. r2hoxFlickr Analytics to understand learning environments Chai Seminar, 14 April 2014 Dr Abelardo Pardo (@abelardopardo) School of Electrical and Information Engineering slideshare.net/abelardo_pardo
  2. 2. Abelardo Pardo Analytics to understand learning environments 2
  3. 3. Abelardo Pardo Analytics to understand learning environments 3 StateRecordsNSWFlickr Lecturer at School of EIE Two courses Grad/Undergrad Active learning Use of technology Tech to empower individuals and communities Behavioral analytics User validation
  4. 4. Abelardo Pardo Analytics to understand learning environments 4 dianetellFlickr Pragmatic approach Dogfooding! Maximize impact
  5. 5. Abelardo Pardo Analytics to understand learning environments 5 VanessaOflickr.com “Historically, humanity has made sense of the world through discourse, dialogue, artifacts, myth, story, and metaphor. While those sensemaking approaches won’t disappear, they will be augmented by data and analytics.” (Siemens, 2014 www.elearnspace.org/blog)
  6. 6. Abelardo Pardo Analytics to understand learning environments 6 QuinnAnyaflickr.com Learning Analytics Observe and Collect View and Act Self-motivation Flipped classroom
  7. 7. Abelardo Pardo Analytics to understand learning environments 7 QuinnAnyaflickr.com Learning Analytics
  8. 8. Abelardo Pardo Analytics to understand learning environments 8 UnhinderedbyTalentflickr.com Many colleges and universities have demonstrated that analytics can help significantly advance an institution in such strategic areas as resource allocation, student success, and finance (Bichsel, 2012)
  9. 9. WSJ 19/07/12 Abelardo Pardo Analytics to understand learning environments 9 How do you read?
  10. 10. NY Times 24/11/12 Abelardo Pardo Analytics to understand learning environments 10
  11. 11. Humans are Subjective Abelardo Pardo Analytics to understand learning environments 11 Mind Sights: Original Visual Illusions, Ambiguities, and Other Anomalies, With a Commentary on the Play of Mind in Perception and Art, Roger N. Shepard, 1990
  12. 12. Abelardo Pardo Analytics to understand learning environments 12 apasciutoflickr.com Tools, technology, algorithms Educational design, pedagogical strategies
  13. 13. Abelardo Pardo Analytics to understand learning environments 13 Kurafireflickr.com Feedback as a dialogue
  14. 14. Abelardo Pardo Analytics to understand learning environments 14 TanakaJuuyohflickr.com Tight feedback loop
  15. 15. “We need better evaluation to acknowledge and esteem excellence when it occurs, as it does.” Abelardo Pardo Analytics to understand learning environments 15 BencroweFlickr (Hattie, 2009)
  16. 16. Abelardo Pardo Analytics to understand learning environments 16 QuinnAnyaflickr.com Learning Analytics Observe and Collect
  17. 17. Abelardo Pardo Analytics to understand learning environments 17 ChefCookeFlickr.com Observe while working on course activities
  18. 18. A clearly identified environment within your computer Abelardo Pardo Analytics to understand learning environments 18 KevinDaviesflickr.com (Pardo & Delgado Kloos, 2011)
  19. 19. Instrumentation Personal Computer Computer Tool 1 Computer Tool 2 Computer Tool 3 Computer Tool 4 Authenticated Virtual Computer Computer Tool Computer Tool Computer Tool Computer Tool Computer Tool Event Dataset Personal Data Encoding Report Infer Act InstructorStudent Abelardo Pardo Analytics to understand learning environments 19
  20. 20. Abelardo Pardo Analytics to understand learning environments 20 HoriaVarlanflickr.com Tool usage vs academic performance (Romero-Zaldívar et al., 2012)
  21. 21. Abelardo Pardo Analytics to understand learning environments 21 Chiot’sRunFlickr.com Collect URLs Compare with course notes Detect new resources (Romero-Zaldívar et al., 2011)
  22. 22. Abelardo Pardo Analytics to understand learning environments 22 AdventuresinLibrarianshipflickr.com Detect engagement while writing (Calvo et al., 2011, Liu et al., 2013)
  23. 23. Facial expressions Detect emotions Abelardo Pardo Analytics to understand learning environments 23 (Monkaresi et al., 2012)
  24. 24. Abelardo Pardo Analytics to understand learning environments 24 QuinnAnyaflickr.com Learning Analytics Observe and Collect View and Act
  25. 25. Learning glass Abelardo Pardo Analytics to understand learning environments 25 (Crespo et al. 2012, Leony et al., 2012)
  26. 26. Abelardo Pardo Analytics to understand learning environments 26
  27. 27. Show question Show correct Show incorrect Show solutions again again Abelardo Pardo Analytics to understand learning environments 27 Transitions are recorded (Pardo et al., 2012)
  28. 28. Abelardo Pardo Analytics to understand learning environments 28 Just in time teaching
  29. 29. Abelardo Pardo Analytics to understand learning environments 29 Browser add-in
  30. 30. Abelardo Pardo Analytics to understand learning environments 30 QuinnAnyaflickr.com Learning Analytics Observe and Collect View and Act Self-motivation
  31. 31. “Transition” for patients with a chronic illness Abelardo Pardo Analytics to understand learning environments 31 (Calvo et al., 2013)
  32. 32. Self-determination theory and types of motivation Abelardo Pardo Analytics to understand learning environments 32 (Ryan and Deci, 2000)
  33. 33. Explore the most adequate channels to dialogue with the patient. Abelardo Pardo Analytics to understand learning environments 33 (Yu Zhao, ASWEC Doctoral Consortium 2014)
  34. 34. Abelardo Pardo Analytics to understand learning environments 34 MathesonLearningCommonsflickr.com First-year transition
  35. 35. Abelardo Pardo Analytics to understand learning environments 35 KeoniCabralflickr.com Tech for high stakes finite time periods
  36. 36. Abelardo Pardo Analytics to understand learning environments 36 QuinnAnyaflickr.com Learning Analytics Observe and Collect View and Act Self-motivation Flipped classroom
  37. 37. Increasing use of videos Abelardo Pardo Analytics to understand learning environments 37
  38. 38. What is missing? Annotation Highlight areas of importance Collaboration Integration in learning environment Abelardo Pardo Analytics to understand learning environments 38
  39. 39. Students “comment” on video with some guidance Abelardo Pardo Analytics to understand learning environments 39 (OLT Project, Using video annotation software to develop student self-regulated learning)
  40. 40. Abelardo Pardo Analytics to understand learning environments 40 KreativeKewlflickr.com Flipped Classroom does not exist! (Bergmann & Sams, 2012)
  41. 41. Abelardo Pardo Analytics to understand learning environments 41 MITCHELLflickr.com Old idea, but revived due to two reasons
  42. 42. Abelardo Pardo Analytics to understand learning environments 42 Krugazorflickr.com (Mazur, 2009) Simple transfer of information is not optimal!
  43. 43. Abelardo Pardo Analytics to understand learning environments 43 JuantanKwonflickr.com Resources everywhere!
  44. 44. Abelardo Pardo Analytics to understand learning environments 44 Fellmanniaflickr.com Face-to-face time is very valuable!
  45. 45. Abelardo Pardo Analytics to understand learning environments 45 -NACH-flickr.com Remember Understand Apply Analyze Evaluate Create InclassAssignments Can we do better?
  46. 46. Abelardo Pardo Analytics to understand learning environments 46 -NACH-flickr.com Remember Understand Apply Analyze Evaluate Create Pre-assignmentsInclass
  47. 47. Abelardo Pardo Analytics to understand learning environments 47 p_a_hflickr.com A) Previous activities (Be prepared!)
  48. 48. Abelardo Pardo Analytics to understand learning environments 48 Hijukalflickr.com B) Activities face-to-face
  49. 49. Abelardo Pardo Analytics to understand learning environments 49 Flyinggflickr.com Great case for data supported decisions!
  50. 50. Weekly activities Abelardo Pardo Analytics to understand learning environments 50
  51. 51. Previous and in-class activities for each session Abelardo Pardo Analytics to understand learning environments 51
  52. 52. Detecting when blocks of text are visualized Abelardo Pardo Analytics to understand learning environments 52
  53. 53. Interactions with videos Abelardo Pardo Analytics to understand learning environments 53
  54. 54. Questions embedded in text Abelardo Pardo Analytics to understand learning environments 54
  55. 55. Problem Sequences Abelardo Pardo Analytics to understand learning environments 55
  56. 56. Data back to the students Abelardo Pardo Analytics to understand learning environments 56
  57. 57. Your activity with respect to the rest of the class Abelardo Pardo Analytics to understand learning environments 57
  58. 58. Abelardo Pardo Analytics to understand learning environments 58 Eleafflickr.com • Will students use data about their events? • Will they act on what they see? • Will the tips have any effect?
  59. 59. Abelardo Pardo Analytics to understand learning environments 59 (OLT Project, Radical transformation: re-imagining engineering education through flipping the classroom in a global learning partnership)
  60. 60. r2hoxFlickr Analytics to understand learning environments Chai Seminar, 14 April 2014 Dr Abelardo Pardo (@abelardopardo) School of Electrical and Information Engineering slideshare.net/abelardo_pardo
  61. 61. References Bichsel, J. (2012). Analytics in Higher Education Benefits, Barriers, Progress, and Recommendations. EDUCAUSE Center for Applied Research Hattie, J. A. C. (2009). Visible learning: A synthesis of over 800 meta-analyses related to achievement. New York: Routledge. Pardo, A., Delgado Kloos, C., 2011, Stepping out of the box. Towards analytics outside the Learning Management System International Conference on Learning Analytics and Knowledge, pp, 163-167, ACM New York, USA Romero-Zaldívar, V.A., Pardo, A., Burgos, D., Delgado Kloos, C., 2012 Monitoring Student Progress Using Virtual Appliances: A Case Study Computer & Education, 58(4):10580–1067, 2012 Romero-Zaldívar, V.A., Crespo García, R., Burgos, D., Delgado Kloos, C., Pardo, A., 2012 Automatic Discovery of Complementary Learning Resources European Conference on Technology Enhanced Learning, 2011 Abelardo Pardo Analytics to understand learning environments 61
  62. 62. References II Liu M., Calvo, R.; Pardo, A., 2013 Visualizing the effect of actions in personal informatics systems Workshop on Personal Informatics, CHI’13 Calvo, R., O’Rourke, S.T., Jones, J., Yacef, K., Reimann, P., 2011 Collaborative Writing Support Tools on the Cloud IEEE Transactions on Learning Technologies, 4(1):88–97 Monkaresi, H., Hussain, M. S., Calvo, R., 2012 A dynamic approach for detecting naturalistic affective states from facial videos during HCI Australasian Joint Conference on Artificial Intelligence, Sydney, Australia. LNAI, Springer 2012, pp.170-181 Crespo García, R.M., Pardo, A., Delgado Kloos, C., Niemann, K., Scheffel, M., Wolpers, M., 2012 Peeking into the black box: visualising learning activities. International Journal on Technology Enhanced Learning, 4(1/2), 2012 Leony, D., Pardo A., De la Fuente Valentín, L., Sánchez de Castro, D., Delgado Kloos, C. 2012 GLASS : A Learning Analytics Visualization Tool International Conference on Learning Analytics and Knowledge, pp. 162-163, ACM Press. Abelardo Pardo Analytics to understand learning environments 62
  63. 63. References III Calvo, R. A., Pardo, A., Zhao, Y., Klineberg, E., Lam, M., and Steinbeck, K. 2013. TransitionMate: a mobile application for chronic illness transition support. In C. Röcker, M. Ziefle, A. Holzinger, K. McGee, S. Hansen, and J. Meyer (Eds.), Fifth International Workshop on Smart Healthcare and Wellness Applications (SmartHealth’13) - OzCHI 2013, Nov 25-26. Adelaide, South Australia: ACM. Ryan, R., and Deci, E. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. Bergmann, J., Sams, A., (2012) Flip Your Classroom: Reach Every Student in Every Class Every Day Hawker Brownlow Education Mazur, E., (2009) Farewell, Lecture? Science, 323, pp. 50-51. Abelardo Pardo Analytics to understand learning environments 63
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×