SlideShare a Scribd company logo
Multimodal Analytics for Real-time
Feedback in Co-located Collaboration
Sambit Praharaj, Maren Scheffel, Hendrik Drachsler and Marcus Specht
What is collaboration?
• Occurs when two or more persons work towards a common goal [12]
• Can be in different settings:
– Online (or remote)
– Co-located (or face-to-face)
• Can be for different purposes:
– Programming (Grover et al., 2016)
– Meetings (Terken & Strum, 2010)
– Problem solving (Cukurova et al., 2018)
– Brainstorming (Tausch et al., 2014), etc.
Pagina 2
What is collaboration?
• Occurs when two or more persons work towards a common goal [12]
• Can be in different settings:
– Online (or remote)
– Co-located (or face-to-face)
• Can be for different purposes:
– Programming (Grover et al., 2016)
– Meetings (Terken & Strum, 2010)
– Problem solving (Cukurova et al., 2018)
– Brainstorming (Tausch et al., 2014), etc.
Pagina 3
What is collaboration?
• Occurs when two or more persons work towards a common goal [12]
• Can be in different settings:
– Online (or remote)
– Co-located (or face-to-face)
• Can be for different purposes:
– Programming [15]
– Meetings [38]
– Problem solving [8]
– Brainstorming [37], etc.
Pagina 4
What is collaboration?
• Occurs when two or more persons work towards a common goal [12]
• Can be in different settings:
– Online (or remote)
– Co-located (or face-to-face)
• Can be for different purposes:
– Programming [15]
– Meetings [38]
– Problem solving [8]
– Brainstorming [37], etc.
Pagina 5
MMLA in CC (Sensors)
Pagina 6
Co-located Collaboration
https://bit.ly/2wz7ukR
MMLA in CC (Mirroring)
Pagina 7
Speaking time
[2]
Research Questions
• RQ1 – What collaboration indicators can be observed and are relevant for
the quality of collaboration during CC?
Pagina 8
Research Questions
• RQ1 – What collaboration indicators can be observed and are relevant for
the quality of collaboration during CC?
• RQ2 – What are the state-of-the-art feedback mechanisms that are used
during CC?
Pagina 9
Related work (MI of CC)
Pagina 10
References Indicators Goal
[27] Hand movements, posture & TUI
logs
Post-hoc analysis of
indicators on learning
[30] Joint Visual Attention (JVA) JVA indicates learning
[34] Distance between hands & faces Extraction of multimodal
features
[15] Pointing, body position & grabbing
mouse
Post-hoc classification of
collaboration
[2] Total speaking time LED display to regulate audio
participation in real-time
[37] Number of ideas Real-time metaphorical
feedback to support CB
Related work (MI of CC)
Pagina 11
References Indicators Goal
[5] Total speaking time Conversation clock will regulate the
equity of conversation in real-time
[8] Hand position and head
direction
Build a non-verbal indicator
framework for collaboration
[19] Intensity & pitch of sound, self
reports
Detect collaboration levels based
on rapport obtained from audio
cues & self-reports
[4] Non-lexical speech & speaker-
based audio cues
Predict collaboration quality from
audio cues
[9] Dialogue, gesture, posture &
gaze
Detect indicators of collaboration
from videotaped recordings
Related work (Feedback)
Pagina 12
[2], [5], [37]
Related work (Feedback)
Pagina 13 [17], [38]
Current problems
• Dearth of studies on automated multimodal analysis in non-computer
supported environments [40]
Pagina 14
Current problems
• Dearth of studies on automated multimodal analysis in non-computer
supported environments [40]
• Not privacy preserving
Pagina 15
Current problems
• Dearth of studies on automated multimodal analysis in non-computer
supported environments [40]
• Not privacy preserving
• Studies in controlled conditions using specialized furniture
• Difficult to adapt in a dynamic setting
Pagina 16
Current problems
• Dearth of studies on automated multimodal analysis in non-computer
supported environments [40]
• Not privacy preserving
• Studies in controlled conditions using specialized furniture
• Difficult to adapt in a dynamic setting
• Lack of clarity of the appropriate sensor setup & configuration
Pagina 17
What we did?
• Designed a Woz study to get empirical data
• Designed a working prototype to track multimodal cues during CC
• Designed a real-time feedback support system to facilitate CC
Pagina 18
WOz study
Pagina 19
WOz study
Pagina 20
WOz study
Pagina 21
Lessons learned
• CC is scenario dependent
Pagina 22
Lessons learned
• CC is scenario dependent
• Designing an efficient real-time feedback is a cumbersome task
• Hybrid WOz setup helps to bootstrap the real-time feedback design
Pagina 23
Lessons learned
• CC is scenario dependent
• Designing an efficient real-time feedback is a cumbersome task
• Hybrid WOz setup helps to bootstrap the real-time feedback design
• This prototype can be extended to track other CI in a modular fashion
Pagina 24
Open Questions
• What collaboration scenario to choose (Open-ended vs Closed)?
• What measures can be used to detect collaboration in that scenario?
• What is the underlying relationship between actual collaboration and
MI?
Pagina 25
Thank you!
Pagina 26
@SambitIllumina
W: https://sambit2.github.io/
Sambit Praharaj
E: sambit_praharaj@yahoo.com
sambit.praharaj@ou.nl
References
1. Anastasiou, D., Ras, E.: A questionnaire-based case study on feedback by a tangible interface. In: Proceedings of the 2017 ACM
WS on Intelligent Interfaces for Ubiquitous and Smart Learning. pp. 39{42. ACM (2017)
2. Bachour, K., Kaplan, F., Dillenbourg, P.: An interactive table for supporting participation balance in face-to-face collaborative
learning. IEEE Transactions on Learning Technologies 3(3), 203{213 (2010)
3. Balaam, M., Fitzpatrick, G., Good, J., Harris, E.: Enhancing interactional synchrony with an ambient display. In: Proceedings of the
SIGCHI Conference on Human Factors in Computing Systems. pp. 867{876. ACM (2011)
4. Bassiou, N., Tsiartas, A., Smith, J., Bratt, H., Richey, C., Shriberg, E., D'Angelo, C., Alozie, N.: Privacy-preserving speech
analytics for automatic assessment of student collaboration. In: INTERSPEECH. pp. 888{892 (2016)
5. Bergstrom, T., Karahalios, K.: Conversation clock: Visualizing audio patterns in co-located groups. In: 40th Annual Hawaii
International Conference on System Sciences. pp. 78{78. IEEE (2007)
6. Chikersal, P., Tomprou, M., Kim, Y.J., Woolley, A.W., Dabbish, L.: Deep structures of collaboration: Physiological correlates of
collective intelligence and group satisfaction. In: CSCW. pp. 873{888 (2017)
7. Cukurova, M., Luckin, R., Mavrikis, M., Mill an, E.: Machine and human observable differences in groups collaborative problem-
solving behaviours. In: Proceedings of the 12th EC-TEL. pp. 17{29. Springer (2017)
8. Cukurova, M., Luckin, R., Mill an, E., Mavrikis, M.: The nispi framework: Analysing collaborative problem-solving from students'
physical interactions. Computers & Education 116, 93{109 (2018)
9. Davidsen, J., Ryberg, T.: this is the size of one meter: Childrens bodily-material collaboration. International Journal of CSCL 12(1),
65{90 (2017)
10. Dede, C.: Comparing frameworks for 21st century skills. 21st century skills: Rethinking how students learn 20, 51{76 (2010)
11. Di Mitri, D., Schneider, J., Drachsler, H., Specht, M.: From signals to knowledge. A conceptual model for multimodal learning
analytics. Journal of Computer Assisted Learning (2018)
Pagina 27
References
12. Dillenbourg, P.: What do you mean by collaborative learning? (1999)
13. DiMicco, J.M., Pandolfo, A., Bender, W.: Infuencing group participation with a shared display. In: Proceedings of the 2004 ACM
Conference on CSCW. pp. 614-623. ACM (2004)
14. Dyckho A.L.: Action research and learning analytics in higher education. Eleed 10(1) (2014)
15. Grover, S., Bienkowski, M., Tamrakar, A., Siddiquie, B., Salter, D., Divakaran, A.: Multimodal analytics to study collaborative
problem solving in pair programming. In: Proceedings of the 6th International Conference on LAK. pp. 516{517. ACM
(2016)
16. Jermann, P., Mullins, D., N•ussli, M.A., Dillenbourg, P.: Collaborative gaze footprints: correlates of interaction quality. In:
CSCL2011 Conference Proceedings. vol. 1, pp. 184{191. International Society of the Learning Sciences (2011)
17. Kim, T., Chang, A., Holland, L., Pentland, A.S.: Meeting mediator: enhancing group collaboration using sociometric feedback. In:
Proc. of the 2008 ACM Conf. on CSCW. pp. 457{466. ACM (2008)
18. Kulyk, O., Wang, J., Terken, J.: Real-time feedback on nonverbal behaviour to enhance social dynamics in small group
meetings. In: International WS on Machine Learning for Multimodal Interaction. pp. 150{161. Springer (2005)
19. Lubold, N., Pon-Barry, H.: Acoustic-prosodic entrainment and rapport in collaborative learning dialogues. In: Proceedings of the
2014 ACM WS on Multimodal Learning Analytics Workshop and Grand Challenge. pp. 5{12. ACM (2014)
20. Madan, A., Caneel, R., Pentland, A.S.: Groupmedia: distributed multi-modal interfaces. In: Proceedings of the 6th International
Conference on Multimodal Interfaces. pp. 309{316. ACM (2004)
21. Martinez-Maldonado, R., Clayphan, A., Yacef, K., Kay, J.: Mtfeedback: providing notifications to enhance teacher awareness of
small group work in the classroom. IEEE Transactions on Learning Technologies 8(2), 187{200 (2015)
22. Meier, A., Spada, H., Rummel, N.: A rating scheme for assessing the quality of computer-supported collaboration processes.
International Journal of CSCL 2(1), 63{86 (2007)
Pagina 28
References
23. O'Donnell, A.M.: The role of peers and group learning. (2006)
24. Pijeira-Daz, H.J., Drachsler, H., Kirschner, P.A., Jrvel, S.: Profiling sympathetic arousal in a physics course: How active are
students? Journal of Computer Assisted Learning (2018)
25. Richardson, D.C., Dale, R.: Looking to understand: The coupling between speakers‘ and listeners' eye movements and its
relationship to discourse comprehension. Cognitive Science 29(6), 1045{1060 (2005)
26. Scherr, R.E., Hammer, D.: Student behavior and epistemological framing: Examples from collaborative active-learning activities
in physics. Cognition and Instruction 27(2), 147{174 (2009)
27. Schneider, B., Blikstein, P.: Unraveling students interaction around a tangible interface using multimodal learning analytics.
Journal of Educational Data Mining 7(3), 89{116 (2015)
28. Schneider, B., Pea, R.: Real-time mutual gaze perception enhances collaborative learning and collaboration quality. International
Journal of CSCL 8(4), 375 - 397 (2013)
29. Schneider, B., Pea, R.: Toward collaboration sensing. International Journal of CSCL 9(4), 371{395 (2014)
30. Schneider, B., Sharma, K., Cuendet, S., Zuferey, G., Dillenbourg, P., Pea, R.D.: 3d tangibles facilitate joint visual attention in
dyads. International Society of the Learning Sciences, Inc.[ISLS]. (2015)
31. Schneider, J., Di Mitri, D., Limbu, B., Drachsler, H.: Multimodal learning hub: a tool for capturing customizable multimodal
learning experiences. In: Proceedings of the 13th EC-TEL. Springer (2018)
32. Shih, P.C., Nguyen, D.H., Hirano, S.H., Redmiles, D.F., Hayes, G.R.: Groupmind: supporting idea generation through a
collaborative mind-mapping tool. In: Proc. of the ACM 2009 Int. Conf. on Supporting Group Work. pp. 139{148. ACM (2009)
33. Spikol, D., Ruffaldi, E., Dabisias, G., Cukurova, M.: Supervised machine learning in multimodal learning analytics for estimating
success in project-based learning. Journal of Computer Assisted Learning (2018)
Onderwerp via >Beeld >Koptekst en voettekst
Pagina 29
References
34. Spikol, D., Ruffaldi, E., Landol, L., Cukurova, M.: Estimation of success in collaborative learning based on multimodal learning
analytics features. In: Proceedings of the 17th ICALT. pp. 269{273. IEEE (2017)
35. Stahl, G., Law, N., Hesse, F.: Reigniting cscl flash themes. International Journal
of CSCL 8(4), 369{374 (2013)
36. Stiefelhagen, R., Zhu, J.: Head orientation and gaze direction in meetings. In: CHI'02 Extended Abstracts on Human Factors in
Computing Systems. pp. 858 - 859. ACM (2002)
37. Tausch, S., Hausen, D., Kosan, I., Raltchev, A., Hussmann, H.: Groupgarden: supporting brainstorming through a metaphorical
group mirror on table or wall. In: Proceedings of the 8th Nordic Conference on Human-Computer Interaction. pp. 541{550. ACM
(2014)
38. Terken, J., Sturm, J.: Multimodal support for social dynamics in co-located meetings. Personal and Ubiquitous Computing 14(8),
703{714 (2010)
39. Triglianos, V., Praharaj, S., Pautasso, C., Bozzon, A., Hauff, C.: Measuring student behaviour dynamics in a large interactive
classroom setting. In: Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization. pp. 212{220. ACM
(2017)
40. Worsley, M., Blikstein, P.: Leveraging multimodal learning analytics to differentiate student learning strategies. In: Proceedings of
the 5th International Conference on LAK. pp. 360{367. ACM (2015)
Onderwerp via >Beeld >Koptekst en voettekst
Pagina 30

More Related Content

What's hot

Learning analytics are more than measurement
Learning analytics are more than measurementLearning analytics are more than measurement
Learning analytics are more than measurement
Dragan Gasevic
 
The tensions between expected and actual engagement in digitally–mediated com...
The tensions between expected and actual engagement in digitally–mediated com...The tensions between expected and actual engagement in digitally–mediated com...
The tensions between expected and actual engagement in digitally–mediated com...
jtelss10
 
Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...
Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...
Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...
Dragan Gasevic
 
Stephen Pinfield: Research Data Management and Libraries: Work in Progress
Stephen Pinfield: Research Data Management and Libraries: Work in ProgressStephen Pinfield: Research Data Management and Libraries: Work in Progress
Stephen Pinfield: Research Data Management and Libraries: Work in Progress
Bodleian Libraries Staff Development
 
Learning analytics are more than a technology
Learning analytics are more than a technologyLearning analytics are more than a technology
Learning analytics are more than a technology
Dragan Gasevic
 
Learning analytics and MOOCs: What have we learned so far and where to go?
Learning analytics and MOOCs: What have we learned so far and where to go?Learning analytics and MOOCs: What have we learned so far and where to go?
Learning analytics and MOOCs: What have we learned so far and where to go?
Dragan Gasevic
 
NAGC Plugging into Creative Outlets
NAGC Plugging into Creative OutletsNAGC Plugging into Creative Outlets
NAGC Plugging into Creative Outlets
Brian Housand
 
CSCWD 2017 Keynote: The Complexities of Sustainability and Design
CSCWD 2017 Keynote: The Complexities of Sustainability and DesignCSCWD 2017 Keynote: The Complexities of Sustainability and Design
CSCWD 2017 Keynote: The Complexities of Sustainability and Design
Jan Recker @ University of Hamburg
 

What's hot (8)

Learning analytics are more than measurement
Learning analytics are more than measurementLearning analytics are more than measurement
Learning analytics are more than measurement
 
The tensions between expected and actual engagement in digitally–mediated com...
The tensions between expected and actual engagement in digitally–mediated com...The tensions between expected and actual engagement in digitally–mediated com...
The tensions between expected and actual engagement in digitally–mediated com...
 
Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...
Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...
Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...
 
Stephen Pinfield: Research Data Management and Libraries: Work in Progress
Stephen Pinfield: Research Data Management and Libraries: Work in ProgressStephen Pinfield: Research Data Management and Libraries: Work in Progress
Stephen Pinfield: Research Data Management and Libraries: Work in Progress
 
Learning analytics are more than a technology
Learning analytics are more than a technologyLearning analytics are more than a technology
Learning analytics are more than a technology
 
Learning analytics and MOOCs: What have we learned so far and where to go?
Learning analytics and MOOCs: What have we learned so far and where to go?Learning analytics and MOOCs: What have we learned so far and where to go?
Learning analytics and MOOCs: What have we learned so far and where to go?
 
NAGC Plugging into Creative Outlets
NAGC Plugging into Creative OutletsNAGC Plugging into Creative Outlets
NAGC Plugging into Creative Outlets
 
CSCWD 2017 Keynote: The Complexities of Sustainability and Design
CSCWD 2017 Keynote: The Complexities of Sustainability and DesignCSCWD 2017 Keynote: The Complexities of Sustainability and Design
CSCWD 2017 Keynote: The Complexities of Sustainability and Design
 

Similar to Multimodal Analytics for Real-time Feedback in Co-located Collaboration, EC-TEL 2018

Multimodal Learning Analytics for Collaborative Learning Understanding and Su...
Multimodal Learning Analytics for Collaborative Learning Understanding and Su...Multimodal Learning Analytics for Collaborative Learning Understanding and Su...
Multimodal Learning Analytics for Collaborative Learning Understanding and Su...
Sambit Praharaj
 
TS4-3: Takumi Sato from Nagoya Institute of Technology
TS4-3: Takumi Sato from Nagoya Institute of TechnologyTS4-3: Takumi Sato from Nagoya Institute of Technology
TS4-3: Takumi Sato from Nagoya Institute of Technology
Jawad Haqbeen
 
PhD proposal: Specialized heuristics for crowdsourcing website design
PhD proposal: Specialized heuristics for crowdsourcing website designPhD proposal: Specialized heuristics for crowdsourcing website design
PhD proposal: Specialized heuristics for crowdsourcing website design
donellemckinley
 
SMART Seminar Series: Learning Journeys – Making learning visible in developi...
SMART Seminar Series: Learning Journeys – Making learning visible in developi...SMART Seminar Series: Learning Journeys – Making learning visible in developi...
SMART Seminar Series: Learning Journeys – Making learning visible in developi...
SMART Infrastructure Facility
 
Collaboration and improvisation
Collaboration and improvisationCollaboration and improvisation
Collaboration and improvisation
Christian Voigt
 
726 Group work
726 Group work726 Group work
726 Group work
emtinanalqurashi
 
Collaborative methodologies for writing open educational textbooks a state of...
Collaborative methodologies for writing open educational textbooks a state of...Collaborative methodologies for writing open educational textbooks a state of...
Collaborative methodologies for writing open educational textbooks a state of...
Proyecto LATIn
 
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
City University London
 
Better together? workshop with Dr Stephen Powell #TELfest at Manchester Met
Better together? workshop with Dr Stephen Powell #TELfest at Manchester MetBetter together? workshop with Dr Stephen Powell #TELfest at Manchester Met
Better together? workshop with Dr Stephen Powell #TELfest at Manchester Met
Chrissi Nerantzi
 
Networked Learning Conference 2011
Networked Learning Conference 2011Networked Learning Conference 2011
Networked Learning Conference 2011
Gill Clough
 
Identification Of Factors Supporting Co-Creative Consensus Building And Propo...
Identification Of Factors Supporting Co-Creative Consensus Building And Propo...Identification Of Factors Supporting Co-Creative Consensus Building And Propo...
Identification Of Factors Supporting Co-Creative Consensus Building And Propo...
Kimberly Jones
 
Towards Collaborative Learning Analytics
Towards Collaborative Learning AnalyticsTowards Collaborative Learning Analytics
Towards Collaborative Learning Analytics
alywise
 
First draft
First draftFirst draft
Overview of the OULDI project
Overview of the OULDI projectOverview of the OULDI project
Overview of the OULDI project
Open University Learning Design Initiative
 
Participatory re-action: reflecting on a Design-Based Research approach in ICT4D
Participatory re-action: reflecting on a Design-Based Research approach in ICT4DParticipatory re-action: reflecting on a Design-Based Research approach in ICT4D
Participatory re-action: reflecting on a Design-Based Research approach in ICT4D
Sara Vannini
 
Linking Reflective Writing Analytics to Learning Design
 Linking Reflective Writing Analytics to Learning Design Linking Reflective Writing Analytics to Learning Design
Linking Reflective Writing Analytics to Learning Design
mingliu107
 
Liberact conference 2013 Gnome Surfer & Moclo Planner
Liberact conference 2013 Gnome Surfer & Moclo PlannerLiberact conference 2013 Gnome Surfer & Moclo Planner
Liberact conference 2013 Gnome Surfer & Moclo Planner
Consuelo Valdes
 
Teacher communities: learning design support, social mechanisms, and case stu...
Teacher communities: learning design support, social mechanisms, and case stu...Teacher communities: learning design support, social mechanisms, and case stu...
Teacher communities: learning design support, social mechanisms, and case stu...
davinia.hl
 
CSCL Tools for Regulating Collaboration & Teamwork
CSCL Tools for Regulating Collaboration & TeamworkCSCL Tools for Regulating Collaboration & Teamwork
CSCL Tools for Regulating Collaboration & Teamwork
TieLab
 
Watanuki napier seminar2
Watanuki napier seminar2Watanuki napier seminar2
Watanuki napier seminar2
Hugo Watanuki
 

Similar to Multimodal Analytics for Real-time Feedback in Co-located Collaboration, EC-TEL 2018 (20)

Multimodal Learning Analytics for Collaborative Learning Understanding and Su...
Multimodal Learning Analytics for Collaborative Learning Understanding and Su...Multimodal Learning Analytics for Collaborative Learning Understanding and Su...
Multimodal Learning Analytics for Collaborative Learning Understanding and Su...
 
TS4-3: Takumi Sato from Nagoya Institute of Technology
TS4-3: Takumi Sato from Nagoya Institute of TechnologyTS4-3: Takumi Sato from Nagoya Institute of Technology
TS4-3: Takumi Sato from Nagoya Institute of Technology
 
PhD proposal: Specialized heuristics for crowdsourcing website design
PhD proposal: Specialized heuristics for crowdsourcing website designPhD proposal: Specialized heuristics for crowdsourcing website design
PhD proposal: Specialized heuristics for crowdsourcing website design
 
SMART Seminar Series: Learning Journeys – Making learning visible in developi...
SMART Seminar Series: Learning Journeys – Making learning visible in developi...SMART Seminar Series: Learning Journeys – Making learning visible in developi...
SMART Seminar Series: Learning Journeys – Making learning visible in developi...
 
Collaboration and improvisation
Collaboration and improvisationCollaboration and improvisation
Collaboration and improvisation
 
726 Group work
726 Group work726 Group work
726 Group work
 
Collaborative methodologies for writing open educational textbooks a state of...
Collaborative methodologies for writing open educational textbooks a state of...Collaborative methodologies for writing open educational textbooks a state of...
Collaborative methodologies for writing open educational textbooks a state of...
 
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
 
Better together? workshop with Dr Stephen Powell #TELfest at Manchester Met
Better together? workshop with Dr Stephen Powell #TELfest at Manchester MetBetter together? workshop with Dr Stephen Powell #TELfest at Manchester Met
Better together? workshop with Dr Stephen Powell #TELfest at Manchester Met
 
Networked Learning Conference 2011
Networked Learning Conference 2011Networked Learning Conference 2011
Networked Learning Conference 2011
 
Identification Of Factors Supporting Co-Creative Consensus Building And Propo...
Identification Of Factors Supporting Co-Creative Consensus Building And Propo...Identification Of Factors Supporting Co-Creative Consensus Building And Propo...
Identification Of Factors Supporting Co-Creative Consensus Building And Propo...
 
Towards Collaborative Learning Analytics
Towards Collaborative Learning AnalyticsTowards Collaborative Learning Analytics
Towards Collaborative Learning Analytics
 
First draft
First draftFirst draft
First draft
 
Overview of the OULDI project
Overview of the OULDI projectOverview of the OULDI project
Overview of the OULDI project
 
Participatory re-action: reflecting on a Design-Based Research approach in ICT4D
Participatory re-action: reflecting on a Design-Based Research approach in ICT4DParticipatory re-action: reflecting on a Design-Based Research approach in ICT4D
Participatory re-action: reflecting on a Design-Based Research approach in ICT4D
 
Linking Reflective Writing Analytics to Learning Design
 Linking Reflective Writing Analytics to Learning Design Linking Reflective Writing Analytics to Learning Design
Linking Reflective Writing Analytics to Learning Design
 
Liberact conference 2013 Gnome Surfer & Moclo Planner
Liberact conference 2013 Gnome Surfer & Moclo PlannerLiberact conference 2013 Gnome Surfer & Moclo Planner
Liberact conference 2013 Gnome Surfer & Moclo Planner
 
Teacher communities: learning design support, social mechanisms, and case stu...
Teacher communities: learning design support, social mechanisms, and case stu...Teacher communities: learning design support, social mechanisms, and case stu...
Teacher communities: learning design support, social mechanisms, and case stu...
 
CSCL Tools for Regulating Collaboration & Teamwork
CSCL Tools for Regulating Collaboration & TeamworkCSCL Tools for Regulating Collaboration & Teamwork
CSCL Tools for Regulating Collaboration & Teamwork
 
Watanuki napier seminar2
Watanuki napier seminar2Watanuki napier seminar2
Watanuki napier seminar2
 

Recently uploaded

BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
Nguyen Thanh Tu Collection
 
Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5
sayalidalavi006
 
How to Add Chatter in the odoo 17 ERP Module
How to Add Chatter in the odoo 17 ERP ModuleHow to Add Chatter in the odoo 17 ERP Module
How to Add Chatter in the odoo 17 ERP Module
Celine George
 
World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024
ak6969907
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
Dr. Mulla Adam Ali
 
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdfANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
Priyankaranawat4
 
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama UniversityNatural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Akanksha trivedi rama nursing college kanpur.
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
Israel Genealogy Research Association
 
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdfবাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
eBook.com.bd (প্রয়োজনীয় বাংলা বই)
 
S1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptxS1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptx
tarandeep35
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
Nicholas Montgomery
 
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptxChapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
Advanced Java[Extra Concepts, Not Difficult].docx
Advanced Java[Extra Concepts, Not Difficult].docxAdvanced Java[Extra Concepts, Not Difficult].docx
Advanced Java[Extra Concepts, Not Difficult].docx
adhitya5119
 
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UPLAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
RAHUL
 
The simplified electron and muon model, Oscillating Spacetime: The Foundation...
The simplified electron and muon model, Oscillating Spacetime: The Foundation...The simplified electron and muon model, Oscillating Spacetime: The Foundation...
The simplified electron and muon model, Oscillating Spacetime: The Foundation...
RitikBhardwaj56
 
BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
Katrina Pritchard
 
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
National Information Standards Organization (NISO)
 
Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
Scholarhat
 
How to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 InventoryHow to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 Inventory
Celine George
 
MARY JANE WILSON, A “BOA MÃE” .
MARY JANE WILSON, A “BOA MÃE”           .MARY JANE WILSON, A “BOA MÃE”           .
MARY JANE WILSON, A “BOA MÃE” .
Colégio Santa Teresinha
 

Recently uploaded (20)

BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
 
Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5
 
How to Add Chatter in the odoo 17 ERP Module
How to Add Chatter in the odoo 17 ERP ModuleHow to Add Chatter in the odoo 17 ERP Module
How to Add Chatter in the odoo 17 ERP Module
 
World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
 
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdfANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
 
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama UniversityNatural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
 
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdfবাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
 
S1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptxS1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptx
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
 
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptxChapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
 
Advanced Java[Extra Concepts, Not Difficult].docx
Advanced Java[Extra Concepts, Not Difficult].docxAdvanced Java[Extra Concepts, Not Difficult].docx
Advanced Java[Extra Concepts, Not Difficult].docx
 
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UPLAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
 
The simplified electron and muon model, Oscillating Spacetime: The Foundation...
The simplified electron and muon model, Oscillating Spacetime: The Foundation...The simplified electron and muon model, Oscillating Spacetime: The Foundation...
The simplified electron and muon model, Oscillating Spacetime: The Foundation...
 
BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
 
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
 
Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
 
How to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 InventoryHow to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 Inventory
 
MARY JANE WILSON, A “BOA MÃE” .
MARY JANE WILSON, A “BOA MÃE”           .MARY JANE WILSON, A “BOA MÃE”           .
MARY JANE WILSON, A “BOA MÃE” .
 

Multimodal Analytics for Real-time Feedback in Co-located Collaboration, EC-TEL 2018

  • 1. Multimodal Analytics for Real-time Feedback in Co-located Collaboration Sambit Praharaj, Maren Scheffel, Hendrik Drachsler and Marcus Specht
  • 2. What is collaboration? • Occurs when two or more persons work towards a common goal [12] • Can be in different settings: – Online (or remote) – Co-located (or face-to-face) • Can be for different purposes: – Programming (Grover et al., 2016) – Meetings (Terken & Strum, 2010) – Problem solving (Cukurova et al., 2018) – Brainstorming (Tausch et al., 2014), etc. Pagina 2
  • 3. What is collaboration? • Occurs when two or more persons work towards a common goal [12] • Can be in different settings: – Online (or remote) – Co-located (or face-to-face) • Can be for different purposes: – Programming (Grover et al., 2016) – Meetings (Terken & Strum, 2010) – Problem solving (Cukurova et al., 2018) – Brainstorming (Tausch et al., 2014), etc. Pagina 3
  • 4. What is collaboration? • Occurs when two or more persons work towards a common goal [12] • Can be in different settings: – Online (or remote) – Co-located (or face-to-face) • Can be for different purposes: – Programming [15] – Meetings [38] – Problem solving [8] – Brainstorming [37], etc. Pagina 4
  • 5. What is collaboration? • Occurs when two or more persons work towards a common goal [12] • Can be in different settings: – Online (or remote) – Co-located (or face-to-face) • Can be for different purposes: – Programming [15] – Meetings [38] – Problem solving [8] – Brainstorming [37], etc. Pagina 5
  • 6. MMLA in CC (Sensors) Pagina 6 Co-located Collaboration https://bit.ly/2wz7ukR
  • 7. MMLA in CC (Mirroring) Pagina 7 Speaking time [2]
  • 8. Research Questions • RQ1 – What collaboration indicators can be observed and are relevant for the quality of collaboration during CC? Pagina 8
  • 9. Research Questions • RQ1 – What collaboration indicators can be observed and are relevant for the quality of collaboration during CC? • RQ2 – What are the state-of-the-art feedback mechanisms that are used during CC? Pagina 9
  • 10. Related work (MI of CC) Pagina 10 References Indicators Goal [27] Hand movements, posture & TUI logs Post-hoc analysis of indicators on learning [30] Joint Visual Attention (JVA) JVA indicates learning [34] Distance between hands & faces Extraction of multimodal features [15] Pointing, body position & grabbing mouse Post-hoc classification of collaboration [2] Total speaking time LED display to regulate audio participation in real-time [37] Number of ideas Real-time metaphorical feedback to support CB
  • 11. Related work (MI of CC) Pagina 11 References Indicators Goal [5] Total speaking time Conversation clock will regulate the equity of conversation in real-time [8] Hand position and head direction Build a non-verbal indicator framework for collaboration [19] Intensity & pitch of sound, self reports Detect collaboration levels based on rapport obtained from audio cues & self-reports [4] Non-lexical speech & speaker- based audio cues Predict collaboration quality from audio cues [9] Dialogue, gesture, posture & gaze Detect indicators of collaboration from videotaped recordings
  • 12. Related work (Feedback) Pagina 12 [2], [5], [37]
  • 14. Current problems • Dearth of studies on automated multimodal analysis in non-computer supported environments [40] Pagina 14
  • 15. Current problems • Dearth of studies on automated multimodal analysis in non-computer supported environments [40] • Not privacy preserving Pagina 15
  • 16. Current problems • Dearth of studies on automated multimodal analysis in non-computer supported environments [40] • Not privacy preserving • Studies in controlled conditions using specialized furniture • Difficult to adapt in a dynamic setting Pagina 16
  • 17. Current problems • Dearth of studies on automated multimodal analysis in non-computer supported environments [40] • Not privacy preserving • Studies in controlled conditions using specialized furniture • Difficult to adapt in a dynamic setting • Lack of clarity of the appropriate sensor setup & configuration Pagina 17
  • 18. What we did? • Designed a Woz study to get empirical data • Designed a working prototype to track multimodal cues during CC • Designed a real-time feedback support system to facilitate CC Pagina 18
  • 22. Lessons learned • CC is scenario dependent Pagina 22
  • 23. Lessons learned • CC is scenario dependent • Designing an efficient real-time feedback is a cumbersome task • Hybrid WOz setup helps to bootstrap the real-time feedback design Pagina 23
  • 24. Lessons learned • CC is scenario dependent • Designing an efficient real-time feedback is a cumbersome task • Hybrid WOz setup helps to bootstrap the real-time feedback design • This prototype can be extended to track other CI in a modular fashion Pagina 24
  • 25. Open Questions • What collaboration scenario to choose (Open-ended vs Closed)? • What measures can be used to detect collaboration in that scenario? • What is the underlying relationship between actual collaboration and MI? Pagina 25
  • 26. Thank you! Pagina 26 @SambitIllumina W: https://sambit2.github.io/ Sambit Praharaj E: sambit_praharaj@yahoo.com sambit.praharaj@ou.nl
  • 27. References 1. Anastasiou, D., Ras, E.: A questionnaire-based case study on feedback by a tangible interface. In: Proceedings of the 2017 ACM WS on Intelligent Interfaces for Ubiquitous and Smart Learning. pp. 39{42. ACM (2017) 2. Bachour, K., Kaplan, F., Dillenbourg, P.: An interactive table for supporting participation balance in face-to-face collaborative learning. IEEE Transactions on Learning Technologies 3(3), 203{213 (2010) 3. Balaam, M., Fitzpatrick, G., Good, J., Harris, E.: Enhancing interactional synchrony with an ambient display. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 867{876. ACM (2011) 4. Bassiou, N., Tsiartas, A., Smith, J., Bratt, H., Richey, C., Shriberg, E., D'Angelo, C., Alozie, N.: Privacy-preserving speech analytics for automatic assessment of student collaboration. In: INTERSPEECH. pp. 888{892 (2016) 5. Bergstrom, T., Karahalios, K.: Conversation clock: Visualizing audio patterns in co-located groups. In: 40th Annual Hawaii International Conference on System Sciences. pp. 78{78. IEEE (2007) 6. Chikersal, P., Tomprou, M., Kim, Y.J., Woolley, A.W., Dabbish, L.: Deep structures of collaboration: Physiological correlates of collective intelligence and group satisfaction. In: CSCW. pp. 873{888 (2017) 7. Cukurova, M., Luckin, R., Mavrikis, M., Mill an, E.: Machine and human observable differences in groups collaborative problem- solving behaviours. In: Proceedings of the 12th EC-TEL. pp. 17{29. Springer (2017) 8. Cukurova, M., Luckin, R., Mill an, E., Mavrikis, M.: The nispi framework: Analysing collaborative problem-solving from students' physical interactions. Computers & Education 116, 93{109 (2018) 9. Davidsen, J., Ryberg, T.: this is the size of one meter: Childrens bodily-material collaboration. International Journal of CSCL 12(1), 65{90 (2017) 10. Dede, C.: Comparing frameworks for 21st century skills. 21st century skills: Rethinking how students learn 20, 51{76 (2010) 11. Di Mitri, D., Schneider, J., Drachsler, H., Specht, M.: From signals to knowledge. A conceptual model for multimodal learning analytics. Journal of Computer Assisted Learning (2018) Pagina 27
  • 28. References 12. Dillenbourg, P.: What do you mean by collaborative learning? (1999) 13. DiMicco, J.M., Pandolfo, A., Bender, W.: Infuencing group participation with a shared display. In: Proceedings of the 2004 ACM Conference on CSCW. pp. 614-623. ACM (2004) 14. Dyckho A.L.: Action research and learning analytics in higher education. Eleed 10(1) (2014) 15. Grover, S., Bienkowski, M., Tamrakar, A., Siddiquie, B., Salter, D., Divakaran, A.: Multimodal analytics to study collaborative problem solving in pair programming. In: Proceedings of the 6th International Conference on LAK. pp. 516{517. ACM (2016) 16. Jermann, P., Mullins, D., N•ussli, M.A., Dillenbourg, P.: Collaborative gaze footprints: correlates of interaction quality. In: CSCL2011 Conference Proceedings. vol. 1, pp. 184{191. International Society of the Learning Sciences (2011) 17. Kim, T., Chang, A., Holland, L., Pentland, A.S.: Meeting mediator: enhancing group collaboration using sociometric feedback. In: Proc. of the 2008 ACM Conf. on CSCW. pp. 457{466. ACM (2008) 18. Kulyk, O., Wang, J., Terken, J.: Real-time feedback on nonverbal behaviour to enhance social dynamics in small group meetings. In: International WS on Machine Learning for Multimodal Interaction. pp. 150{161. Springer (2005) 19. Lubold, N., Pon-Barry, H.: Acoustic-prosodic entrainment and rapport in collaborative learning dialogues. In: Proceedings of the 2014 ACM WS on Multimodal Learning Analytics Workshop and Grand Challenge. pp. 5{12. ACM (2014) 20. Madan, A., Caneel, R., Pentland, A.S.: Groupmedia: distributed multi-modal interfaces. In: Proceedings of the 6th International Conference on Multimodal Interfaces. pp. 309{316. ACM (2004) 21. Martinez-Maldonado, R., Clayphan, A., Yacef, K., Kay, J.: Mtfeedback: providing notifications to enhance teacher awareness of small group work in the classroom. IEEE Transactions on Learning Technologies 8(2), 187{200 (2015) 22. Meier, A., Spada, H., Rummel, N.: A rating scheme for assessing the quality of computer-supported collaboration processes. International Journal of CSCL 2(1), 63{86 (2007) Pagina 28
  • 29. References 23. O'Donnell, A.M.: The role of peers and group learning. (2006) 24. Pijeira-Daz, H.J., Drachsler, H., Kirschner, P.A., Jrvel, S.: Profiling sympathetic arousal in a physics course: How active are students? Journal of Computer Assisted Learning (2018) 25. Richardson, D.C., Dale, R.: Looking to understand: The coupling between speakers‘ and listeners' eye movements and its relationship to discourse comprehension. Cognitive Science 29(6), 1045{1060 (2005) 26. Scherr, R.E., Hammer, D.: Student behavior and epistemological framing: Examples from collaborative active-learning activities in physics. Cognition and Instruction 27(2), 147{174 (2009) 27. Schneider, B., Blikstein, P.: Unraveling students interaction around a tangible interface using multimodal learning analytics. Journal of Educational Data Mining 7(3), 89{116 (2015) 28. Schneider, B., Pea, R.: Real-time mutual gaze perception enhances collaborative learning and collaboration quality. International Journal of CSCL 8(4), 375 - 397 (2013) 29. Schneider, B., Pea, R.: Toward collaboration sensing. International Journal of CSCL 9(4), 371{395 (2014) 30. Schneider, B., Sharma, K., Cuendet, S., Zuferey, G., Dillenbourg, P., Pea, R.D.: 3d tangibles facilitate joint visual attention in dyads. International Society of the Learning Sciences, Inc.[ISLS]. (2015) 31. Schneider, J., Di Mitri, D., Limbu, B., Drachsler, H.: Multimodal learning hub: a tool for capturing customizable multimodal learning experiences. In: Proceedings of the 13th EC-TEL. Springer (2018) 32. Shih, P.C., Nguyen, D.H., Hirano, S.H., Redmiles, D.F., Hayes, G.R.: Groupmind: supporting idea generation through a collaborative mind-mapping tool. In: Proc. of the ACM 2009 Int. Conf. on Supporting Group Work. pp. 139{148. ACM (2009) 33. Spikol, D., Ruffaldi, E., Dabisias, G., Cukurova, M.: Supervised machine learning in multimodal learning analytics for estimating success in project-based learning. Journal of Computer Assisted Learning (2018) Onderwerp via >Beeld >Koptekst en voettekst Pagina 29
  • 30. References 34. Spikol, D., Ruffaldi, E., Landol, L., Cukurova, M.: Estimation of success in collaborative learning based on multimodal learning analytics features. In: Proceedings of the 17th ICALT. pp. 269{273. IEEE (2017) 35. Stahl, G., Law, N., Hesse, F.: Reigniting cscl flash themes. International Journal of CSCL 8(4), 369{374 (2013) 36. Stiefelhagen, R., Zhu, J.: Head orientation and gaze direction in meetings. In: CHI'02 Extended Abstracts on Human Factors in Computing Systems. pp. 858 - 859. ACM (2002) 37. Tausch, S., Hausen, D., Kosan, I., Raltchev, A., Hussmann, H.: Groupgarden: supporting brainstorming through a metaphorical group mirror on table or wall. In: Proceedings of the 8th Nordic Conference on Human-Computer Interaction. pp. 541{550. ACM (2014) 38. Terken, J., Sturm, J.: Multimodal support for social dynamics in co-located meetings. Personal and Ubiquitous Computing 14(8), 703{714 (2010) 39. Triglianos, V., Praharaj, S., Pautasso, C., Bozzon, A., Hauff, C.: Measuring student behaviour dynamics in a large interactive classroom setting. In: Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization. pp. 212{220. ACM (2017) 40. Worsley, M., Blikstein, P.: Leveraging multimodal learning analytics to differentiate student learning strategies. In: Proceedings of the 5th International Conference on LAK. pp. 360{367. ACM (2015) Onderwerp via >Beeld >Koptekst en voettekst Pagina 30