Learning Analytics
support for
Just-in-time Teaching
Israel Gutiérrez
Jornadas GAST - 8 de julio de 2013
Just-in-time
Teaching
Awareness
Learning
Analytics
Lab sessions
photo: berkeleylab at flickr
Research
Questions
Research
Questions
“What are the problems that emerge in highly interactive
face-to-face sessions?”
Research
Questions
“Could a just-in-time teaching system be used to overcome
the previous problems, facilitating the teacher
management of the session driving it to the intended
learning objectives and improving the efficiency of the
students allowing them to focus on the assignment?”
“What are the problems that emerge in highly interactive
face-to-face sessions?”
Methodology
Design-based research
Methodology
Design-based research
• Based on theory but pragmatic
Methodology
Design-based research
• Based on theory but pragmatic
• Real-world setting
Methodology
Design-based research
• Based on theory but pragmatic
• Real-world setting
• Iterative process
Methodology
Design-based research
• Based on theory but pragmatic
• Real-world setting
• Iterative process
• Mixed methods
Methodology
Design-based research
• Based on theory but pragmatic
• Real-world setting
• Iterative process
• Mixed methods
• Research agenda updated with findings
Problems in
lab session
Literature Experiments
Experts
Literature
Lantern (Alavi & Dillenbourg, 2009)
PLITAZ (Dong & Hwang, 2012)
Problem Source Stakeholder
Demand an answer Alavi09 Students
Wait longer Alavi09 Students
Fails to notice requests Alavi09 Teachers
Heavy workload Dong12 Teachers
Isolation Dong12 Students
Limited awareness Dong12 Teachers
Simultaneous requests Dong12 Teachers
AMM11 (Gutiérrez Rojas, Crespo García, & Delgado Kloos, 11)
AS11 (Gutiérrez Rojas & Crespo García, 12)
AMM12 (Gutiérrez Rojas, Crespo García, & Delgado Kloos, 12)
Problem Source Stakeholder
Methodology increases workload AMM11 Teachers
Huge number of requests AS11 Teachers
Attention to personalized feedback AS11 Students
Ask without thinking AS11 Students
Shorten explanation if overwhelmed AS11 Teachers
Perceive not enough teachers AS11 Students
Attention order unfairness AS11 Teachers
Devote time monitoring the teacher AS11 Students
Not aware of time AS11 Teachers
Not like writing questions AMM12 Students
Not relevant not current info AMM12 Teachers
Interface not straight-forward AMM12 Teachers
Experiments
OUNL
UC3M
Experts
KU Leuven
RWTH Aachen
Problem Source Stakeholder
Not support for project-based learning EXP Teachers
Not support for exchange questions EXP Students
Not support for exchange progress EXP Students
Not collecting evidences for summative EXP Teachers
Requirements
Requirement Stakeholder
Provide time management mechanisms Teachers
Provide info about students progression Teachers
Provide info about students requests Teachers
Straightforward UI Teachers
Responsive UI Teachers
Store and process students records Teachers
Support different teaching methods Teachers
Provide info to students for self-awareness Students
As much personalized feedback as possible Students
Enable students to focus on the assignment Students
Share and rate questions and answers Students
Share progression Students
in-Class Live Analytics
for Assessment and
Orchestration
http://www.class-on.org
Student UI
Student UI
Teacher
UI
Teacher
UI
Analytics
Video
Authentic
experiments
AMM12 AS12 AMM13
Date
March-May
2012
November
2012
February-May
2013
Duration 18 sessions 6 sessions 10 sessions*
Teachers 4 3 1
Students 70 121 30
Group
settings
Dyads Dyads Dyads
Results
Teachers
interviews
Students
surveys
Collected
traces
Results
Teachers
interviews
Students
surveys
Collected
traces
Results
Teachers
interviews
Students
surveys
Collected
traces Requirements
Lessons
Learned
Lessons
Learned
Lessons
Learned
Lessons
Learned
Lessons
Learned
Contributions
Contributions
Contributions
Contributions
Related
Publications
Gutiérrez Rojas, I., Crespo García, R. M., & Delgado Kloos, C. (2012). Enhancing
orchestration of lab sessions by means of awareness mechanisms.
EC-TEL 2012: 21st century learning for 21st century skills: 7th European
Conference of Technology Enhanced Learning, 18-21 September 2012, Saarbrücken
(Germany) (Vol. 7563, pp. 113–125).
Gutiérrez Rojas, I., & Crespo García, R. M. (2012). Towards efficient provision
of feedback in lab sessions. International Conference on Advanced Learning
Technologies (ICALT) (Vol. 1). Rome.
Gutiérrez Rojas, I., Crespo García, R. M., & Delgado Kloos, C. (2011).
Orchestration and feedback in lab sessions: improvements in
quick feedback provision. Towards Ubiquitous Learning. 6th European Conference
ofTechnology Enhanced Learning, EC-TEL 2011 Palermo, Italy, September 20-23, 2011
Proceedings. LNCS, 6964. doi:10.1007/978-3-642-23985-4
Future Work
Future Work
http://www.moocrank.com
Thank you
very much!

Learning Analytics Support for Just-in-time Teaching