Learning Dashboards &
                       Learnscapes
                                    Sten Govaerts
                OUJ-GLOBE/AXIES/KU - International Seminar for MOOCs and
                                   Digital Libraries




                                           1
Sunday, February 24, 13
KULeuven team:
                              Human-Computer Interaction

                              • technology enhanced learning
                              • music
                              • research
                                     http://hci.cs.kuleuven.be/


                              EPFL team:
                              REACT - Real-time Coordination &
                              Distributed Interaction Systems Group

                              • technology enhanced learning
                              • social media
                              • transportation
                          2
                                        http://react.epfl.ch/
Sunday, February 24, 13
Learning Analytics is about
                collecting traces
                that learners leave behind
                and using those traces
                to improve learning.

                          http://erikduval.wordpress.com/2012/01/30/learning-analytics-and-educational-data-mining/

                                                3
Sunday, February 24, 13
MOOCs & learning
                             analytics
                    •     what is going on in the course?

                    • what are (other) students doing?
                    • which resources are important?
                    • which students are experiencing problems?
                    • can we automatically grade assessments?

                    • can we provide automatic feedback to
                          students?
                                             4

Sunday, February 24, 13
5
Sunday, February 24, 13
13
                          6
Sunday, February 24, 13
how do we track?
                    • twitter
                    • blog/blog comments
                    • time tracking: toggl.com
                    • user actions:
                     • eclipse plug-in
                     • virtual machines
                     • logs from learning management systems
                                        7
Sunday, February 24, 13
how do we track?
                    • twitter
                    • blog/blog comments    }   OPEN

                    • time tracking: toggl.com
                    • user actions:
                     • eclipse plug-in
                     • virtual machines
                     • logs from learning management systems
                                        7
Sunday, February 24, 13
case studies.



                                8
Sunday, February 24, 13
J. L. Santos, K.Verbert,
                          S. Govaerts, and E.
                          Duval. Visualizing PLE
                          Usage. Proceedings of
                          EFEPLE11: 1st
                          Workshop on Exploring
                          the Fitness and
                          Evolvability of Personal
                          Learning Environments,
                          CEUR Laclusaz, France,
                          30-31 March 2011
                                     9
Sunday, February 24, 13
http://jlsantoso.blogspot.com/

                                        10

Sunday, February 24, 13
Jose Luis Santos; Sten Govaerts; Katrien Verbert; Erik Duval. Goal-
                          oriented visualizations of activity tracking: a case study with engineering
                          students. ACM Learning Analytics and Knowledge Conference 2012.
                          h"p://ariadne.cs.kuleuven.be/stepup/dashboardthesis.jsp
                                                     11

Sunday, February 24, 13
Govaerts, Sten;Verbert, Katrien,
      Duval, Erik; Pardo, Abelardo, The
      Student Activity Meter for
      Awareness and Self-reflection.
   http://ariadne.cs.kuleuven.be/monitorwidget-chi
                                                     12
Sunday, February 24, 13
Govaerts, Sten;Verbert, Katrien,
      Duval, Erik; Pardo, Abelardo, The
      Student Activity Meter for
      Awareness and Self-reflection.
   http://ariadne.cs.kuleuven.be/monitorwidget-chi
                                                     12
Sunday, February 24, 13
Govaerts, Sten;Verbert, Katrien,
      Duval, Erik; Pardo, Abelardo, The
      Student Activity Meter for
      Awareness and Self-reflection.
   http://ariadne.cs.kuleuven.be/monitorwidget-chi
                                                     12
Sunday, February 24, 13
Sunday, February 24, 13
                          13




                               http://mume11.snakeflash.com/
also on tabletop...




                   Vandeputte, Bram; Klerkx, Joris; Duval, Erik. Applying Design
                   Strategies in Publication Networks - A Case Study.

                                                    14
Sunday, February 24, 13
issues.



                             15
Sunday, February 24, 13
user tracking issues
                                                          how do we know
                                                          which actions are
                                                          relevant before we
                                                          track them?


                   • what are relevant learner actions?




                                         16

Sunday, February 24, 13
user tracking issues
                                                           how do we know
                                                           which actions are
                                                           relevant before we
                                                           track them?


                   • what are relevant learner actions?
                   • how can we capture learner actions?



                                        16

Sunday, February 24, 13
feedback loops.




                                 17

Sunday, February 24, 13
evaluation issues
                      • how to evaluate usefulness?




                                          18

Sunday, February 24, 13
evaluation issues
                      • how to evaluate usefulness?
                      • how to evaluate learning impact?




                                           18

Sunday, February 24, 13
19
Sunday, February 24, 13
20

Sunday, February 24, 13
architectural issues
                    • how to exploit mobile devices to
                          collaborate and communicate?




                                            21

Sunday, February 24, 13
architectural issues
                    • how to exploit mobile devices to
                          collaborate and communicate?
                    • what kind of infrastructure can support
                          learning analytics applications best?




                                               21

Sunday, February 24, 13
architectural issues
                    • how to exploit mobile devices to
                          collaborate and communicate?
                    • what kind of infrastructure can support
                          learning analytics applications best?
                    • how to make learning analytics re-usable?



                                               21

Sunday, February 24, 13
architectural issues
                    • how to exploit mobile devices to
                          collaborate and communicate?
                    • what kind of infrastructure can support
                          learning analytics applications best?
                    • how to make learning analytics re-usable?
                    • how to create seamless transition between
                          mobile, laptop, tablet, tabletop and large
                          public displays?

                                               21

Sunday, February 24, 13
Go-Lab project
             • remote & virtual labs for
                    elementary & secondary school
                    students to promote science
             • learning analytics in online labs for
                    teachers & students
             • enabling scaffolds,
                    recommendations &
                    dashboards
                     http://www.go-lab-project.eu/
                                                     22

Sunday, February 24, 13
portable learning
                          analytics dashboards
                    • re-use dashboard across platforms and users




                                         23

Sunday, February 24, 13
portable learning
                           analytics dashboards
                    • re-use dashboard across platforms and users
                    • standardise the way to track and query
                          learning analytics data
                          • Activity Streams
                          • OpenSocial widgets



                                               23

Sunday, February 24, 13
portable learning
                           analytics dashboards
                    • re-use dashboard across platforms and users
                    • standardise the way to track and query
                          learning analytics data
                          • Activity Streams
                          • OpenSocial widgets
                    • learning analytics on any platform that
                          supports OpenSocial


                                               23

Sunday, February 24, 13
portable learning
                           analytics dashboards
                    • re-use dashboard across platforms and users
                    • standardise the way to track and query
                          learning analytics data
                          • Activity Streams
                          • OpenSocial widgets
                    • learning analytics on any platform that
                          supports OpenSocial
                    • dashboard config can be made portable.
                                               23

Sunday, February 24, 13
portable learning
                           analytics dashboards
                    • re-use dashboard across platforms and users
                    • standardise the way to track and query
                          learning analytics data
                          • Activity Streams
                          • OpenSocial widgets
                    • learning analytics on any platform that
                          supports OpenSocial
                    • dashboard config can be made portable.
                                               23

Sunday, February 24, 13
どうも ありがとう ございます!
         sten.govaerts@epfl.ch
         slides will appear on http://www.slideshare.net/stengovaerts

                 LAK13: Learning Analytics and Knowledge
                 8-12 April 2013           Leuven, Belgium




                          http://lakconference.org/
                                       24
Sunday, February 24, 13

Learning Dashboards & Learnscapes

  • 1.
    Learning Dashboards & Learnscapes Sten Govaerts OUJ-GLOBE/AXIES/KU - International Seminar for MOOCs and Digital Libraries 1 Sunday, February 24, 13
  • 2.
    KULeuven team: Human-Computer Interaction • technology enhanced learning • music • research http://hci.cs.kuleuven.be/ EPFL team: REACT - Real-time Coordination & Distributed Interaction Systems Group • technology enhanced learning • social media • transportation 2 http://react.epfl.ch/ Sunday, February 24, 13
  • 3.
    Learning Analytics isabout collecting traces that learners leave behind and using those traces to improve learning. http://erikduval.wordpress.com/2012/01/30/learning-analytics-and-educational-data-mining/ 3 Sunday, February 24, 13
  • 4.
    MOOCs & learning analytics • what is going on in the course? • what are (other) students doing? • which resources are important? • which students are experiencing problems? • can we automatically grade assessments? • can we provide automatic feedback to students? 4 Sunday, February 24, 13
  • 5.
  • 6.
    13 6 Sunday, February 24, 13
  • 7.
    how do wetrack? • twitter • blog/blog comments • time tracking: toggl.com • user actions: • eclipse plug-in • virtual machines • logs from learning management systems 7 Sunday, February 24, 13
  • 8.
    how do wetrack? • twitter • blog/blog comments } OPEN • time tracking: toggl.com • user actions: • eclipse plug-in • virtual machines • logs from learning management systems 7 Sunday, February 24, 13
  • 9.
    case studies. 8 Sunday, February 24, 13
  • 10.
    J. L. Santos,K.Verbert, S. Govaerts, and E. Duval. Visualizing PLE Usage. Proceedings of EFEPLE11: 1st Workshop on Exploring the Fitness and Evolvability of Personal Learning Environments, CEUR Laclusaz, France, 30-31 March 2011 9 Sunday, February 24, 13
  • 11.
    http://jlsantoso.blogspot.com/ 10 Sunday, February 24, 13
  • 12.
    Jose Luis Santos;Sten Govaerts; Katrien Verbert; Erik Duval. Goal- oriented visualizations of activity tracking: a case study with engineering students. ACM Learning Analytics and Knowledge Conference 2012. h"p://ariadne.cs.kuleuven.be/stepup/dashboardthesis.jsp 11 Sunday, February 24, 13
  • 13.
    Govaerts, Sten;Verbert, Katrien, Duval, Erik; Pardo, Abelardo, The Student Activity Meter for Awareness and Self-reflection. http://ariadne.cs.kuleuven.be/monitorwidget-chi 12 Sunday, February 24, 13
  • 14.
    Govaerts, Sten;Verbert, Katrien, Duval, Erik; Pardo, Abelardo, The Student Activity Meter for Awareness and Self-reflection. http://ariadne.cs.kuleuven.be/monitorwidget-chi 12 Sunday, February 24, 13
  • 15.
    Govaerts, Sten;Verbert, Katrien, Duval, Erik; Pardo, Abelardo, The Student Activity Meter for Awareness and Self-reflection. http://ariadne.cs.kuleuven.be/monitorwidget-chi 12 Sunday, February 24, 13
  • 16.
    Sunday, February 24,13 13 http://mume11.snakeflash.com/
  • 17.
    also on tabletop... Vandeputte, Bram; Klerkx, Joris; Duval, Erik. Applying Design Strategies in Publication Networks - A Case Study. 14 Sunday, February 24, 13
  • 18.
    issues. 15 Sunday, February 24, 13
  • 19.
    user tracking issues how do we know which actions are relevant before we track them? • what are relevant learner actions? 16 Sunday, February 24, 13
  • 20.
    user tracking issues how do we know which actions are relevant before we track them? • what are relevant learner actions? • how can we capture learner actions? 16 Sunday, February 24, 13
  • 21.
    feedback loops. 17 Sunday, February 24, 13
  • 22.
    evaluation issues • how to evaluate usefulness? 18 Sunday, February 24, 13
  • 23.
    evaluation issues • how to evaluate usefulness? • how to evaluate learning impact? 18 Sunday, February 24, 13
  • 24.
  • 25.
  • 26.
    architectural issues • how to exploit mobile devices to collaborate and communicate? 21 Sunday, February 24, 13
  • 27.
    architectural issues • how to exploit mobile devices to collaborate and communicate? • what kind of infrastructure can support learning analytics applications best? 21 Sunday, February 24, 13
  • 28.
    architectural issues • how to exploit mobile devices to collaborate and communicate? • what kind of infrastructure can support learning analytics applications best? • how to make learning analytics re-usable? 21 Sunday, February 24, 13
  • 29.
    architectural issues • how to exploit mobile devices to collaborate and communicate? • what kind of infrastructure can support learning analytics applications best? • how to make learning analytics re-usable? • how to create seamless transition between mobile, laptop, tablet, tabletop and large public displays? 21 Sunday, February 24, 13
  • 30.
    Go-Lab project • remote & virtual labs for elementary & secondary school students to promote science • learning analytics in online labs for teachers & students • enabling scaffolds, recommendations & dashboards http://www.go-lab-project.eu/ 22 Sunday, February 24, 13
  • 31.
    portable learning analytics dashboards • re-use dashboard across platforms and users 23 Sunday, February 24, 13
  • 32.
    portable learning analytics dashboards • re-use dashboard across platforms and users • standardise the way to track and query learning analytics data • Activity Streams • OpenSocial widgets 23 Sunday, February 24, 13
  • 33.
    portable learning analytics dashboards • re-use dashboard across platforms and users • standardise the way to track and query learning analytics data • Activity Streams • OpenSocial widgets • learning analytics on any platform that supports OpenSocial 23 Sunday, February 24, 13
  • 34.
    portable learning analytics dashboards • re-use dashboard across platforms and users • standardise the way to track and query learning analytics data • Activity Streams • OpenSocial widgets • learning analytics on any platform that supports OpenSocial • dashboard config can be made portable. 23 Sunday, February 24, 13
  • 35.
    portable learning analytics dashboards • re-use dashboard across platforms and users • standardise the way to track and query learning analytics data • Activity Streams • OpenSocial widgets • learning analytics on any platform that supports OpenSocial • dashboard config can be made portable. 23 Sunday, February 24, 13
  • 36.
    どうも ありがとう ございます! sten.govaerts@epfl.ch slides will appear on http://www.slideshare.net/stengovaerts LAK13: Learning Analytics and Knowledge 8-12 April 2013 Leuven, Belgium http://lakconference.org/ 24 Sunday, February 24, 13