Data-driven Research and Learning Analytics




Hendrik Drachsler (a), Katrien Verbert (b)

(a) CELSTEC, Open University of the Netherlands
(b) Dept. Computer Science, K.U.Leuven, Belgium




                          1
Who is dataTEL ?
      dataTEL is a Theme Team funded by the
          STELLAR network of excellence



  Riina   Stephanie    Katrien     Nikos      Martin     Hendrik
Vuorikari Lindstaedt   Verbert   Manouselis   Wolpers   Drachsler




                                 2
Who is dataTEL ?
         dataTEL is a Theme Team funded by the
             STELLAR network of excellence



  Riina   Stephanie    Katrien     Nikos      Martin     Hendrik
Vuorikari Lindstaedt   Verbert   Manouselis   Wolpers   Drachsler

             MAVSEL                   CEN PT
                                      Social Data



  Miguel                     Joris
Angel Sicillia              Klerkx2
Survey on TEL Recommender




           3
Survey on TEL Recommender




           3
The TEL recommender
research is a bit like this...




              4
But...
“The performance results
of different research
efforts in TEL
recommender systems
are hardly comparable.”

(Manouselis et al., 2010)
                                Kaptain Kobold
                                http://www.flickr.com/photos/
                                kaptainkobold/3203311346/




                            5
But...
“TheTEL recommender
The performance results
of different research
experiments lack
efforts in TEL They need
transparency.
recommender systems
to be repeatable to test:
are hardly comparable.”
• Validity
(Manouselis et al., 2010)
• Verification
• Compare results               Kaptain Kobold
                                http://www.flickr.com/photos/
                                kaptainkobold/3203311346/




                            5
dataTEL::Collection




         7
8
9
Grand Challenges

    1. Topic: Evaluation of
    recommender systems in TEL

    2. Topic: Data supported learning
    examples

    3. Topic: Datasets from learning
    object repositories and web content

    4. Topic: Privacy and data protection
    for educational datasets




9
10
Who is dataTEL ?


  Riina   Stephanie    Katrien      Nikos      Martin     Hendrik
Vuorikari Lindstaedt   Verbert    Manouselis   Wolpers   Drachsler

             MAVSEL                    CEN PT
                                       Social Data



  Miguel                     Joris
Angel Sicillia              Klerkx11
12
http://bit.ly/datatel




  12
Objectives of the SIG d
• Fostering of a research network on educational datasets

• Representing dataTEL researchers to promote the release of
  open datasets

• Contributing to policies on ethical implications
  (privacy and legal protection rights)

• Fostering a shared understanding of evaluation methods in
  Learning Analytics

• Fostering the standardizations of datasets to enable exchange
 and interoperability



                                  13
How to achieve the goals

•	

Setting up a website / maintain TELeurope group
    community

•	

Set up a open data repository for sharing educational
    datasets and related researches outcomes

•	

Organizing annual workshop and SI

• Organizing a data competition like in TREC



                               14
15
Call for Journal Papers (IJTEL)

Datasets and Data Supported Learning
Deadline: 25.10.2011

http://bit.ly/SI-datatel




                           15
Learning Analytics Questionnaire
http://bit.ly/
Learning_Analytics

‣234 response
‣16 countries
‣Mostly Higher
Education




                     16
Many thanks for your attention, and now...




                                               17
picture by Tom Raftery   http://www.flickr.com/photos/traftery/4773457853/sizes/l
Many thanks for your attention, and now...




      You face ethical and privacy issues when you want to work with edu. data!
                                               17
picture by Tom Raftery   http://www.flickr.com/photos/traftery/4773457853/sizes/l
Many thanks for your attention, and now...




              You are looking for the right tools to manipulated your data!


      You face ethical and privacy issues when you want to work with edu. data!
                                               17
picture by Tom Raftery   http://www.flickr.com/photos/traftery/4773457853/sizes/l
Many thanks for your attention, and now...




                         You are looking for educational datasets!

              You are looking for the right tools to manipulated your data!


      You face ethical and privacy issues when you want to work with edu. data!
                                               17
picture by Tom Raftery   http://www.flickr.com/photos/traftery/4773457853/sizes/l
Many thanks for your attention, and now...




                         You are looking for educational datasets!

              You are looking for the right tools to manipulated your data!


      You face ethical and privacy issues when you want to work with edu. data!
                                               17
picture by Tom Raftery   http://www.flickr.com/photos/traftery/4773457853/sizes/l

Launch of the EATEL SIG dataTEL at ECTEL 2011

  • 1.
    Data-driven Research andLearning Analytics Hendrik Drachsler (a), Katrien Verbert (b) (a) CELSTEC, Open University of the Netherlands (b) Dept. Computer Science, K.U.Leuven, Belgium 1
  • 2.
    Who is dataTEL? dataTEL is a Theme Team funded by the STELLAR network of excellence Riina Stephanie Katrien Nikos Martin Hendrik Vuorikari Lindstaedt Verbert Manouselis Wolpers Drachsler 2
  • 3.
    Who is dataTEL? dataTEL is a Theme Team funded by the STELLAR network of excellence Riina Stephanie Katrien Nikos Martin Hendrik Vuorikari Lindstaedt Verbert Manouselis Wolpers Drachsler MAVSEL CEN PT Social Data Miguel Joris Angel Sicillia Klerkx2
  • 4.
    Survey on TELRecommender 3
  • 5.
    Survey on TELRecommender 3
  • 6.
    The TEL recommender researchis a bit like this... 4
  • 7.
    But... “The performance results ofdifferent research efforts in TEL recommender systems are hardly comparable.” (Manouselis et al., 2010) Kaptain Kobold http://www.flickr.com/photos/ kaptainkobold/3203311346/ 5
  • 8.
    But... “TheTEL recommender The performanceresults of different research experiments lack efforts in TEL They need transparency. recommender systems to be repeatable to test: are hardly comparable.” • Validity (Manouselis et al., 2010) • Verification • Compare results Kaptain Kobold http://www.flickr.com/photos/ kaptainkobold/3203311346/ 5
  • 10.
  • 11.
  • 12.
  • 13.
    Grand Challenges 1. Topic: Evaluation of recommender systems in TEL 2. Topic: Data supported learning examples 3. Topic: Datasets from learning object repositories and web content 4. Topic: Privacy and data protection for educational datasets 9
  • 14.
  • 15.
    Who is dataTEL? Riina Stephanie Katrien Nikos Martin Hendrik Vuorikari Lindstaedt Verbert Manouselis Wolpers Drachsler MAVSEL CEN PT Social Data Miguel Joris Angel Sicillia Klerkx11
  • 16.
  • 17.
  • 18.
    Objectives of theSIG d • Fostering of a research network on educational datasets • Representing dataTEL researchers to promote the release of open datasets • Contributing to policies on ethical implications (privacy and legal protection rights) • Fostering a shared understanding of evaluation methods in Learning Analytics • Fostering the standardizations of datasets to enable exchange and interoperability 13
  • 19.
    How to achievethe goals • Setting up a website / maintain TELeurope group community • Set up a open data repository for sharing educational datasets and related researches outcomes • Organizing annual workshop and SI • Organizing a data competition like in TREC 14
  • 20.
  • 21.
    Call for JournalPapers (IJTEL) Datasets and Data Supported Learning Deadline: 25.10.2011 http://bit.ly/SI-datatel 15
  • 22.
    Learning Analytics Questionnaire http://bit.ly/ Learning_Analytics ‣234response ‣16 countries ‣Mostly Higher Education 16
  • 23.
    Many thanks foryour attention, and now... 17 picture by Tom Raftery http://www.flickr.com/photos/traftery/4773457853/sizes/l
  • 24.
    Many thanks foryour attention, and now... You face ethical and privacy issues when you want to work with edu. data! 17 picture by Tom Raftery http://www.flickr.com/photos/traftery/4773457853/sizes/l
  • 25.
    Many thanks foryour attention, and now... You are looking for the right tools to manipulated your data! You face ethical and privacy issues when you want to work with edu. data! 17 picture by Tom Raftery http://www.flickr.com/photos/traftery/4773457853/sizes/l
  • 26.
    Many thanks foryour attention, and now... You are looking for educational datasets! You are looking for the right tools to manipulated your data! You face ethical and privacy issues when you want to work with edu. data! 17 picture by Tom Raftery http://www.flickr.com/photos/traftery/4773457853/sizes/l
  • 27.
    Many thanks foryour attention, and now... You are looking for educational datasets! You are looking for the right tools to manipulated your data! You face ethical and privacy issues when you want to work with edu. data! 17 picture by Tom Raftery http://www.flickr.com/photos/traftery/4773457853/sizes/l