SlideShare a Scribd company logo
LEARNING ANALYTICS DASHBOARD TO
SUPPORT THE LIVE INTERACTION BETWEEN
STUDENT ADVISOR AND STUDENT
Tinne De Laet
KU Leuven, Belgium
OUTLINE
1. Who am I? Why I am here?
2. What is learning analytics?
3. Specific context & methodology
4. Results
5. Conclusion & reflections
WHO AM I? WHY I AM HERE?
WHO AM I? WHY I AM HERE?
woman
engineer
Head Tutorial Services
Engineering Science
KU Leuven, Belgium
.
Tinne De Laet
associate
professor
WHO AM I? WHY I AM HERE?
Head of Tutorial Services of Engineering
Science KU Leuven
• Daily experiences of challenges in transition from
secondary to higher education
• looking for opportunities for cross-fertilization
between “first-year experience” and “engineering”
•Strategic Partnership: 2015-1-UK01-KA203-013767
•Achieving Benefits from Learning Analytics
•Nottingham Trent University (UK), KU Leuven (Belgium),
Leiden University (Netherlands)
• http://www.ableproject.eu/
KU Leuven promotor of ABLE
Erasmus+ strategic partnership project
WHAT IS LEARNING ANALYTICS?
WHAT IS LEARNING ANALYTICS?
no universally agreed definition
7
“the measurement, collection, analysis and reporting of data about learners and their
contexts, for purposes of understanding and optimizing learning and the environments in
which it occurs” [1]
[1] Learning and Academic Analytics, Siemens, G., 5 August 2011, http://www.learninganalytics.net/?p=131
[2] What is Analytics? Definition and Essential Characteristics, Vol. 1, No. 5. CETIS Analytics Series, Cooper, A.,
http://publications.cetis.ac.uk/2012/521
“the process of developing actionable insights through problem definition and the
application of statistical models and analysis against existing and/or simulated future
data” [2]
WAT IS LEARNING ANALYTICS?
8
[3] Learning Analytics and Educational Data Mining, Erik Duval’s Weblog, 30 January 2012,
https://erikduval.wordpress.com/2012/01/30/learning-analytics-and-educational-data-mining/
“learning analytics is about collecting
traces that learners leave behind and
using those traces to improve learning”
[Erik Duval, 3]
† 12 March 2016
no universally agreed definition
IS IT ABOUT INSTITUTIONAL DATA?
•high-level figures:
provide an overview for internal and external reports;
used for organisational planning purposes.
•academic analytics:
figures on retention and success, used by the institution to assess performance.
•educational data mining:
searching for patterns in the data.
•learning analytics:
use of data, which may include ‘big data’,
to provide actionable intelligence for learners and teachers.
[4] Learning analytics FAQs, Rebecca Ferguson, Slideshare,
http://www.slideshare.net/R3beccaF/learning-analytics-fa-qs
SPECIFIC CONTEXT & METHODOLOGY
SPECIFIC CONTEXT
• open admission in the Flemish (Belgium) higher education system
→ a substantial part of first-year students enters without the right qualifications
→ bachelor drop-out rate of around 40% in the Faculties of Science & Technology at KU
Leuven.
• university invests in advising students before and throughout the first-year
• study career guidance by study advisors assigned to particular program
• study advisors are professionals, trained in coaching students
• BUT study advisors too often “drive blind”
hard to gather data that could support the advising session
interaction
self-reflection
1
2
3
scores
scores
learning skills
study advisor STUDENT
1 Erasmus+ project ABLE 2 Erasmus+ project STELA3
METHODOLOGY
1. Development
• need analysis with five study advisors and brainstorm sessions
• user-centred, rapid-prototyping design approach
• six iterations: four digital mock-ups and two functional dashboards
• two visualisation experts & head of the Tutorial Services of Engineering Science
2. Result = LISSA
→ Learning dashboard for Insights and Support during Study Advice
3. Evaluation with students & study advisors
RESULTS
THE EVALUATION
Presentations to 17 study advisors for preliminary
feedback
• data-supported evidence
• LISSA should not be used without a study advisor’s guidance.
• LISSA should remain secondary to the experience and expertise of
study advisor
• decrease in workload: no need to “look for data” and
manual preparations
• data transparancy
• open and honest approach
• some concern around student protesting againts difficulty of a course
“with the facts visualised it is easier to
convince the student”
“certain myths exist with students,
like how some people
manage to successfully complete
seven exams during re-sits”.
THE EVALUATION
97 sessions, interview of study advisors,
15 sessions observed
LISSA supporting a personal dialogue
• the level of usage depends on the experience of the
study advisors
• fact-based evidence at the side
• narrative thread
• key moments and student path help to reconstruct
personal track
“When I show them the number of students that
succeed seven or eight exams, they are
surprised, but now they believe me. Before, I
used my gut feeling, now I feel
more certain of what I say as well”.
“It’s like a main thread guiding the conversation”
“I can talk about what to do with the results,
instead of each time looking for the data, and
puzzling it together”
“Students don’t know where to look during the
conversation, and avoid eye contact. The
dashboard provides them a point of focus”.
“I have changed my study method in June and
now see it paid off.”
THE EVALUATION
the student evaluation
CONCLUSION AND REFLECTIONS
DISCUSSION AND LESSONS LEARNT
• Learning Analytics data
• only data that is available at any higher education institute is used
• now easily available to study advisors
• Visualisation
• minimal design without animations as LISSA is a mere supportive tool, allowing focus on the contextualisation and not on the
dashboard features itself
• visual encoding of information provide fast and easy overview (e.g. color coding of failed courses)
• Study advisor
• The role of the study advisor is key: critical and reflective interpretation, coaching
• LISSA leaves room for personal opinion and tacit experience
• Transparancy
• LISSA uses data transparently
• not always desired to use with student with really bad results (demotivation), but can also motivate students
• comparison to peers is not considered desired by all study advisors
• senstive nature of histograms of courses
CONCLUSION AND REFLECTIONS
• study advisors and student “like” LISSA
• LISSA is a mere supportive tool
• expertise of study advisors is key
Future
• repeat interventions and extend (KU Leuven and Leiden University)
• extend dashboard with other student data
looking how student background data can be integrated in an ethical manner
• qualitative analysis using focus groups and structured interviews with students
MORE READING?
http://ieeexplore.ieee.org/document/7959628/

More Related Content

What's hot

Head Start - Library-led innovation and collaboration enhancing the student e...
Head Start - Library-led innovation and collaboration enhancing the student e...Head Start - Library-led innovation and collaboration enhancing the student e...
Head Start - Library-led innovation and collaboration enhancing the student e...
northerncollaboration
 
Learning analytics, learning design and MOOCs
Learning analytics, learning design and MOOCsLearning analytics, learning design and MOOCs
Learning analytics, learning design and MOOCs
Rebecca Ferguson
 
Scaling up learning analytics
Scaling up learning analyticsScaling up learning analytics
Scaling up learning analytics
Rebecca Ferguson
 
Scholarship of Teaching and Learning - Design and Analysis
Scholarship of Teaching and Learning - Design and AnalysisScholarship of Teaching and Learning - Design and Analysis
Scholarship of Teaching and Learning - Design and Analysis
Staci Trekles
 
ABLE - Inside Government E Foster 26th November 2015
ABLE - Inside Government E Foster 26th November 2015ABLE - Inside Government E Foster 26th November 2015
ABLE - Inside Government E Foster 26th November 2015
Ed Foster
 
Personalised and Adaptive Mentoring in Medical Education - The myPAL project
Personalised and Adaptive Mentoring in Medical Education - The myPAL projectPersonalised and Adaptive Mentoring in Medical Education - The myPAL project
Personalised and Adaptive Mentoring in Medical Education - The myPAL project
Nicolas Van Labeke
 
LASI workshop social learning analytics
LASI workshop social learning analyticsLASI workshop social learning analytics
LASI workshop social learning analytics
Rebecca Ferguson
 
Is there a statistically significant relationship between library resource ac...
Is there a statistically significant relationship between library resource ac...Is there a statistically significant relationship between library resource ac...
Is there a statistically significant relationship between library resource ac...
northerncollaboration
 
Teacher and Researcher Performance Quality Assessment in Higher Education
Teacher and Researcher Performance Quality Assessment in Higher EducationTeacher and Researcher Performance Quality Assessment in Higher Education
Teacher and Researcher Performance Quality Assessment in Higher Education
Dr. Ollé János
 
Learning analytics FAQs
Learning analytics FAQsLearning analytics FAQs
Learning analytics FAQs
Rebecca Ferguson
 
Using learning analytics to improve student transition into and support throu...
Using learning analytics to improve student transition into and support throu...Using learning analytics to improve student transition into and support throu...
Using learning analytics to improve student transition into and support throu...
Tinne De Laet
 
How to Personalize ASCA Competencies
How to Personalize ASCA CompetenciesHow to Personalize ASCA Competencies
How to Personalize ASCA Competencies
Hobsons
 
ABLE - LAK 2018
ABLE - LAK 2018ABLE - LAK 2018
ABLE - LAK 2018
Ed Foster
 
Research output in Irish H.E. academic libraries 2000-2015
Research output in Irish H.E. academic libraries 2000-2015 Research output in Irish H.E. academic libraries 2000-2015
Research output in Irish H.E. academic libraries 2000-2015
Terry O'Brien
 
LACE Masterclass Learning Analytics M&L Brussels 2014
LACE Masterclass Learning Analytics M&L Brussels 2014LACE Masterclass Learning Analytics M&L Brussels 2014
LACE Masterclass Learning Analytics M&L Brussels 2014
Kennisnet
 
The experimental classroom at Uppsala University - Mats Cullhed #edlw2018
The experimental classroom at Uppsala University - Mats Cullhed #edlw2018The experimental classroom at Uppsala University - Mats Cullhed #edlw2018
The experimental classroom at Uppsala University - Mats Cullhed #edlw2018
EDEN Digital Learning Europe
 
Using learning analytics to support formative assessment oln 20171111
Using learning analytics to support formative assessment oln 20171111Using learning analytics to support formative assessment oln 20171111
Using learning analytics to support formative assessment oln 20171111
Yi-Shan Tsai
 
SSE Taking Stock 2018
SSE Taking Stock 2018SSE Taking Stock 2018
SSE Taking Stock 2018
polmagl
 
2016-2017 Mentorship Program details
2016-2017 Mentorship Program details2016-2017 Mentorship Program details
2016-2017 Mentorship Program details
Staci Trekles
 

What's hot (20)

Head Start - Library-led innovation and collaboration enhancing the student e...
Head Start - Library-led innovation and collaboration enhancing the student e...Head Start - Library-led innovation and collaboration enhancing the student e...
Head Start - Library-led innovation and collaboration enhancing the student e...
 
Learning analytics, learning design and MOOCs
Learning analytics, learning design and MOOCsLearning analytics, learning design and MOOCs
Learning analytics, learning design and MOOCs
 
Scaling up learning analytics
Scaling up learning analyticsScaling up learning analytics
Scaling up learning analytics
 
Scholarship of Teaching and Learning - Design and Analysis
Scholarship of Teaching and Learning - Design and AnalysisScholarship of Teaching and Learning - Design and Analysis
Scholarship of Teaching and Learning - Design and Analysis
 
ABLE - Inside Government E Foster 26th November 2015
ABLE - Inside Government E Foster 26th November 2015ABLE - Inside Government E Foster 26th November 2015
ABLE - Inside Government E Foster 26th November 2015
 
Personalised and Adaptive Mentoring in Medical Education - The myPAL project
Personalised and Adaptive Mentoring in Medical Education - The myPAL projectPersonalised and Adaptive Mentoring in Medical Education - The myPAL project
Personalised and Adaptive Mentoring in Medical Education - The myPAL project
 
LASI workshop social learning analytics
LASI workshop social learning analyticsLASI workshop social learning analytics
LASI workshop social learning analytics
 
Is there a statistically significant relationship between library resource ac...
Is there a statistically significant relationship between library resource ac...Is there a statistically significant relationship between library resource ac...
Is there a statistically significant relationship between library resource ac...
 
Teacher and Researcher Performance Quality Assessment in Higher Education
Teacher and Researcher Performance Quality Assessment in Higher EducationTeacher and Researcher Performance Quality Assessment in Higher Education
Teacher and Researcher Performance Quality Assessment in Higher Education
 
Learning analytics FAQs
Learning analytics FAQsLearning analytics FAQs
Learning analytics FAQs
 
Using learning analytics to improve student transition into and support throu...
Using learning analytics to improve student transition into and support throu...Using learning analytics to improve student transition into and support throu...
Using learning analytics to improve student transition into and support throu...
 
How to Personalize ASCA Competencies
How to Personalize ASCA CompetenciesHow to Personalize ASCA Competencies
How to Personalize ASCA Competencies
 
ABLE - LAK 2018
ABLE - LAK 2018ABLE - LAK 2018
ABLE - LAK 2018
 
Research output in Irish H.E. academic libraries 2000-2015
Research output in Irish H.E. academic libraries 2000-2015 Research output in Irish H.E. academic libraries 2000-2015
Research output in Irish H.E. academic libraries 2000-2015
 
LACE Masterclass Learning Analytics M&L Brussels 2014
LACE Masterclass Learning Analytics M&L Brussels 2014LACE Masterclass Learning Analytics M&L Brussels 2014
LACE Masterclass Learning Analytics M&L Brussels 2014
 
The experimental classroom at Uppsala University - Mats Cullhed #edlw2018
The experimental classroom at Uppsala University - Mats Cullhed #edlw2018The experimental classroom at Uppsala University - Mats Cullhed #edlw2018
The experimental classroom at Uppsala University - Mats Cullhed #edlw2018
 
Using learning analytics to support formative assessment oln 20171111
Using learning analytics to support formative assessment oln 20171111Using learning analytics to support formative assessment oln 20171111
Using learning analytics to support formative assessment oln 20171111
 
SSE Taking Stock 2018
SSE Taking Stock 2018SSE Taking Stock 2018
SSE Taking Stock 2018
 
2016-2017 Mentorship Program details
2016-2017 Mentorship Program details2016-2017 Mentorship Program details
2016-2017 Mentorship Program details
 
SWilliamsCV
SWilliamsCVSWilliamsCV
SWilliamsCV
 

Similar to ABLE project presentation EFYE 2017

ABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of Derby
Ed Foster
 
Framing Blended learning, teaching, and education
Framing Blended learning, teaching, and educationFraming Blended learning, teaching, and education
Framing Blended learning, teaching, and education
EADTU
 
Learning Analytics presentation for Australian e-learning Congress Feb 14
Learning Analytics presentation for Australian e-learning Congress Feb 14Learning Analytics presentation for Australian e-learning Congress Feb 14
Learning Analytics presentation for Australian e-learning Congress Feb 14
siwelsh
 
Analysing analytics, what is learning analytics?
Analysing analytics, what is learning analytics?Analysing analytics, what is learning analytics?
Analysing analytics, what is learning analytics?
Moodlerooms
 
MRR - Teaching, Learning and Research in Engineering Education
MRR -  Teaching, Learning and Research in Engineering EducationMRR -  Teaching, Learning and Research in Engineering Education
MRR - Teaching, Learning and Research in Engineering Education
Raja Reddy Mitta
 
ABLE - UKAT - Using Learning Analytics to Boost Personal Tutoring
ABLE - UKAT - Using Learning Analytics to Boost Personal TutoringABLE - UKAT - Using Learning Analytics to Boost Personal Tutoring
ABLE - UKAT - Using Learning Analytics to Boost Personal Tutoring
Ed Foster
 
Assessment Analytics - EUNIS 2015 E-Learning Task Force Workshop
Assessment Analytics - EUNIS 2015 E-Learning Task Force WorkshopAssessment Analytics - EUNIS 2015 E-Learning Task Force Workshop
Assessment Analytics - EUNIS 2015 E-Learning Task Force Workshop
LACE Project
 
Studying learning journeys with lecture capture through Staff-Student partner...
Studying learning journeys with lecture capture through Staff-Student partner...Studying learning journeys with lecture capture through Staff-Student partner...
Studying learning journeys with lecture capture through Staff-Student partner...
Karl Luke
 
Scalable, Actionable, and Ethical Learning Dashboards: a reality check
Scalable, Actionable, and Ethical Learning Dashboards: a reality checkScalable, Actionable, and Ethical Learning Dashboards: a reality check
Scalable, Actionable, and Ethical Learning Dashboards: a reality check
Tinne De Laet
 
Learning Analytics
Learning AnalyticsLearning Analytics
Learning Analytics
Gavin Henrick
 
Using learning analytics to improve student transition into and support throu...
Using learning analytics to improve student transition into and support throu...Using learning analytics to improve student transition into and support throu...
Using learning analytics to improve student transition into and support throu...
Tinne De Laet
 
Effective Creation, Mediation and Use of Knowledge in and about Education.
Effective Creation, Mediation and Use of Knowledge in and about Education.Effective Creation, Mediation and Use of Knowledge in and about Education.
Effective Creation, Mediation and Use of Knowledge in and about Education.
EduSkills OECD
 
I-HE2020 The European Maturity Model for Blended Education
I-HE2020 The European Maturity Model for Blended EducationI-HE2020 The European Maturity Model for Blended Education
I-HE2020 The European Maturity Model for Blended Education
EADTU
 
Learning Analytics for online and on-campus education: experience and research
Learning Analytics for online and on-campus education: experience and researchLearning Analytics for online and on-campus education: experience and research
Learning Analytics for online and on-campus education: experience and research
Tinne De Laet
 
Learning dashboards for actionable feedback: the (non)sense of chances of suc...
Learning dashboards for actionable feedback: the (non)sense of chances of suc...Learning dashboards for actionable feedback: the (non)sense of chances of suc...
Learning dashboards for actionable feedback: the (non)sense of chances of suc...
Tinne De Laet
 
ABLE - NTU Eunis case study - Nov 2017
ABLE - NTU Eunis case study - Nov 2017ABLE - NTU Eunis case study - Nov 2017
ABLE - NTU Eunis case study - Nov 2017
Ed Foster
 
Data-based feedback through learning dashboards: does it support the first-ye...
Data-based feedback through learning dashboards: does it support the first-ye...Data-based feedback through learning dashboards: does it support the first-ye...
Data-based feedback through learning dashboards: does it support the first-ye...
Tinne De Laet
 
Learning analytics: the state of the art and the future
Learning analytics: the state of the art and the futureLearning analytics: the state of the art and the future
Learning analytics: the state of the art and the future
Rebecca Ferguson
 
Learning analytics: developing an action plan ... developing a vision
Learning analytics: developing an action plan ... developing a visionLearning analytics: developing an action plan ... developing a vision
Learning analytics: developing an action plan ... developing a vision
Rebecca Ferguson
 
EDDE_205_Tuscano_Report Module 6
EDDE_205_Tuscano_Report Module 6EDDE_205_Tuscano_Report Module 6
EDDE_205_Tuscano_Report Module 6
Xavier School
 

Similar to ABLE project presentation EFYE 2017 (20)

ABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of Derby
 
Framing Blended learning, teaching, and education
Framing Blended learning, teaching, and educationFraming Blended learning, teaching, and education
Framing Blended learning, teaching, and education
 
Learning Analytics presentation for Australian e-learning Congress Feb 14
Learning Analytics presentation for Australian e-learning Congress Feb 14Learning Analytics presentation for Australian e-learning Congress Feb 14
Learning Analytics presentation for Australian e-learning Congress Feb 14
 
Analysing analytics, what is learning analytics?
Analysing analytics, what is learning analytics?Analysing analytics, what is learning analytics?
Analysing analytics, what is learning analytics?
 
MRR - Teaching, Learning and Research in Engineering Education
MRR -  Teaching, Learning and Research in Engineering EducationMRR -  Teaching, Learning and Research in Engineering Education
MRR - Teaching, Learning and Research in Engineering Education
 
ABLE - UKAT - Using Learning Analytics to Boost Personal Tutoring
ABLE - UKAT - Using Learning Analytics to Boost Personal TutoringABLE - UKAT - Using Learning Analytics to Boost Personal Tutoring
ABLE - UKAT - Using Learning Analytics to Boost Personal Tutoring
 
Assessment Analytics - EUNIS 2015 E-Learning Task Force Workshop
Assessment Analytics - EUNIS 2015 E-Learning Task Force WorkshopAssessment Analytics - EUNIS 2015 E-Learning Task Force Workshop
Assessment Analytics - EUNIS 2015 E-Learning Task Force Workshop
 
Studying learning journeys with lecture capture through Staff-Student partner...
Studying learning journeys with lecture capture through Staff-Student partner...Studying learning journeys with lecture capture through Staff-Student partner...
Studying learning journeys with lecture capture through Staff-Student partner...
 
Scalable, Actionable, and Ethical Learning Dashboards: a reality check
Scalable, Actionable, and Ethical Learning Dashboards: a reality checkScalable, Actionable, and Ethical Learning Dashboards: a reality check
Scalable, Actionable, and Ethical Learning Dashboards: a reality check
 
Learning Analytics
Learning AnalyticsLearning Analytics
Learning Analytics
 
Using learning analytics to improve student transition into and support throu...
Using learning analytics to improve student transition into and support throu...Using learning analytics to improve student transition into and support throu...
Using learning analytics to improve student transition into and support throu...
 
Effective Creation, Mediation and Use of Knowledge in and about Education.
Effective Creation, Mediation and Use of Knowledge in and about Education.Effective Creation, Mediation and Use of Knowledge in and about Education.
Effective Creation, Mediation and Use of Knowledge in and about Education.
 
I-HE2020 The European Maturity Model for Blended Education
I-HE2020 The European Maturity Model for Blended EducationI-HE2020 The European Maturity Model for Blended Education
I-HE2020 The European Maturity Model for Blended Education
 
Learning Analytics for online and on-campus education: experience and research
Learning Analytics for online and on-campus education: experience and researchLearning Analytics for online and on-campus education: experience and research
Learning Analytics for online and on-campus education: experience and research
 
Learning dashboards for actionable feedback: the (non)sense of chances of suc...
Learning dashboards for actionable feedback: the (non)sense of chances of suc...Learning dashboards for actionable feedback: the (non)sense of chances of suc...
Learning dashboards for actionable feedback: the (non)sense of chances of suc...
 
ABLE - NTU Eunis case study - Nov 2017
ABLE - NTU Eunis case study - Nov 2017ABLE - NTU Eunis case study - Nov 2017
ABLE - NTU Eunis case study - Nov 2017
 
Data-based feedback through learning dashboards: does it support the first-ye...
Data-based feedback through learning dashboards: does it support the first-ye...Data-based feedback through learning dashboards: does it support the first-ye...
Data-based feedback through learning dashboards: does it support the first-ye...
 
Learning analytics: the state of the art and the future
Learning analytics: the state of the art and the futureLearning analytics: the state of the art and the future
Learning analytics: the state of the art and the future
 
Learning analytics: developing an action plan ... developing a vision
Learning analytics: developing an action plan ... developing a visionLearning analytics: developing an action plan ... developing a vision
Learning analytics: developing an action plan ... developing a vision
 
EDDE_205_Tuscano_Report Module 6
EDDE_205_Tuscano_Report Module 6EDDE_205_Tuscano_Report Module 6
EDDE_205_Tuscano_Report Module 6
 

More from Tinne De Laet

2021 nyu-learn - ai for academic advising, a matter of trust
2021 nyu-learn - ai for academic advising, a matter of trust2021 nyu-learn - ai for academic advising, a matter of trust
2021 nyu-learn - ai for academic advising, a matter of trust
Tinne De Laet
 
Learning Dashboards for Feedback at Scale
Learning Dashboards for Feedback at ScaleLearning Dashboards for Feedback at Scale
Learning Dashboards for Feedback at Scale
Tinne De Laet
 
Co-designing learning dashboards for scalable feedback
Co-designing learning dashboards for scalable feedbackCo-designing learning dashboards for scalable feedback
Co-designing learning dashboards for scalable feedback
Tinne De Laet
 
Learning dashboard for supporting students: from first-year engineering to MO...
Learning dashboard for supporting students: from first-year engineering to MO...Learning dashboard for supporting students: from first-year engineering to MO...
Learning dashboard for supporting students: from first-year engineering to MO...
Tinne De Laet
 
Can learning analytics improve engineering education in both MOOC and traditi...
Can learning analytics improve engineering education in both MOOC and traditi...Can learning analytics improve engineering education in both MOOC and traditi...
Can learning analytics improve engineering education in both MOOC and traditi...
Tinne De Laet
 
Successful transition from secondary to higher education using learning analy...
Successful transition from secondary to higher education using learning analy...Successful transition from secondary to higher education using learning analy...
Successful transition from secondary to higher education using learning analy...
Tinne De Laet
 
Improving education by learning analtyics
Improving education by learning analtyicsImproving education by learning analtyics
Improving education by learning analtyics
Tinne De Laet
 
Learning dashboards for actionable feedback: the (non)sense of chances of suc...
Learning dashboards for actionable feedback: the (non)sense of chances of suc...Learning dashboards for actionable feedback: the (non)sense of chances of suc...
Learning dashboards for actionable feedback: the (non)sense of chances of suc...
Tinne De Laet
 
Learning analytics tussen droom en daad: eerlijke ervaringen uit concrete imp...
Learning analytics tussen droom en daad: eerlijke ervaringen uit concrete imp...Learning analytics tussen droom en daad: eerlijke ervaringen uit concrete imp...
Learning analytics tussen droom en daad: eerlijke ervaringen uit concrete imp...
Tinne De Laet
 
Learning dashboards voor feedback op leer- en studeervaardigheden en academis...
Learning dashboards voor feedback op leer- en studeervaardigheden en academis...Learning dashboards voor feedback op leer- en studeervaardigheden en academis...
Learning dashboards voor feedback op leer- en studeervaardigheden en academis...
Tinne De Laet
 
Confidence in and beliefs about first year engineering student success
Confidence in and beliefs about first year engineering student successConfidence in and beliefs about first year engineering student success
Confidence in and beliefs about first year engineering student success
Tinne De Laet
 

More from Tinne De Laet (11)

2021 nyu-learn - ai for academic advising, a matter of trust
2021 nyu-learn - ai for academic advising, a matter of trust2021 nyu-learn - ai for academic advising, a matter of trust
2021 nyu-learn - ai for academic advising, a matter of trust
 
Learning Dashboards for Feedback at Scale
Learning Dashboards for Feedback at ScaleLearning Dashboards for Feedback at Scale
Learning Dashboards for Feedback at Scale
 
Co-designing learning dashboards for scalable feedback
Co-designing learning dashboards for scalable feedbackCo-designing learning dashboards for scalable feedback
Co-designing learning dashboards for scalable feedback
 
Learning dashboard for supporting students: from first-year engineering to MO...
Learning dashboard for supporting students: from first-year engineering to MO...Learning dashboard for supporting students: from first-year engineering to MO...
Learning dashboard for supporting students: from first-year engineering to MO...
 
Can learning analytics improve engineering education in both MOOC and traditi...
Can learning analytics improve engineering education in both MOOC and traditi...Can learning analytics improve engineering education in both MOOC and traditi...
Can learning analytics improve engineering education in both MOOC and traditi...
 
Successful transition from secondary to higher education using learning analy...
Successful transition from secondary to higher education using learning analy...Successful transition from secondary to higher education using learning analy...
Successful transition from secondary to higher education using learning analy...
 
Improving education by learning analtyics
Improving education by learning analtyicsImproving education by learning analtyics
Improving education by learning analtyics
 
Learning dashboards for actionable feedback: the (non)sense of chances of suc...
Learning dashboards for actionable feedback: the (non)sense of chances of suc...Learning dashboards for actionable feedback: the (non)sense of chances of suc...
Learning dashboards for actionable feedback: the (non)sense of chances of suc...
 
Learning analytics tussen droom en daad: eerlijke ervaringen uit concrete imp...
Learning analytics tussen droom en daad: eerlijke ervaringen uit concrete imp...Learning analytics tussen droom en daad: eerlijke ervaringen uit concrete imp...
Learning analytics tussen droom en daad: eerlijke ervaringen uit concrete imp...
 
Learning dashboards voor feedback op leer- en studeervaardigheden en academis...
Learning dashboards voor feedback op leer- en studeervaardigheden en academis...Learning dashboards voor feedback op leer- en studeervaardigheden en academis...
Learning dashboards voor feedback op leer- en studeervaardigheden en academis...
 
Confidence in and beliefs about first year engineering student success
Confidence in and beliefs about first year engineering student successConfidence in and beliefs about first year engineering student success
Confidence in and beliefs about first year engineering student success
 

Recently uploaded

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
Fwdays
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
Abida Shariff
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 

Recently uploaded (20)

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 

ABLE project presentation EFYE 2017

  • 1. LEARNING ANALYTICS DASHBOARD TO SUPPORT THE LIVE INTERACTION BETWEEN STUDENT ADVISOR AND STUDENT Tinne De Laet KU Leuven, Belgium
  • 2. OUTLINE 1. Who am I? Why I am here? 2. What is learning analytics? 3. Specific context & methodology 4. Results 5. Conclusion & reflections
  • 3. WHO AM I? WHY I AM HERE?
  • 4. WHO AM I? WHY I AM HERE? woman engineer Head Tutorial Services Engineering Science KU Leuven, Belgium . Tinne De Laet associate professor
  • 5. WHO AM I? WHY I AM HERE? Head of Tutorial Services of Engineering Science KU Leuven • Daily experiences of challenges in transition from secondary to higher education • looking for opportunities for cross-fertilization between “first-year experience” and “engineering” •Strategic Partnership: 2015-1-UK01-KA203-013767 •Achieving Benefits from Learning Analytics •Nottingham Trent University (UK), KU Leuven (Belgium), Leiden University (Netherlands) • http://www.ableproject.eu/ KU Leuven promotor of ABLE Erasmus+ strategic partnership project
  • 6. WHAT IS LEARNING ANALYTICS?
  • 7. WHAT IS LEARNING ANALYTICS? no universally agreed definition 7 “the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs” [1] [1] Learning and Academic Analytics, Siemens, G., 5 August 2011, http://www.learninganalytics.net/?p=131 [2] What is Analytics? Definition and Essential Characteristics, Vol. 1, No. 5. CETIS Analytics Series, Cooper, A., http://publications.cetis.ac.uk/2012/521 “the process of developing actionable insights through problem definition and the application of statistical models and analysis against existing and/or simulated future data” [2]
  • 8. WAT IS LEARNING ANALYTICS? 8 [3] Learning Analytics and Educational Data Mining, Erik Duval’s Weblog, 30 January 2012, https://erikduval.wordpress.com/2012/01/30/learning-analytics-and-educational-data-mining/ “learning analytics is about collecting traces that learners leave behind and using those traces to improve learning” [Erik Duval, 3] † 12 March 2016 no universally agreed definition
  • 9. IS IT ABOUT INSTITUTIONAL DATA? •high-level figures: provide an overview for internal and external reports; used for organisational planning purposes. •academic analytics: figures on retention and success, used by the institution to assess performance. •educational data mining: searching for patterns in the data. •learning analytics: use of data, which may include ‘big data’, to provide actionable intelligence for learners and teachers. [4] Learning analytics FAQs, Rebecca Ferguson, Slideshare, http://www.slideshare.net/R3beccaF/learning-analytics-fa-qs
  • 10. SPECIFIC CONTEXT & METHODOLOGY
  • 11. SPECIFIC CONTEXT • open admission in the Flemish (Belgium) higher education system → a substantial part of first-year students enters without the right qualifications → bachelor drop-out rate of around 40% in the Faculties of Science & Technology at KU Leuven. • university invests in advising students before and throughout the first-year • study career guidance by study advisors assigned to particular program • study advisors are professionals, trained in coaching students • BUT study advisors too often “drive blind” hard to gather data that could support the advising session
  • 12. interaction self-reflection 1 2 3 scores scores learning skills study advisor STUDENT 1 Erasmus+ project ABLE 2 Erasmus+ project STELA3
  • 13. METHODOLOGY 1. Development • need analysis with five study advisors and brainstorm sessions • user-centred, rapid-prototyping design approach • six iterations: four digital mock-ups and two functional dashboards • two visualisation experts & head of the Tutorial Services of Engineering Science 2. Result = LISSA → Learning dashboard for Insights and Support during Study Advice 3. Evaluation with students & study advisors
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 22. THE EVALUATION Presentations to 17 study advisors for preliminary feedback • data-supported evidence • LISSA should not be used without a study advisor’s guidance. • LISSA should remain secondary to the experience and expertise of study advisor • decrease in workload: no need to “look for data” and manual preparations • data transparancy • open and honest approach • some concern around student protesting againts difficulty of a course “with the facts visualised it is easier to convince the student” “certain myths exist with students, like how some people manage to successfully complete seven exams during re-sits”.
  • 23. THE EVALUATION 97 sessions, interview of study advisors, 15 sessions observed LISSA supporting a personal dialogue • the level of usage depends on the experience of the study advisors • fact-based evidence at the side • narrative thread • key moments and student path help to reconstruct personal track “When I show them the number of students that succeed seven or eight exams, they are surprised, but now they believe me. Before, I used my gut feeling, now I feel more certain of what I say as well”. “It’s like a main thread guiding the conversation” “I can talk about what to do with the results, instead of each time looking for the data, and puzzling it together” “Students don’t know where to look during the conversation, and avoid eye contact. The dashboard provides them a point of focus”. “I have changed my study method in June and now see it paid off.”
  • 26. DISCUSSION AND LESSONS LEARNT • Learning Analytics data • only data that is available at any higher education institute is used • now easily available to study advisors • Visualisation • minimal design without animations as LISSA is a mere supportive tool, allowing focus on the contextualisation and not on the dashboard features itself • visual encoding of information provide fast and easy overview (e.g. color coding of failed courses) • Study advisor • The role of the study advisor is key: critical and reflective interpretation, coaching • LISSA leaves room for personal opinion and tacit experience • Transparancy • LISSA uses data transparently • not always desired to use with student with really bad results (demotivation), but can also motivate students • comparison to peers is not considered desired by all study advisors • senstive nature of histograms of courses
  • 27. CONCLUSION AND REFLECTIONS • study advisors and student “like” LISSA • LISSA is a mere supportive tool • expertise of study advisors is key Future • repeat interventions and extend (KU Leuven and Leiden University) • extend dashboard with other student data looking how student background data can be integrated in an ethical manner • qualitative analysis using focus groups and structured interviews with students