SlideShare a Scribd company logo
1 of 44
Download to read offline
#technology_can_do_that
The “testing effect” revisited
(by technology)
(e-)assessment
assessment - exam – evaluation - certification
for
(e-)learning (e-)assessment
Kennis
Tijd
Ebbinghaus’ forgetting curve
Time
Knowledge/
retention
Hermann Ebbinghaus (January 24, 1850 – February 26, 1909) was a German psychologist who pioneered the experimental study of memory, and
is known for his discovery of the forgetting curve and the spacing effect. He was also the first person to describe the learning curve. (Wikipedia)
of new knowledge
is lost after 30 days
81%
Ebbinghaus’ forgetting curve
Assessments, evaluations, exercises…
formative
evaluation
summative
evaluation
Micro-e-learning
Connaissances
TempsTime
Retention
#technology_can_do_that
distributed practice effect
(or spaced effect)
Assessments, evaluations, exercises…
formative
evaluation
summative
evaluation
(e-)assessment
assessment - exam - evaluation - certification - …
for
(e-)learning (e-)assessment
Dr. Kim Dirkx
"Testing effect"
The first documented empirical studies on the testing effect were published in 1909 by Edwina E. Abbott.
Research confirms
that evaluating and examining have several
advantages, the most important advantage, so called:
"Testing effect"
= testing or evaluation itself has a major
and very positive influence on learning or
memorizing information.
Testing effect
Roediger e.a. (2011)
Carrier and Pashler (1992):
testing does not just provide an additional practice opportunity,
but produces better results than other forms of studying
#exams_are_good_for_you
promote testing/evaluating
as a positive thing!
Further research confirms
Dirkx e.a. (2014):
especially in the longer term,
information was much better remembered if,
in addition to or after a learning effort,
there was also a test about what was learned:
an immediate test after offering new information.
#technology_can_do_that
technology-supported environments can excellently offer
alternating learning and testing paths!
What if…
IMHO
osmosis.org has the best videos on this topic
The power of feedback
• Important to integrate immediate feedback in the testing
• Correct/wrong (+score)
• Qualitative feedback (explaining, showing,…)
Showing feedback “in” a test or exam:
#technology_can_do_that
• In linear navigation mode:
automatic feedback option
• In free navigation mode:
show feedback on “submit”
#technology_can_do_that
• Less common but perfectly possible:
show immediate feedback to the examinee
• impossible in written exams!
Technology can do that.
Revision of translations today…
Revision today…
Impossible to get
overviews and
statistics and
evolutions…
Impossible to
be consistent
and objective
Big Wrong Data…
“Afval bestaat niet”
(There’s no such thing as waste)
Let’s have a look at some revision memories
• Revision memory insights
• The magic of Excel pivot tables…
• Numbers of errors
• How many different
errors?
• Frequency of errors
• Which categories of errors?
• Score distribution
• Per category
• Per revisor
• …
#we_are_your_friend_☺
#exams_are_good_for_you
#technology_can_do_that
More good practices:
#Evaluation in Distance Education @ VIVES:
Some Tools and Trends
Hendrik Coucke, Koen Verhulst, Sylke Vandercruysse, VIVES
University of Applied Sciences, Belgium
PEP
Patient Education Point
We Underestimate the “Testing Effect” (and How Technology can Help) - Bert Wylin #eden19
We Underestimate the “Testing Effect” (and How Technology can Help) - Bert Wylin #eden19

More Related Content

Similar to We Underestimate the “Testing Effect” (and How Technology can Help) - Bert Wylin #eden19

Session 2 into to qualitative research intro
Session 2   into to qualitative research introSession 2   into to qualitative research intro
Session 2 into to qualitative research intro
Angela Ferrara
 
Bridging the gap between closed and open items or how to make CALL more intel...
Bridging the gap between closed and open items or how to make CALL more intel...Bridging the gap between closed and open items or how to make CALL more intel...
Bridging the gap between closed and open items or how to make CALL more intel...
bwylin
 
Make good use of explortary testing
Make good use of explortary testingMake good use of explortary testing
Make good use of explortary testing
gaoliang641
 
Vladimirs Ivanovs Motivacijas sistēmas un motivēšana projektos
Vladimirs Ivanovs Motivacijas sistēmas un motivēšana projektosVladimirs Ivanovs Motivacijas sistēmas un motivēšana projektos
Vladimirs Ivanovs Motivacijas sistēmas un motivēšana projektos
Vladimirs Ivanovs
 
Introduction to machine learning-2023-IT-AI and DS.pdf
Introduction to machine learning-2023-IT-AI and DS.pdfIntroduction to machine learning-2023-IT-AI and DS.pdf
Introduction to machine learning-2023-IT-AI and DS.pdf
SisayNegash4
 

Similar to We Underestimate the “Testing Effect” (and How Technology can Help) - Bert Wylin #eden19 (20)

Lecture-2.pdf
Lecture-2.pdfLecture-2.pdf
Lecture-2.pdf
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
 
Session 2 into to qualitative research intro
Session 2   into to qualitative research introSession 2   into to qualitative research intro
Session 2 into to qualitative research intro
 
Validation and mechanism: exploring the limits of evaluation
Validation and mechanism: exploring the limits of evaluationValidation and mechanism: exploring the limits of evaluation
Validation and mechanism: exploring the limits of evaluation
 
Multimodal Learning Analytics
Multimodal Learning AnalyticsMultimodal Learning Analytics
Multimodal Learning Analytics
 
Coaching teams in Creative Problem Solving v.2
Coaching teams in Creative Problem Solving v.2Coaching teams in Creative Problem Solving v.2
Coaching teams in Creative Problem Solving v.2
 
Tech. Writing Usability Presentation
Tech. Writing Usability PresentationTech. Writing Usability Presentation
Tech. Writing Usability Presentation
 
Bring your own idea - Visual learning analytics
Bring your own idea - Visual learning analyticsBring your own idea - Visual learning analytics
Bring your own idea - Visual learning analytics
 
Agent-Based Modelling: Social Science Meets Computer Science?
Agent-Based Modelling: Social Science Meets Computer Science?Agent-Based Modelling: Social Science Meets Computer Science?
Agent-Based Modelling: Social Science Meets Computer Science?
 
Bridging the gap between closed and open items or how to make CALL more intel...
Bridging the gap between closed and open items or how to make CALL more intel...Bridging the gap between closed and open items or how to make CALL more intel...
Bridging the gap between closed and open items or how to make CALL more intel...
 
Multimodal Learning Analytics
Multimodal Learning AnalyticsMultimodal Learning Analytics
Multimodal Learning Analytics
 
Methodological Issues in Bio-inspired Computing or How to Get a PhD in?
Methodological Issues in Bio-inspired Computing or How to Get a PhD in?Methodological Issues in Bio-inspired Computing or How to Get a PhD in?
Methodological Issues in Bio-inspired Computing or How to Get a PhD in?
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
 
Make good use of explortary testing
Make good use of explortary testingMake good use of explortary testing
Make good use of explortary testing
 
ML
MLML
ML
 
Course 10 : Introduction to machine learning by Christoph Evers
Course 10 :  Introduction to machine learning by Christoph EversCourse 10 :  Introduction to machine learning by Christoph Evers
Course 10 : Introduction to machine learning by Christoph Evers
 
Troubleshooting
TroubleshootingTroubleshooting
Troubleshooting
 
Vladimirs Ivanovs Motivacijas sistēmas un motivēšana projektos
Vladimirs Ivanovs Motivacijas sistēmas un motivēšana projektosVladimirs Ivanovs Motivacijas sistēmas un motivēšana projektos
Vladimirs Ivanovs Motivacijas sistēmas un motivēšana projektos
 
Introduction to machine learning-2023-IT-AI and DS.pdf
Introduction to machine learning-2023-IT-AI and DS.pdfIntroduction to machine learning-2023-IT-AI and DS.pdf
Introduction to machine learning-2023-IT-AI and DS.pdf
 
The Past, Present and Future of ABM: How To Cope With A New Research Method
The Past, Present and Future of ABM: How To Cope With A New Research Method The Past, Present and Future of ABM: How To Cope With A New Research Method
The Past, Present and Future of ABM: How To Cope With A New Research Method
 

More from EDEN Digital Learning Europe

More from EDEN Digital Learning Europe (20)

Digital experiences in technical higher education
Digital experiences in technical higher educationDigital experiences in technical higher education
Digital experiences in technical higher education
 
Digital experiences in technical higher education
Digital experiences in technical higher educationDigital experiences in technical higher education
Digital experiences in technical higher education
 
Digital experiences in technical higher education
Digital experiences in technical higher educationDigital experiences in technical higher education
Digital experiences in technical higher education
 
Digital experiences in technical higher education
Digital experiences in technical higher educationDigital experiences in technical higher education
Digital experiences in technical higher education
 
Survey of student satisfaction with education process
Survey of student satisfaction with education processSurvey of student satisfaction with education process
Survey of student satisfaction with education process
 
Practices in Digital Education for Universities
Practices in Digital Education for UniversitiesPractices in Digital Education for Universities
Practices in Digital Education for Universities
 
A multisectoral approach towards a strategy for OER and distance education fo...
A multisectoral approach towards a strategy for OER and distance education fo...A multisectoral approach towards a strategy for OER and distance education fo...
A multisectoral approach towards a strategy for OER and distance education fo...
 
Multisectoral Collaboration for OER: Adaptation and development to ensure qua...
Multisectoral Collaboration for OER: Adaptation and development to ensure qua...Multisectoral Collaboration for OER: Adaptation and development to ensure qua...
Multisectoral Collaboration for OER: Adaptation and development to ensure qua...
 
Creating environments for learner centered learning: Paving the way for hyflex
Creating environments for learner centered learning: Paving the way for hyflexCreating environments for learner centered learning: Paving the way for hyflex
Creating environments for learner centered learning: Paving the way for hyflex
 
Antonio Teixeira: Reflecting on Dx in HE
Antonio Teixeira: Reflecting on Dx in HE Antonio Teixeira: Reflecting on Dx in HE
Antonio Teixeira: Reflecting on Dx in HE
 
Mark Brown: Some Reflections: EDEN2021
Mark Brown: Some Reflections: EDEN2021Mark Brown: Some Reflections: EDEN2021
Mark Brown: Some Reflections: EDEN2021
 
Learning and teaching in the digital age - Time for new pedagogies??
Learning and teaching in the digital age - Time for new pedagogies??Learning and teaching in the digital age - Time for new pedagogies??
Learning and teaching in the digital age - Time for new pedagogies??
 
Covadonga Rodrigo: Trespass for Rapporteur
Covadonga Rodrigo: Trespass for RapporteurCovadonga Rodrigo: Trespass for Rapporteur
Covadonga Rodrigo: Trespass for Rapporteur
 
Diana Laurillard: A collaborative academic programme to improve higher and pr...
Diana Laurillard: A collaborative academic programme to improve higher and pr...Diana Laurillard: A collaborative academic programme to improve higher and pr...
Diana Laurillard: A collaborative academic programme to improve higher and pr...
 
Francesc Pedro: Back into the Future
Francesc Pedro: Back into the FutureFrancesc Pedro: Back into the Future
Francesc Pedro: Back into the Future
 
Darcy W Hardy: Light at the End of the Tunnel: Now What?
Darcy W Hardy: Light at the End of the Tunnel: Now What?Darcy W Hardy: Light at the End of the Tunnel: Now What?
Darcy W Hardy: Light at the End of the Tunnel: Now What?
 
Ulf Ehlers: Opportunity knocks! Have your say in shaping EDEN2030 Conversation
Ulf Ehlers: Opportunity knocks! Have your say in shaping EDEN2030 ConversationUlf Ehlers: Opportunity knocks! Have your say in shaping EDEN2030 Conversation
Ulf Ehlers: Opportunity knocks! Have your say in shaping EDEN2030 Conversation
 
Mark Nichols: A brief on transformation in higher education
Mark Nichols: A brief on transformation in higher educationMark Nichols: A brief on transformation in higher education
Mark Nichols: A brief on transformation in higher education
 
Keynote Presentation of Manuel Castro
Keynote Presentation of Manuel CastroKeynote Presentation of Manuel Castro
Keynote Presentation of Manuel Castro
 
Georgi Dimitrov: Digital Education for EU’s Digital Decade: The Digital Educa...
Georgi Dimitrov: Digital Education for EU’s Digital Decade: The Digital Educa...Georgi Dimitrov: Digital Education for EU’s Digital Decade: The Digital Educa...
Georgi Dimitrov: Digital Education for EU’s Digital Decade: The Digital Educa...
 

Recently uploaded

The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
heathfieldcps1
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
MateoGardella
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 

Recently uploaded (20)

Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 

We Underestimate the “Testing Effect” (and How Technology can Help) - Bert Wylin #eden19