RESEARCH METHODS
IN TECHNOLOGY-ENHANCED LEARNING
A presentation by Sandra Schön
& Martin Ebner
Adjunct Professor of Innovations in Learning
at Universitas Negeri Malang
Project manager at Forum New Media in
Higher Education Austria (fnma.at)
Senior Researcher at Graz University of
Technology (Educational Technology), Austria
DR. SANDRA SCHÖNTHISISME!
License
This presentation is published under the
CC BY-SA international 4.0 license, see
https://creativecommons.org/licenses/by-sa/4.0/deed.en
Please attribute to Sandra Schön and Martin Ebner
THREE WAYS OF RESEARCH
METHODS TYPOLOGIES
• Different research approaches
• Qualitative vs. Quantitative approach
• Different research purposes
THREE WAYS OF RESEARCH
METHODS TYPOLOGIES
• Different research approaches
• Qualitative vs. Quantitative approach
• Different research purposes
Sandra Schön
2020
S. Schön & M. Ebner
Three Research
Approaches
https://yout
u.be/SEBbB
46ojTs
different research
approaches:3• Hypothesis testing research
• Explorative research
• Design-based research
You should have an idea of…
METHODS TYPOLOGY 1
HYPOTHESIS
TESTING
APPROACH
DESIGN-
BASED
APPROACH
EXPLORATIVE
APPROACH
METHODS TYPOLOGY 1
HYPOTHESIS
TESTING
APPROACH
DESIGN-
BASED
APPROACH
EXPLORATIVE
APPROACH
IS A CERTAIN
“HYPOTHESIS“
RIGHT?
METHODS TYPOLOGY 1
HYPOTHESIS
TESTING
APPROACH
DESIGN-
BASED
APPROACH
EXPLORATIVE
APPROACH
IS A CERTAIN
“HYPOTHESIS“
RIGHT?
ARE THERE
ANY
…RULES?
…EXPLANATION?
METHODS TYPOLOGY 1
HYPOTHESIS
TESTING
APPROACH
DESIGN-
BASED
APPROACH
EXPLORATIVE
APPROACH
IS A CERTAIN
“HYPOTHESIS“
RIGHT?
ARE THERE
ANY
…RULES?
…EXPLANATION?
HOW TO
DEVELOP/
IMPLEMENT
S.TH. NOVEL
THREE WAYS OF RESEARCH
METHODS TYPOLOGIES
• Different research approaches
• Qualitative vs. Quantitative approach
• Different research purposes
METHODS TYPOLOGY 2
QUANTITATIVE
METHODS
QUALITATIVE
METHODS
METHODS TYPOLOGY 2
QUANTITATIVE
METHODS
QUALITATIVE
METHODS
METHODS TYPOLOGY 2
EXAMPLES
QUANTITATIVE
METHODS
QUALITATIVE
METHODS
FIELD / PARTICPATIVE
RESEARCH
STATISTICS
METHODS TYPOLOGY 2
QUANTITATIVE
METHODS
QUALITATIVE
METHODS
METHODS TYPOLOGY 2
QUANTITATIVE
METHODS
QUALITATIVE
METHODS
METHOD
MIX
THREE WAYS OF RESEARCH
METHODS TYPOLOGIES
• Different research approaches
• Qualitative vs. Quantitative approach
• Different research purposes
METHODS TYPOLOGY 3
DIFFERENT RESEARCH PURPOSES
DATA
COLLECTION
DEVELOP-
MENT
DATA
ANALYSIS
HOW TO
GET
DATA?
HOW TO
DEAL WITH
DATA?
HOW TO
IMPLEMENT
S.TH.
NEW?
METHODS TYPOLOGY 3
DIFFERENT RESEARCH PURPOSES
DATA
COLLECTION
DEVELOP-
MENT
DATA
ANALYSIS
HOW TO
GET
DATA?
HOW TO
DEAL WITH
DATA?
HOW TO
IMPLEMENT
S.TH.
NEW?
METHODS TYPOLOGY 3
DIFFERENT RESEARCH PURPOSES
DATA
COLLECTION
DEVELOP-
MENT
DATA
ANALYSIS
DATA COLLECTION
• OBSERVATION
DATA COLLECTION
• OBSERVATION
• SURVEY • ORAL/WRITTEN/ONLINE
• OPEN/STANDARDIZED QUESTIONS
• …
DATA COLLECTION
• OBSERVATION
• SURVEY
• TEST
• ORAL/WRITTEN/ONLINE
• OPEN/STANDARDIZED QUESTIONS
• …
• STANDARDIZED, APPROVED, e.g. INTELLIGENCE TEST
DATA COLLECTION
IF YOU WANT TO COMPARE
GROUP
A
GROUP
B
DATA COLLECTION
IF YOU WANT TO COMPARE
PRE-
TEST
POST-
TEST
INTER-
VENTION
DATA COLLECTION
EXPERIMENT
COMPLETELY CONTROLLED SETTING
DATA COLLECTION
EXPERIMENT
CONTROLLED
CHANGE OF
INDEPENDENT
VARIABLE
COMPLETELY CONTROLLED SETTING
DATA COLLECTION
EXPERIMENT
DEPENDENT
VARIABLE
CONTROLLED
CHANGE OF
INDEPENDENT
VARIABLE
COMPLETELY CONTROLLED SETTING
DATA COLLECTION
EXPERIMENT
DEPENDENT
VARIABLE
CONTROLLED
CHANGE OF
INDEPENDENT
VARIABLE
E.G. LIGHT
COMPLETELY CONTROLLED SETTING
E.G. TEST RESULT
DATA COLLECTION
EXPERIMENTS IN LEARNING/TEACHING
DATA COLLECTION
EXPERIMENTS IN LEARNING/TEACHING
• CONTROLLING OTHER
VARIABLES (prior
knowledge,
communication)
DATA COLLECTION
EXPERIMENTS IN LEARNING/TEACHING
• CONTROLLING OTHER
VARIABLES (prior
knowledge, communication)
• REAL EXPERIMENTS ARE
VERY SELDOM!
DATA ANALYSIS
• Statistical
approaches
(descriptive,
inference)
DATA ANALYSIS
• Statistical
approaches
(descriptive,
inference)
• Algorithmic
approaches
(decision tree,
cluster)
Children
Age < 8 Age > 8
girls boys
DATA ANALYSIS
• Educational Data Mining
(esp. explorative!)
DATA ANALYSIS
• Educational Data Mining
(esp. explorative!)
• Learning Analytics
(to support learners)
DATA ANALYSIS
• QUALITATIVE
APPROACHES
DATA ANALYSIS
• QUALITATIVE
APPROACHES
e.g. identifying
categories for
school-drop-outs in
open interviews
DEVELOPMENT
TEACHING/LEARNING
• Instructional Design Theory
• E.g. ADDIE-Model (Analysis, Design,
Development, Implementation, Evaluation)
DEVELOPMENT
TEACHING/LEARNING
• Instructional Design Theory
• E.g. ADDIE-Model (Analysis, Design,
Development, Implementation, Evaluation)
TECHNOLOGIES
• User Centred Design
• Prototyping
THREE WAYS OF RESEARCH
METHODS TYPOLOGIES
• Different research approaches
• Qualitative vs. Quantitative approach
• Different research purposes
I PRESENTED …
Schön, Sandra & Ebner, Martin (2020).
Research approaches and methods in
technology-enhanced learning.
(Version July 2020).
And more links and materials can be
found here:
https://sansch.wordpress.com/?p=8065
READ MORE
COMMON CHALLENGE
IN RESEARCH IN TECHNOLOGY-ENHANCED LEARNING
COMMON CHALLENGE
IN RESEARCH IN TECHNOLOGY-ENHANCED LEARNING
TECHNOLOGIES
ARE NEW
COMMON CHALLENGE
IN RESEARCH IN TECHNOLOGY-ENHANCED LEARNING
TECHNOLOGIES
ARE NEWAssociation
of positive
change
COMMON CHALLENGE
IN RESEARCH IN TECHNOLOGY-ENHANCED LEARNING
TECHNOLOGIES
ARE NEWAssociation
of positive
change
Expectation
of positive
change
COMMON CHALLENGE
IN RESEARCH IN TECHNOLOGY-ENHANCED LEARNING
TECHNOLOGIES
ARE NEWAssociation
of positive
change
Expectation
of positive
change
File-drawer
effect
(bias)
COMMON CHALLENGE
IN RESEARCH IN TECHNOLOGY-ENHANCED LEARNING
TECHNOLOGIES
ARE NEWAssociation
of positive
change
Expectation
of positive
change
File-drawer
effect
(bias)
novelty
effects
Adjunct Professor of Innovations in Learning
at Universitas Negeri Malang
https://sandra-schoen.de
DR. SANDRA SCHÖN
THANKS!
Sources
• Photos are from pixabay.de (CC 0)
• Schön, Sandra & Ebner, Martin (2020).
Research approaches and methods in
technology-enhanced learning.
(Version July 2020)
• Drawings by Sandra Schön (CC BY 4.0 Int.)

RESEARCH METHODS IN TECHNOLOGY-ENHANCED LEARNING