SlideShare a Scribd company logo
Gyöngyvér Molnár
University of Szeged
http://www.staff.u-szeged.hu/~gymolnar
Technology-based Assessment:
Challenges and Promises
6th EDEN Research Workshop
Budapest, Hungary, 24-27 October, 2010
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
„Developing Diagnostic Assessments” Project
Outline
• Need for change
• Possibilities and promises of TBA
• Implementing TBA in international projects
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
The need for change
• Technology abounds
• Change - Live, learn,
communicate
• New insight into the
learning process
• Potential to transform
education
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
The need for change
• New expectation,
lifestyle - the Net
Generation “digital
natives” => calls for
different type of teaching
• Schifting from generation
gap to generation lap
• New demands on the
education
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
The need for change
• Existing models of
assessment fail
• New assessments are
required
• Multi-sensory feature
• Retention rates
• Technology alone will not
result in higher achievement
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
• Technology is not the issue - > catalyst
The need for change
• Data about education
quality and its impact on
economic output
• After 4 cycles of PISA
• Economic modeling
• E.g. how the GDP would
change according to the
change in educational
output
• Result: relatively small
improvements – large
impact on future
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
0
200
400
600
800
1000
1200
Mexico
Turkey
Greece
Portugal
Italy
Luxembourg
Spain
UnitedStates
Poland
Norway
SlovakRepublic
OECD
Hungary
Denmark
Germany
Iceland
France
Ireland
Sweden
Austria
Switzerland
Belgium
CzechRepublic
UnitedKingdom
Australia
NewZealand
Canada
Netherlands
Japan
Korea
Finland
Catching up with Finland
(in percent of GDP)
% current
GDP
Why is assessment so important?
„You can not improve what you can not measure”
(Schleicher, 2010)
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
The feedback in education
• ICT – growing in every segment of education
• International tendencies (OECD, ETS, NCES) in
educational assessment
• PPT reached its barrier
• Human resources, cost of money and time
• TBA solve this problem
• NEED to use technology to improve the efficiency of
assessment
• Improved quality of data and increased speed of
assessment
• Better conditions to improve the educational system
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
Possibilities and promises of TBA
(1)
• Reach stimulus material (multimedia tools)
• New item formats
• New construct (PS in technology reach environment)
• New areas (dynamic assessment) – assessing dynamic
– MicroDYN approach
– example
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
Possibilities and promises of TBA
(2)
• TBA rises new issues in assessment:
– background data – testing prozess - e.g. educational
data mining – log file analyses - issues of reaction
time, sequence
– annotations regarding eye and face tracking
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
Possibilities and promises of TBA
(3)
• offers new assessment methods (adaptive testing)
– the difficulty of the test tailors dynamically to the
student’s ability level
– items are selected from an item bank dependent at a
difficulty appropriate for the student
– provides more time-efficient and accurate
assessments.
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
-4
-3
-2
-1
0
1
2
3
4
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
logitscale
item
Adaptive testing
Person ability level
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
(4)
• increases motivation - students with high and low ability
level - flow experience
(5)
• changes the whole assessment process (item generation,
scoring, data-processing, information flow, feedback and
the speed of assessment)
• rapid and precise feedback
(6)
• poses new questions and problems – if TBA – replace PP
∑ improved quality and increased quantity of data and
increased speed of assessment
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
Possibilities and promises of TBA
Implementing TBA in international
projects
• Europe: growing attention in several European countries
and the European Union also facilitates these attempts
• At national level Luxemburg leads the way:
– able to assess an entire cohort simultaneously
– automatic generation of the feedback to the teachers
– University of Luxembourg and the Public Research
Center Henri Tudor
– TAO (Testing Assisté par Ordinateur)
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
Implementing TBA in international
projects
• Germany – DIPF – TBA project :
– adapts and further develops the TAO platform
– establish a national standard for technology-
assisted testing
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
Implementing TBA in international
projects
• In Hungary – 2008 – first – media effect study:
– Inductive reasoning
– 5th grader (PP + CB)
– TAO platform
– Result: global achievement highly correlate – items,
persons – behave differently
• 2009 - a large-scale project was launched by the Center
for Research on Learning and Instruction - University of
Szeged - develop an online diagnostic assessment
system for the first six grades of primary school in
reading, mathematics and science
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
„Developing Diagnostic
Assessments” Project
• the development of assessment frameworks
• devising a large number of items both on paper and on
computer - building item banks
• research on comparing the achievements on the tests
using different media.
• long-term project aims: an online formative assessment
system for the first six grades of primary school
• First phase: pilot the system in 200 schools
• study the related technological and methodological
issues in detail
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
Implementing TBA in international
projects
• US - many instances
– CBA and online assessment so wide spread - testing
industry - engaged in writing and developing task and
different testing software
– Despite of this – in 2009 – Microsoft, Cisco and Intel -
transforming global educational assessment and
improving learning outcomes
– Teaching of 21st Century Skills project
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
Teaching of 21st Century Skills
project
• Aim: resolve the gap - exists between what goes on
in schools and what goes on in the real world
• better measure the skills - needed for the 21st-
century
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
Teaching of 21st Century Skills
project
• Specify high-priority skills, competencies, - 21st century -
turn these into measurable standards and assessment
framework
• Examine innovative learning environments and formative
assessments - draw implications for ICT-based
summative assessments
• Identify methodological and technological barriers –
support solutions
• implementation of these standards and methodologies,
pilot test, make recommendations for broader
educational assessment reform.
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
OECD PISA
• Started to implement CBA
• 2006 – CBAS
• 2009 - ERA
• 2012 - problem solving
• 2015 - completely to CBT
• still a lot of open questions
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
• Despite of the advantages - in large-scale national and
international assessment - faces several technological
challenges
• complexity of issues - no simple and clear solution
• Several technological means available in schools
• diversity, compatibility, connectivity require further
considerations
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
But the future is more promising…
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
Institute of Education,
University of Szeged
Thank you for your kind attention!
http://www.staff.u-szeged.hu/~gymolnar
Research Group on the Development of Competencies,
Hungarian Academy of Sciences
… and remember:
„Without data, you are just another person
with an Opinion” (Schleicher, 2010)

More Related Content

What's hot

Improving Education by Learning Analtyics (EADTU-EU Summit 2017)
Improving Education by Learning Analtyics (EADTU-EU Summit 2017)Improving Education by Learning Analtyics (EADTU-EU Summit 2017)
Improving Education by Learning Analtyics (EADTU-EU Summit 2017)
EADTU
 
Presentations from the 3rd PISA for Development International Advisory Group ...
Presentations from the 3rd PISA for Development International Advisory Group ...Presentations from the 3rd PISA for Development International Advisory Group ...
Presentations from the 3rd PISA for Development International Advisory Group ...
EduSkills OECD
 
Information Literacy:what it means for employability
Information Literacy:what it means for employabilityInformation Literacy:what it means for employability
Information Literacy:what it means for employability
Moira Wright
 
International rankings of universities; An overview for managers M&C TU Delft
International rankings of universities; An overview for managers M&C TU DelftInternational rankings of universities; An overview for managers M&C TU Delft
International rankings of universities; An overview for managers M&C TU Delft
Kim Huijpen
 
Sharon Smith
Sharon SmithSharon Smith
Sharon Smith
Lucia Garcia
 
Technology-enabled learning-oriented assessment
Technology-enabled learning-oriented assessmentTechnology-enabled learning-oriented assessment
Technology-enabled learning-oriented assessment
David Carless
 
Presentations from the 3rd PISA for Development International Advisory Group ...
Presentations from the 3rd PISA for Development International Advisory Group ...Presentations from the 3rd PISA for Development International Advisory Group ...
Presentations from the 3rd PISA for Development International Advisory Group ...
EduSkills OECD
 
Openness Initiatives in Distance Education
Openness Initiatives in Distance EducationOpenness Initiatives in Distance Education
Openness Initiatives in Distance Education
Gülay Ekren
 
Developing Self-regulated Learning in High-school Students: The Role of Learn...
Developing Self-regulated Learning in High-school Students: The Role of Learn...Developing Self-regulated Learning in High-school Students: The Role of Learn...
Developing Self-regulated Learning in High-school Students: The Role of Learn...
Vitomir Kovanovic
 
2021_03_26 "Drop-out prediction in online learning environments" - Paola Velardi
2021_03_26 "Drop-out prediction in online learning environments" - Paola Velardi2021_03_26 "Drop-out prediction in online learning environments" - Paola Velardi
2021_03_26 "Drop-out prediction in online learning environments" - Paola Velardi
eMadrid network
 
Mm5 ossiannilsson2014
Mm5 ossiannilsson2014Mm5 ossiannilsson2014
Mm5 ossiannilsson2014
Ebba Ossiannilsson
 
Designing effective assessment
Designing effective assessment Designing effective assessment
Designing effective assessment
David Carless
 
Tam esg ossiannilsson2019
Tam esg ossiannilsson2019Tam esg ossiannilsson2019
Tam esg ossiannilsson2019
Ebba Ossiannilsson
 
Strategically partnering in co-creating the VLEs of the future
Strategically partnering in co-creating the VLEs of the futureStrategically partnering in co-creating the VLEs of the future
Strategically partnering in co-creating the VLEs of the future
Charles Darwin University
 
OECD Reviews of Evaluation and Assessment in Education: Czech Republic
OECD Reviews of Evaluation and Assessment in Education: Czech RepublicOECD Reviews of Evaluation and Assessment in Education: Czech Republic
OECD Reviews of Evaluation and Assessment in Education: Czech Republic
EduSkills OECD
 
Open Education Research : Overview, Benefits and Challenges
Open Education Research : Overview, Benefits and Challenges Open Education Research : Overview, Benefits and Challenges
Open Education Research : Overview, Benefits and Challenges
Robert Farrow
 
Sunil Maher
Sunil MaherSunil Maher
Sunil Maher
Lucia Garcia
 
Computers and Learning Research Group: Research methods in open education: I...
Computers and Learning Research Group: Research methods in open education: I...Computers and Learning Research Group: Research methods in open education: I...
Computers and Learning Research Group: Research methods in open education: I...
Robert Farrow
 
Learning analytics: the way forward
Learning analytics: the way forwardLearning analytics: the way forward
Learning analytics: the way forward
Rebecca Ferguson
 
Learning-oriented assessment in higher education
Learning-oriented assessment in higher educationLearning-oriented assessment in higher education
Learning-oriented assessment in higher education
David Carless
 

What's hot (20)

Improving Education by Learning Analtyics (EADTU-EU Summit 2017)
Improving Education by Learning Analtyics (EADTU-EU Summit 2017)Improving Education by Learning Analtyics (EADTU-EU Summit 2017)
Improving Education by Learning Analtyics (EADTU-EU Summit 2017)
 
Presentations from the 3rd PISA for Development International Advisory Group ...
Presentations from the 3rd PISA for Development International Advisory Group ...Presentations from the 3rd PISA for Development International Advisory Group ...
Presentations from the 3rd PISA for Development International Advisory Group ...
 
Information Literacy:what it means for employability
Information Literacy:what it means for employabilityInformation Literacy:what it means for employability
Information Literacy:what it means for employability
 
International rankings of universities; An overview for managers M&C TU Delft
International rankings of universities; An overview for managers M&C TU DelftInternational rankings of universities; An overview for managers M&C TU Delft
International rankings of universities; An overview for managers M&C TU Delft
 
Sharon Smith
Sharon SmithSharon Smith
Sharon Smith
 
Technology-enabled learning-oriented assessment
Technology-enabled learning-oriented assessmentTechnology-enabled learning-oriented assessment
Technology-enabled learning-oriented assessment
 
Presentations from the 3rd PISA for Development International Advisory Group ...
Presentations from the 3rd PISA for Development International Advisory Group ...Presentations from the 3rd PISA for Development International Advisory Group ...
Presentations from the 3rd PISA for Development International Advisory Group ...
 
Openness Initiatives in Distance Education
Openness Initiatives in Distance EducationOpenness Initiatives in Distance Education
Openness Initiatives in Distance Education
 
Developing Self-regulated Learning in High-school Students: The Role of Learn...
Developing Self-regulated Learning in High-school Students: The Role of Learn...Developing Self-regulated Learning in High-school Students: The Role of Learn...
Developing Self-regulated Learning in High-school Students: The Role of Learn...
 
2021_03_26 "Drop-out prediction in online learning environments" - Paola Velardi
2021_03_26 "Drop-out prediction in online learning environments" - Paola Velardi2021_03_26 "Drop-out prediction in online learning environments" - Paola Velardi
2021_03_26 "Drop-out prediction in online learning environments" - Paola Velardi
 
Mm5 ossiannilsson2014
Mm5 ossiannilsson2014Mm5 ossiannilsson2014
Mm5 ossiannilsson2014
 
Designing effective assessment
Designing effective assessment Designing effective assessment
Designing effective assessment
 
Tam esg ossiannilsson2019
Tam esg ossiannilsson2019Tam esg ossiannilsson2019
Tam esg ossiannilsson2019
 
Strategically partnering in co-creating the VLEs of the future
Strategically partnering in co-creating the VLEs of the futureStrategically partnering in co-creating the VLEs of the future
Strategically partnering in co-creating the VLEs of the future
 
OECD Reviews of Evaluation and Assessment in Education: Czech Republic
OECD Reviews of Evaluation and Assessment in Education: Czech RepublicOECD Reviews of Evaluation and Assessment in Education: Czech Republic
OECD Reviews of Evaluation and Assessment in Education: Czech Republic
 
Open Education Research : Overview, Benefits and Challenges
Open Education Research : Overview, Benefits and Challenges Open Education Research : Overview, Benefits and Challenges
Open Education Research : Overview, Benefits and Challenges
 
Sunil Maher
Sunil MaherSunil Maher
Sunil Maher
 
Computers and Learning Research Group: Research methods in open education: I...
Computers and Learning Research Group: Research methods in open education: I...Computers and Learning Research Group: Research methods in open education: I...
Computers and Learning Research Group: Research methods in open education: I...
 
Learning analytics: the way forward
Learning analytics: the way forwardLearning analytics: the way forward
Learning analytics: the way forward
 
Learning-oriented assessment in higher education
Learning-oriented assessment in higher educationLearning-oriented assessment in higher education
Learning-oriented assessment in higher education
 

Similar to Technology-based Assessment: Challenges and Promises

E-learning and Employability Shift Focus on Learning (Again) - Blazenka Divjak
E-learning and Employability Shift Focus on Learning (Again) - Blazenka DivjakE-learning and Employability Shift Focus on Learning (Again) - Blazenka Divjak
E-learning and Employability Shift Focus on Learning (Again) - Blazenka Divjak
EDEN Digital Learning Europe
 
OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...
OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...
OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...
EduSkills OECD
 
Higher education: measurement and quality - ethics
Higher education: measurement and quality - ethicsHigher education: measurement and quality - ethics
Higher education: measurement and quality - ethics
icdeslides
 
Teachers in the Digital Age
Teachers in the Digital AgeTeachers in the Digital Age
Teachers in the Digital Age
The Open Education Consortium
 
Scottish Initiatives in e-Learning - Enhancement-Led Innovation
Scottish Initiatives in e-Learning - Enhancement-Led InnovationScottish Initiatives in e-Learning - Enhancement-Led Innovation
Scottish Initiatives in e-Learning - Enhancement-Led Innovation
drdjwalker
 
Digital environments improving quality and efficiency of teaching leru - br...
Digital environments improving quality and efficiency of teaching   leru - br...Digital environments improving quality and efficiency of teaching   leru - br...
Digital environments improving quality and efficiency of teaching leru - br...
dvndamme
 
Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...
Beck Pitt
 
Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...
OER Hub
 
Affective behaviour cognition learning gains project presentation
Affective behaviour cognition learning gains project presentationAffective behaviour cognition learning gains project presentation
Affective behaviour cognition learning gains project presentation
Bart Rienties
 
TTTNet - Teamwork, Training and Technology Network
TTTNet - Teamwork, Training and Technology NetworkTTTNet - Teamwork, Training and Technology Network
TTTNet - Teamwork, Training and Technology Network
Technological Ecosystems for Enhancing Multiculturality
 
A broader view of undergraduate research opportunity programmes: collaborativ...
A broader view of undergraduate research opportunity programmes: collaborativ...A broader view of undergraduate research opportunity programmes: collaborativ...
A broader view of undergraduate research opportunity programmes: collaborativ...
Simon Haslett
 
Prospect for learning analytics to achieve adaptive learning model
Prospect for learning analytics to achieve adaptive learning modelProspect for learning analytics to achieve adaptive learning model
Prospect for learning analytics to achieve adaptive learning model
Open Cyber University of Korea
 
Learning analytics the good the bad & the ugly
Learning analytics the good the bad & the uglyLearning analytics the good the bad & the ugly
Learning analytics the good the bad & the ugly
Eduworks Network
 
Embedding and sustaining inclusive STEM practices
Embedding and sustaining inclusive STEM practicesEmbedding and sustaining inclusive STEM practices
Embedding and sustaining inclusive STEM practices
IES / IAQM
 
2021_01_15 «Applying Learning Analytics in Living Labs for Educational Innova...
2021_01_15 «Applying Learning Analytics in Living Labs for Educational Innova...2021_01_15 «Applying Learning Analytics in Living Labs for Educational Innova...
2021_01_15 «Applying Learning Analytics in Living Labs for Educational Innova...
eMadrid network
 
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
Jon Rosewell
 
Kelt - SMILE, we’re making the most of other peoples work – not reinventing t...
Kelt - SMILE, we’re making the most of other peoples work – not reinventing t...Kelt - SMILE, we’re making the most of other peoples work – not reinventing t...
Kelt - SMILE, we’re making the most of other peoples work – not reinventing t...IL Group (CILIP Information Literacy Group)
 
Oer panel
Oer panelOer panel
Oer panelgrainne
 
Learning analytics research informed institutional practice
Learning analytics research informed institutional practiceLearning analytics research informed institutional practice
Learning analytics research informed institutional practice
Yi-Shan Tsai
 
A quality dialogue: from inspection to inspiration
A quality dialogue: from inspection to inspirationA quality dialogue: from inspection to inspiration
A quality dialogue: from inspection to inspiration
UOC Universitat Oberta de Catalunya
 

Similar to Technology-based Assessment: Challenges and Promises (20)

E-learning and Employability Shift Focus on Learning (Again) - Blazenka Divjak
E-learning and Employability Shift Focus on Learning (Again) - Blazenka DivjakE-learning and Employability Shift Focus on Learning (Again) - Blazenka Divjak
E-learning and Employability Shift Focus on Learning (Again) - Blazenka Divjak
 
OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...
OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...
OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...
 
Higher education: measurement and quality - ethics
Higher education: measurement and quality - ethicsHigher education: measurement and quality - ethics
Higher education: measurement and quality - ethics
 
Teachers in the Digital Age
Teachers in the Digital AgeTeachers in the Digital Age
Teachers in the Digital Age
 
Scottish Initiatives in e-Learning - Enhancement-Led Innovation
Scottish Initiatives in e-Learning - Enhancement-Led InnovationScottish Initiatives in e-Learning - Enhancement-Led Innovation
Scottish Initiatives in e-Learning - Enhancement-Led Innovation
 
Digital environments improving quality and efficiency of teaching leru - br...
Digital environments improving quality and efficiency of teaching   leru - br...Digital environments improving quality and efficiency of teaching   leru - br...
Digital environments improving quality and efficiency of teaching leru - br...
 
Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...
 
Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...
 
Affective behaviour cognition learning gains project presentation
Affective behaviour cognition learning gains project presentationAffective behaviour cognition learning gains project presentation
Affective behaviour cognition learning gains project presentation
 
TTTNet - Teamwork, Training and Technology Network
TTTNet - Teamwork, Training and Technology NetworkTTTNet - Teamwork, Training and Technology Network
TTTNet - Teamwork, Training and Technology Network
 
A broader view of undergraduate research opportunity programmes: collaborativ...
A broader view of undergraduate research opportunity programmes: collaborativ...A broader view of undergraduate research opportunity programmes: collaborativ...
A broader view of undergraduate research opportunity programmes: collaborativ...
 
Prospect for learning analytics to achieve adaptive learning model
Prospect for learning analytics to achieve adaptive learning modelProspect for learning analytics to achieve adaptive learning model
Prospect for learning analytics to achieve adaptive learning model
 
Learning analytics the good the bad & the ugly
Learning analytics the good the bad & the uglyLearning analytics the good the bad & the ugly
Learning analytics the good the bad & the ugly
 
Embedding and sustaining inclusive STEM practices
Embedding and sustaining inclusive STEM practicesEmbedding and sustaining inclusive STEM practices
Embedding and sustaining inclusive STEM practices
 
2021_01_15 «Applying Learning Analytics in Living Labs for Educational Innova...
2021_01_15 «Applying Learning Analytics in Living Labs for Educational Innova...2021_01_15 «Applying Learning Analytics in Living Labs for Educational Innova...
2021_01_15 «Applying Learning Analytics in Living Labs for Educational Innova...
 
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
 
Kelt - SMILE, we’re making the most of other peoples work – not reinventing t...
Kelt - SMILE, we’re making the most of other peoples work – not reinventing t...Kelt - SMILE, we’re making the most of other peoples work – not reinventing t...
Kelt - SMILE, we’re making the most of other peoples work – not reinventing t...
 
Oer panel
Oer panelOer panel
Oer panel
 
Learning analytics research informed institutional practice
Learning analytics research informed institutional practiceLearning analytics research informed institutional practice
Learning analytics research informed institutional practice
 
A quality dialogue: from inspection to inspiration
A quality dialogue: from inspection to inspirationA quality dialogue: from inspection to inspiration
A quality dialogue: from inspection to inspiration
 

More from EDEN Digital Learning Europe

Digital experiences in technical higher education
Digital experiences in technical higher educationDigital experiences in technical higher education
Digital experiences in technical higher education
EDEN Digital Learning Europe
 
Digital experiences in technical higher education
Digital experiences in technical higher educationDigital experiences in technical higher education
Digital experiences in technical higher education
EDEN Digital Learning Europe
 
Digital experiences in technical higher education
Digital experiences in technical higher educationDigital experiences in technical higher education
Digital experiences in technical higher education
EDEN Digital Learning Europe
 
Digital experiences in technical higher education
Digital experiences in technical higher educationDigital experiences in technical higher education
Digital experiences in technical higher education
EDEN Digital Learning Europe
 
Survey of student satisfaction with education process
Survey of student satisfaction with education processSurvey of student satisfaction with education process
Survey of student satisfaction with education process
EDEN Digital Learning Europe
 
Practices in Digital Education for Universities
Practices in Digital Education for UniversitiesPractices in Digital Education for Universities
Practices in Digital Education for Universities
EDEN Digital Learning Europe
 
A multisectoral approach towards a strategy for OER and distance education fo...
A multisectoral approach towards a strategy for OER and distance education fo...A multisectoral approach towards a strategy for OER and distance education fo...
A multisectoral approach towards a strategy for OER and distance education fo...
EDEN Digital Learning Europe
 
Multisectoral Collaboration for OER: Adaptation and development to ensure qua...
Multisectoral Collaboration for OER: Adaptation and development to ensure qua...Multisectoral Collaboration for OER: Adaptation and development to ensure qua...
Multisectoral Collaboration for OER: Adaptation and development to ensure qua...
EDEN Digital Learning Europe
 
Creating environments for learner centered learning: Paving the way for hyflex
Creating environments for learner centered learning: Paving the way for hyflexCreating environments for learner centered learning: Paving the way for hyflex
Creating environments for learner centered learning: Paving the way for hyflex
EDEN Digital Learning Europe
 
Antonio Teixeira: Reflecting on Dx in HE
Antonio Teixeira: Reflecting on Dx in HE Antonio Teixeira: Reflecting on Dx in HE
Antonio Teixeira: Reflecting on Dx in HE
EDEN Digital Learning Europe
 
Mark Brown: Some Reflections: EDEN2021
Mark Brown: Some Reflections: EDEN2021Mark Brown: Some Reflections: EDEN2021
Mark Brown: Some Reflections: EDEN2021
EDEN Digital Learning Europe
 
Learning and teaching in the digital age - Time for new pedagogies??
Learning and teaching in the digital age - Time for new pedagogies??Learning and teaching in the digital age - Time for new pedagogies??
Learning and teaching in the digital age - Time for new pedagogies??
EDEN Digital Learning Europe
 
Covadonga Rodrigo: Trespass for Rapporteur
Covadonga Rodrigo: Trespass for RapporteurCovadonga Rodrigo: Trespass for Rapporteur
Covadonga Rodrigo: Trespass for Rapporteur
EDEN Digital Learning Europe
 
Diana Laurillard: A collaborative academic programme to improve higher and pr...
Diana Laurillard: A collaborative academic programme to improve higher and pr...Diana Laurillard: A collaborative academic programme to improve higher and pr...
Diana Laurillard: A collaborative academic programme to improve higher and pr...
EDEN Digital Learning Europe
 
Francesc Pedro: Back into the Future
Francesc Pedro: Back into the FutureFrancesc Pedro: Back into the Future
Francesc Pedro: Back into the Future
EDEN Digital Learning Europe
 
Darcy W Hardy: Light at the End of the Tunnel: Now What?
Darcy W Hardy: Light at the End of the Tunnel: Now What?Darcy W Hardy: Light at the End of the Tunnel: Now What?
Darcy W Hardy: Light at the End of the Tunnel: Now What?
EDEN Digital Learning Europe
 
Ulf Ehlers: Opportunity knocks! Have your say in shaping EDEN2030 Conversation
Ulf Ehlers: Opportunity knocks! Have your say in shaping EDEN2030 ConversationUlf Ehlers: Opportunity knocks! Have your say in shaping EDEN2030 Conversation
Ulf Ehlers: Opportunity knocks! Have your say in shaping EDEN2030 Conversation
EDEN Digital Learning Europe
 
Mark Nichols: A brief on transformation in higher education
Mark Nichols: A brief on transformation in higher educationMark Nichols: A brief on transformation in higher education
Mark Nichols: A brief on transformation in higher education
EDEN Digital Learning Europe
 
Keynote Presentation of Manuel Castro
Keynote Presentation of Manuel CastroKeynote Presentation of Manuel Castro
Keynote Presentation of Manuel Castro
EDEN Digital Learning Europe
 
Georgi Dimitrov: Digital Education for EU’s Digital Decade: The Digital Educa...
Georgi Dimitrov: Digital Education for EU’s Digital Decade: The Digital Educa...Georgi Dimitrov: Digital Education for EU’s Digital Decade: The Digital Educa...
Georgi Dimitrov: Digital Education for EU’s Digital Decade: The Digital Educa...
EDEN Digital Learning Europe
 

More from EDEN Digital Learning Europe (20)

Digital experiences in technical higher education
Digital experiences in technical higher educationDigital experiences in technical higher education
Digital experiences in technical higher education
 
Digital experiences in technical higher education
Digital experiences in technical higher educationDigital experiences in technical higher education
Digital experiences in technical higher education
 
Digital experiences in technical higher education
Digital experiences in technical higher educationDigital experiences in technical higher education
Digital experiences in technical higher education
 
Digital experiences in technical higher education
Digital experiences in technical higher educationDigital experiences in technical higher education
Digital experiences in technical higher education
 
Survey of student satisfaction with education process
Survey of student satisfaction with education processSurvey of student satisfaction with education process
Survey of student satisfaction with education process
 
Practices in Digital Education for Universities
Practices in Digital Education for UniversitiesPractices in Digital Education for Universities
Practices in Digital Education for Universities
 
A multisectoral approach towards a strategy for OER and distance education fo...
A multisectoral approach towards a strategy for OER and distance education fo...A multisectoral approach towards a strategy for OER and distance education fo...
A multisectoral approach towards a strategy for OER and distance education fo...
 
Multisectoral Collaboration for OER: Adaptation and development to ensure qua...
Multisectoral Collaboration for OER: Adaptation and development to ensure qua...Multisectoral Collaboration for OER: Adaptation and development to ensure qua...
Multisectoral Collaboration for OER: Adaptation and development to ensure qua...
 
Creating environments for learner centered learning: Paving the way for hyflex
Creating environments for learner centered learning: Paving the way for hyflexCreating environments for learner centered learning: Paving the way for hyflex
Creating environments for learner centered learning: Paving the way for hyflex
 
Antonio Teixeira: Reflecting on Dx in HE
Antonio Teixeira: Reflecting on Dx in HE Antonio Teixeira: Reflecting on Dx in HE
Antonio Teixeira: Reflecting on Dx in HE
 
Mark Brown: Some Reflections: EDEN2021
Mark Brown: Some Reflections: EDEN2021Mark Brown: Some Reflections: EDEN2021
Mark Brown: Some Reflections: EDEN2021
 
Learning and teaching in the digital age - Time for new pedagogies??
Learning and teaching in the digital age - Time for new pedagogies??Learning and teaching in the digital age - Time for new pedagogies??
Learning and teaching in the digital age - Time for new pedagogies??
 
Covadonga Rodrigo: Trespass for Rapporteur
Covadonga Rodrigo: Trespass for RapporteurCovadonga Rodrigo: Trespass for Rapporteur
Covadonga Rodrigo: Trespass for Rapporteur
 
Diana Laurillard: A collaborative academic programme to improve higher and pr...
Diana Laurillard: A collaborative academic programme to improve higher and pr...Diana Laurillard: A collaborative academic programme to improve higher and pr...
Diana Laurillard: A collaborative academic programme to improve higher and pr...
 
Francesc Pedro: Back into the Future
Francesc Pedro: Back into the FutureFrancesc Pedro: Back into the Future
Francesc Pedro: Back into the Future
 
Darcy W Hardy: Light at the End of the Tunnel: Now What?
Darcy W Hardy: Light at the End of the Tunnel: Now What?Darcy W Hardy: Light at the End of the Tunnel: Now What?
Darcy W Hardy: Light at the End of the Tunnel: Now What?
 
Ulf Ehlers: Opportunity knocks! Have your say in shaping EDEN2030 Conversation
Ulf Ehlers: Opportunity knocks! Have your say in shaping EDEN2030 ConversationUlf Ehlers: Opportunity knocks! Have your say in shaping EDEN2030 Conversation
Ulf Ehlers: Opportunity knocks! Have your say in shaping EDEN2030 Conversation
 
Mark Nichols: A brief on transformation in higher education
Mark Nichols: A brief on transformation in higher educationMark Nichols: A brief on transformation in higher education
Mark Nichols: A brief on transformation in higher education
 
Keynote Presentation of Manuel Castro
Keynote Presentation of Manuel CastroKeynote Presentation of Manuel Castro
Keynote Presentation of Manuel Castro
 
Georgi Dimitrov: Digital Education for EU’s Digital Decade: The Digital Educa...
Georgi Dimitrov: Digital Education for EU’s Digital Decade: The Digital Educa...Georgi Dimitrov: Digital Education for EU’s Digital Decade: The Digital Educa...
Georgi Dimitrov: Digital Education for EU’s Digital Decade: The Digital Educa...
 

Recently uploaded

The basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptxThe basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptx
heathfieldcps1
 
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Dr. Vinod Kumar Kanvaria
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
Special education needs
 
Advantages and Disadvantages of CMS from an SEO Perspective
Advantages and Disadvantages of CMS from an SEO PerspectiveAdvantages and Disadvantages of CMS from an SEO Perspective
Advantages and Disadvantages of CMS from an SEO Perspective
Krisztián Száraz
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
camakaiclarkmusic
 
Digital Artifact 2 - Investigating Pavilion Designs
Digital Artifact 2 - Investigating Pavilion DesignsDigital Artifact 2 - Investigating Pavilion Designs
Digital Artifact 2 - Investigating Pavilion Designs
chanes7
 
Normal Labour/ Stages of Labour/ Mechanism of Labour
Normal Labour/ Stages of Labour/ Mechanism of LabourNormal Labour/ Stages of Labour/ Mechanism of Labour
Normal Labour/ Stages of Labour/ Mechanism of Labour
Wasim Ak
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
Jean Carlos Nunes Paixão
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
DeeptiGupta154
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
Chapter -12, Antibiotics (One Page Notes).pdf
Chapter -12, Antibiotics (One Page Notes).pdfChapter -12, Antibiotics (One Page Notes).pdf
Chapter -12, Antibiotics (One Page Notes).pdf
Kartik Tiwari
 
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdfMASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
goswamiyash170123
 
A Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptxA Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptx
thanhdowork
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
The Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptxThe Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptx
DhatriParmar
 
Pride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School DistrictPride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School District
David Douglas School District
 
Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
TechSoup
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 

Recently uploaded (20)

The basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptxThe basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptx
 
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
 
Advantages and Disadvantages of CMS from an SEO Perspective
Advantages and Disadvantages of CMS from an SEO PerspectiveAdvantages and Disadvantages of CMS from an SEO Perspective
Advantages and Disadvantages of CMS from an SEO Perspective
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
 
Digital Artifact 2 - Investigating Pavilion Designs
Digital Artifact 2 - Investigating Pavilion DesignsDigital Artifact 2 - Investigating Pavilion Designs
Digital Artifact 2 - Investigating Pavilion Designs
 
Normal Labour/ Stages of Labour/ Mechanism of Labour
Normal Labour/ Stages of Labour/ Mechanism of LabourNormal Labour/ Stages of Labour/ Mechanism of Labour
Normal Labour/ Stages of Labour/ Mechanism of Labour
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
 
Chapter -12, Antibiotics (One Page Notes).pdf
Chapter -12, Antibiotics (One Page Notes).pdfChapter -12, Antibiotics (One Page Notes).pdf
Chapter -12, Antibiotics (One Page Notes).pdf
 
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdfMASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
MASS MEDIA STUDIES-835-CLASS XI Resource Material.pdf
 
A Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptxA Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptx
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
The Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptxThe Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptx
 
Pride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School DistrictPride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School District
 
Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 

Technology-based Assessment: Challenges and Promises

  • 1. Gyöngyvér Molnár University of Szeged http://www.staff.u-szeged.hu/~gymolnar Technology-based Assessment: Challenges and Promises 6th EDEN Research Workshop Budapest, Hungary, 24-27 October, 2010 Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged „Developing Diagnostic Assessments” Project
  • 2. Outline • Need for change • Possibilities and promises of TBA • Implementing TBA in international projects Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 3. The need for change • Technology abounds • Change - Live, learn, communicate • New insight into the learning process • Potential to transform education Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 4. The need for change • New expectation, lifestyle - the Net Generation “digital natives” => calls for different type of teaching • Schifting from generation gap to generation lap • New demands on the education Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 5. The need for change • Existing models of assessment fail • New assessments are required • Multi-sensory feature • Retention rates • Technology alone will not result in higher achievement Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged • Technology is not the issue - > catalyst
  • 6. The need for change • Data about education quality and its impact on economic output • After 4 cycles of PISA • Economic modeling • E.g. how the GDP would change according to the change in educational output • Result: relatively small improvements – large impact on future Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 7. Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged 0 200 400 600 800 1000 1200 Mexico Turkey Greece Portugal Italy Luxembourg Spain UnitedStates Poland Norway SlovakRepublic OECD Hungary Denmark Germany Iceland France Ireland Sweden Austria Switzerland Belgium CzechRepublic UnitedKingdom Australia NewZealand Canada Netherlands Japan Korea Finland Catching up with Finland (in percent of GDP) % current GDP
  • 8. Why is assessment so important? „You can not improve what you can not measure” (Schleicher, 2010) Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 9. The feedback in education • ICT – growing in every segment of education • International tendencies (OECD, ETS, NCES) in educational assessment • PPT reached its barrier • Human resources, cost of money and time • TBA solve this problem • NEED to use technology to improve the efficiency of assessment • Improved quality of data and increased speed of assessment • Better conditions to improve the educational system Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 10. Possibilities and promises of TBA (1) • Reach stimulus material (multimedia tools) • New item formats • New construct (PS in technology reach environment) • New areas (dynamic assessment) – assessing dynamic – MicroDYN approach – example Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 11.
  • 12. Possibilities and promises of TBA (2) • TBA rises new issues in assessment: – background data – testing prozess - e.g. educational data mining – log file analyses - issues of reaction time, sequence – annotations regarding eye and face tracking Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 13. Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 14. Possibilities and promises of TBA (3) • offers new assessment methods (adaptive testing) – the difficulty of the test tailors dynamically to the student’s ability level – items are selected from an item bank dependent at a difficulty appropriate for the student – provides more time-efficient and accurate assessments. Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 15. -4 -3 -2 -1 0 1 2 3 4 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 logitscale item Adaptive testing Person ability level Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 16. (4) • increases motivation - students with high and low ability level - flow experience (5) • changes the whole assessment process (item generation, scoring, data-processing, information flow, feedback and the speed of assessment) • rapid and precise feedback (6) • poses new questions and problems – if TBA – replace PP ∑ improved quality and increased quantity of data and increased speed of assessment Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged Possibilities and promises of TBA
  • 17. Implementing TBA in international projects • Europe: growing attention in several European countries and the European Union also facilitates these attempts • At national level Luxemburg leads the way: – able to assess an entire cohort simultaneously – automatic generation of the feedback to the teachers – University of Luxembourg and the Public Research Center Henri Tudor – TAO (Testing Assisté par Ordinateur) Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 18. Implementing TBA in international projects • Germany – DIPF – TBA project : – adapts and further develops the TAO platform – establish a national standard for technology- assisted testing Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 19. Implementing TBA in international projects • In Hungary – 2008 – first – media effect study: – Inductive reasoning – 5th grader (PP + CB) – TAO platform – Result: global achievement highly correlate – items, persons – behave differently • 2009 - a large-scale project was launched by the Center for Research on Learning and Instruction - University of Szeged - develop an online diagnostic assessment system for the first six grades of primary school in reading, mathematics and science Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 20. „Developing Diagnostic Assessments” Project • the development of assessment frameworks • devising a large number of items both on paper and on computer - building item banks • research on comparing the achievements on the tests using different media. • long-term project aims: an online formative assessment system for the first six grades of primary school • First phase: pilot the system in 200 schools • study the related technological and methodological issues in detail Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 21. Implementing TBA in international projects • US - many instances – CBA and online assessment so wide spread - testing industry - engaged in writing and developing task and different testing software – Despite of this – in 2009 – Microsoft, Cisco and Intel - transforming global educational assessment and improving learning outcomes – Teaching of 21st Century Skills project Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 22. Teaching of 21st Century Skills project • Aim: resolve the gap - exists between what goes on in schools and what goes on in the real world • better measure the skills - needed for the 21st- century Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 23. Teaching of 21st Century Skills project • Specify high-priority skills, competencies, - 21st century - turn these into measurable standards and assessment framework • Examine innovative learning environments and formative assessments - draw implications for ICT-based summative assessments • Identify methodological and technological barriers – support solutions • implementation of these standards and methodologies, pilot test, make recommendations for broader educational assessment reform. Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 24. OECD PISA • Started to implement CBA • 2006 – CBAS • 2009 - ERA • 2012 - problem solving • 2015 - completely to CBT • still a lot of open questions Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 25. • Despite of the advantages - in large-scale national and international assessment - faces several technological challenges • complexity of issues - no simple and clear solution • Several technological means available in schools • diversity, compatibility, connectivity require further considerations Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 26. But the future is more promising… Research Group on the Development of Competencies, Hungarian Academy of Sciences Institute of Education, University of Szeged
  • 27. Thank you for your kind attention! http://www.staff.u-szeged.hu/~gymolnar Research Group on the Development of Competencies, Hungarian Academy of Sciences … and remember: „Without data, you are just another person with an Opinion” (Schleicher, 2010)