SlideShare a Scribd company logo
Sergey Sosnovsky, Saarland University / DFKI
MetaMath: Evaluation
Methodology
Tampere, 19-21/01/2015
Evaluation Goal
❖ Implement large scale evaluation trials of the reformed courses
to demonstrate that the reformed courses bring educational
value
❖ Improved grades (higher average grade, lower percentage of students
failing the course,…)
❖ Higher knowledge gain (on average, for underachieving students, for
female students, for CS students…)
❖ Lower drop-out rates (how to measure?)
❖ Increased motivation, improved attitude toward learning mathematics
❖ Positive evaluation by students (some students… of some features)
Which of these parameters
should we collect? All of them
Overall experiment design
❖ Longitudinal study
❖ Two groups: Group1 (controlled) and
Group2(experimental)
❖ Each group is observed for one semester
❖ Group1 - in 2015, Group2 - in 2016
❖ Group1 is taught with the old version of the course
❖ Group2 is taught with the new version of the course
❖ Main challenge: inter-group differences as uncontrolled
factors that would influence the results
Assessment methodology
Pre /post-tests
❖ SEFI competencies should be framework for developing tests
questions.
❖ Isomorphism of questions can be achieved by using different
numerical values (avoid complex calculations that would
increase the complexity without influencing difficulty)
❖ Test must assess both the target competencies and prerequisite
competencies

Issues:
- electronic or paper?
- when to organise?
- how long?
- what is the nature of questions?
- … then they will be graded
Pre-questionnaire
❖ Demographics
❖ Gender
❖ Major/speciality
❖ Background
❖ experience with e-Learning
❖ lifetime Math experience
❖ Motivation
❖ Interest in math
❖ Fear of failure
❖ Extrinsic valut
❖ Expectations from the course (amount of learning, need for future studies/
career personal grade prediction)
Challenge:
- cannot be anonymises
Issues:
- electronic or paper?
- when to organise?
Post-questionnaire
❖ Motivation
❖ Interest in math
❖ Fear of failure
❖ Extrinsic valut
❖ How expectations from the course have been met
❖ Which aspect of the course they like/ did not like
❖ …standard course evaluation forms
❖ (during the 2nd semester): Math-Bridge-related
questionnaire
Challenge:
- ensure that students fill
it in
Issues:
- electronic or paper?
- when to organise?

More Related Content

What's hot

Schulz-Evaluation-Adjunct Faculty Annual Summary-153
Schulz-Evaluation-Adjunct Faculty Annual Summary-153Schulz-Evaluation-Adjunct Faculty Annual Summary-153
Schulz-Evaluation-Adjunct Faculty Annual Summary-153
Zachary W. Schulz
 
Impact of Timing of Algebra on Future Mathematics Achievement
Impact of Timing of Algebra on Future Mathematics AchievementImpact of Timing of Algebra on Future Mathematics Achievement
Impact of Timing of Algebra on Future Mathematics Achievement
EDD SFSU
 
0 overview of our redesign
0   overview of our redesign0   overview of our redesign
0 overview of our redesign
chairsty
 
Using Multiple Data Points to Identify Gifted and Highly Able Learners
Using Multiple Data Points to Identify Gifted and Highly Able LearnersUsing Multiple Data Points to Identify Gifted and Highly Able Learners
Using Multiple Data Points to Identify Gifted and Highly Able Learners
Kris Happe, M.Ed
 
Phase I: Overview
Phase I: OverviewPhase I: Overview
Phase I: Overview
shannonstaley70
 
P T A Presentation
P T A  PresentationP T A  Presentation
P T A Presentation
Meagan
 
Experiential Education Approaches in Nonprofit Management & Leadershi...
Experiential Education Approaches in   Nonprofit Management & Leadershi...Experiential Education Approaches in   Nonprofit Management & Leadershi...
Experiential Education Approaches in Nonprofit Management & Leadershi...
heathercarpenter
 
Assessment for learning part 2
Assessment for learning part 2Assessment for learning part 2
Assessment for learning part 2
donpott
 
Evaluation in swaziland schools
Evaluation in swaziland schoolsEvaluation in swaziland schools
Evaluation in swaziland schools
Mabuza Moses
 
Types of assessments
Types of assessmentsTypes of assessments
Types of assessments
steph8790
 
Assessments - Data Driven Instruction
Assessments - Data Driven InstructionAssessments - Data Driven Instruction
Assessments - Data Driven Instruction
Sharon Frausto
 
Identifying processes of Classroom Assessment Morrow
Identifying processes of Classroom Assessment MorrowIdentifying processes of Classroom Assessment Morrow
Identifying processes of Classroom Assessment Morrow
Lisa Morrow
 
Technological needs calling for the application of coaching in university adv...
Technological needs calling for the application of coaching in university adv...Technological needs calling for the application of coaching in university adv...
Technological needs calling for the application of coaching in university adv...
Technological Ecosystems for Enhancing Multiculturality
 
First results of the General Evaluation - SPICE project,
First results of the General Evaluation - SPICE project, First results of the General Evaluation - SPICE project,
First results of the General Evaluation - SPICE project,
Brussels, Belgium
 
Influence of the students’ learning strategy on the evaluation scores
Influence of the students’ learning strategy on the evaluation scoresInfluence of the students’ learning strategy on the evaluation scores
Influence of the students’ learning strategy on the evaluation scores
Technological Ecosystems for Enhancing Multiculturality
 
Standardized Information Literacy Assessment
Standardized Information Literacy AssessmentStandardized Information Literacy Assessment
Standardized Information Literacy Assessment
NicoleBranch
 
Overview of approach to instructional design
Overview of approach to instructional designOverview of approach to instructional design
Overview of approach to instructional design
Janine Theiler
 
Leader Anticipation
Leader  AnticipationLeader  Anticipation
Leader Anticipation
NSW Department of Education
 
Med brochure
Med brochureMed brochure
Med brochure
Julia Tan
 

What's hot (19)

Schulz-Evaluation-Adjunct Faculty Annual Summary-153
Schulz-Evaluation-Adjunct Faculty Annual Summary-153Schulz-Evaluation-Adjunct Faculty Annual Summary-153
Schulz-Evaluation-Adjunct Faculty Annual Summary-153
 
Impact of Timing of Algebra on Future Mathematics Achievement
Impact of Timing of Algebra on Future Mathematics AchievementImpact of Timing of Algebra on Future Mathematics Achievement
Impact of Timing of Algebra on Future Mathematics Achievement
 
0 overview of our redesign
0   overview of our redesign0   overview of our redesign
0 overview of our redesign
 
Using Multiple Data Points to Identify Gifted and Highly Able Learners
Using Multiple Data Points to Identify Gifted and Highly Able LearnersUsing Multiple Data Points to Identify Gifted and Highly Able Learners
Using Multiple Data Points to Identify Gifted and Highly Able Learners
 
Phase I: Overview
Phase I: OverviewPhase I: Overview
Phase I: Overview
 
P T A Presentation
P T A  PresentationP T A  Presentation
P T A Presentation
 
Experiential Education Approaches in Nonprofit Management & Leadershi...
Experiential Education Approaches in   Nonprofit Management & Leadershi...Experiential Education Approaches in   Nonprofit Management & Leadershi...
Experiential Education Approaches in Nonprofit Management & Leadershi...
 
Assessment for learning part 2
Assessment for learning part 2Assessment for learning part 2
Assessment for learning part 2
 
Evaluation in swaziland schools
Evaluation in swaziland schoolsEvaluation in swaziland schools
Evaluation in swaziland schools
 
Types of assessments
Types of assessmentsTypes of assessments
Types of assessments
 
Assessments - Data Driven Instruction
Assessments - Data Driven InstructionAssessments - Data Driven Instruction
Assessments - Data Driven Instruction
 
Identifying processes of Classroom Assessment Morrow
Identifying processes of Classroom Assessment MorrowIdentifying processes of Classroom Assessment Morrow
Identifying processes of Classroom Assessment Morrow
 
Technological needs calling for the application of coaching in university adv...
Technological needs calling for the application of coaching in university adv...Technological needs calling for the application of coaching in university adv...
Technological needs calling for the application of coaching in university adv...
 
First results of the General Evaluation - SPICE project,
First results of the General Evaluation - SPICE project, First results of the General Evaluation - SPICE project,
First results of the General Evaluation - SPICE project,
 
Influence of the students’ learning strategy on the evaluation scores
Influence of the students’ learning strategy on the evaluation scoresInfluence of the students’ learning strategy on the evaluation scores
Influence of the students’ learning strategy on the evaluation scores
 
Standardized Information Literacy Assessment
Standardized Information Literacy AssessmentStandardized Information Literacy Assessment
Standardized Information Literacy Assessment
 
Overview of approach to instructional design
Overview of approach to instructional designOverview of approach to instructional design
Overview of approach to instructional design
 
Leader Anticipation
Leader  AnticipationLeader  Anticipation
Leader Anticipation
 
Med brochure
Med brochureMed brochure
Med brochure
 

Viewers also liked

Math-Bridge Installation
Math-Bridge InstallationMath-Bridge Installation
Math-Bridge Installation
metamath
 
Optimization Methods
Optimization MethodsOptimization Methods
Optimization Methods
metamath
 
Discrete Mathematics
Discrete MathematicsDiscrete Mathematics
Discrete Mathematics
metamath
 
Probability Theory and Mathematical Statistics in Tver State University
Probability Theory and Mathematical Statistics in Tver State UniversityProbability Theory and Mathematical Statistics in Tver State University
Probability Theory and Mathematical Statistics in Tver State University
metamath
 
A Course of Calculus for IT-Students
A Course of Calculus for IT-StudentsA Course of Calculus for IT-Students
A Course of Calculus for IT-Students
metamath
 
Probability Theory and Mathematical Statistics
Probability Theory and Mathematical StatisticsProbability Theory and Mathematical Statistics
Probability Theory and Mathematical Statistics
metamath
 
OMSU vs. EU comparative curricula study
OMSU vs. EU comparative curricula studyOMSU vs. EU comparative curricula study
OMSU vs. EU comparative curricula study
metamath
 
Math-Bridge Event Systems
Math-Bridge Event SystemsMath-Bridge Event Systems
Math-Bridge Event Systems
metamath
 
Math-Bridge Student Interface
Math-Bridge Student InterfaceMath-Bridge Student Interface
Math-Bridge Student Interface
metamath
 
Math-Bridge Additional Interactivity
Math-Bridge Additional InteractivityMath-Bridge Additional Interactivity
Math-Bridge Additional Interactivity
metamath
 
Math-Bridge Architecture
Math-Bridge ArchitectureMath-Bridge Architecture
Math-Bridge Architecture
metamath
 
Math-Bridge Exercise System
Math-Bridge Exercise SystemMath-Bridge Exercise System
Math-Bridge Exercise System
metamath
 
Math-Bridge Author AdvdEx
Math-Bridge Author AdvdExMath-Bridge Author AdvdEx
Math-Bridge Author AdvdEx
metamath
 
Math-Bridge Author Staticl-os
Math-Bridge Author Staticl-osMath-Bridge Author Staticl-os
Math-Bridge Author Staticl-os
metamath
 
Math-Bridge Content Collections
Math-Bridge Content CollectionsMath-Bridge Content Collections
Math-Bridge Content Collections
metamath
 
Math-Bridge Trouble shooting
Math-Bridge Trouble shootingMath-Bridge Trouble shooting
Math-Bridge Trouble shooting
metamath
 
Math-Bridge Author DREx
Math-Bridge Author DRExMath-Bridge Author DREx
Math-Bridge Author DREx
metamath
 
Assessment in Math-Bridge
Assessment in Math-BridgeAssessment in Math-Bridge
Assessment in Math-Bridge
metamath
 
Math-Bridge Teacher Tools
Math-Bridge Teacher ToolsMath-Bridge Teacher Tools
Math-Bridge Teacher Tools
metamath
 
Math-Birdge Author BasicEx
Math-Birdge Author BasicExMath-Birdge Author BasicEx
Math-Birdge Author BasicEx
metamath
 

Viewers also liked (20)

Math-Bridge Installation
Math-Bridge InstallationMath-Bridge Installation
Math-Bridge Installation
 
Optimization Methods
Optimization MethodsOptimization Methods
Optimization Methods
 
Discrete Mathematics
Discrete MathematicsDiscrete Mathematics
Discrete Mathematics
 
Probability Theory and Mathematical Statistics in Tver State University
Probability Theory and Mathematical Statistics in Tver State UniversityProbability Theory and Mathematical Statistics in Tver State University
Probability Theory and Mathematical Statistics in Tver State University
 
A Course of Calculus for IT-Students
A Course of Calculus for IT-StudentsA Course of Calculus for IT-Students
A Course of Calculus for IT-Students
 
Probability Theory and Mathematical Statistics
Probability Theory and Mathematical StatisticsProbability Theory and Mathematical Statistics
Probability Theory and Mathematical Statistics
 
OMSU vs. EU comparative curricula study
OMSU vs. EU comparative curricula studyOMSU vs. EU comparative curricula study
OMSU vs. EU comparative curricula study
 
Math-Bridge Event Systems
Math-Bridge Event SystemsMath-Bridge Event Systems
Math-Bridge Event Systems
 
Math-Bridge Student Interface
Math-Bridge Student InterfaceMath-Bridge Student Interface
Math-Bridge Student Interface
 
Math-Bridge Additional Interactivity
Math-Bridge Additional InteractivityMath-Bridge Additional Interactivity
Math-Bridge Additional Interactivity
 
Math-Bridge Architecture
Math-Bridge ArchitectureMath-Bridge Architecture
Math-Bridge Architecture
 
Math-Bridge Exercise System
Math-Bridge Exercise SystemMath-Bridge Exercise System
Math-Bridge Exercise System
 
Math-Bridge Author AdvdEx
Math-Bridge Author AdvdExMath-Bridge Author AdvdEx
Math-Bridge Author AdvdEx
 
Math-Bridge Author Staticl-os
Math-Bridge Author Staticl-osMath-Bridge Author Staticl-os
Math-Bridge Author Staticl-os
 
Math-Bridge Content Collections
Math-Bridge Content CollectionsMath-Bridge Content Collections
Math-Bridge Content Collections
 
Math-Bridge Trouble shooting
Math-Bridge Trouble shootingMath-Bridge Trouble shooting
Math-Bridge Trouble shooting
 
Math-Bridge Author DREx
Math-Bridge Author DRExMath-Bridge Author DREx
Math-Bridge Author DREx
 
Assessment in Math-Bridge
Assessment in Math-BridgeAssessment in Math-Bridge
Assessment in Math-Bridge
 
Math-Bridge Teacher Tools
Math-Bridge Teacher ToolsMath-Bridge Teacher Tools
Math-Bridge Teacher Tools
 
Math-Birdge Author BasicEx
Math-Birdge Author BasicExMath-Birdge Author BasicEx
Math-Birdge Author BasicEx
 

Similar to MetaMath: Evaluation Methodology

Evaluation Methodology
Evaluation MethodologyEvaluation Methodology
Evaluation Methodology
mathgear
 
High School Guidance Presentation - 06/23/15
High School Guidance Presentation - 06/23/15High School Guidance Presentation - 06/23/15
High School Guidance Presentation - 06/23/15
Franklin Matters
 
Engaging learners in computer-based summative exams: Reflections on a partici...
Engaging learners in computer-based summative exams: Reflections on a partici...Engaging learners in computer-based summative exams: Reflections on a partici...
Engaging learners in computer-based summative exams: Reflections on a partici...
RichardM_Walker
 
Assessment in Higher Education
Assessment in Higher EducationAssessment in Higher Education
Assessment in Higher Education
NewportCELT
 
Learning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
Learning about Assessment Literacy - Nicky Spawls and Clare O'DonoghueLearning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
Learning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
mdxaltc
 
Assessment and Rubrics
Assessment and RubricsAssessment and Rubrics
Assessment and Rubrics
SERC at Carleton College
 
The Application of Game-Like Learning Design to Real-World Settings: a Holist...
The Application of Game-Like Learning Design to Real-World Settings: a Holist...The Application of Game-Like Learning Design to Real-World Settings: a Holist...
The Application of Game-Like Learning Design to Real-World Settings: a Holist...
Benita Rowe
 
Awl
AwlAwl
Unit 1 jcs math foundations
Unit 1 jcs math foundationsUnit 1 jcs math foundations
Unit 1 jcs math foundations
jcsmathfoundations
 
Group1 Assessment
Group1 AssessmentGroup1 Assessment
Group1 Assessment
Azhar Alramadan
 
Assessment dr. asmma'
Assessment  dr. asmma'Assessment  dr. asmma'
Assessment dr. asmma'
Walaa Abdelnaby
 
EVALUATION AND ASSESSEMENT IN ESP
EVALUATION AND ASSESSEMENT IN ESPEVALUATION AND ASSESSEMENT IN ESP
EVALUATION AND ASSESSEMENT IN ESP
steadyfalcon
 
ePortfolio 2009 London
ePortfolio 2009 LondonePortfolio 2009 London
ePortfolio 2009 London
Pädagogische Hochschule St.Gallen
 
Using Assessment Data for Educator and Student Growth
Using Assessment Data for Educator and Student GrowthUsing Assessment Data for Educator and Student Growth
Using Assessment Data for Educator and Student Growth
NWEA
 
Required Online Orientation: A Predictor of Success?
Required Online Orientation:  A Predictor of Success?Required Online Orientation:  A Predictor of Success?
Required Online Orientation: A Predictor of Success?
ldefelice
 
Cz la eds-jun-21_v3
Cz la eds-jun-21_v3Cz la eds-jun-21_v3
Cz la eds-jun-21_v3
Catherine Zhao
 
Assessment without levels - Feedback Group
Assessment without levels - Feedback GroupAssessment without levels - Feedback Group
Assessment without levels - Feedback Group
Chris Hildrew
 
Technology-Enhanced-Assessment-for-Learning.pptx
Technology-Enhanced-Assessment-for-Learning.pptxTechnology-Enhanced-Assessment-for-Learning.pptx
Technology-Enhanced-Assessment-for-Learning.pptx
FroilanAlexCuevas1
 
Increasing STEM Mobility through Study Abroad in Europe: Engineering, Archite...
Increasing STEM Mobility through Study Abroad in Europe: Engineering, Archite...Increasing STEM Mobility through Study Abroad in Europe: Engineering, Archite...
Increasing STEM Mobility through Study Abroad in Europe: Engineering, Archite...
CIEE
 
Designing digital badges for a college course
Designing digital badges for a college courseDesigning digital badges for a college course
Designing digital badges for a college course
Vanessa Dennen
 

Similar to MetaMath: Evaluation Methodology (20)

Evaluation Methodology
Evaluation MethodologyEvaluation Methodology
Evaluation Methodology
 
High School Guidance Presentation - 06/23/15
High School Guidance Presentation - 06/23/15High School Guidance Presentation - 06/23/15
High School Guidance Presentation - 06/23/15
 
Engaging learners in computer-based summative exams: Reflections on a partici...
Engaging learners in computer-based summative exams: Reflections on a partici...Engaging learners in computer-based summative exams: Reflections on a partici...
Engaging learners in computer-based summative exams: Reflections on a partici...
 
Assessment in Higher Education
Assessment in Higher EducationAssessment in Higher Education
Assessment in Higher Education
 
Learning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
Learning about Assessment Literacy - Nicky Spawls and Clare O'DonoghueLearning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
Learning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
 
Assessment and Rubrics
Assessment and RubricsAssessment and Rubrics
Assessment and Rubrics
 
The Application of Game-Like Learning Design to Real-World Settings: a Holist...
The Application of Game-Like Learning Design to Real-World Settings: a Holist...The Application of Game-Like Learning Design to Real-World Settings: a Holist...
The Application of Game-Like Learning Design to Real-World Settings: a Holist...
 
Awl
AwlAwl
Awl
 
Unit 1 jcs math foundations
Unit 1 jcs math foundationsUnit 1 jcs math foundations
Unit 1 jcs math foundations
 
Group1 Assessment
Group1 AssessmentGroup1 Assessment
Group1 Assessment
 
Assessment dr. asmma'
Assessment  dr. asmma'Assessment  dr. asmma'
Assessment dr. asmma'
 
EVALUATION AND ASSESSEMENT IN ESP
EVALUATION AND ASSESSEMENT IN ESPEVALUATION AND ASSESSEMENT IN ESP
EVALUATION AND ASSESSEMENT IN ESP
 
ePortfolio 2009 London
ePortfolio 2009 LondonePortfolio 2009 London
ePortfolio 2009 London
 
Using Assessment Data for Educator and Student Growth
Using Assessment Data for Educator and Student GrowthUsing Assessment Data for Educator and Student Growth
Using Assessment Data for Educator and Student Growth
 
Required Online Orientation: A Predictor of Success?
Required Online Orientation:  A Predictor of Success?Required Online Orientation:  A Predictor of Success?
Required Online Orientation: A Predictor of Success?
 
Cz la eds-jun-21_v3
Cz la eds-jun-21_v3Cz la eds-jun-21_v3
Cz la eds-jun-21_v3
 
Assessment without levels - Feedback Group
Assessment without levels - Feedback GroupAssessment without levels - Feedback Group
Assessment without levels - Feedback Group
 
Technology-Enhanced-Assessment-for-Learning.pptx
Technology-Enhanced-Assessment-for-Learning.pptxTechnology-Enhanced-Assessment-for-Learning.pptx
Technology-Enhanced-Assessment-for-Learning.pptx
 
Increasing STEM Mobility through Study Abroad in Europe: Engineering, Archite...
Increasing STEM Mobility through Study Abroad in Europe: Engineering, Archite...Increasing STEM Mobility through Study Abroad in Europe: Engineering, Archite...
Increasing STEM Mobility through Study Abroad in Europe: Engineering, Archite...
 
Designing digital badges for a college course
Designing digital badges for a college courseDesigning digital badges for a college course
Designing digital badges for a college course
 

More from metamath

Course - Discrete Mathematics
Course - Discrete MathematicsCourse - Discrete Mathematics
Course - Discrete Mathematics
metamath
 
SEFI comparative study: Course - Algebra and Geometry
SEFI comparative study: Course - Algebra and GeometrySEFI comparative study: Course - Algebra and Geometry
SEFI comparative study: Course - Algebra and Geometry
metamath
 
о лаб мод и упр 2014
о лаб мод и упр 2014о лаб мод и упр 2014
о лаб мод и упр 2014
metamath
 
Mathematical foundations of fuzzy systems
Mathematical foundations of fuzzy systemsMathematical foundations of fuzzy systems
Mathematical foundations of fuzzy systems
metamath
 
Probability Theory and Mathematical Statistics in Tver State University
Probability Theory and Mathematical Statistics in Tver State UniversityProbability Theory and Mathematical Statistics in Tver State University
Probability Theory and Mathematical Statistics in Tver State University
metamath
 
Calculus - St. Petersburg Electrotechnical University "LETI"
Calculus - St. Petersburg Electrotechnical University "LETI"Calculus - St. Petersburg Electrotechnical University "LETI"
Calculus - St. Petersburg Electrotechnical University "LETI"
metamath
 
Discrete Mathematics
Discrete MathematicsDiscrete Mathematics
Discrete Mathematics
metamath
 
стратегия развития книту каи
стратегия развития книту каистратегия развития книту каи
стратегия развития книту каи
metamath
 
Probability Theory and Mathematical Statistics
Probability Theory and Mathematical StatisticsProbability Theory and Mathematical Statistics
Probability Theory and Mathematical Statistics
metamath
 
Optimization Methods
Optimization MethodsOptimization Methods
Optimization Methods
metamath
 
Math Education for STEM disciplines in the EU
Math Education for STEM disciplines in the EUMath Education for STEM disciplines in the EU
Math Education for STEM disciplines in the EU
metamath
 
International Activities of the University in academic field
International Activities of the University in academic fieldInternational Activities of the University in academic field
International Activities of the University in academic field
metamath
 
How to design a miniature train set that always loops back well? Two question...
How to design a miniature train set that always loops back well? Two question...How to design a miniature train set that always loops back well? Two question...
How to design a miniature train set that always loops back well? Two question...
metamath
 
UNN - Mr. Shvetsov
UNN - Mr. ShvetsovUNN - Mr. Shvetsov
UNN - Mr. Shvetsov
metamath
 
UNN - Mr. Kuzenkov
UNN - Mr. KuzenkovUNN - Mr. Kuzenkov
UNN - Mr. Kuzenkov
metamath
 
UNN - Mr. Fedosin
UNN - Mr. FedosinUNN - Mr. Fedosin
UNN - Mr. Fedosin
metamath
 
TSU
TSUTSU
OMSU - Mr. Syromiasov
OMSU - Mr. SyromiasovOMSU - Mr. Syromiasov
OMSU - Mr. Syromiasov
metamath
 
OMSU - Mr. Chuchaev
OMSU - Mr. ChuchaevOMSU - Mr. Chuchaev
OMSU - Mr. Chuchaev
metamath
 
LETI - Mr. Posov
LETI - Mr. PosovLETI - Mr. Posov
LETI - Mr. Posov
metamath
 

More from metamath (20)

Course - Discrete Mathematics
Course - Discrete MathematicsCourse - Discrete Mathematics
Course - Discrete Mathematics
 
SEFI comparative study: Course - Algebra and Geometry
SEFI comparative study: Course - Algebra and GeometrySEFI comparative study: Course - Algebra and Geometry
SEFI comparative study: Course - Algebra and Geometry
 
о лаб мод и упр 2014
о лаб мод и упр 2014о лаб мод и упр 2014
о лаб мод и упр 2014
 
Mathematical foundations of fuzzy systems
Mathematical foundations of fuzzy systemsMathematical foundations of fuzzy systems
Mathematical foundations of fuzzy systems
 
Probability Theory and Mathematical Statistics in Tver State University
Probability Theory and Mathematical Statistics in Tver State UniversityProbability Theory and Mathematical Statistics in Tver State University
Probability Theory and Mathematical Statistics in Tver State University
 
Calculus - St. Petersburg Electrotechnical University "LETI"
Calculus - St. Petersburg Electrotechnical University "LETI"Calculus - St. Petersburg Electrotechnical University "LETI"
Calculus - St. Petersburg Electrotechnical University "LETI"
 
Discrete Mathematics
Discrete MathematicsDiscrete Mathematics
Discrete Mathematics
 
стратегия развития книту каи
стратегия развития книту каистратегия развития книту каи
стратегия развития книту каи
 
Probability Theory and Mathematical Statistics
Probability Theory and Mathematical StatisticsProbability Theory and Mathematical Statistics
Probability Theory and Mathematical Statistics
 
Optimization Methods
Optimization MethodsOptimization Methods
Optimization Methods
 
Math Education for STEM disciplines in the EU
Math Education for STEM disciplines in the EUMath Education for STEM disciplines in the EU
Math Education for STEM disciplines in the EU
 
International Activities of the University in academic field
International Activities of the University in academic fieldInternational Activities of the University in academic field
International Activities of the University in academic field
 
How to design a miniature train set that always loops back well? Two question...
How to design a miniature train set that always loops back well? Two question...How to design a miniature train set that always loops back well? Two question...
How to design a miniature train set that always loops back well? Two question...
 
UNN - Mr. Shvetsov
UNN - Mr. ShvetsovUNN - Mr. Shvetsov
UNN - Mr. Shvetsov
 
UNN - Mr. Kuzenkov
UNN - Mr. KuzenkovUNN - Mr. Kuzenkov
UNN - Mr. Kuzenkov
 
UNN - Mr. Fedosin
UNN - Mr. FedosinUNN - Mr. Fedosin
UNN - Mr. Fedosin
 
TSU
TSUTSU
TSU
 
OMSU - Mr. Syromiasov
OMSU - Mr. SyromiasovOMSU - Mr. Syromiasov
OMSU - Mr. Syromiasov
 
OMSU - Mr. Chuchaev
OMSU - Mr. ChuchaevOMSU - Mr. Chuchaev
OMSU - Mr. Chuchaev
 
LETI - Mr. Posov
LETI - Mr. PosovLETI - Mr. Posov
LETI - Mr. Posov
 

Recently uploaded

LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UPLAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
RAHUL
 
Bed Making ( Introduction, Purpose, Types, Articles, Scientific principles, N...
Bed Making ( Introduction, Purpose, Types, Articles, Scientific principles, N...Bed Making ( Introduction, Purpose, Types, Articles, Scientific principles, N...
Bed Making ( Introduction, Purpose, Types, Articles, Scientific principles, N...
Leena Ghag-Sakpal
 
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
GeorgeMilliken2
 
Main Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docxMain Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docx
adhitya5119
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
Nicholas Montgomery
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
TechSoup
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
Nguyen Thanh Tu Collection
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Fajar Baskoro
 
IGCSE Biology Chapter 14- Reproduction in Plants.pdf
IGCSE Biology Chapter 14- Reproduction in Plants.pdfIGCSE Biology Chapter 14- Reproduction in Plants.pdf
IGCSE Biology Chapter 14- Reproduction in Plants.pdf
Amin Marwan
 
BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
Katrina Pritchard
 
clinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdfclinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdf
Priyankaranawat4
 
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) CurriculumPhilippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
MJDuyan
 
Wound healing PPT
Wound healing PPTWound healing PPT
Wound healing PPT
Jyoti Chand
 
The basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptxThe basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptx
heathfieldcps1
 
Chapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptxChapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptx
Denish Jangid
 
math operations ued in python and all used
math operations ued in python and all usedmath operations ued in python and all used
math operations ued in python and all used
ssuser13ffe4
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
Nicholas Montgomery
 
UGC NET Exam Paper 1- Unit 1:Teaching Aptitude
UGC NET Exam Paper 1- Unit 1:Teaching AptitudeUGC NET Exam Paper 1- Unit 1:Teaching Aptitude
UGC NET Exam Paper 1- Unit 1:Teaching Aptitude
S. Raj Kumar
 
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem studentsRHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
Himanshu Rai
 
Walmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdfWalmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdf
TechSoup
 

Recently uploaded (20)

LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UPLAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
 
Bed Making ( Introduction, Purpose, Types, Articles, Scientific principles, N...
Bed Making ( Introduction, Purpose, Types, Articles, Scientific principles, N...Bed Making ( Introduction, Purpose, Types, Articles, Scientific principles, N...
Bed Making ( Introduction, Purpose, Types, Articles, Scientific principles, N...
 
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
 
Main Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docxMain Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docx
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
 
IGCSE Biology Chapter 14- Reproduction in Plants.pdf
IGCSE Biology Chapter 14- Reproduction in Plants.pdfIGCSE Biology Chapter 14- Reproduction in Plants.pdf
IGCSE Biology Chapter 14- Reproduction in Plants.pdf
 
BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
 
clinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdfclinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdf
 
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) CurriculumPhilippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
 
Wound healing PPT
Wound healing PPTWound healing PPT
Wound healing PPT
 
The basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptxThe basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptx
 
Chapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptxChapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptx
 
math operations ued in python and all used
math operations ued in python and all usedmath operations ued in python and all used
math operations ued in python and all used
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
 
UGC NET Exam Paper 1- Unit 1:Teaching Aptitude
UGC NET Exam Paper 1- Unit 1:Teaching AptitudeUGC NET Exam Paper 1- Unit 1:Teaching Aptitude
UGC NET Exam Paper 1- Unit 1:Teaching Aptitude
 
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem studentsRHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
 
Walmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdfWalmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdf
 

MetaMath: Evaluation Methodology

  • 1. Sergey Sosnovsky, Saarland University / DFKI MetaMath: Evaluation Methodology Tampere, 19-21/01/2015
  • 2. Evaluation Goal ❖ Implement large scale evaluation trials of the reformed courses to demonstrate that the reformed courses bring educational value ❖ Improved grades (higher average grade, lower percentage of students failing the course,…) ❖ Higher knowledge gain (on average, for underachieving students, for female students, for CS students…) ❖ Lower drop-out rates (how to measure?) ❖ Increased motivation, improved attitude toward learning mathematics ❖ Positive evaluation by students (some students… of some features) Which of these parameters should we collect? All of them
  • 3. Overall experiment design ❖ Longitudinal study ❖ Two groups: Group1 (controlled) and Group2(experimental) ❖ Each group is observed for one semester ❖ Group1 - in 2015, Group2 - in 2016 ❖ Group1 is taught with the old version of the course ❖ Group2 is taught with the new version of the course ❖ Main challenge: inter-group differences as uncontrolled factors that would influence the results
  • 5. Pre /post-tests ❖ SEFI competencies should be framework for developing tests questions. ❖ Isomorphism of questions can be achieved by using different numerical values (avoid complex calculations that would increase the complexity without influencing difficulty) ❖ Test must assess both the target competencies and prerequisite competencies
 Issues: - electronic or paper? - when to organise? - how long? - what is the nature of questions? - … then they will be graded
  • 6. Pre-questionnaire ❖ Demographics ❖ Gender ❖ Major/speciality ❖ Background ❖ experience with e-Learning ❖ lifetime Math experience ❖ Motivation ❖ Interest in math ❖ Fear of failure ❖ Extrinsic valut ❖ Expectations from the course (amount of learning, need for future studies/ career personal grade prediction) Challenge: - cannot be anonymises Issues: - electronic or paper? - when to organise?
  • 7. Post-questionnaire ❖ Motivation ❖ Interest in math ❖ Fear of failure ❖ Extrinsic valut ❖ How expectations from the course have been met ❖ Which aspect of the course they like/ did not like ❖ …standard course evaluation forms ❖ (during the 2nd semester): Math-Bridge-related questionnaire Challenge: - ensure that students fill it in Issues: - electronic or paper? - when to organise?