WP4a Quantitative Evaluation

1. Evalua&on Results
CHRISTIAN MERCAT – UCBL - FRANCE
PEDRO LEALDINO FILHO – UCBL - FRANCE

2. Evalua&on Goal
Implement large scale evalua0on trials of the reformed
courses to demonstrate that the reformed courses bring
educa0onal value.

3. Experimental Design
Longitudinal study
Two Groups
Each group is observed for one semester
G1 - old version of the course
G2 - new version of the course
Main challenge: inter-group differences as uncontrolled factors that would influence the results.

4. Experimental Design

5. Results
On the next session we present the results of some of the large scale
evalua0on of modernized courses from Russian universi0es.

6. Tver State University (TSU)
FUZZY LOGIC
-20
0
20
40
60
80
100
Linear
func0ons
Plots Regions min & max L-R type α-level sets Possibilis0c
op0miza0on
#1
Possibilis0c
op0miza0on
#1
Knowledge Gain 2014-2015
Pre-test Knowledge Gain
0
20
40
60
80
100
Linear
func0ons
Plots Regions min & max L-R type α-level sets Possibilis0c
op0miza0on
#1
Possibilis0c
op0miza0on
#1
The results of the pre and post tests 2014-2015
Pre-test Post-test
-20
0
20
40
60
Linear
func0ons
Plots Regions min & max L-R type α-level sets Possibilis0c
op0miza0on
#1
Possibilis0c
op0miza0on
#1
Knowledge Gain 2014-2015

7. Tver State University (TSU)
PROBABILITY THEORY
0
5
10
15
20
25
Combinatorics classical
defini0on of
probability
Sets theory probability,
total
probability
formula
series elementary
func0ons and
their graphs
figures set of points
on the plane
Knowledge Gain 2014-2015
Pre-test Knowledge Gain
0
5
10
15
20
25
The results of the pre and post tests 2014-2015
Pre-test Post-test
0
2
4
6
8
10
12
14
Combinatorics classical defini0on
of probability
Sets theory probability, total
probability
formula
series elementary
func0ons and
their graphs
figures set of points on
the plane
Knowledge Gain 2014-2015

8. Tver State University (TSU)
PROBABILITY THEORY
0
5
10
15
20
25
Combinatorics classical
defini0on of
probability
Sets theory probability,
total
probability
formula
series elementary
func0ons and
their graphs
figures set of points
on the plane
Knowledge Gain 2014-2015
Pre-test Knowledge Gain
0
5
10
15
20
25
The results of the pre and post tests 2014-2015
Pre-test Post-test
0
2
4
6
8
10
12
14
Combinatorics classical defini0on
of probability
Sets theory probability, total
probability
formula
series elementary
func0ons and
their graphs
figures set of points on
the plane
Knowledge Gain 2014-2015

9. Nizhny Novgorod State University (NNSU)
Analysis
Analysis
Before Moderniza0on group B A^er Moderniza0on group A
pre-test post-test pre-test post-test
Sample 57% ∓ 13 69% ∓ 13 72% ∓ 17 84 ∓ 13
Sample Before: 35
Sample A^er: 17

10. Nizhny Novgorod State University (NNSU)
Modelling
Math Model
Before Moderniza0on group B A^er Moderniza0on group A
pre-test post-test pre-test post-test
Sample 72% ∓ 21 67% ∓ 18 69% ∓ 18 78 ∓ 6
Sample Before: 23
Sample A^er : 13

11. Kazan Na&onal Research Technical University (KNRTU-KAI)
Probability and Mathema0cal Sta0s0cs

12. Kazan Na&onal Research Technical University
(KNRTU-KAI)
Op0miza0on Methods
Sample: 10
Op0miza0on Methods
Before Moderniza0on A^er Moderniza0on
pre-test post-test pre-test post-test
Sample 68 ∓ 16.6 x x 86 ∓ 13.19

13. Kazan Na&onal Research Technical University (KNRTU-KAI)
Probability and Mathema0cal Sta0s0cs
Probability and Mathema0cal Sta0s0cs
Before Moderniza0on A^er Moderniza0on
pre-test post-test pre-test post-test
Group 1 14 ∓ 3.74 36 ∓ 6.81 24 ∓ 4.09 43 ∓ 6.26
Group 2 13 ∓ 8.98 33 ∓ 9.18 21 ∓ 12.30 43 ∓ 7.79
Group 3 10 ∓ 8,80 34 ∓ 7.10 22 ∓ 11.22 42 ∓ 6.95
General 12 ∓ 7.92 34 ∓ 7.77 22 ∓ 10.12 43 ∓ 7.52

14. Saint-Petersburg Electrotechnical University (LETI)
Analysis, differen0al equa0ons Logics

15. Saint-Petersburg Electrotechnical University (LETI)
Calculus

16. Ogarev Mordovia State University (OMSU)
Algebra and Geometry
Before Moderniza0on A^er Moderniza0on
pre-test post-test pre-test post-test
Sample 7.2 ∓ 4.08 6.83 ∓ 3.75 x x

17. Ogarev Mordovia State University (OMSU)
Discrete Mathema0cs
Before Moderniza0on A^er Moderniza0on
pre-test post-test pre-test post-test
Sample 8.03 ∓ 4.34 12.03 ∓ 7.06 x x

18. Thank you, Большое спасибо
SPECIAL THANKS FOR ALL THE NICE WORK DONE TOGETHER AND
THE POLISHED DATA THAT YOU PRODUCED SO FAST J !