Micro-Scholarship, What it is, How can it help me.pdf
A strategy to reduce the blank answers on math tests at first engineering courses
1. A strategy to reduce the
blank answers on math
tests at first engineering
courses
Susana Nieto (1,2) sni@usal.es
Higinio Ramos (1) higra@usal.es
(1) Applied Mathematics Department
(2) Institute of Educational Sciences
UNIVERSITY OF SALAMANCA
2. Context
Engineering students at the
Polytechnic School of
Zamora (University of
Salamanca).
Math subjects at the first
courses.
2
S. Nieto, H. Ramos, 2016
3. Context
Students having special difficulties
handling math subjects:
◦ Increasing group of students from Vocational
Training Modules.
◦ Poor basic knowledge about mathematics
even in students from scientific or technical
Bachelors.
◦ Not only in Spain [1-2, 6-7], similar situation in
other European countries [3-5]
3S. Nieto, H. Ramos, 2016
4. Context
Persistence along time of these
deficiencies.
Poor mathematical skills + low level of
confidence about their capability of
passing mathematical subjects = “vicious
circle”.
4S. Nieto, H. Ramos, 2016
Bad experiences
in examinations
Poor mathematical
performance
Low level of
self-confidence
5. Context
It generates a increasing group of
repeating students (1)= high dropping
rate.
5S. Nieto, H. Ramos, 2016
CALCULUS (Mechanical Engineering) 2015-2016
Students who have not taken any call
for midterms or final exams 10,9%
Students who have not taken
the final exam 27,2%
Students who have not taken
the second-chance examination 31,5%
6. Context
It generates a increasing group of
repeating students (II)= bad results at
examinations
6S. Nieto, H. Ramos, 2016
CALCULUS (Mechanical Engineering) 2015-2016
Students who passed
the mid-term exams 18,2%
Students who passed
the final exam 30,9%
Students who passed
the second-chance examination 5,2%
7. Context
In our experience, a big amount of
questions at the written examinations of
mathematics remain unanswered
Maximum 7 over 10.
7S. Nieto, H. Ramos, 2016
CALCULUS (Mechanical Engineering) 2015-2016
Average of blank answers
on the final exam 3,68
Average of blank answers
on the second-chance exam 3,33
8. Context
Diagnosis:
◦ Bad results at examinations come from
the students’ bad performance , but also
from the big number of blank questions.
◦ Students tend to abandon the execution
of mathematical procedures at early
stages, when they find (minor)
difficulties of calculus.
8S. Nieto, H. Ramos, 2016
9. Context
Why happens?:
◦ Students usually perform a “visual”
study of mathematical subjects.
◦ Short time dedicated to solve “pen-and-
paper” exercises by themselves.
9S. Nieto, H. Ramos, 2016
10. Objectives
Avoid the (common) mistake of
studying mathematics by simply
reading exercises solved by the
teacher.
Help students to face autonomously
the main mathematical procedures.
10S. Nieto, H. Ramos, 2016
12. Objectives
Expected consequences:
◦ Improvement of students' abilities in
mathematics,
◦ Improvement of the results in
written examinations,
◦ Decrease of the high drop-out rate,
◦ Decrease of the number of blank
questions in written examinations.
12S. Nieto, H. Ramos, 2016
13. Description of the project
Students of Calculus at the first course
(2015-2016) of Mechanical Engineering at
the Polytechnic School of Zamora.
Criterion for the selection of students: to
have faced the examinations of the
subject in three or more occasions.
13S. Nieto, H. Ramos, 2016
14. Description of the project
Students who have accumulated a
set of experiences of failure in
examinations:
◦ They are susceptible of abandon the
proposed mathematical tasks at early
stages.
◦ They can have doubts about their own
ability to have success at the written
tests.
14S. Nieto, H. Ramos, 2016
15. Description of the project
Both groups have access to the general
material of the subject via STUDIUM (the
virtual campus of the University of
Salamanca, based in Moodle).
15S. Nieto, H. Ramos, 2016
16. Description of the project
The project group have also access
to additional material specifically
developed, and they have followed
an extra classroom hour each week.
During this extra classroom hour,
they work individually under the
supervision and monitoring of the
teacher.
16S. Nieto, H. Ramos, 2016
17. Description of the project
The extra hour includes: realization
of problems, consultation of doubts
about procedures or algorithms,
debate, etc., always in an active way
and encouraging the autonomous
work of the students (with the helping
of the teacher when needed).
The material to solve is selected from
previous written examinations.
17S. Nieto, H. Ramos, 2016
18. Description of the project
The selection of these material is
important, because are exercises
that these students have not been
capable to solve in previous
occasions.
They are selected to provide success
experiences and to change students’
opinions about their own capabilities.
18S. Nieto, H. Ramos, 2016
19. Results
Analysis of the main results:
◦ Drop-out rate during the course 2015-2016.
◦ Results obtained in the assessment test (mid-
term, final and second chance examinations).
◦ Blank questions.
Other results of interest:
◦ Average scores.
◦ Average scores and standard deviation of the
failed exams.
19S. Nieto, H. Ramos, 2016
20. Results
Dropping rate:
20S. Nieto, H. Ramos, 2016
CALCULUS (2015-2016) Control
Project
Group
Students who have not taken
any call for midterms or final
exams
10,9% 2,7%
Students who have not taken
the final exam 27,2% 16,2%
Students who have not taken
the second-chance examination 31,5% 26,9%
21. Results
Dropping rate:
◦ The majority of the students of the project
group (97,3% vs. 89,1%) have faced any of
the examinations along the course. This
results show the increase of these students’
self-confidence. 21S. Nieto, H. Ramos, 2016
CALCULUS (2015-2016) Control
Project
Group
Students who have not taken
any call for midterms or final
exams
10,9% 2,7%
22. Results
Dropping rate:
◦ The project group also has a better behavior
facing the final exam (83,8% vs. 72,8%),
which also indicates their intention of facing
the tests.
22S. Nieto, H. Ramos, 2016
CALCULUS (2015-2016) Control
Project
Group
Students who have not taken
the final exam 27,2% 16,2%
23. Results
Dropping rate:
◦ Results about the second-chance
examination are better in the project group,
even taking into account exams from other
courses (73,1% vs. 68,5%).
23S. Nieto, H. Ramos, 2016
CALCULUS (2015-2016) Control
Project
Group
Students who have not taken
the second-chance examination 31,5% 26,9%
24. Results
Results in the assessment tests:
24S. Nieto, H. Ramos, 2016
CALCULUS (2015-2016) Control
Project
Group
Students who passed
the mid-term exams 18,2% 10,8%
Students who passed
the final exam 30,9% 29,7%
Students who passed
the second-chance examination 5,2% 7,6%
25. Results
Results in the examinations:
◦ The results during the mid-term exams are
worse for the project group, probably
because they needed some time-lapse to
improve their mathematical skills and to
acquire self-confidence.
25S. Nieto, H. Ramos, 2016
CALCULUS (2015-2016) Control
Project
Group
Students who passed
the mid-term exams 18,2% 10,8%
26. Results
Results in the assessment tests:
◦ The results in the final exam are comparable
to those from the control group, which is a
great success for students who have failed
three or more times that kind of examination.
26S. Nieto, H. Ramos, 2016
CALCULUS (2015-2016) Control
Project
Group
Students who passed
the final exam 30,9% 29,7%
27. Results
Results in the assessment tests:
◦ Results for the second-chance examination
are better for the experimental group,
probably due to the superposition of
examinations from other courses: these
students have tried to use all the opportunities
to pass the subject.
27S. Nieto, H. Ramos, 2016
CALCULUS (2015-2016) Control
Project
Group
Students who passed
the second-chance examination 5,2% 7,6%
28. Results
Results in the assessment tests:
28S. Nieto, H. Ramos, 2016
10.8%
29.7%
7.6%
18.2%
30.9%
5.2%0%
10%
20%
30%
40%
mid-term exams final exam second-chance
exam
Project Group Control
29. Results
Blank answers
◦ Much better performance in the experimental
group. Statistically significant (p<0.01).
29S. Nieto, H. Ramos, 2016
CALCULUS (2015-2016) Control
Project
Group
Average of blank answers
on the final exam 3,68 1,47
Average of blank answers
on the second-chance exam 3,33 1,31
30. Results
Blank answers
◦ The students of the project group tried to
solve a bigger amount of questions than the
control.
30S. Nieto, H. Ramos, 2016
CALCULUS (2015-2016) Control
Project
Group
Maximum of blank answers
on the final exam (over 10) 7 4
Number of examinations reaching
the minimum 4 1
31. Results
Other Results: average scores
◦ The project group shows a slight better
result in the final exam, and improves the
result of the control in the second-chance
exam.
31S. Nieto, H. Ramos, 2016
CALCULUS (2015-2016) Control
Project
Group
Average scores in the final exam 3,06 3,61
Average scores in the second-
chance exam
2,61 3,25
32. Results
Other Results: failed exams
◦ The students in the project group obtain better
scores even in failed exams.
◦ The standard deviation is much inferior, so their
behavior is more homogeneous.
32S. Nieto, H. Ramos, 2016
CALCULUS (2015-2016) Control
Project
Group
Average scores of failed
examinations
2,14 2,78
Standard deviation of the scores
of failed examinations
1,35 0,58
33. Conclusions
The students from the project group:
◦ They try to solve a bigger amount of
questions in the written test and they leave (in
a statistically significant way) a smaller
number of problems unanswered than the
control.
◦ They follow a consistently increasing line of
academic results, being worse than the
control at mid-term exams, comparable at the
final exam and better when facing the second-
chance exam.
33S. Nieto, H. Ramos, 2016
34. Conclusions
The students from the project group:
◦ They show better average scores than the
control. This improvement in consistent (but
not statistically significant) and is shown in the
final exam and also in the second-chance
exam.
◦ They have better scores even in the failed
exams, and show less dispersion, and a more
homogeneous behavior.
◦ ¡Students with special difficulties in
mathematics!
34S. Nieto, H. Ramos, 2016
35. Conclusions
The students from the project group:
◦ They show a very active and participative
attitude in the extra classroom hour.
◦ They attend tutorials more frequently, which
shows their interest and their greater
involvement.
◦ Have an inferior drop-out rate than the
control, probably because they faced the
mathematical exams with better success’
perspectives and higher confidence on their
mathematical skills.
35S. Nieto, H. Ramos, 2016
36. A strategy to reduce the
blank answers on math
tests at first engineering
courses
Susana Nieto sni@usal.es
Higinio Ramos higra@usal.es
Thanks for your attention