2. Assessing students’ Achievement
الطلبة تحصيل تقييم
Various data can be used to support student
achievement
الطلبة تحصيل لدعم تستخدم أن يمكن مختلفة بيانات:
– MoE Test results والتعليم التربية وزارة امتحانات نتائج
– NEU Test results الوطنية االمتحانات نتائج
– TIMSS results ( Trends in Mathematics and Science
Study; international comparative tests carried out
every 4 years ) نتائجالتيمز
2
3. Assessing students’ Achievement
The review is looking at different aspects of achievement.
الطلبة إلنجاز مختلفة أوجه مالحظة:
– Students’ absolute attainment against the national cohort
–الوطنية االمتحانات في انجازهم مقابل المدرسية االمتحانات في الطلبة انجاز
– Students’ relative performance compared with their staring point ( ie.
how much progress)
–بداية نقطة مع مقارنة للطلبة النسبي األداء.
– Trends in student academic performance over time ( ie. rising, falling,
or static trends
–الزمن عبر للطلبة األكاديمية التوجهات(،الرسوب ،الترفيع)...
– Reviewers also judge students’ attainment by their performance in
observed lessons; and through a scrutiny of their written work
–التدقي خالل ومن الدروس مالحظة خالل من الطلبة إنجاز على يحكمون ًاأيض المراجعونق
كتاباتهم في.
3
14. NEU Test trends over time
Data need interpreting very carefully
• What do they tell us ?البيانات به تخبرنا الذي ما
• In all subjects and at all grades, except for English in Grade
9, there has been a decline in student performance over
time
•الصف باستثناء ،الممتحنة الصفوف ولجميع الموضوعات جميع في،التاسع
الزمن عبر الطلبة أداء في تراجع هناك.
• Important to view all raw data in context, note that the
2011 tests were taken by students during the period of
national instability
•أ مالحظة مع ،فيه تمت الذي السياق خالل البيانات جميع مراجعة المهم منن
العام في االمتحانات2011وطنية استقرار عدم حالة في أجريت.
14
16. A question of interpretation
Data need interpreting very carefully
Why are girls doing SO much better than boys in
TIMSS ? or are boys doing particularly badly?
امتحانات في الطالب أداء من أفضل الطالبات أداء لماذاالتيمز؟
What might these data indicate in terms of the
efficacy of government education reforms in
Bahrain and Jordan in respect of girls and boys?
يمكن الذي ماتشير أنهذه إليهإصن فعالينة حينف منن البياناتالحات
يتعلنننق فيمنننا واألردن البحنننرين فننني الحكنننومي التعلنننيمبنننالطالب
والطالبات.
16
17. Other sources of evidence
School reviewers will make their own assessments of
students’ achievement through :-
• lesson observations; الدروس مالحظات
• scrutiny of students’ written work and their projects
or classroom displays;
•تدقيقالمكتوبة الطلبة أعمالومشاريعهمأوالصف في عروضهموف
الدراسية.
• oral questioning of groups and individual students
•الجماعية أو الفردية الشفوية التساؤالت.
17
18. Discussion
How can you encourage the colleagues at your school
best to prepare a portfolio of evidence to present
reviewers with the best and most rounded picture of
students’ academic performance.
تشجيع يمكنك كيفإلعداد المدرسة في زمالءكاألدلة من مجموعةللمراج لتقديمهاعينمع
لألداء صورة أفضل اظهارللطلبة األكاديمي.
18
Editor's Notes
Recap on Session 2 and the need to complete the SEF as an assessed exercise for this course. Introduce the session with the notion that all the judgements on school review are supposed to be underpinned by objective evidence; the most significant pieces of evidence which the reviewers need to consider is how well the students are performing in examinations. The students performance will be judged primarily by their performance in MoE tests in the core subjects of Arabic & Islamic studies; Mathematics & Science; and English. However, additional data are now available from the NEU through their standardised testing in Grades 3,6,9 & 12; data are also available, in an international context from the TIMSS test results in 2004, 2007 and 2011.
Discuss with the group the difference between the MoE tests and the NEU tests and TIMSS; what is standardised testing? Why is it important ? what is its relevance to school review?
Reviewers are interested in two aspects of student achievement: their overall attainment; and their progress ( relative to their starting point)
There are three ways of looking at this:
1)how are the students at a school performing overall compared with other schools and with similar schools ( ie. absolute and relative performance overall )
2)how are the students performing relative to their starting point ( ie. what is their progress)
3) what are the trends over time ie. are overall success rates improving or declining?
Consider the NEU section in the QAAET Annual Report 2011 pages 35-46
( participants should have read this for their homework for Session 2 – NB. The annual report is presented in this resource pack in the English version, but there is an Arabic version available on the QAAET website)
All participants need to have their own hard or soft copy of this report.
Spend 15 minutes refreshing memories on this and coming to conclusions.
What are the main findings? ( Some Key features and graphs are available as Ppt slides)
Take participants through the interpretation of these performance graphs. This S shaped curve is a standard sigmoid curve for variation amongst any statistical sample. A flattening on the left of the X axis indicates depressed performance at the highest attainment levels. A shift of the whole curve along the X axis indicates an overall decline in standards.
Are participants able to produce evidence for their school which indicates how they are in line with; have exceeded; or are below the national trend line?
Any hard evidence which the school can produce is very valuable to the reviewers since it helps them to draw an accurate picture of the academic performance of the students at the school and this helps them to arrive at an accurate judgement for the school overall. Note that in all the review reports which you can read on the QAAET website there is a very strong correlation between a school’s overall effectiveness and the students’ attainment and progress; this, in turn, correlates strongly with the quality of teaching and the quality of leadership and management.
It will be helpful here to have a general discussion amongst all participants about the relationship between the MoE tests and the NEU tests and the relative reliability of each of these measures.
Participants need to understand that the reviewers in their school will also make judgements of students’ performance in the lessons which they observe. There is an expectation that the standards which reviewers witness in the classroom should be a reflection of the standards which students attain in the MoE tests.
A brief diversion into TIMSS; just by way of information. School-level data is seldom released but it is made available to the MoE; it may be helpful for schools to have access to their TIMSS data to make a case to the reviewers
Note the interpretation of the TIMSS data in Wiseman’s paper ( slide #15). What does this tell us. Are girls doing SO much better than boys in TIMSS ? or are boys doing particularly badly ? what does these data indicate in terms of the efficacy of government education reforms in Bahrain and Jordan in respect of girls and boys?
Consider reviewers’ other sources of information which they may use in arriving at a judgement about students’ attainment and progress. – the scrutiny of students workbooks and the standards that they see students achieving in lessons ( remind participants that every lesson observation evidence form requires the reviewer to make a judgement about students’ attainment and progress – note that in a great number of school reports that reviewers note their judgements of students performance in observed lessons to be below the achievements in the MoE tests)Any hard evidence which the school can produce is very valuable to the reviewers since it helps them to draw an accurate picture of the academic performance of the students at the school and this helps them to arrive at an accurate judgement for the school overall. Note that in all the review reports which you can read on the QAAET website there is a very strong correlation between a school’s overall effectiveness and the students’ attainment and progress; this, in turn, correlates strongly with the quality of teaching and the quality of leadership and management.
It will be helpful here to have a general discussion amongst all participants about the relationship between the MoE tests and the NEU tests and the relative reliability of each of these measures.
Participants need to understand that the reviewers in their school will also make judgements of students’ performance in the lessons which they observe. There is an expectation that the standards which reviewers witness in the classroom should be a reflection of the standards which students attain in the MoE tests.
Are participants able to produce evidence for their school which indicates how they are in line with; have exceeded; or are below the national trend line?
Any hard evidence which the school can produce is very valuable to the reviewers since it helps them to draw an accurate picture of the academic performance of the students at the school and this helps them to arrive at an accurate judgement for the school overall. Note that in all the review reports which you can read on the QAAET website there is a very strong correlation between a school’s overall effectiveness and the students’ attainment and progress; this, in turn, correlates strongly with the quality of teaching and the quality of leadership and management.
It will be helpful here to have a general discussion amongst all participants about the relationship between the MoE tests and the NEU tests and the relative reliability of each of these measures.
Participants need to understand that the reviewers in their school will also make judgements of students’ performance in the lessons which they observe. There is an expectation that the standards which reviewers witness in the classroom should be a reflection of the standards which students attain in the MoE tests.
Are participants able to produce evidence for their school which indicates how they are in line with; have exceeded; or are below the national trend line?
Any hard evidence which the school can produce is very valuable to the reviewers since it helps them to draw an accurate picture of the academic performance of the students at the school and this helps them to arrive at an accurate judgement for the school overall. Note that in all the review reports which you can read on the QAAET website there is a very strong correlation between a school’s overall effectiveness and the students’ attainment and progress; this, in turn, correlates strongly with the quality of teaching and the quality of leadership and management.
It will be helpful here to have a general discussion amongst all participants about the relationship between the MoE tests and the NEU tests and the relative reliability of each of these measures.
Participants need to understand that the reviewers in their school will also make judgements of students’ performance in the lessons which they observe. There is an expectation that the standards which reviewers witness in the classroom should be a reflection of the standards which students attain in the MoE tests.