Presentasjon av artiklene: Black, Paul and Wiliam, Dylan: Assessment in Education: Principles, Policy & Practice; Mar1998, Vol. 5 Issue 1, p7, Black, P. & Wiliam, D. (1998): Inside the black box. Raising Standards Through Classroom

1. Inside the black box
Black, Paul and Wiliam, Dylan: Assessment in Education: Principles,
Policy & Practice; Mar1998, Vol. 5 Issue 1, p7,
Black, P. & Wiliam, D. (1998): Inside the black box. Raising
Standards Through Classroom
http://academic.sun.ac.za/mathed/174/formassess.pdf
E-assessment 2013 1

2. Background
• Two substantial review articles; Natriello
(1987) and Crooks (1988) serve as baselines
for there review
• with a few exceptions, all of the articles
covered here were published during or after
1988
• a total of 681 publications
• 250 of these publications as being sufficiently
important to require reading in full
E-assessment 2013 2

3. Three important questions
• Is there evidence that improving formative
assessment raises standards?
• Is there evidence that there is room for
improvement?
• Is there evidence about how to improve
formative assessment?
The conclusion they have reached from their
research review is that the answer to each of the
three questions above is clearly yes.
E-assessment 2013 3

4. Does Improving Formative Assessment
Raise Standards?
• Formative assessment produce significant and
often substantial learning gains
• Effect sizes of the formative assessment
experiments were between 0.4 and 0.7
• These effect sizes are larger than most of
those found for educational interventions
• Improved formative assessment helps low
achievers more than other students
E-assessment 2013 4

5. Raise a number of other issues
• Such work involves new ways to enhance
feedback
• That will require significant changes in classroom
practice
• Assumptions about what makes for effective
learning
– students have to be actively involved
• For assessment to function formatively, the
results have to be used to adjust teaching and
learning
E-assessment 2013 5

6. Is There Room for Improvement?
1.
• Marking often fails to offer guidance on how
work can be improved
• Teachers consider that formative assessment
practice is unrealistic in the present
educational context
• The tests used by teachers encourage rote and
superficial learning
• The questions and other methods teachers use
are not shared with other teachers
E-assessment 2013 6

7. Is There Room for Improvement?
2.
• The teachers are not critically reviewed in
relation to what they actually assess
• Is a tendency to emphasize quantity and
neglect its quality in relation to learning
• Giving of marks and the grading function are
overemphasized
• Giving of useful advice and the learning
function are underemphasized
E-assessment 2013 7

8. Is There Room for Improvement?
3.
• Pupils are compared with one another
• Competition rather than personal improvement
• Teachersʹ feedback seems to serve social and managerial
functions
• Teachers are often able to predict pupilsʹ results on
external tests
– their own tests imitate them
– teachers know too little about their pupilsʹ learning
needs
• The collection of marks is given higher priority than the
analysis of pupilsʹ work to discern learning needs
• Teachers pay no attention to the assessment records of
their pupilsʹ previous teachers
E-assessment 2013 8

9. How Can We Improve Formative
Assessment?
• The ultimate user of assessment information is
the pupil
• Needed is a culture of success, backed by a
belief that all pupils can achieve
• Feedback to any pupil should be about the
particular qualities of his or her work
• Feedback should avoid comparisons with other
pupils
E-assessment 2013 9

10. Self‐assessment by pupils
• Self‐ and peer-assessment by pupils as ways of
enhancing formative assessment
• Pupils can assess themselves only when they have
a sufficiently clear picture of the targets that their
learning is meant to attain
• Feedback about the learning effort has three
elements:
– recognition of the desired goal
– evidence about present position
– understanding of a way to close the gap between the
two
E-assessment 2013 10

11. The evolution of effective teaching
Tasks
• The choice of tasks for classroom work and
homework is important
– Tasks have to be justified in terms of the learning
aims that they serve
• Opportunities for pupils to communicate their
evolving understanding has to be built into the
planning
• Discussion, observation of activities is
important
E-assessment 2013 11

12. The evolution of effective teaching
Asking
• Asking of questions by the teacher is often
unproductive, better to:
– involve giving pupils time to respond
– asking them to discuss their thinking in pairs or in
small groups
– giving pupils a choice between different possible
answers and asking them to vote on the options
– asking all of them to write down an answer and
then reading out a selected few
E-assessment 2013 12

13. The evolution of effective teaching
Testing and feedback
• Better to have frequent short tests than infrequent long
ones
• Questions of good quality is essential to ensure the
quality of the feedback
• Given only marks or grades, they do not benefit from
the feedback
• Feedback improve learning when it gives each pupil
specific guidance on strengths and weaknesses
• Feedback on tests should give each pupil guidance on
how to improve
• Feedback must give help and an opportunity to work
on the improvement
E-assessment 2013 13

14. All pupils can learn more effectively
“Ways of managing formative assessment that
work with the assumptions of ʹuntapped
potentialʹ do help all pupils to learn and can
give particular help to those who have
previously struggled.”
E-assessment 2013 14

15. Changing the policy perspective
“There is a need now to move further, to focus
on the inside of the ʹblack boxʹ and so to
explore the potential of assessment to raise
standards directly as an integral part of each
pupilʹs learning work.”
E-assessment 2013 15

16. Four‐point scheme for teacher
development
• Learning from development
– What teachers need is a variety of living examples of implementation
– They need to see examples of what doing better means in practice
• Dissemination
– Each teacher must find his or her own ways of incorporating the lessons and ideas that
are set out
– Such a process will take time
• Reducing obstacles
– Assessment is far from a merely technical problem
– It is deeply social and personal
– Collaborative work is very important in everyday life but is forbidden by current norms of
formal testing
• Research
– Successful innovations generally fail to give clear accounts of one or another of the
important details as classroom-methods, the motivation and experience of the teachers,
the nature of the tests used as measures of success, or the outlooks and expectations of
the pupils involved
E-assessment 2013 16

17. The paper's contribution to the field
of e-assessment
• These two articles are linked together and are often cited in
other articles on the subject. This is why I link them here
together.
• Black and Wiliam have a strong reputation and they have
written several importants articles build on these two
articles
– Black, P., Harrison, C., Lee, C., Marshall, B. & Wiliam, D.
(2009): Assessment for Learning. Putting it into practice. Open
University Press.
– Black, P. & Wiliam, D. (2009): Developing the theory of
formative assessment. Educational Assessment, Evaluationand
Accountability, 1(21), 5-31.
– Wiliam, D. (2011): What is assessment for learning? Studies in
Educational Evaluation, 37, 3-14
E-assessment 2013 17

18. Reflections on how to apply the idea of
this paper in a relevant educational
context
I have applied formative assessment as in this articles the last year
with my mediastudents. I do find much of the same in Hatties latest
book (Hattie, 2012). For me formative assessment is a way to make the
learning visible, as Hatties says. Ingrid Langseth (Langseth,2012) has shown
that classes that works after the principles og formative assessment
are better to manage their own learning working in front of their
computer. I can find much the same in my class. The biggest problem is
to changes the students thinking of there own learning and to give
them a sufficiently clear picture of the targets that their learning is
meant to attain. The same with self‐assessment. It is not easy to train
them in self-assessment so they can understand the main purpose of
their learning. At the same time I can see that ICT can support this
effort. As Black and Wiliams says: “There is no quick fix that can alter
existing practice by promising rapid rewards” , and the process will
take time.
E-assessment 2013 18

19. E-assessment 2013 19

20. References
• Hattie, J. (2012). Visible Learning for
Teachers, Maximizing Impact on Learning.
London: Routlegde
• Langseth, I. (2012), Teknologi i et lærerstyrt
undervisningsdesign for fremmedspråk,
Norsk Pedagogisk Tidsskrift, årgang 96 nr. 2, s.
86 – 97.
E-assessment 2013 20