This document discusses formative and summative assessment and the importance of balancing the two. It analyzes data showing assessment patterns with different programs and how formative versus summative assessment relates to deep versus surface learning. The document also examines why formative assessment is important but often struggles to be implemented, providing several theories for this. Finally, it outlines five case studies of programs successfully incorporating formative assessment and has attendees brainstorm principles from these cases to adapt for their own disciplines.
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
Â
Good cop, bad cop
1. Good cop, bad cop?
Cracking formative, using
summative well
Tansy Jessop
SLTI Workshop
17 March 2017
2. This session
⢠Data about formative and summative balance
⢠Implications for student learning
⢠The bitter divorce
⢠Why we need formative
⢠Why we struggle
⢠Distilling principles from five case studies
3.
4. Assessment patterns (n=73 programmes)
Characteristic Low Medium High
Volume of summative
assessment
Below 33 40-48 More than 48
Volume of formative only Below 1 5-19 More than 19
% of tasks by examinations Below 11% 22-31% More than 31%
Variety of assessment
methods
Below 8 11-15 More than 15
Written feedback in words Less than 3,800 6,000-7,600 More than 7,600
5. Deep and Surface Learning (Marton and
Saljo (1976)
Deep Learning
⢠Meaning
⢠Concepts
⢠Active learning
⢠Generating knowledge
⢠Relationship new and
previous knowledge
⢠Real-world learning
Surface Learning
⢠External purpose
⢠Topics
⢠Passive process
⢠Reproducing knowledge
⢠Isolated and
disconnected knowledge
⢠Artificial learning
7. Measures of educational
process predict learning gain:
⢠Class size,
⢠the level of student effort
and engagement,
⢠who undertakes the
teaching,
⢠the quantity and quality of
feedback to students
Gibbs 2010
9. 1) Low-risk, more frequent opportunities for students to
learn from feedback (Sadler, 1989)
2) Helps students to fine-tune and understand
requirements and standards (Boud 2000, Nicol, 2006)
3) Feedback to lecturers from formative tasks helps to
adapt teaching (Hattie, 2009)
4) Engages students in cycles of reflection and
collaboration (Biggs 2003; Nicol & McFarlane Dick 2006)
5) Encourages and distributes student effort (Gibbs 2004).
Why formative matters
10. What is formative assessment?
Process of âŚ..short-circuiting the randomness
and inefficiency of trial-and-error learning
(Sadler 1989, p.120).
TESTA â ungraded, required, eliciting feedback
13. Theory 2: Summative competes for time
and effort with formative
If there werenât loads of other assessments, Iâd do it.
âIâm sorry, but we canât afford to stay here. Weâre
off to do our assignmentâ (Harland, 2014).
14. Theory 3: Students are grades-oriented
Itâs good to know youâre being graded because you take it
more seriously.
I always find myself going to the library and going âThese are
the books related to this essayâ and thatâs it.
Although you learn a lot more than you would if you were
revising for an exam, because you have to do wider research
and stuff, you still donât do research really unless itâs directly
related to essays.
15. Theory 4: Academics struggle with systemic
problems and low student interest
16. I found the consequence of it not being officially part of the diet
being that a hard core did it and no more.
At any particular assessment point... somebody in our
department would probably have to read something between
300,000 and 0.5 million words.
You end up assessing for assessmentâs sake rather than thinking
about what the assessment is for.
Weâre finding formative assessment more difficult as the
numbers grow on the courses, and a lot of us now are thinking I
canât do this because itâs just so much extra time....
17. So, how do we do it?
Five case studies of
successful formative
Your task will be to identify
the principles that make
them work
How could you adapt them?
18. Case Study 1: Business School
⢠Reduction from average 2 x summative, zero
formative per module
⢠âŚto 1 x summative and 3 x formative
⢠Required by students in entire business school
⢠All working to similar script
⢠Systematic shift, experimentation, less risky
together
19. Case Study 2: Social Sciences
⢠Education, Sociology and PGCAP degrees
⢠Problem: silent seminar, students not reading
⢠Public platform blogging
⢠Current academic texts
⢠In-class
⢠Threads and live discussion
⢠Linked to summative
20. Case Study 3: Media degree
⢠Media degree
⢠Presentations formative
⢠Students get feedback (peer and tutor)
⢠Refines their thinking forâŚ
⢠Linked summative essay
21. Case study 4: Film and TV
⢠Seminar
⢠Problem: lack of discrimination about sources
⢠Students bring 1 x book, 1 x chapter, 1 x
journal article, 2 x pop culture articles
⢠Justify choices to group
⢠Reach consensus about five best sources
22. Case study 5: Engineering
⢠Engineering
⢠Problem low averages
⢠Course requirement to complete 50 problems
⢠Peer assessed in six âlectureâ slots
⢠Marks do not count
⢠Lectures, problems, classes, exams unchanged
⢠Exam marks increased from 45% to 85%
23. Your task
⢠In groups, identify five principles for making
formative work. Write them down on flipchart
paper.
⢠Devise one or two adaptations for your
discipline, using the principles, and make one
poster which outlines/draws your adaptation.
You can be creative!
24. Becker, H. (1968) Making the grade: the academic side of college life.
Boud, D. (2000) Sustainable Assessment: Rethinking assessment for the learning society, Studies in
Continuing Education, 22: 2, 151 â 167.
Gibbs, G. & Simpson, C. (2004) Conditions under which assessment supports students' learning.
Learning and Teaching in Higher Education. 1(1): 3-31.
Hattie, J. (2007) The Power of Feedback. Review of Educational Research. 77(1) 81-112.
Harland, T. et al. (2014) An Assessment Arms Race and its fallout: high-stakes grading and the case for
slow scholarship. Assessment and Evaluation inn Higher Education.
http://www.tandfonline.com/doi/abs/10.1080/02602938.2014.931927
Nicol, D. J. and McFarlane-Dick, D. (2006) Formative Assessment and Self-Regulated Learning: A Model
and Seven Principles of Good Feedback Practice. Studies in Higher Education. 31(2): 199-218.
Jessop, T. (2017) Inspiring transformation through TESTAâs programme approach. In Carless (2017)
Scaling up Assessment for Learning in HE. Singapore. Springer.
Jessop, T. , El Hakim, Y. and Gibbs, G. (2013) The whole is greater than the sum of its parts: a large-
scale study of studentsâ learning in response to different assessment patterns. Assessment and
Evaluation in Higher Education. ifirst.
Jessop, T, McNab, N and Gubby, L. (2012) Mind the gap: An analysis of how quality assurance
processes influence programme assessment patterns. Active Learning in Higher Education. 13(3). 143-
154.
Sadler, D.R. (1989) Formative assessment and the design of instructional systems, Instructional
Science, 18, 119-144.
Yorke, M. (2003) Formative assessment in higher education: Moves towards theory and the
enhancement of pedagogic practice. Higher Education. 45
References