SlideShare a Scribd company logo
Changing the assessment landscape
@solentlearning
@tansyjtweets
Dr Tansy Jessop
Professor of Research Informed Teaching
#ISSOTL17, 12 October 2017
Outline
• Scoping the problem: your view and mine
• What is TESTA?
• Exploring why TESTA works as a change approach
• Linking it to principles of educational change
The big backwash
1) Assessment drives what students pay attention
to, and defines the actual curriculum (Ramsden
2003).
2) Feedback is the single most important factor in
learning (Hattie 2009; Black and Wiliam 1998).
Starting with you…
What is the main assessment & feedback challenge
you face?
Go to www.menti.com and use the code 54 65 24
Write down three words or phrases that spring to
mind
It was heavy, tons of
marking for the tutor. It
was such hard work. It was
criminal.
Media Course Leader
I’m really bad at reading
feedback. I’ll look at the
mark and then be like ‘well
stuff it, I can’t do anything
about it’
Student, TESTA focus group
Lose-lose situation
Feedback impasse
Relationship breakdown
Your essay lacked structure and
your referencing is problematic
Your classes are boring and I
don’t really like you 
These are symptoms of a system-wide
problem
The modular degree
IKEA is great for flat-pack furniture but…
Curriculum privileges knowing stuff
The best approach from the student’s perspective is to focus
on concepts. I’m sorry to break it to you, but your students are
not going to remember 90 per cent – possibly 99 per cent – of
what you teach them unless it’s conceptual…. when broad,
over-arching connections are made, education occurs. Most
details are only a necessary means to that end.
http://www.timeshighereducation.co.uk/features/a-students-
lecture-to-rofessors/2013238.fullarticle#.U3orx_f9xWc.twitter
A student’s lecture to her professor
The problem in a nutshell
• Modular curricula foster fragmentation
• Solutions applied to single modules
• Individual improvements holistic change
• Culture of blame and frustration
• We have a curriculum design problem
• We have a teamwork problem
• We have a systems problem…
Mixed methods approach
Programme
Team
Meeting
Assessment
Experience
Questionnaire
(AEQ)
TESTA
Programme
Audit
Student
Focus Groups
Sustained sector-wide growth
TESTA….
“…is a way of thinking
about assessment and
feedback”
Graham Gibbs
It seems to work
60%
65%
70%
75%
80%
85%
90%
95%
Q5 Q6 Q7 Q8 Q9 OS
AVERAGENSSSCORES
COMPARISON 32 PROGRAMMES IN 13 UNIVERSITIES WITH SECTOR
SCORES
NSS 2015 SCORES TESTA SCORES
Why does it work?
• Addresses a burning question for academics
and students
• Uses rigorous research
• Builds on SOTL
• Engages whole teams in a collegiate process
• Provides practical strategies
• Engages with wider institutional systems
Burning questions (academics)
I was quite shocked when I discovered that
people just did things in a random way, but to me
it all makes sense. I was teaching in a vacuum.
I was struck by the sheer amount of assessment.
(Programme Leader Interviews)
The value was to look at what we do from a scientific
perspective and look at things objectively, and that is
really enabling us to re-think how we do things.
Robust data is compelling
I’ve found it useful to have
a mirror held up, to give a
real reflection. We talk
about the ‘student voice’,
but actually this has
provided a mechanism.
It’s been challenging. It
has shown us that
there is no room for
complacency. It also
has shown us that we
need to listen more to
what students are
saying.
It builds on SOTL
• ‘Time-on-task’ (Gibbs 2004)
• Challenging and high expectations (Chickering
and Gamson 1987; Arum and Roksa 2011)
• Internalising goals and standards (Sadler 1989;
Nicol and McFarlane-Dick 2006)
• Prompt, detailed, specific, developmental,
dialogic feedback practice and design (Gibbs
2004; Nicol 2010; Boud and Molloy 2013)
• Deep learning (Marton and Saljo 1976).
Collegial process
But I don’t think it’s just the tools. The tools are good
and they work really, really well, it’s also the
approach. It comes through a kind of collegiality.
(Programme Leader)
For the first time, I felt as though I was a player on
the pitch, rather than someone watching from the
side lines. We were discussing real issues
(Senior Lecturer).
Everybody has brought
in more formative. The
idea was to consolidate
the summative
assessment and bring in
more formative.
Do we want to continue
offering twenty different
types of assessment or
do we bite the bullet and
say “We want the
students to be able to
master five of them”?
There has been more of a
spacing of assessments.
Practical strategies
There is a lot more feed
forward, which is what
came out of the TESTA.
System-wide changes
• Quality assurance and
enhancement working
together
• 18 month design cycle
• TESTA required process
• Evidence-informed
curriculum design
• New lecturer course
curriculum design module
It is not top-down!
References
Arum, R. and Roksa, J. (2011) Academically Adrift: Limited Learning on College Campuses. Chicago.
University of Chicago Press.
Boud, D. and Molloy, E. (2013) ‘Rethinking models of feedback for learning: The challenge of
design’, Assessment & Evaluation in Higher Education, 38(6), pp. 698–712.
Gibbs, G. & Simpson, C. (2004) Conditions r which assessment supports students' learning. Learning and
Teaching in Higher Education. 1(1): 3-31.
Harland, T., McLean, A., Wass, R., Miller, E. and Sim, K. N. (2014) ‘An assessment arms race and its fallout:
High-stakes grading and the case for slow scholarship’, Assessment & Evaluation in Higher Education.
Jessop, T. and Tomas, C. (2016) The implications of programme assessment on student learning. Assessment
and Evaluation in Higher Education. Published online 2 August 2016.
Jessop, T. 2016. Seven years and still no itch – why TESTA keeps going. Educational Developments, 17(3) 5-8.
SEDA.
Jessop, T. and Maleckar, B. (2014). The Influence of disciplinary assessment patterns on student learning: a
comparative study. Studies in Higher Education. Published Online 27 August 2014
Jessop, T. , El Hakim, Y. and Gibbs, G. (2014) The whole is greater than the sum of its parts: a large-scale
study of students’ learning in response to different assessment patterns. Assessment and Evaluation in
Higher Education. 39(1) 73-88.
Jessop, T., El Hakim, Y. and Gibbs, G. TESTA 2014: A way of thinking about assessment and feedback.
Educational Developments 14:3.
Nicol, D. (2010) From monologue to dialogue: improving written feedback processes in mass higher
education, Assessment & Evaluation in Higher Education, 35: 5, 501 – 517.
O'Donovan, B , Price, M. and Rust, C. (2008) 'Developing student understanding of assessment standards: a
nested hierarchy of approaches', Teaching in Higher Education, 13: 2, 205-217.
Sadler, D. R. (1989) ‘Formative assessment and the design of instructional systems’, Instructional Science,
18(2), pp. 119–144. doi: 10.1007/bf00117714.

More Related Content

What's hot

Examining the Student Teacher Relationship (STR) for Children with and Withou...
Examining the Student Teacher Relationship (STR) for Children with and Withou...Examining the Student Teacher Relationship (STR) for Children with and Withou...
Examining the Student Teacher Relationship (STR) for Children with and Withou...
crealcsuf
 
Teacher Education research
Teacher Education researchTeacher Education research
Teacher Education research
Richard Beach
 
Advancing Methodologies: A Conversation with John Creswel
Advancing Methodologies: A Conversation with John CreswelAdvancing Methodologies: A Conversation with John Creswel
Advancing Methodologies: A Conversation with John Creswel
SAGE Publishing
 
2016 leading seagulls 10 early birds
2016 leading seagulls 10 early birds 2016 leading seagulls 10 early birds
2016 leading seagulls 10 early birds
Association for Innovative Collaboration (YİMEDER)
 
Dylan Willam- Leadership for Teacher Learning- Times Festival of Education
Dylan Willam- Leadership for Teacher Learning- Times Festival of EducationDylan Willam- Leadership for Teacher Learning- Times Festival of Education
Dylan Willam- Leadership for Teacher Learning- Times Festival of Educationhannahtyreman
 
2016 leading seagulls 12 pyramid
2016 leading seagulls 12  pyramid 2016 leading seagulls 12  pyramid
2016 leading seagulls 12 pyramid
Association for Innovative Collaboration (YİMEDER)
 
2016 leading seagulls 20 icebreakers
2016 leading seagulls 20 icebreakers 2016 leading seagulls 20 icebreakers
2016 leading seagulls 20 icebreakers
Association for Innovative Collaboration (YİMEDER)
 
Teachers’ Organizational Commitment in Nazarbayev Intellectual School in Tara...
Teachers’ Organizational Commitment in Nazarbayev Intellectual School in Tara...Teachers’ Organizational Commitment in Nazarbayev Intellectual School in Tara...
Teachers’ Organizational Commitment in Nazarbayev Intellectual School in Tara...
Nagima Sarsenbayeva
 
Faculty 2 copy - developing a new teacher eval process
Faculty 2 copy - developing a new teacher eval  processFaculty 2 copy - developing a new teacher eval  process
Faculty 2 copy - developing a new teacher eval process
Gillespie-Fauquier High School
 
Benefit(s)/effectiveness of Google Classroom
Benefit(s)/effectiveness of Google ClassroomBenefit(s)/effectiveness of Google Classroom
Benefit(s)/effectiveness of Google Classroom
Niroj Dahal
 
AERA handout for roundtable session
AERA handout for roundtable sessionAERA handout for roundtable session
AERA handout for roundtable session
Michael Nantais
 
Extended Version_2021_Haldimann_Schmid_Hascher_The Role of Teacher-Student Re...
Extended Version_2021_Haldimann_Schmid_Hascher_The Role of Teacher-Student Re...Extended Version_2021_Haldimann_Schmid_Hascher_The Role of Teacher-Student Re...
Extended Version_2021_Haldimann_Schmid_Hascher_The Role of Teacher-Student Re...
Manuela Haldimann
 
Summer teaching
Summer teachingSummer teaching
Summer teachingggio1234
 
Social Media Pedagogy
Social Media PedagogySocial Media Pedagogy
Social Media Pedagogy
Michael Nantais
 
2016 leading seagulls 7 teacher candy dates
2016 leading seagulls 7 teacher candy dates2016 leading seagulls 7 teacher candy dates
2016 leading seagulls 7 teacher candy dates
Association for Innovative Collaboration (YİMEDER)
 
Students and Faculty – Do They Agree on What Makes an Effective Online Classr...
Students and Faculty – Do They Agree on What Makes an Effective Online Classr...Students and Faculty – Do They Agree on What Makes an Effective Online Classr...
Students and Faculty – Do They Agree on What Makes an Effective Online Classr...
D2L Barry
 
Using Social Media to Engage Educators in Learning
Using Social Media to Engage Educators in LearningUsing Social Media to Engage Educators in Learning
Using Social Media to Engage Educators in Learning
Michael Nantais
 
Lif sec coquitlam.jan 2015
Lif sec coquitlam.jan 2015Lif sec coquitlam.jan 2015
Lif sec coquitlam.jan 2015
Faye Brownlie
 

What's hot (20)

Examining the Student Teacher Relationship (STR) for Children with and Withou...
Examining the Student Teacher Relationship (STR) for Children with and Withou...Examining the Student Teacher Relationship (STR) for Children with and Withou...
Examining the Student Teacher Relationship (STR) for Children with and Withou...
 
Teacher Education research
Teacher Education researchTeacher Education research
Teacher Education research
 
Advancing Methodologies: A Conversation with John Creswel
Advancing Methodologies: A Conversation with John CreswelAdvancing Methodologies: A Conversation with John Creswel
Advancing Methodologies: A Conversation with John Creswel
 
2016 leading seagulls 10 early birds
2016 leading seagulls 10 early birds 2016 leading seagulls 10 early birds
2016 leading seagulls 10 early birds
 
Utrecht sb- ora kwo
Utrecht  sb- ora kwoUtrecht  sb- ora kwo
Utrecht sb- ora kwo
 
Dylan Willam- Leadership for Teacher Learning- Times Festival of Education
Dylan Willam- Leadership for Teacher Learning- Times Festival of EducationDylan Willam- Leadership for Teacher Learning- Times Festival of Education
Dylan Willam- Leadership for Teacher Learning- Times Festival of Education
 
2016 leading seagulls 12 pyramid
2016 leading seagulls 12  pyramid 2016 leading seagulls 12  pyramid
2016 leading seagulls 12 pyramid
 
Clute PPT (2)
Clute PPT (2)Clute PPT (2)
Clute PPT (2)
 
2016 leading seagulls 20 icebreakers
2016 leading seagulls 20 icebreakers 2016 leading seagulls 20 icebreakers
2016 leading seagulls 20 icebreakers
 
Teachers’ Organizational Commitment in Nazarbayev Intellectual School in Tara...
Teachers’ Organizational Commitment in Nazarbayev Intellectual School in Tara...Teachers’ Organizational Commitment in Nazarbayev Intellectual School in Tara...
Teachers’ Organizational Commitment in Nazarbayev Intellectual School in Tara...
 
Faculty 2 copy - developing a new teacher eval process
Faculty 2 copy - developing a new teacher eval  processFaculty 2 copy - developing a new teacher eval  process
Faculty 2 copy - developing a new teacher eval process
 
Benefit(s)/effectiveness of Google Classroom
Benefit(s)/effectiveness of Google ClassroomBenefit(s)/effectiveness of Google Classroom
Benefit(s)/effectiveness of Google Classroom
 
AERA handout for roundtable session
AERA handout for roundtable sessionAERA handout for roundtable session
AERA handout for roundtable session
 
Extended Version_2021_Haldimann_Schmid_Hascher_The Role of Teacher-Student Re...
Extended Version_2021_Haldimann_Schmid_Hascher_The Role of Teacher-Student Re...Extended Version_2021_Haldimann_Schmid_Hascher_The Role of Teacher-Student Re...
Extended Version_2021_Haldimann_Schmid_Hascher_The Role of Teacher-Student Re...
 
Summer teaching
Summer teachingSummer teaching
Summer teaching
 
Social Media Pedagogy
Social Media PedagogySocial Media Pedagogy
Social Media Pedagogy
 
2016 leading seagulls 7 teacher candy dates
2016 leading seagulls 7 teacher candy dates2016 leading seagulls 7 teacher candy dates
2016 leading seagulls 7 teacher candy dates
 
Students and Faculty – Do They Agree on What Makes an Effective Online Classr...
Students and Faculty – Do They Agree on What Makes an Effective Online Classr...Students and Faculty – Do They Agree on What Makes an Effective Online Classr...
Students and Faculty – Do They Agree on What Makes an Effective Online Classr...
 
Using Social Media to Engage Educators in Learning
Using Social Media to Engage Educators in LearningUsing Social Media to Engage Educators in Learning
Using Social Media to Engage Educators in Learning
 
Lif sec coquitlam.jan 2015
Lif sec coquitlam.jan 2015Lif sec coquitlam.jan 2015
Lif sec coquitlam.jan 2015
 

Similar to Changing the assessment landscape

1 why do testa
1 why do testa1 why do testa
1 why do testa
Tansy Jessop
 
Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...
Tansy Jessop
 
TESTA: changing conceptions and practice
TESTA: changing conceptions and practiceTESTA: changing conceptions and practice
TESTA: changing conceptions and practice
Tansy Jessop
 
Developing assessment patterns that work through TESTA
Developing assessment patterns that work through TESTADeveloping assessment patterns that work through TESTA
Developing assessment patterns that work through TESTA
Tansy Jessop
 
LSE Assessment
LSE AssessmentLSE Assessment
LSE Assessment
Tansy Jessop
 
Implications of TESTA for curriculum design
Implications of TESTA for curriculum designImplications of TESTA for curriculum design
Implications of TESTA for curriculum design
Tansy Jessop
 
Why a programme view? Why TESTA?
Why a programme view? Why TESTA?Why a programme view? Why TESTA?
Why a programme view? Why TESTA?
Tansy Jessop
 
Changing conceptions
Changing conceptionsChanging conceptions
Changing conceptions
Tansy Jessop
 
Changing conceptions and practice
Changing conceptions and practiceChanging conceptions and practice
Changing conceptions and practice
Tansy Jessop
 
SLTCC 2016 (Keynote 2) Evidence to Action: Why TESTA works
SLTCC 2016 (Keynote 2) Evidence to Action: Why TESTA worksSLTCC 2016 (Keynote 2) Evidence to Action: Why TESTA works
SLTCC 2016 (Keynote 2) Evidence to Action: Why TESTA works
Solent Learning and Teaching Institute
 
Evidence to action: Why TESTA works
Evidence to action: Why TESTA worksEvidence to action: Why TESTA works
Evidence to action: Why TESTA works
Tansy Jessop
 
Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium
Tansy Jessop
 
Changing conceptions and practice
Changing conceptions and practiceChanging conceptions and practice
Changing conceptions and practice
Tansy Jessop
 
Inaugural lecture
Inaugural lectureInaugural lecture
Inaugural lecture
Tansy Jessop
 
From alienation to engagement through a programme assessment approach
From alienation to engagement through a programme assessment approachFrom alienation to engagement through a programme assessment approach
From alienation to engagement through a programme assessment approach
Tansy Jessop
 
Being known and knowing stuff: linking feedback and RIT
Being known and knowing stuff: linking feedback and RITBeing known and knowing stuff: linking feedback and RIT
Being known and knowing stuff: linking feedback and RIT
Tansy Jessop
 
Frustrating formative
Frustrating formativeFrustrating formative
Frustrating formative
Tansy Jessop
 
TESTA, School of Politics & International Relations, University of Nottingham...
TESTA, School of Politics & International Relations, University of Nottingham...TESTA, School of Politics & International Relations, University of Nottingham...
TESTA, School of Politics & International Relations, University of Nottingham...
TESTA winch
 
Changing the assessment narrative
Changing the assessment narrativeChanging the assessment narrative
Changing the assessment narrative
Tansy Jessop
 
Testa interactive masterclass
Testa interactive masterclassTesta interactive masterclass
Testa interactive masterclass
Tansy Jessop
 

Similar to Changing the assessment landscape (20)

1 why do testa
1 why do testa1 why do testa
1 why do testa
 
Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...
 
TESTA: changing conceptions and practice
TESTA: changing conceptions and practiceTESTA: changing conceptions and practice
TESTA: changing conceptions and practice
 
Developing assessment patterns that work through TESTA
Developing assessment patterns that work through TESTADeveloping assessment patterns that work through TESTA
Developing assessment patterns that work through TESTA
 
LSE Assessment
LSE AssessmentLSE Assessment
LSE Assessment
 
Implications of TESTA for curriculum design
Implications of TESTA for curriculum designImplications of TESTA for curriculum design
Implications of TESTA for curriculum design
 
Why a programme view? Why TESTA?
Why a programme view? Why TESTA?Why a programme view? Why TESTA?
Why a programme view? Why TESTA?
 
Changing conceptions
Changing conceptionsChanging conceptions
Changing conceptions
 
Changing conceptions and practice
Changing conceptions and practiceChanging conceptions and practice
Changing conceptions and practice
 
SLTCC 2016 (Keynote 2) Evidence to Action: Why TESTA works
SLTCC 2016 (Keynote 2) Evidence to Action: Why TESTA worksSLTCC 2016 (Keynote 2) Evidence to Action: Why TESTA works
SLTCC 2016 (Keynote 2) Evidence to Action: Why TESTA works
 
Evidence to action: Why TESTA works
Evidence to action: Why TESTA worksEvidence to action: Why TESTA works
Evidence to action: Why TESTA works
 
Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium
 
Changing conceptions and practice
Changing conceptions and practiceChanging conceptions and practice
Changing conceptions and practice
 
Inaugural lecture
Inaugural lectureInaugural lecture
Inaugural lecture
 
From alienation to engagement through a programme assessment approach
From alienation to engagement through a programme assessment approachFrom alienation to engagement through a programme assessment approach
From alienation to engagement through a programme assessment approach
 
Being known and knowing stuff: linking feedback and RIT
Being known and knowing stuff: linking feedback and RITBeing known and knowing stuff: linking feedback and RIT
Being known and knowing stuff: linking feedback and RIT
 
Frustrating formative
Frustrating formativeFrustrating formative
Frustrating formative
 
TESTA, School of Politics & International Relations, University of Nottingham...
TESTA, School of Politics & International Relations, University of Nottingham...TESTA, School of Politics & International Relations, University of Nottingham...
TESTA, School of Politics & International Relations, University of Nottingham...
 
Changing the assessment narrative
Changing the assessment narrativeChanging the assessment narrative
Changing the assessment narrative
 
Testa interactive masterclass
Testa interactive masterclassTesta interactive masterclass
Testa interactive masterclass
 

More from Tansy Jessop

Rewriting the script about pedagogic research in HE
Rewriting the script about pedagogic research in HERewriting the script about pedagogic research in HE
Rewriting the script about pedagogic research in HE
Tansy Jessop
 
Engaging in meaningful change in assessment
Engaging in meaningful change in assessmentEngaging in meaningful change in assessment
Engaging in meaningful change in assessment
Tansy Jessop
 
Pigs might fly: changing the assessment narrative through TESTA
Pigs might fly: changing the assessment narrative through TESTAPigs might fly: changing the assessment narrative through TESTA
Pigs might fly: changing the assessment narrative through TESTA
Tansy Jessop
 
A curriculum for personal knowing
A curriculum for personal knowingA curriculum for personal knowing
A curriculum for personal knowing
Tansy Jessop
 
Netherlands
NetherlandsNetherlands
Netherlands
Tansy Jessop
 
A broken assessment paradigm?
A broken assessment paradigm?A broken assessment paradigm?
A broken assessment paradigm?
Tansy Jessop
 
TESTA Interactive Masterclass
TESTA Interactive MasterclassTESTA Interactive Masterclass
TESTA Interactive Masterclass
Tansy Jessop
 
Making sense of curriculum in Higher Education
Making sense of curriculum in Higher EducationMaking sense of curriculum in Higher Education
Making sense of curriculum in Higher Education
Tansy Jessop
 
Activating student agency through feedback
Activating student agency through feedbackActivating student agency through feedback
Activating student agency through feedback
Tansy Jessop
 
The untapped potential of pedagogic research
The untapped potential of pedagogic researchThe untapped potential of pedagogic research
The untapped potential of pedagogic research
Tansy Jessop
 
A very brief history: Universities, Solent and the question of purpose
A very brief history: Universities, Solent and the question of purposeA very brief history: Universities, Solent and the question of purpose
A very brief history: Universities, Solent and the question of purpose
Tansy Jessop
 
Increasing engagement to transform student learning
Increasing engagement to transform student learningIncreasing engagement to transform student learning
Increasing engagement to transform student learning
Tansy Jessop
 
Curriculum Transformation: a rough guide to Solent's approach
Curriculum Transformation: a rough guide to Solent's approachCurriculum Transformation: a rough guide to Solent's approach
Curriculum Transformation: a rough guide to Solent's approach
Tansy Jessop
 
At home everywhere and nowhere: the place of pedagogic research in HE
At home everywhere and nowhere: the place of pedagogic research in HEAt home everywhere and nowhere: the place of pedagogic research in HE
At home everywhere and nowhere: the place of pedagogic research in HE
Tansy Jessop
 
Curriculum as counter narrative
Curriculum as counter narrativeCurriculum as counter narrative
Curriculum as counter narrative
Tansy Jessop
 
Old and new hands at academic development
Old and new hands at academic developmentOld and new hands at academic development
Old and new hands at academic development
Tansy Jessop
 
Writers' banquet
Writers' banquet Writers' banquet
Writers' banquet
Tansy Jessop
 
The unexamined curriculum is not worth teaching
The unexamined curriculum is not worth teaching The unexamined curriculum is not worth teaching
The unexamined curriculum is not worth teaching
Tansy Jessop
 
Rolling out testa
Rolling out testaRolling out testa
Rolling out testa
Tansy Jessop
 
Getting to grips with TESTA methods
Getting to grips with TESTA methodsGetting to grips with TESTA methods
Getting to grips with TESTA methods
Tansy Jessop
 

More from Tansy Jessop (20)

Rewriting the script about pedagogic research in HE
Rewriting the script about pedagogic research in HERewriting the script about pedagogic research in HE
Rewriting the script about pedagogic research in HE
 
Engaging in meaningful change in assessment
Engaging in meaningful change in assessmentEngaging in meaningful change in assessment
Engaging in meaningful change in assessment
 
Pigs might fly: changing the assessment narrative through TESTA
Pigs might fly: changing the assessment narrative through TESTAPigs might fly: changing the assessment narrative through TESTA
Pigs might fly: changing the assessment narrative through TESTA
 
A curriculum for personal knowing
A curriculum for personal knowingA curriculum for personal knowing
A curriculum for personal knowing
 
Netherlands
NetherlandsNetherlands
Netherlands
 
A broken assessment paradigm?
A broken assessment paradigm?A broken assessment paradigm?
A broken assessment paradigm?
 
TESTA Interactive Masterclass
TESTA Interactive MasterclassTESTA Interactive Masterclass
TESTA Interactive Masterclass
 
Making sense of curriculum in Higher Education
Making sense of curriculum in Higher EducationMaking sense of curriculum in Higher Education
Making sense of curriculum in Higher Education
 
Activating student agency through feedback
Activating student agency through feedbackActivating student agency through feedback
Activating student agency through feedback
 
The untapped potential of pedagogic research
The untapped potential of pedagogic researchThe untapped potential of pedagogic research
The untapped potential of pedagogic research
 
A very brief history: Universities, Solent and the question of purpose
A very brief history: Universities, Solent and the question of purposeA very brief history: Universities, Solent and the question of purpose
A very brief history: Universities, Solent and the question of purpose
 
Increasing engagement to transform student learning
Increasing engagement to transform student learningIncreasing engagement to transform student learning
Increasing engagement to transform student learning
 
Curriculum Transformation: a rough guide to Solent's approach
Curriculum Transformation: a rough guide to Solent's approachCurriculum Transformation: a rough guide to Solent's approach
Curriculum Transformation: a rough guide to Solent's approach
 
At home everywhere and nowhere: the place of pedagogic research in HE
At home everywhere and nowhere: the place of pedagogic research in HEAt home everywhere and nowhere: the place of pedagogic research in HE
At home everywhere and nowhere: the place of pedagogic research in HE
 
Curriculum as counter narrative
Curriculum as counter narrativeCurriculum as counter narrative
Curriculum as counter narrative
 
Old and new hands at academic development
Old and new hands at academic developmentOld and new hands at academic development
Old and new hands at academic development
 
Writers' banquet
Writers' banquet Writers' banquet
Writers' banquet
 
The unexamined curriculum is not worth teaching
The unexamined curriculum is not worth teaching The unexamined curriculum is not worth teaching
The unexamined curriculum is not worth teaching
 
Rolling out testa
Rolling out testaRolling out testa
Rolling out testa
 
Getting to grips with TESTA methods
Getting to grips with TESTA methodsGetting to grips with TESTA methods
Getting to grips with TESTA methods
 

Recently uploaded

aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdfESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
Fundacja Rozwoju Społeczeństwa Przedsiębiorczego
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
Celine George
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
Excellence Foundation for South Sudan
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
MIRIAMSALINAS13
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
Jheel Barad
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
MysoreMuleSoftMeetup
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
Pavel ( NSTU)
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
DeeptiGupta154
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
RaedMohamed3
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
Special education needs
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
Tamralipta Mahavidyalaya
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
PedroFerreira53928
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
GeoBlogs
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 

Recently uploaded (20)

aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdfESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 

Changing the assessment landscape

  • 1. Changing the assessment landscape @solentlearning @tansyjtweets Dr Tansy Jessop Professor of Research Informed Teaching #ISSOTL17, 12 October 2017
  • 2. Outline • Scoping the problem: your view and mine • What is TESTA? • Exploring why TESTA works as a change approach • Linking it to principles of educational change
  • 3. The big backwash 1) Assessment drives what students pay attention to, and defines the actual curriculum (Ramsden 2003). 2) Feedback is the single most important factor in learning (Hattie 2009; Black and Wiliam 1998).
  • 4. Starting with you… What is the main assessment & feedback challenge you face? Go to www.menti.com and use the code 54 65 24 Write down three words or phrases that spring to mind
  • 5. It was heavy, tons of marking for the tutor. It was such hard work. It was criminal. Media Course Leader I’m really bad at reading feedback. I’ll look at the mark and then be like ‘well stuff it, I can’t do anything about it’ Student, TESTA focus group Lose-lose situation
  • 7. Relationship breakdown Your essay lacked structure and your referencing is problematic Your classes are boring and I don’t really like you 
  • 8. These are symptoms of a system-wide problem
  • 10. IKEA is great for flat-pack furniture but…
  • 12. The best approach from the student’s perspective is to focus on concepts. I’m sorry to break it to you, but your students are not going to remember 90 per cent – possibly 99 per cent – of what you teach them unless it’s conceptual…. when broad, over-arching connections are made, education occurs. Most details are only a necessary means to that end. http://www.timeshighereducation.co.uk/features/a-students- lecture-to-rofessors/2013238.fullarticle#.U3orx_f9xWc.twitter A student’s lecture to her professor
  • 13. The problem in a nutshell • Modular curricula foster fragmentation • Solutions applied to single modules • Individual improvements holistic change • Culture of blame and frustration • We have a curriculum design problem • We have a teamwork problem • We have a systems problem…
  • 14.
  • 17. TESTA…. “…is a way of thinking about assessment and feedback” Graham Gibbs
  • 18. It seems to work 60% 65% 70% 75% 80% 85% 90% 95% Q5 Q6 Q7 Q8 Q9 OS AVERAGENSSSCORES COMPARISON 32 PROGRAMMES IN 13 UNIVERSITIES WITH SECTOR SCORES NSS 2015 SCORES TESTA SCORES
  • 19. Why does it work? • Addresses a burning question for academics and students • Uses rigorous research • Builds on SOTL • Engages whole teams in a collegiate process • Provides practical strategies • Engages with wider institutional systems
  • 20. Burning questions (academics) I was quite shocked when I discovered that people just did things in a random way, but to me it all makes sense. I was teaching in a vacuum. I was struck by the sheer amount of assessment. (Programme Leader Interviews)
  • 21. The value was to look at what we do from a scientific perspective and look at things objectively, and that is really enabling us to re-think how we do things. Robust data is compelling I’ve found it useful to have a mirror held up, to give a real reflection. We talk about the ‘student voice’, but actually this has provided a mechanism. It’s been challenging. It has shown us that there is no room for complacency. It also has shown us that we need to listen more to what students are saying.
  • 22. It builds on SOTL • ‘Time-on-task’ (Gibbs 2004) • Challenging and high expectations (Chickering and Gamson 1987; Arum and Roksa 2011) • Internalising goals and standards (Sadler 1989; Nicol and McFarlane-Dick 2006) • Prompt, detailed, specific, developmental, dialogic feedback practice and design (Gibbs 2004; Nicol 2010; Boud and Molloy 2013) • Deep learning (Marton and Saljo 1976).
  • 23. Collegial process But I don’t think it’s just the tools. The tools are good and they work really, really well, it’s also the approach. It comes through a kind of collegiality. (Programme Leader) For the first time, I felt as though I was a player on the pitch, rather than someone watching from the side lines. We were discussing real issues (Senior Lecturer).
  • 24. Everybody has brought in more formative. The idea was to consolidate the summative assessment and bring in more formative. Do we want to continue offering twenty different types of assessment or do we bite the bullet and say “We want the students to be able to master five of them”? There has been more of a spacing of assessments. Practical strategies There is a lot more feed forward, which is what came out of the TESTA.
  • 25. System-wide changes • Quality assurance and enhancement working together • 18 month design cycle • TESTA required process • Evidence-informed curriculum design • New lecturer course curriculum design module
  • 26. It is not top-down!
  • 27. References Arum, R. and Roksa, J. (2011) Academically Adrift: Limited Learning on College Campuses. Chicago. University of Chicago Press. Boud, D. and Molloy, E. (2013) ‘Rethinking models of feedback for learning: The challenge of design’, Assessment & Evaluation in Higher Education, 38(6), pp. 698–712. Gibbs, G. & Simpson, C. (2004) Conditions r which assessment supports students' learning. Learning and Teaching in Higher Education. 1(1): 3-31. Harland, T., McLean, A., Wass, R., Miller, E. and Sim, K. N. (2014) ‘An assessment arms race and its fallout: High-stakes grading and the case for slow scholarship’, Assessment & Evaluation in Higher Education. Jessop, T. and Tomas, C. (2016) The implications of programme assessment on student learning. Assessment and Evaluation in Higher Education. Published online 2 August 2016. Jessop, T. 2016. Seven years and still no itch – why TESTA keeps going. Educational Developments, 17(3) 5-8. SEDA. Jessop, T. and Maleckar, B. (2014). The Influence of disciplinary assessment patterns on student learning: a comparative study. Studies in Higher Education. Published Online 27 August 2014 Jessop, T. , El Hakim, Y. and Gibbs, G. (2014) The whole is greater than the sum of its parts: a large-scale study of students’ learning in response to different assessment patterns. Assessment and Evaluation in Higher Education. 39(1) 73-88. Jessop, T., El Hakim, Y. and Gibbs, G. TESTA 2014: A way of thinking about assessment and feedback. Educational Developments 14:3. Nicol, D. (2010) From monologue to dialogue: improving written feedback processes in mass higher education, Assessment & Evaluation in Higher Education, 35: 5, 501 – 517. O'Donovan, B , Price, M. and Rust, C. (2008) 'Developing student understanding of assessment standards: a nested hierarchy of approaches', Teaching in Higher Education, 13: 2, 205-217. Sadler, D. R. (1989) ‘Formative assessment and the design of instructional systems’, Instructional Science, 18(2), pp. 119–144. doi: 10.1007/bf00117714.

Editor's Notes

  1. We need to do something. This is something. Let’s do it! Yes Minister – very different approach
  2. Feedback: all that effort, but what is the effect? Margaret Price But lots of projects and programmes do….
  3. Disconnected seeing the whole degree in silos – my module, lecturer perspective (Elephant, trunk, ears, tusks etc) compared to student perspective of the whole huge beast. I realise that what we were saying is two per module
  4. Not so good for complex learning, integrating knowledge, lends itself to disposable curriculum fragmented learning. Amplified summative, less time for formative. Hard to make connections, difficult to see the joins between assessments, much more assessment, much more assessment to accredit each little box. Multiplier effect. Less challenge, less integration. Lots of little neo-liberal tasks. The Assessment Arms Race.
  5. Language of ‘covering material’ Should we be surprised? Knowledge wastage
  6. What started as a research methodology has become a way of thinking. David Nicol – changing the discourse, the way we think about assessment and feedback; not only technical, research, mapping, also shaping our thinking. Evidence, assessment principles. Habermas framework.
  7. Root, branch, ecological changes – Hargreaves and Fullan