Ofqual is taking steps to improve the quality of marking for GCSE and A-level exams in response to increasing rates of grade changes from enquiries about results. Actions include requiring more detailed data from exam boards, overhauling the enquiries and appeals systems, developing standardized quality indicators, researching best practices for mark scheme design, upgrading exam boards' action plans, improving monitoring of markers, and evaluating marker training effectiveness. Changes will be implemented between 2015 and 2017.
Countries’ presentation on internal quality control: NepalExternalEvents
The second lab managers’ meeting of the South-East Asia Laboratory NETwork (SEALNET) took place on 19 - 23 November 2018 in ICAR-IISS (Indian Institute of Soil Science), Bhopal, India.
Mr. Janardan Khadka, Soil Management Directorate, Nepal (2nd Day)
Countries’ presentation on internal quality control: NepalExternalEvents
The second lab managers’ meeting of the South-East Asia Laboratory NETwork (SEALNET) took place on 19 - 23 November 2018 in ICAR-IISS (Indian Institute of Soil Science), Bhopal, India.
Mr. Janardan Khadka, Soil Management Directorate, Nepal (2nd Day)
Bringing Consistency to Digital Resource EvaluationPaula Weaver
Overview of process used by the Clifton Park-Halfmoon Public Library to create a survey tool for consistent digital resource evaluation. Presented as a flash talk during the SMART Membership Meeting at the 2015 NYLA Conference.
Reliable Relevant Metrics to the Right Audience - Manual Testing WhitepaperIndium Software
'What cannot be measured cannot be managed” is the guiding philosophy behind testing metrics, a phenomenon that promises to deliver business efficiencies beyond just improving quality. Measurement helps with planning, tracking and managing the software project and enables organizations to objectively assess quality
Collection, Maintenance and Validation of Effective Evidence for Program Asse...Stephen Frezza
Describes methods and tools for maintaining educational assessment information - primarily for program outcomes assessment. This is describing outcomes assessment processes and tools for an ABET-Accredited university undergraduate programs. Discusses direct and indirect evidence use, and how to use these to efficiently validate the program.
Regulating for quality in assessment speech delivered by Isabel Nisbet at the AAIA (Association for Achievement and Improvement through Assessment) conference on 15 September 2010.
I create themes for each PeopleSoft module roll-out. The theme for the Employee Talent Management presentation was "Who's driving your career?" It was well received and connected with our workforce.
I create themes for each PeopleSoft module roll-out. The theme for the Manager Talent Management presentation was "The ROAD to Employee Engagement" and a logo was added to communications, etc.
Establishing measurable performance expectations Feb 2019 Criterion Conferenc...Mark Hocknell
Setting measurable performance expectations; involves using a methodology and :
1 Ensuring the outcome/result is written so it can be measured
2 Measures are designed for the result
3 Targets are set sensible
Bringing Consistency to Digital Resource EvaluationPaula Weaver
Overview of process used by the Clifton Park-Halfmoon Public Library to create a survey tool for consistent digital resource evaluation. Presented as a flash talk during the SMART Membership Meeting at the 2015 NYLA Conference.
Reliable Relevant Metrics to the Right Audience - Manual Testing WhitepaperIndium Software
'What cannot be measured cannot be managed” is the guiding philosophy behind testing metrics, a phenomenon that promises to deliver business efficiencies beyond just improving quality. Measurement helps with planning, tracking and managing the software project and enables organizations to objectively assess quality
Collection, Maintenance and Validation of Effective Evidence for Program Asse...Stephen Frezza
Describes methods and tools for maintaining educational assessment information - primarily for program outcomes assessment. This is describing outcomes assessment processes and tools for an ABET-Accredited university undergraduate programs. Discusses direct and indirect evidence use, and how to use these to efficiently validate the program.
Regulating for quality in assessment speech delivered by Isabel Nisbet at the AAIA (Association for Achievement and Improvement through Assessment) conference on 15 September 2010.
I create themes for each PeopleSoft module roll-out. The theme for the Employee Talent Management presentation was "Who's driving your career?" It was well received and connected with our workforce.
I create themes for each PeopleSoft module roll-out. The theme for the Manager Talent Management presentation was "The ROAD to Employee Engagement" and a logo was added to communications, etc.
Establishing measurable performance expectations Feb 2019 Criterion Conferenc...Mark Hocknell
Setting measurable performance expectations; involves using a methodology and :
1 Ensuring the outcome/result is written so it can be measured
2 Measures are designed for the result
3 Targets are set sensible
Audit update
Slides from a webinar to the Federation of Awarding Bodies on Monday 27 April 2015
Webinar hosted by Bryan Horne
Associate Director Standards for Vocational Qualifications and Apprenticeships
The Ethics of Accountability in Education Assessment: Ofqual ethics symposiumOfqual Slideshare
The Ethics of Accountability in Education Assessment
A presentation by Professor Paola Mattei, Associate Professor in Comparative Social Policy at the University of Oxford
26th March 2015
Teacher Malpractice in Assessment: the International Context: Ofqual Ethics S...Ofqual Slideshare
Teacher Malpractice in Assessment: the International Context
A presentation by Ardeshir Geranpayeh, Ph.D. Head of Psychometrics & Data Services - Oxford at the Ofqual ethics symposium
26th March 2015
Westminster Forum: The future for Apprenticeships in England: Trailblazers, f...Ofqual Slideshare
How assessments and qualifications fit into apprenticeships, Ofqual’s new regulatory approach to vocational qualifications and Ofqual's work on the reformed apprenticeships.
Securing Standards in Qualifications and Assessment (October 2014)Ofqual Slideshare
Marc Baker, Acting Executive Director for General Qualifications speech to the Inside Government conference on Raising School Attainment
14th October 2014
New approaches to dealing with malpractice and maladministration - cskills pr...Ofqual Slideshare
New Approaches to Dealing with Malpractice and Maladministration - Cskills Awards
9th May 2014
Presentation by
Christopher Simpson
Quality Assurance Manager/ RO
Palestine last event orientationfvgnh .pptxRaedMohamed3
An EFL lesson about the current events in Palestine. It is intended to be for intermediate students who wish to increase their listening skills through a short lesson in power point.
Macroeconomics- Movie Location
This will be used as part of your Personal Professional Portfolio once graded.
Objective:
Prepare a presentation or a paper using research, basic comparative analysis, data organization and application of economic information. You will make an informed assessment of an economic climate outside of the United States to accomplish an entertainment industry objective.
Acetabularia Information For Class 9 .docxvaibhavrinwa19
Acetabularia acetabulum is a single-celled green alga that in its vegetative state is morphologically differentiated into a basal rhizoid and an axially elongated stalk, which bears whorls of branching hairs. The single diploid nucleus resides in the rhizoid.
Introduction to AI for Nonprofits with Tapp NetworkTechSoup
Dive into the world of AI! Experts Jon Hill and Tareq Monaur will guide you through AI's role in enhancing nonprofit websites and basic marketing strategies, making it easy to understand and apply.
Honest Reviews of Tim Han LMA Course Program.pptxtimhan337
Personal development courses are widely available today, with each one promising life-changing outcomes. Tim Han’s Life Mastery Achievers (LMA) Course has drawn a lot of interest. In addition to offering my frank assessment of Success Insider’s LMA Course, this piece examines the course’s effects via a variety of Tim Han LMA course reviews and Success Insider comments.
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...Levi Shapiro
Letter from the Congress of the United States regarding Anti-Semitism sent June 3rd to MIT President Sally Kornbluth, MIT Corp Chair, Mark Gorenberg
Dear Dr. Kornbluth and Mr. Gorenberg,
The US House of Representatives is deeply concerned by ongoing and pervasive acts of antisemitic
harassment and intimidation at the Massachusetts Institute of Technology (MIT). Failing to act decisively to ensure a safe learning environment for all students would be a grave dereliction of your responsibilities as President of MIT and Chair of the MIT Corporation.
This Congress will not stand idly by and allow an environment hostile to Jewish students to persist. The House believes that your institution is in violation of Title VI of the Civil Rights Act, and the inability or
unwillingness to rectify this violation through action requires accountability.
Postsecondary education is a unique opportunity for students to learn and have their ideas and beliefs challenged. However, universities receiving hundreds of millions of federal funds annually have denied
students that opportunity and have been hijacked to become venues for the promotion of terrorism, antisemitic harassment and intimidation, unlawful encampments, and in some cases, assaults and riots.
The House of Representatives will not countenance the use of federal funds to indoctrinate students into hateful, antisemitic, anti-American supporters of terrorism. Investigations into campus antisemitism by the Committee on Education and the Workforce and the Committee on Ways and Means have been expanded into a Congress-wide probe across all relevant jurisdictions to address this national crisis. The undersigned Committees will conduct oversight into the use of federal funds at MIT and its learning environment under authorities granted to each Committee.
• The Committee on Education and the Workforce has been investigating your institution since December 7, 2023. The Committee has broad jurisdiction over postsecondary education, including its compliance with Title VI of the Civil Rights Act, campus safety concerns over disruptions to the learning environment, and the awarding of federal student aid under the Higher Education Act.
• The Committee on Oversight and Accountability is investigating the sources of funding and other support flowing to groups espousing pro-Hamas propaganda and engaged in antisemitic harassment and intimidation of students. The Committee on Oversight and Accountability is the principal oversight committee of the US House of Representatives and has broad authority to investigate “any matter” at “any time” under House Rule X.
• The Committee on Ways and Means has been investigating several universities since November 15, 2023, when the Committee held a hearing entitled From Ivory Towers to Dark Corners: Investigating the Nexus Between Antisemitism, Tax-Exempt Universities, and Terror Financing. The Committee followed the hearing with letters to those institutions on January 10, 202
Embracing GenAI - A Strategic ImperativePeter Windle
Artificial Intelligence (AI) technologies such as Generative AI, Image Generators and Large Language Models have had a dramatic impact on teaching, learning and assessment over the past 18 months. The most immediate threat AI posed was to Academic Integrity with Higher Education Institutes (HEIs) focusing their efforts on combating the use of GenAI in assessment. Guidelines were developed for staff and students, policies put in place too. Innovative educators have forged paths in the use of Generative AI for teaching, learning and assessments leading to pockets of transformation springing up across HEIs, often with little or no top-down guidance, support or direction.
This Gasta posits a strategic approach to integrating AI into HEIs to prepare staff, students and the curriculum for an evolving world and workplace. We will highlight the advantages of working with these technologies beyond the realm of teaching, learning and assessment by considering prompt engineering skills, industry impact, curriculum changes, and the need for staff upskilling. In contrast, not engaging strategically with Generative AI poses risks, including falling behind peers, missed opportunities and failing to ensure our graduates remain employable. The rapid evolution of AI technologies necessitates a proactive and strategic approach if we are to remain relevant.
Operation “Blue Star” is the only event in the history of Independent India where the state went into war with its own people. Even after about 40 years it is not clear if it was culmination of states anger over people of the region, a political game of power or start of dictatorial chapter in the democratic setup.
The people of Punjab felt alienated from main stream due to denial of their just demands during a long democratic struggle since independence. As it happen all over the word, it led to militant struggle with great loss of lives of military, police and civilian personnel. Killing of Indira Gandhi and massacre of innocent Sikhs in Delhi and other India cities was also associated with this movement.
Francesca Gottschalk - How can education support child empowerment.pptxEduSkills OECD
Francesca Gottschalk from the OECD’s Centre for Educational Research and Innovation presents at the Ask an Expert Webinar: How can education support child empowerment?
Instructions for Submissions thorugh G- Classroom.pptxJheel Barad
This presentation provides a briefing on how to upload submissions and documents in Google Classroom. It was prepared as part of an orientation for new Sainik School in-service teacher trainees. As a training officer, my goal is to ensure that you are comfortable and proficient with this essential tool for managing assignments and fostering student engagement.
Read| The latest issue of The Challenger is here! We are thrilled to announce that our school paper has qualified for the NATIONAL SCHOOLS PRESS CONFERENCE (NSPC) 2024. Thank you for your unwavering support and trust. Dive into the stories that made us stand out!
2. Introduction
The proportion of GCSE and A/AS level papers where an EAR was
requested has continually increased:
4
3.5
3
2.5
2
1.5
1
0.5
0
GCSE A level
Total
2011 2012 2013 2014
% of scripts marked that received
an enquiry
% of GCSE and A level papers marked that received an EAR, 2011 - 2014
3. Introduction
There is a similar picture of grade changes resulting from EAR
0.7
0.6
0.5
0.4
0.3
0.2
0.1
% of GCSE and A level qualification results involved in enquiries that had a grade
change, summer exam series 2011 - 2014
0
2011 2012 2013 2014
% of total qualifications awarded
resulting in a qualification grade
change
GCSE A level
4. Steps we are taking to improve the quality
of marking
1. Analysing this year’s Enquiries About Results data and
requiring more information from exam boards
2. Improving the Enquiries About Results (EAR) and Appeals
system to make it more simple, transparent and fair
3. Developing better ways for exam boards to measure and report
on quality of marking in future
4. Identifying best practice in mark scheme design
5. Requiring exam boards to upgrade action plans on quality of
marking
6. Requiring exam boards to improve their monitoring of markers
as they mark
7. Evaluating the effectiveness of marker training.
5. 1. Analysing this year’s Enquiries About
Results data and requiring more
information from exam boards
Issue
Provisional data shows increased EAR
requests and more grade changes
Increased EAR may reflect teacher
anxiety around changes to qualifications
and school performance measures
Grade changes may reflect small
changes to marks just below a grade
boundary…or may reflect more
significant mark changes
In more subjective subjects, small mark
changes may reflect legitimate
differences of opinion
We need to understand whether there
has been deterioration in the quality of
marking this summer
What we’re going to do
November: exam boards submit final
EAR data to us, including:
Average size of mark adjustment
for each paper
Detailed breakdown of the causes
of any grade change
December: we will publish a report of
the EAR data and analyses provided by
exam boards
March 2015: deadline for all boards to
have detailed quality of marking action
plans based on their analyses
Summer 2015: boards must report on
the impact of these plans on the
summer exam series
6. 2. Improving the Enquiries About Results
(EAR) and Appeals system to make it
more simple, transparent and fair
Issue
Some teachers lack confidence in the
EAR and Appeals system
The EAR process fails to distinguish
between true marking errors and
legitimate differences of opinion
Exam boards have varying practice for
the re-standardisation of markers
The basis upon which exam boards
decide to authorise an extended review
of marking is unclear and creates
suspicion of unfairness
Teachers don’t think appeal panel
hearings are sufficiently independent of
the exam boards
What we’re going to do
December: launch consultation on our
proposals to overhaul the EAR and
Appeals system, including:
All markers to be appropriately re-standardised
Boards to review and publish their
principles for extending a review of
marking
Boards to have procedures to
demonstrate how they meet
Appeals’ independence requirement
Summer 2015: we think some of our
proposals can be put in place ready for
the summer exam series, and the
remainder by summer 2016
7. 3. Developing better ways for exam boards
to measure and report on quality of
marking in future
Issue
EAR and Appeals data is not a good
indicator of quality of marking
The current Appeals data lumps
together small mark changes in
subjectively marked subjects and large
mark changes in objectively marked
subjects…the latter are far more
concerning than the former
There is poor visibility of the quality of
marking. Teachers cannot make
informed choices about exam boards on
the basis of the quality of their marking
What we’re going to do
Create standardised quality of marking
indicators across exam boards to give a
more accurate picture of marking quality
Summer 2017: indicators will be in place
for the reformed GCSEs and revised A
levels examined for the first time in 2017
8. 4. Identifying best practice in mark
scheme design
Issue
Well designed mark schemes are
important determinants of marking
quality, especially in more subjective
subjects
Levels based mark schemes are often
used in subjects associated with poorer
consistency of marking
While a lot is known about how to write
levels based mark schemes, there are
still aspects about which there is little
evidence
What we’re going to do
We are conducting research studies into
levels based mark schemes so we can
require boards to follow best practice
Summer 2015: we will begin to report
findings from this long term piece of
work
9. 5. Requiring exam boards to upgrade
action plans on quality of marking
Issue
Before the summer we wrote to exam
boards to check what actions they
were taking in response to the issues
raised in our Quality of Marking report,
published in February 2014
Exam boards wrote back during the
summer with action plans which we
have reviewed
What we’re going to do
We have identified the need for more
detailed plans to be produced to
address outstanding areas of concern
raised in our original Quality of
Marking report
We expect revised action plans to be
with us by early November for
review. We will then monitor their
implementation as part of our regular
audit activity.
10. 6. Requiring exam boards to improve their
monitoring of markers as they mark
Issue
Over 50,000 markers are involved in
GCSE and A level marking: the vast
majority behave with utmost
professionalism
But some rogue markers may need to
be weeded out
Online marking opens the possibility of
marker probity systems: real time
data analysis to identify patterns that
would trigger investigation and action
What we’re going to do
2015: require exam boards to:
Tell us how they currently monitor
marker probity
Consider how they could improve
these systems
Consider implementing new, more
robust systems
Summer 2015: some improvements to
marker monitoring will be in place
Summer 2016: noticeable improvements
to quality control systems will have been
made
11. 7. Evaluating the effectiveness of marker
training
Issue
Standardisation of markers is
increasingly being carried out online
Online standardisation has cost and
speed advantages and can be as good
as face-to-face training
But online standardisation is unpopular
with some markers
And exam boards vary greatly in how
they deliver it – the quality of online
standardisation is not always as high as
it could be
What we’re going to do
Conduct an extensive evaluation of the
impact of online standardisation on
marking quality:
Differences between exam boards
Where does it work
Where does it not work, and why
Audit exam boards’ standardisation
processes in summer 2015
Carry out a research evaluation of the
impact of online standardisation on
marking quality
Investigate how boards monitor and
improve their standardisation processes
over time
12. Summary of actions
Action Nov Dec Jan
2015
Feb Mar Summer
2015
Summer
2016
Summer
2017
Exam boards submit detailed EAR data analysis
We publish our report of the boards’ EAR data and analyses
We launch consultation on our proposals to overhaul the EAR
and Appeals process
Deadline for boards to have detailed QoM action plans in place
Boards start reporting on the impact of their QoM plans on the
summer exam series
We audit exam boards’ standardisation processes
Some improvements to examiner monitoring are in place
Some reforms to the EAR and Appeals process are in place
We begin to report findings from our research into levels based
mark schemes
All reforms to EAR and Appeals process are implemented
Noticeable improvements to exam boards’ quality control
systems are in place
Standardised QoM indicators are in place for reformed GCSEs
and A levels