SlideShare a Scribd company logo
Elements of a quality assessment
system
Kerrie-Anne Sommerfeld
Rubric Training Solutions
1. What I want to know is……………..
2. My role is teacher/manager/consultant/other?
1311
0
NUMBER OF RTOS AUDITED BY ASQA
2013 - 2014
assessments done
properly 26%
assessments needs
improvement
74%
% RTOS MEETING ASSESSMENT REQUIREMENTS
Common assessment issues
Presentation Title Here
Common assessment issues
Presentation Title Here
• Assessments don’t assess what they are meant to assess
• Assessments are too hard/ too easy
• Lack of clear instructions to students & assessors
• No (or unreliable) marking criteria
• Third party evidence put forward as primary evidence
• Not enough evidence to make sound assessment judgements
• Lack of industry consultation
• Assessors don’t have currency/competency at the unit level
• Assessments not being validated or not validated ‘properly’
Standards for RTOs 2015
Conduct effective assessment 1.8 – 1.12
Overview
1.8 RTOs have an assessment system in place
A system to ensure assessments
• Meet the principles of assessment and rules of evidence
• Meet the requirements of the Training Package
• Including RPL assessments
Where to start?
Build strong foundations
accountability
Build strong foundations
Build strong foundations
Assessment policies and procedures
• Developing/identifying good assessments
• Conducting assessment
• Recording and storing assessments
• Validating assessment
Templates
• Assessment validation schedule
• Assessment validation report
• Assessment mapping template
• Assessment task templates
Policies and procedures
Policy and/or procedure Templates / guidelines
1. Plan assessment TAS
Industry consultation record
2. Develop assessment tools Assessment task templates for:
Practical assessments
Knowledge assessments
Portfolio assessments
RPL assessments
Third party evidence
3. Map assessments Assessment mapping templates
4. Validate assessments Assessment Validation Report
Validation schedule for all qualifications/skills sets/ stand
alone units
5. Conducting assessment Assessment appeals
Time for assessments to be judged
Recording results
RTO allowance for repeating assessments
Retention and storage of assessments
6. Evaluating assessments Student feedback/industry feedback/Continuous
improvement strategies
Qualification
e.g SIB50110
Overview docs
Unit code 1
Unit code 2
Unit code 3
Unit code 4
Unit code 5
etc
Assessment mapping
Assessment validation
Delivery/session plans
Assessments
Learner guide
Teacher guide
TAS
Assessment validation
schedule
Industry consultation
Student feedback
Work placement
Suggested training and assessment system
Policies/ Procedures/ templates/professional
development/management support/monitoring
Why is validation so important?
Validation is
quality control
of your training
and assessment
Training and
assessment strategy
for the qualification
Assessment tasks
Mapping information
for at least 2
units/qualification
Sample of completed
student assessments
Checking our assessments are ok
Assess the skills and knowledge required by the unit
Relevant to work practices
Clear instructions to students
Clear instructions to assessors
Good marking guides
Don’t over assess/ assess things not required
Can be adjusted for certain learners
Our judgements of competent/ not yet competent are
reasonable
Validation schedule for all qualifications/skill sets/
Stand alone units
What units, when and who
2015 Year 1
Qualification (e.g. 15 units)
2016
2017
2018
2019 Year 5
Assessments for at least 2 units
including a sample of completed
assessments have been validated
AURE318866A
Repair electrical systems
Current TAE qualification or
assessor skill set and a
trainer/assessor of this unit
using these assessments
AURE318866A
Repair electrical systems
Current TAE qualification or
assessor skill set
Current industry skills and
knowledge in the unit but not
using these assessments
Current TAE qualification or
assessor skill set and a
trainer/assessor of this unit
using these assessments
AURE318866A
Repair electrical systems
Current industry skills and
knowledge in the unit but is
not a qualified trainer/assessor
Current TAE qualification or
assessor skill set
Current industry skills and
knowledge in the unit but not
using these assessments
Current TAE qualification
or assessor skill set
without the skills and
knowledge in the unit
Current TAE qualification or
assessor skill set and a
trainer/assessor of this unit
using these assessments
TAE Training and Education
And for providers of
Standards for RTOs 2015
Delivery of TAE qualifications 1.21 – 1.25
Overview
By 2016
trainers delivering any qualification or skill set from the TAE Training
Package must hold the qualification at least to the level they are
delivering or higher level qualification in adult education
Demonstrate that the assessments, policies and procedures have
been independently validated
By 2017
Trainers delivering any qualification or skill set from the TAE Training
Package must hold will need to hold a TAE Diploma or higher level
qualification in adult education to deliver any TAE qualification or
skill set or work under supervision of a person that does.
TAE qualifications
TAE assessor skill set
Current knowledge and
skills in VET learning and
teaching
The TAE qualification or
skill set to the level
being validated
TAE qualifications
TAE assessor skill set
Current knowledge and
skills in VET learning and
teaching
The TAE qualification or
skill set to the level
being validated
Not employed or
subcontracted by the
RTO
Have no other
involvement or
interest in the
operations of the RTO
The resources your RTO
uses for training And
how you structure your
delivery
The industry skills and
knowledge trainers and
assessors need
Your training strategies and resources
That assessments ensure
graduates have the skills and
knowledge required by
industry and the units of
competency
Assessment methods
Ask and record industry responses to the following questions :
Do the assessment method/s reflect workplace situations?
Is the workplace environment appropriately simulated?
Do assessments demonstrate that students can apply their skills in
different situations?
Are Assessments assessing things not required by the unit?
Do these assessments equip students with entry level skills
expected by the unit for my industry?
Other comments?
TAE Training and Education
And for providers of
Training and
assessment strategy
for the qualification
Assessment tasks
Mapping information
Completed student
assessments
Assessment policies and
procedures
• Developing/identifying good
assessments
• Conducting assessment
• Recording and storing assessments
• Validating assessment
Refer to
• ASQA’s Guide to RTO Standards
• ASQA Fact Sheet: Conducting Validation
• ASQA Fact Sheet: Using third party evidence
to assess competency
• ASQA Guide: Developing Assessment Tools
Key requirements of assessments
1. Clear written instructions to students including:
How they will be assessed, when, when, how long they have, what
resources/equipment they need to supply, what
resources/equipment will be supplied
2. Clear written instructions to assessors including:
Any special requirements in terms of setting up for assessment, how
much support students can be provided, how to record results and
store completed assessments
3. Detailed marking guide
E.g. Observations checklist/ model answers to questions/rubric
4. Meet Principles of Assessment and Rules of Evidence
Do your assessments meet the principles of assessment?
Principles of assessment - VRFF
Valid Reliable
Flexible Fair
Validation includes reviewing a statistically valid
sample of completed assessments against the
rules of evidence.
refer to ASQA’s validation sample size calculator in the
Conducting Validation fact sheet
Rules of Evidence
Valid Current
Sufficient Authentic
(VIC / SA)
Policy and/or procedure Templates / guidelines
1. Plan assessment TAS
Industry consultation record
2. Develop assessment tools Assessment task templates for:
Practical assessments
Knowledge assessments
Portfolio assessments
RPL assessments
Third party evidence
3. Map assessments Assessment mapping templates
4. Validate assessments Assessment Validation Report
Validation schedule for all qualifications/skills sets/ stand
alone units
5. Conducting assessment Assessment appeals
Time for assessments to be judged
Recording results
RTO allowance for repeating assessments
Retention and storage of assessments
6. Evaluating assessments Student feedback/industry feedback/Continuous
improvement strategies
The quality stamp
Other associated webinars on this topic:
• Techniques to help you successfully map assessments
• Engage effectively with employers and industry
• Volume of learning and amount of training –
introduction
• ACPET Validation Sessions in Victoria initially then
nationally - sharyn.bellingham@acpet.edu.au

More Related Content

What's hot

Validity, Reliability and Feasibility
Validity, Reliability and FeasibilityValidity, Reliability and Feasibility
Validity, Reliability and Feasibility
Jasna3134
 
ENC Msc 2a Unit Research Critique.pptx
ENC Msc 2a Unit Research Critique.pptxENC Msc 2a Unit Research Critique.pptx
ENC Msc 2a Unit Research Critique.pptx
Chinna Chadayan
 
How to ace Phd/Doctoral final oral defense or viva voce'
How to ace Phd/Doctoral final oral defense or viva voce'How to ace Phd/Doctoral final oral defense or viva voce'
How to ace Phd/Doctoral final oral defense or viva voce'
DoctoralNet Limited
 
What is assessment ‫‬
What is assessment ‫‬What is assessment ‫‬
What is assessment ‫‬
Ali Shaqour
 
Writing literature review
Writing literature reviewWriting literature review
Writing literature review
Preeti Bhaskar
 
Research Critique.pptx
Research Critique.pptxResearch Critique.pptx
Research Critique.pptx
Asokan R
 
Alternative assessment
Alternative assessmentAlternative assessment
Alternative assessment
Hernán Sarasty
 
A review of State of the Art in X (SOTAX)
A review of State of the Art in X (SOTAX) A review of State of the Art in X (SOTAX)
A review of State of the Art in X (SOTAX)
Togar Simatupang
 
Test construction
Test constructionTest construction
Test construction
lpiresha
 
Personal statement format
Personal statement formatPersonal statement format
Personal statement format
sigmaessays
 
ITEM ANALYSIS
ITEM ANALYSISITEM ANALYSIS
ITEM ANALYSIS
MEF Ramos
 
Rubrics.pptx
Rubrics.pptxRubrics.pptx
Rubrics.pptx
Manjeet Yadav
 
Test Construction
Test ConstructionTest Construction
Test Construction
Dr. Cristobal
 
Reading for the Real World 3rd Edition
Reading for the Real World 3rd EditionReading for the Real World 3rd Edition
Reading for the Real World 3rd Edition
Compass Publishing
 
Principles and Techniques of Test Construction
Principles and Techniques of Test ConstructionPrinciples and Techniques of Test Construction
Principles and Techniques of Test Construction
Olufemi Jeremiah Olubodun
 
Six system inspection model
Six system inspection modelSix system inspection model
Six system inspection model
AartiThakur71
 
Portfolio Revision
Portfolio RevisionPortfolio Revision
Portfolio Revision
Anisahunitsatu
 
Reporting Test Results to Parents
Reporting Test Results to ParentsReporting Test Results to Parents
Reporting Test Results to Parents
Dr. Amjad Ali Arain
 
Installation Qualification.pdf
Installation Qualification.pdfInstallation Qualification.pdf
Installation Qualification.pdf
Muhammad Asim Niazi
 

What's hot (20)

Validity, Reliability and Feasibility
Validity, Reliability and FeasibilityValidity, Reliability and Feasibility
Validity, Reliability and Feasibility
 
ENC Msc 2a Unit Research Critique.pptx
ENC Msc 2a Unit Research Critique.pptxENC Msc 2a Unit Research Critique.pptx
ENC Msc 2a Unit Research Critique.pptx
 
Thesis writing apa format
Thesis writing apa formatThesis writing apa format
Thesis writing apa format
 
How to ace Phd/Doctoral final oral defense or viva voce'
How to ace Phd/Doctoral final oral defense or viva voce'How to ace Phd/Doctoral final oral defense or viva voce'
How to ace Phd/Doctoral final oral defense or viva voce'
 
What is assessment ‫‬
What is assessment ‫‬What is assessment ‫‬
What is assessment ‫‬
 
Writing literature review
Writing literature reviewWriting literature review
Writing literature review
 
Research Critique.pptx
Research Critique.pptxResearch Critique.pptx
Research Critique.pptx
 
Alternative assessment
Alternative assessmentAlternative assessment
Alternative assessment
 
A review of State of the Art in X (SOTAX)
A review of State of the Art in X (SOTAX) A review of State of the Art in X (SOTAX)
A review of State of the Art in X (SOTAX)
 
Test construction
Test constructionTest construction
Test construction
 
Personal statement format
Personal statement formatPersonal statement format
Personal statement format
 
ITEM ANALYSIS
ITEM ANALYSISITEM ANALYSIS
ITEM ANALYSIS
 
Rubrics.pptx
Rubrics.pptxRubrics.pptx
Rubrics.pptx
 
Test Construction
Test ConstructionTest Construction
Test Construction
 
Reading for the Real World 3rd Edition
Reading for the Real World 3rd EditionReading for the Real World 3rd Edition
Reading for the Real World 3rd Edition
 
Principles and Techniques of Test Construction
Principles and Techniques of Test ConstructionPrinciples and Techniques of Test Construction
Principles and Techniques of Test Construction
 
Six system inspection model
Six system inspection modelSix system inspection model
Six system inspection model
 
Portfolio Revision
Portfolio RevisionPortfolio Revision
Portfolio Revision
 
Reporting Test Results to Parents
Reporting Test Results to ParentsReporting Test Results to Parents
Reporting Test Results to Parents
 
Installation Qualification.pdf
Installation Qualification.pdfInstallation Qualification.pdf
Installation Qualification.pdf
 

Similar to Elements of a quality assessment system

Developing the assessment skills of VET teachers
Developing the assessment skills of VET teachersDeveloping the assessment skills of VET teachers
Developing the assessment skills of VET teachers
Kerrie-Anne Sommerfeld
 
Can We Demonstrate the Difference that Norwegian Aid makes? - Evaluation of t...
Can We Demonstrate the Difference that Norwegian Aid makes? - Evaluation of t...Can We Demonstrate the Difference that Norwegian Aid makes? - Evaluation of t...
Can We Demonstrate the Difference that Norwegian Aid makes? - Evaluation of t...Itad Ltd
 
Top compliance challenges for trainers and assessors
Top compliance challenges for trainers and assessorsTop compliance challenges for trainers and assessors
Top compliance challenges for trainers and assessors
ACPET Professional Development
 
Validation and moderation workshop Session 1
Validation and moderation workshop Session 1Validation and moderation workshop Session 1
Validation and moderation workshop Session 1SarinaRussoInstitute
 
PLAN ASSESSMENT ACTIVITIES AND PROCESSES
PLAN ASSESSMENT ACTIVITIES AND PROCESSESPLAN ASSESSMENT ACTIVITIES AND PROCESSES
PLAN ASSESSMENT ACTIVITIES AND PROCESSES
Surono Surono
 
What is Validation and why do RTOs need to complete the Process?
What is Validation and why do RTOs need to complete the Process?What is Validation and why do RTOs need to complete the Process?
What is Validation and why do RTOs need to complete the Process?
Skynet Education
 
8.TYPES AND METHODS OF ASSESSMENT.pptx
8.TYPES AND METHODS OF ASSESSMENT.pptx8.TYPES AND METHODS OF ASSESSMENT.pptx
8.TYPES AND METHODS OF ASSESSMENT.pptx
SamuelLepariyo
 
Admin Irene C PD
Admin Irene C PDAdmin Irene C PD
Admin Irene C PDIrene Casey
 
IntroductionPurposeThis document provides necessary informatio.docx
IntroductionPurposeThis document provides necessary informatio.docxIntroductionPurposeThis document provides necessary informatio.docx
IntroductionPurposeThis document provides necessary informatio.docx
mariuse18nolet
 
Alan Perkins Innovate presentation
Alan Perkins Innovate presentationAlan Perkins Innovate presentation
Alan Perkins Innovate presentation
Mike Harris
 
Evaluation of training
Evaluation of trainingEvaluation of training
Evaluation of training
Self-employed
 
Compliance, Assessments and Activity Tracking
Compliance, Assessments and Activity TrackingCompliance, Assessments and Activity Tracking
Compliance, Assessments and Activity Tracking
Kenneth Scott Huntley
 
Tae assessment cluster part 1
Tae assessment cluster   part 1Tae assessment cluster   part 1
Tae assessment cluster part 110shilcl
 
Moderation workshop dietetics april 2017b
Moderation workshop dietetics april 2017bModeration workshop dietetics april 2017b
Moderation workshop dietetics april 2017b
Rita Ndagire Kizito
 
Ppt elements of compliant tas webinar v2 032015
Ppt elements of compliant tas webinar v2 032015Ppt elements of compliant tas webinar v2 032015
Ppt elements of compliant tas webinar v2 032015
ACPET Professional Development
 
Training program effectiveness a measuring instrument (1)
Training program effectiveness a measuring instrument (1)Training program effectiveness a measuring instrument (1)
Training program effectiveness a measuring instrument (1)
TheGrowthFactor
 
NCA PGR Session 7 May 02 2018
NCA PGR Session 7 May 02 2018NCA PGR Session 7 May 02 2018
NCA PGR Session 7 May 02 2018
CHC Connecticut
 
NCA Residency Session 8 April 5 2017
NCA Residency Session 8 April 5 2017NCA Residency Session 8 April 5 2017
NCA Residency Session 8 April 5 2017
CHC Connecticut
 
CPEC Assessment Pilot JIT Training
CPEC Assessment Pilot JIT TrainingCPEC Assessment Pilot JIT Training
CPEC Assessment Pilot JIT Training
Peter Stinson
 

Similar to Elements of a quality assessment system (20)

Developing the assessment skills of VET teachers
Developing the assessment skills of VET teachersDeveloping the assessment skills of VET teachers
Developing the assessment skills of VET teachers
 
Can We Demonstrate the Difference that Norwegian Aid makes? - Evaluation of t...
Can We Demonstrate the Difference that Norwegian Aid makes? - Evaluation of t...Can We Demonstrate the Difference that Norwegian Aid makes? - Evaluation of t...
Can We Demonstrate the Difference that Norwegian Aid makes? - Evaluation of t...
 
Top compliance challenges for trainers and assessors
Top compliance challenges for trainers and assessorsTop compliance challenges for trainers and assessors
Top compliance challenges for trainers and assessors
 
Validation and moderation workshop Session 1
Validation and moderation workshop Session 1Validation and moderation workshop Session 1
Validation and moderation workshop Session 1
 
PLAN ASSESSMENT ACTIVITIES AND PROCESSES
PLAN ASSESSMENT ACTIVITIES AND PROCESSESPLAN ASSESSMENT ACTIVITIES AND PROCESSES
PLAN ASSESSMENT ACTIVITIES AND PROCESSES
 
What is Validation and why do RTOs need to complete the Process?
What is Validation and why do RTOs need to complete the Process?What is Validation and why do RTOs need to complete the Process?
What is Validation and why do RTOs need to complete the Process?
 
8.TYPES AND METHODS OF ASSESSMENT.pptx
8.TYPES AND METHODS OF ASSESSMENT.pptx8.TYPES AND METHODS OF ASSESSMENT.pptx
8.TYPES AND METHODS OF ASSESSMENT.pptx
 
Admin Irene C PD
Admin Irene C PDAdmin Irene C PD
Admin Irene C PD
 
IntroductionPurposeThis document provides necessary informatio.docx
IntroductionPurposeThis document provides necessary informatio.docxIntroductionPurposeThis document provides necessary informatio.docx
IntroductionPurposeThis document provides necessary informatio.docx
 
Alan Perkins Innovate presentation
Alan Perkins Innovate presentationAlan Perkins Innovate presentation
Alan Perkins Innovate presentation
 
Meeting Standard 1 - A guide for RTOs
Meeting Standard 1 - A guide for RTOsMeeting Standard 1 - A guide for RTOs
Meeting Standard 1 - A guide for RTOs
 
Evaluation of training
Evaluation of trainingEvaluation of training
Evaluation of training
 
Compliance, Assessments and Activity Tracking
Compliance, Assessments and Activity TrackingCompliance, Assessments and Activity Tracking
Compliance, Assessments and Activity Tracking
 
Tae assessment cluster part 1
Tae assessment cluster   part 1Tae assessment cluster   part 1
Tae assessment cluster part 1
 
Moderation workshop dietetics april 2017b
Moderation workshop dietetics april 2017bModeration workshop dietetics april 2017b
Moderation workshop dietetics april 2017b
 
Ppt elements of compliant tas webinar v2 032015
Ppt elements of compliant tas webinar v2 032015Ppt elements of compliant tas webinar v2 032015
Ppt elements of compliant tas webinar v2 032015
 
Training program effectiveness a measuring instrument (1)
Training program effectiveness a measuring instrument (1)Training program effectiveness a measuring instrument (1)
Training program effectiveness a measuring instrument (1)
 
NCA PGR Session 7 May 02 2018
NCA PGR Session 7 May 02 2018NCA PGR Session 7 May 02 2018
NCA PGR Session 7 May 02 2018
 
NCA Residency Session 8 April 5 2017
NCA Residency Session 8 April 5 2017NCA Residency Session 8 April 5 2017
NCA Residency Session 8 April 5 2017
 
CPEC Assessment Pilot JIT Training
CPEC Assessment Pilot JIT TrainingCPEC Assessment Pilot JIT Training
CPEC Assessment Pilot JIT Training
 

More from ACPET Professional Development

Managing compliance with the esos framework take the worry out updated
Managing compliance with the esos framework   take the worry out updatedManaging compliance with the esos framework   take the worry out updated
Managing compliance with the esos framework take the worry out updated
ACPET Professional Development
 
introduction to the standards
introduction to the standardsintroduction to the standards
introduction to the standards
ACPET Professional Development
 
Introduction to the vet sector
Introduction to the vet sectorIntroduction to the vet sector
Introduction to the vet sector
ACPET Professional Development
 

More from ACPET Professional Development (9)

Quality in assessment
Quality in assessmentQuality in assessment
Quality in assessment
 
Tp and uo c pp webinar
Tp and uo c pp webinarTp and uo c pp webinar
Tp and uo c pp webinar
 
Unpacking a training package
Unpacking a training packageUnpacking a training package
Unpacking a training package
 
Top 10 non compliances
Top 10 non compliancesTop 10 non compliances
Top 10 non compliances
 
Managing compliance with the esos framework take the worry out updated
Managing compliance with the esos framework   take the worry out updatedManaging compliance with the esos framework   take the worry out updated
Managing compliance with the esos framework take the worry out updated
 
Meeting the cricos standards v1 15
Meeting the cricos standards v1 15Meeting the cricos standards v1 15
Meeting the cricos standards v1 15
 
Acpet planning and conducting internal audit
Acpet planning and conducting internal auditAcpet planning and conducting internal audit
Acpet planning and conducting internal audit
 
introduction to the standards
introduction to the standardsintroduction to the standards
introduction to the standards
 
Introduction to the vet sector
Introduction to the vet sectorIntroduction to the vet sector
Introduction to the vet sector
 

Recently uploaded

The Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptxThe Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptx
DhatriParmar
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
Levi Shapiro
 
Guidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th SemesterGuidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th Semester
Atul Kumar Singh
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
Peter Windle
 
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
Nguyen Thanh Tu Collection
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
Jisc
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
Tamralipta Mahavidyalaya
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
Pavel ( NSTU)
 
Digital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and ResearchDigital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and Research
Vikramjit Singh
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
Special education needs
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
RaedMohamed3
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
Honest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptxHonest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptx
timhan337
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
camakaiclarkmusic
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
Delapenabediema
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
EugeneSaldivar
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
Jisc
 

Recently uploaded (20)

The Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptxThe Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptx
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
 
Guidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th SemesterGuidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th Semester
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
 
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 
Digital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and ResearchDigital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and Research
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
Honest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptxHonest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptx
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
 

Elements of a quality assessment system

  • 1. Elements of a quality assessment system Kerrie-Anne Sommerfeld Rubric Training Solutions
  • 2. 1. What I want to know is…………….. 2. My role is teacher/manager/consultant/other?
  • 3.
  • 4. 1311 0 NUMBER OF RTOS AUDITED BY ASQA 2013 - 2014
  • 5. assessments done properly 26% assessments needs improvement 74% % RTOS MEETING ASSESSMENT REQUIREMENTS
  • 7. Common assessment issues Presentation Title Here • Assessments don’t assess what they are meant to assess • Assessments are too hard/ too easy • Lack of clear instructions to students & assessors • No (or unreliable) marking criteria • Third party evidence put forward as primary evidence • Not enough evidence to make sound assessment judgements • Lack of industry consultation • Assessors don’t have currency/competency at the unit level • Assessments not being validated or not validated ‘properly’
  • 8. Standards for RTOs 2015 Conduct effective assessment 1.8 – 1.12 Overview 1.8 RTOs have an assessment system in place A system to ensure assessments • Meet the principles of assessment and rules of evidence • Meet the requirements of the Training Package • Including RPL assessments
  • 11.
  • 15. Assessment policies and procedures • Developing/identifying good assessments • Conducting assessment • Recording and storing assessments • Validating assessment Templates • Assessment validation schedule • Assessment validation report • Assessment mapping template • Assessment task templates
  • 17.
  • 18. Policy and/or procedure Templates / guidelines 1. Plan assessment TAS Industry consultation record 2. Develop assessment tools Assessment task templates for: Practical assessments Knowledge assessments Portfolio assessments RPL assessments Third party evidence 3. Map assessments Assessment mapping templates 4. Validate assessments Assessment Validation Report Validation schedule for all qualifications/skills sets/ stand alone units 5. Conducting assessment Assessment appeals Time for assessments to be judged Recording results RTO allowance for repeating assessments Retention and storage of assessments 6. Evaluating assessments Student feedback/industry feedback/Continuous improvement strategies
  • 19. Qualification e.g SIB50110 Overview docs Unit code 1 Unit code 2 Unit code 3 Unit code 4 Unit code 5 etc Assessment mapping Assessment validation Delivery/session plans Assessments Learner guide Teacher guide TAS Assessment validation schedule Industry consultation Student feedback Work placement Suggested training and assessment system Policies/ Procedures/ templates/professional development/management support/monitoring
  • 20. Why is validation so important?
  • 21. Validation is quality control of your training and assessment
  • 22. Training and assessment strategy for the qualification Assessment tasks Mapping information for at least 2 units/qualification Sample of completed student assessments
  • 23. Checking our assessments are ok Assess the skills and knowledge required by the unit Relevant to work practices Clear instructions to students Clear instructions to assessors Good marking guides Don’t over assess/ assess things not required Can be adjusted for certain learners Our judgements of competent/ not yet competent are reasonable
  • 24. Validation schedule for all qualifications/skill sets/ Stand alone units What units, when and who 2015 Year 1 Qualification (e.g. 15 units) 2016 2017 2018 2019 Year 5 Assessments for at least 2 units including a sample of completed assessments have been validated
  • 25. AURE318866A Repair electrical systems Current TAE qualification or assessor skill set and a trainer/assessor of this unit using these assessments
  • 26. AURE318866A Repair electrical systems Current TAE qualification or assessor skill set Current industry skills and knowledge in the unit but not using these assessments Current TAE qualification or assessor skill set and a trainer/assessor of this unit using these assessments
  • 27. AURE318866A Repair electrical systems Current industry skills and knowledge in the unit but is not a qualified trainer/assessor Current TAE qualification or assessor skill set Current industry skills and knowledge in the unit but not using these assessments Current TAE qualification or assessor skill set without the skills and knowledge in the unit Current TAE qualification or assessor skill set and a trainer/assessor of this unit using these assessments
  • 28. TAE Training and Education And for providers of
  • 29. Standards for RTOs 2015 Delivery of TAE qualifications 1.21 – 1.25 Overview By 2016 trainers delivering any qualification or skill set from the TAE Training Package must hold the qualification at least to the level they are delivering or higher level qualification in adult education Demonstrate that the assessments, policies and procedures have been independently validated By 2017 Trainers delivering any qualification or skill set from the TAE Training Package must hold will need to hold a TAE Diploma or higher level qualification in adult education to deliver any TAE qualification or skill set or work under supervision of a person that does.
  • 30. TAE qualifications TAE assessor skill set Current knowledge and skills in VET learning and teaching The TAE qualification or skill set to the level being validated
  • 31. TAE qualifications TAE assessor skill set Current knowledge and skills in VET learning and teaching The TAE qualification or skill set to the level being validated Not employed or subcontracted by the RTO Have no other involvement or interest in the operations of the RTO
  • 32. The resources your RTO uses for training And how you structure your delivery The industry skills and knowledge trainers and assessors need Your training strategies and resources That assessments ensure graduates have the skills and knowledge required by industry and the units of competency Assessment methods
  • 33. Ask and record industry responses to the following questions : Do the assessment method/s reflect workplace situations? Is the workplace environment appropriately simulated? Do assessments demonstrate that students can apply their skills in different situations? Are Assessments assessing things not required by the unit? Do these assessments equip students with entry level skills expected by the unit for my industry? Other comments?
  • 34. TAE Training and Education And for providers of
  • 35. Training and assessment strategy for the qualification Assessment tasks Mapping information Completed student assessments Assessment policies and procedures • Developing/identifying good assessments • Conducting assessment • Recording and storing assessments • Validating assessment
  • 36. Refer to • ASQA’s Guide to RTO Standards • ASQA Fact Sheet: Conducting Validation • ASQA Fact Sheet: Using third party evidence to assess competency • ASQA Guide: Developing Assessment Tools
  • 37. Key requirements of assessments 1. Clear written instructions to students including: How they will be assessed, when, when, how long they have, what resources/equipment they need to supply, what resources/equipment will be supplied 2. Clear written instructions to assessors including: Any special requirements in terms of setting up for assessment, how much support students can be provided, how to record results and store completed assessments 3. Detailed marking guide E.g. Observations checklist/ model answers to questions/rubric 4. Meet Principles of Assessment and Rules of Evidence
  • 38. Do your assessments meet the principles of assessment?
  • 39. Principles of assessment - VRFF Valid Reliable Flexible Fair
  • 40. Validation includes reviewing a statistically valid sample of completed assessments against the rules of evidence. refer to ASQA’s validation sample size calculator in the Conducting Validation fact sheet
  • 41. Rules of Evidence Valid Current Sufficient Authentic (VIC / SA)
  • 42. Policy and/or procedure Templates / guidelines 1. Plan assessment TAS Industry consultation record 2. Develop assessment tools Assessment task templates for: Practical assessments Knowledge assessments Portfolio assessments RPL assessments Third party evidence 3. Map assessments Assessment mapping templates 4. Validate assessments Assessment Validation Report Validation schedule for all qualifications/skills sets/ stand alone units 5. Conducting assessment Assessment appeals Time for assessments to be judged Recording results RTO allowance for repeating assessments Retention and storage of assessments 6. Evaluating assessments Student feedback/industry feedback/Continuous improvement strategies
  • 43.
  • 45. Other associated webinars on this topic: • Techniques to help you successfully map assessments • Engage effectively with employers and industry • Volume of learning and amount of training – introduction • ACPET Validation Sessions in Victoria initially then nationally - sharyn.bellingham@acpet.edu.au