NAFEA 2019 Presentation - A framework for quality assurance
Matthew Campbell (QUT) Dr.Ricky Tunny (QUT)
Leoni Russell (RMIT) Prof.Lorraine Smith (USyd)
Em. Prof.Lindy McAllister (USyd) Dr.Kate Thomson (USyd)
This researchhasbeen supported by an ACENResearchGrant.
A framework to support institution-wide
quality assurance of work integrated
• Outline of project
• Mapping the current landscape of quality and WIL
• Exploring constructs of quality in WIL
• Unpacking the framework
• Benchmarking for quality using the framework
3. Project aim
Undertake a review of existinginstrumentsand approachesto quality
assuranceof WIL across Australianuniversities,to develop and
benchmark a sharedqualityassuranceframework to supportthe
4. Project timeline
Development ofdraft framework
● Validation workshops with expert panels
● Survey validating quality indicators
● Institutional-level andfaculty-
level benchmarking case study
● Literature review anddesktop
analysis ofexisting practice
● Interviews with a rangeof academic
andprofessional staff anduniversity
Publication of validatedframework
Benchmarking and‘how to’ guidance
6. Understanding quality in HE
• Whodefines what is ‘quality’?
• What practices does your institution currently use to assure
• How are these practices used in respect of teaching and
7. Understanding WIL
“A better understanding of WIL parameters and attributes is needed to inform discussions
between and among key stakeholders including students, institutions, employers, and
governments. Without such, the potential for developing and promoting appropriate offerings,
conducting meaningful research, collecting data, developing quality standards, and assessing
impact is limited.”
McRae andJohnston (2016, p. 338, emphasis added)
9. Theoretical framing
• WILis acomplexinterconnection ofa variety of elements acrossfourspaces ofoutcomes,relationships,resources andcontext
• WILis understoodasstudentexperiences ofworkwithincurriculum, undertakenin partnership, throughengagementwith
authenticandgenuine activitieswithandforindustry,businessor communitypartners,andwhich are assessed.
10. Presage, product, process
• ‘3P model’ of quality (Biggs,1993; Gibbs, 2010): the context beforestudents learn (presage),
what goes on during their learning (process) and the outcomesof thatlearning (product).
• Theframework is built around four domains ofpractice: (1) student experience,(2) curriculum design, (3)
institutional requirements, (4) stakeholder engagement
• Within each element, based on the literature review, expertinterviews and stakeholder feedback, area set of
• Each standard of practice is brought to life through inclusion of examplesof possible evidence and
• Themodel reflects that which has been used in othernational standards, for example the AITSL National
15. DOMAINS Student Experience Curriculum Design Institutional Requirements Stakeholder Engagement
A quality WIL experience should provide students with
a scaffolded, connected and supported pedagogical
A quality WIL curriculum should contain embedded,
accessible and transformative learning and assessment
within an intended and enacted curriculum.
Quality WIL activity across institutions should be
evidenced by the proper management of staff, risk
management and reporting around WIL experiences
supporting continual improvement.
Quality WIL experiences are supported by engagement,
connection and responsiveness to the dynamic
expectations of diverse stakeholders (industry,
community, government, higher education sector,
professional bodies, students).
Standard 1.1 Ensure student readiness and
preparation for learning in the workplace
Standard 1.2 Student WIL experiences are
connected to prior and future learning and
Standard 1.3 Student WIL experiences align
with their learning goals and capabilities
Standard 2.1 WIL experiences are embedded
through a whole-of-qualification curriculum
design underpinned by current research and
Standard 2.2 Students and industry are partners
in the design of WIL curriculum
Standard 3.1 Institutions have shared goals,
policies, principles and values about WIL
Standard 3.2 Institutions have identifiable
leadership and governance structures for WIL
Standard 3.3 WIL is supported by adequate and
effective IT and administrative systems
Standard 4.1 Diverse stakeholders are active
participants across WIL activities
Standard 4.2 Partner sites are reviewed for
health and safety, and suitability for WIL activities
Standard 1.4 Student WIL experiences are safe
Standard 1.5 Student WIL experiences offer
scaffolded learning opportunities
Standard 1.6 Support and guidance is provided
for students within the WIL experience
Standard 2.3 WIL curriculum design reflects
professional accreditation requirements and
ongoing career and employability development
Standard 2.4 WIL curriculum design provides
inclusive, equitable and accessible experiences
Standard 2.5 WIL assessment design is supported
by authentic tasks, aligned with learning goals
and graduate outcomes
Standard 3.4 Institutions provide targeted
professional development for academic and
professional staff, and industry and community
Standard 3.5 Enacted legal and risk management
frameworks, compliance procedures and
Standard 4.3 Institution has effective policies and
procedures in place for ongoing quality assurance
of stakeholders including partner agreements,
financial arrangements, and supervision quality
Standard 4.4 Institutions undertake site contact
and stakeholder communication
Standard 4.5 Effective and sustainable
relationship management including appropriate
communication, reward and recognition
Standard 1.7 Students receive, use, and provide
feedback on WIL experience to ensure progress
towards learning goals
Standard 2.6 Student learning gains are
measurable against intended outcomes
Standard 2.7 Benchmarking of WIL assessment
and identification of areas for improvement
Standard 3.6 Provision of funding, resourcing,
support, and recognition necessary to achieve
WIL strategic goals
Standard 3.7 Evaluation and tracking of short to
long term WIL outcomes for continuous quality
Standard 4.6 Partnership arrangements are
16. Example (Standard 2.2)
2. Curriculum Design
Standard 2.2: Students and industryare partnersin the design of WILcurriculum
Achievement ofthis standardmaybeevidenced by:
• Engagement of keyindustryand communityleaders in curriculumdesign advisory panels
• Useof past and prospective students in supporting the curriculumdesign process
• Execution and use of student and industry feedback to inform curriculumdesign and ongoing improvement
• Positive perceptions by students and industry of the appropriateness and relevanceof the curriculum
17. Considering the standards
• Focusononedimension oftheframework(e.g. curriculumdesign)
• Thinkaboutwhetherthe presentedstandardsreflect yourexperienceof WILin youruniversity.
• Do these standards thoroughly capture quality practice in this dimension?
• What would successfulpractice look like for these standards?
• How would you evidence successof these standards?
19. Employing the frameworkfor quality assurance
• Benchmarkingwasundertakenatbothaninstitution-wideanddiscipline level utlising the framework.
• Disciplinelevel benchmarkingfocussedoncommon disciplinesbetween University ofSydneyandQUT.
• Reviewofdocumentedevidence andreportonthe “quality”ofthisevidence againstthe standardsofthe framework.
• Initial desktopauditof availableevidence.
• How accessible is theevidence? Accessible, Accessible withsomeeffort,Notaccessible.
• Review withrelevant stakeholderstofill in the “gaps”andensureaccuracy–Unit Coordinators,CourseCoordinators,Associate
• Agree upontheopportunitiesforimprovement anddevelop implementationplanwithagreed timeframes.
• Implementationplanwill continuetobemonitoredandreviewed on aregularbasis.
20. Employing the frameworkfor quality assurance (Lessons
• Types of evidence not limited to the examples cited in the framework.
• Commentaries included on significantmatters.
• Checklist is important to guide the benchmarking process and todocument evidence and
opportunities for improvement.
• Checklist is easy to tickoff but is the evidence effective?
• Important to look at the level of “quality” of the evidence (e.g. elementary, emerging,
21. Employing the framework forquality assurance (Challenges &
• Intended for the useof WIL leaders and practitioners across tertiary institutions, especially when
implementing orreviewing WIL.
• Breadth ofthe framework goes acrossall facets of practice.
• An individual may focus on one or more domains toreviewtheir practice.
• But the intention is for a holistic approach to reviewing WIL.
• Provide guidance to reviewWIL practice across an institution.
• Promote institutional-wide reflective culture ofongoing quality assurance, quality improvement (and
compliance with quality assurance standards of WIL).
• Regularity of review: annually, aligned with internal and external accreditation processes, whenthere are
changes to the curriculum.
23. Reviewingevidence within the framework
A draft copyof the complete frameworkis available at: http://bit.ly/WILQualityDraft
• Review the draft framework in light of what you thought would be appropriate evidence.
• Is the framework consistent with your thinking?
• Do you have examples of practice which you may be able to contribute to the final
25. Mapping a quality process
• Whoare theactorsinvolvedinthelifecycleofWIL at youruniversity?
• HowiscommunicationorganizedwithinyourWIL area (university,faculty,school,course)?
• What kindofqualityproceduresalreadyexistaroundyourWIL area?
26. Developing an action plan
A good action plan should:
• Be specificto the issues identified
• Be written in consultation with key stakeholders
• Identify priorities, specific targets and outcomes
• Include indicators and criteria for recognizing improvements
• Be manageable and achievable
27. Developing an action plan
Standard Where are we now
Where do we want
How will we get
How will we know
Partner sites are
reviewed for health and
safety, and suitability for
• Regular reports of
WHS incidents on
provided to the
• Incidents are
recorded in central
• Annual report is
identify patterns and
• Increase the number
of on site visits and
• Develop and
for partner sites
bullying policy and
28. Future considerations
• Finalframework should be published by mid-November, 2019
• Opportunities exist for further research to:
• Extend the framework to all post-secondary settings (e.g.vocational education)
• Support the benchmarking of WIL practice across Australian higher education
• Cross-mapping of framework with global experiences of WIL
• To keep up to date email: email@example.com