SlideShare a Scribd company logo
1 | P a g e
Brighton Students’ Union
Academic Quality Reporting
Project Case Study
2014
2 | P a g e
Contents
Introduction ....................................................................................................................... 3
Background Brighton Students’ Union............................................................................ 3
Project Aims ...................................................................................................................... 3
Methodology...................................................................................................................... 4
Quality and Enhancement.............................................................................................. 4
Language....................................................................................................................... 4
Benchmarking................................................................................................................ 4
Thematic Approach........................................................................................................ 4
Our Evidence Collection................................................................................................. 5
Structuring the report ..................................................................................................... 6
Engaging with the Institution.............................................................................................. 6
Challenges Faced ............................................................................................................. 6
Impact of the Report ...................................................................................................... 6
Annual Quality Reporting Developments ........................................................................... 7
Student Researchers ..................................................................................................... 7
Working with partner Colleges ....................................................................................... 8
3 | P a g e
INTRODUCTION
BACKGROUND BRIGHTON STUDENTS’ UNION
Brighton Students’ Union works with a university population of around 22,000 across five
campuses in Brighton, Eastbourne and Hastings, alongside our partner colleges as far afield
as Worthing. We have offices across our five main campuses and in two of our partner
colleges but have a core team of central dedicated staff that work on matters of Academic
Quality. In 2014 Brighton Students’ Union restructured creating a specific division for looking
at Academic Quality and covering three main areas:
This would allow us over the academic year increase our ability to engage students in
enhancing the quality of their education and influencing University decision making. At the
core of this we will be working to provide greater support to Course Reps and School Reps
and student-led enhancement activities.
Changes to current activity include increased support and resources for School Reps and
through this for Course Reps and a focus on more in-depth studies of the student
experience. We will also be developing our networks of university staff outside of the Senior
Management of the university to raise awareness of what we do an increase our credibility
with them to influence how they communicate the union to students. There will also be a
greater focus on promoting and supporting students to access ‘What’s Going On?’, Agency
funding and other funding streams within and out with the University relating to their
academic experience.
PROJECT AIMS
Our main aims as set out in the Annual Quality Reporting project were to:
 Create Sustainable annual reporting process and policy to measure impact of SU
and University enhancement and engagement activity and identify issues
 Create links with university reporting processes where this report will be seen as a
valid part of QA and QE institutionally
Student Representation
and Leadership:
Capacity for Doing and
Changing
Reporting and
Research:
Evidencing and
Informing Decisions
Staff Networks for
Change:
Developing
Relationships and
Credibility
4 | P a g e
 Use report to move university language and policy closer to sector in terms of QE
and student partnership
The Annual Quality Report project was intended to enable a partnership between the
Students' Union and the institution to drive positive, well-researched change and strengthen
our ability to communicate and collaborate. Student Written Submissions are produced as
part of the QAA Higher Education review process, providing a valuable and well-informed
tool for both the institution and the Students' Union to understand the student perspective
and how to drive quality. Incorporating elements of a SWS into a rolling programme of
Annual Quality Reporting reduces the once-off burden of producing a SWS, raises the
professionalism and utility of the Students' Union's involvement in quality processes.
Brighton Students’ Union is highly regarded within this project and is being used as a case
study.
METHODOLOGY
QUALITY AND ENHANCEMENT
We wanted out report to will be critical in tone with a view to driving change and enhancing
the student experience. We wanted the project drive change but also to measure the impact
of this change. As such the use of Qualitative data was key, this was also time consuming
so focus needed to be refined and reliability of collection process assured. We also were
keen to have the student voice come through strongly in the report and as such decided that
use of direct quotations from students was more powerful than the use of statistics that can
be seen as arbitrary and risk dehumanising the issues that are having a direct impact on the
lives and academic progress of students.
LANGUAGE
We are in the process of trying to actively change the discourse of the university to reflect
where the sector stands in presently in terms of Quality Enhancement and Student
Engagement and Partnership. Ensuring we are using this language to frame the quality
processes we use is central. We wanted our approach needs to be Quality Enhancement
focused, even through some of our data could flag up assurance issues for the university.
We want to avoid duplicating existing reporting streams where possible.
BENCHMARKING
We decided to benchmark against the recommendations made in the Student Written
Submission from the 2013 QAA Review. We would seek out examples of progress that
have been made towards the recommendations from the Student Written Submission, not
aiming to cover all activity that has taken place but to share best practice by giving an
example of the changes that have been made that relate directly to the previous
recommendations.
THEMATIC APPROACH
While not being able to cover all areas of the student experience in this report but decided to
tackle thematic issues that impact on students across the University. Through examination
of the evidence from our Keep, Stop, Start Survey, the National Student Survey, the Course
Rep Impact report and discussions with sabbatical officers and students we identified areas
where we felt there was the greatest need for change:
5 | P a g e
 Student Engagement: Specifically Course Rep Recruitment and Student Staff
Meetings
 Organisation: Timetabling, Reading Lists
 Resources: IT, Libraries and Specialist
We also identified the three topics for the following year that we would focus on so evidence
collection could begin at the start of the academic year. This will be:
 Assessment Practices
 Feedback to Students
 Student Engagement in Quality Processes – specifically looking at progress on the
Student Engagement in Quality Policy that has been recently implemented.
OUR EVIDENCE COLLECTION
We took a tailored collection approach to each topic area, using slightly different sources.
We did not carry out any additional surveys of students as we already conduct a lot of
surveys and had a lot of information to draw from.
Our sources included:
Keep, Stop, Start Data – This is data we collected during our student engagement week
where we did outreach work on every campus, every day for a week asking students what
the University should keep, stop and start doing.
Course Rep Survey - Our main mechanism for evaluating the course representative system
is the Course Rep Survey. This year the names of 966 course representatives were passed
to the Students’ Union. The response rate for this year’s Course Rep survey was 35%, with
337 reps taking part. The course rep report has a huge resource of qualitative commentary
from course reps on not just their own experience of being a rep but also of the issues faced
by students on their course.
Course Rep Benchmarking Exercise – The NUS benchmarking tool for course rep
systems is designed to enable students’ unions to measure the effectiveness of their course
reps system and identify areas in which it could be improved. It aims to facilitate self-
reflection and consideration of structures within the university and it is also proposed that it
can be used to track developments and improvements over time, we were able to make
reference to our latest benchmarking exercise to show progress that had been made.
National Student Survey Comments – rather than focusing on the numbers we focused on
the student commentary, trying to understand the specifics of what students were
experiencing.
Papers from Boards and Committees – We used these to source specific updates and
progress that had been made against specific recommendations from the previous Student
Written Submission.
Case Studies – We were able to provide specific examples where we had worked with
students and had seen improvements made or serious issues raised.
Sources we did not include:
6 | P a g e
Commentary from the Excellence Awards Nominations – while this is a rich data source
we were did not have the capacity to analyse this fully for inclusion this year.
STRUCTURING THE REPORT
Our report was structured to highlight recommendations from previous reports, progress
made against these, to highlight the current situation and to make further recommendations.
This way we can trace progress and ensure that we are always pushing from change.
ENGAGING WITH THE INSTITUTION
Engagement with this project was well received by the University Senior Management. A
paper to Academic Standards Committee in February 2014 set out how this report and the
other reports produced by the Students’ Union were to fit into the quality processes of the
University. This paper sought to formalise and extend this process and align Students’
Union quality processes with those of the University in a way that drives enhancement,
specifically supporting the implementation of the Student Engagement in Quality Policy and
seek to provide some mechanisms to monitor the impact of changes and developments as a
result of this policy.
Members of the board to agreed that where the reports are tied to specific committees they
are now included in the terms of reference to those committees when they are next
approved and that reports are referred to in both Academic Health and/or the implementation
plan for the Student Engagement in Quality Policy as appropriate to formalise the process.
Overall engagement in the process has been very positive, particularly from Information
Services who were keen to highlight the progress they had made but also to strengthen
communication with the union where students have raised issues so they could be resolved
efficiently.
CHALLENGES FACED
One of the key challenges was to streamlining the data that we had and to decide on what
areas the report will focus on. At present even when we have looked at doing an academic
policy we end up with such a huge amount of issues we want to tackle that everything ends
up looking like an impossible task. It will also be a challenge to prioritise recommendations
from the Student Written Submission which have all been researched in detail.
We are also given additional funding from the University to look at retention and it is are area
we would definitely look at reporting on, tracking our impact on this is extremely difficult as
we can only suggest the correlation between any improvements and it is difficult to estimate
the genuine value of our contribution.
At present there is no way of evaluating exactly what impact reps are having in each school
as this data is not being collected at a school level. Work also needs to be done exploring
the effectiveness of current meetings as places where Reps feel empowered to express the
student view and for change to occur. The following report contains evidence of the nature of
the issues that Course Reps resolve and their experience of their role. In addition it will
indicate how the union will work to enhance the Course Rep Experience and
recommendations for how the Union and the University can work in partnership on this over
the coming year.
IMPACT OF THE REPORT
7 | P a g e
The report was widely shared. It was posted on StudentCentral for all students to see,
featured in the all student newsletter sent out from the union, shared via the front pages of
StaffCentral and in the Course Rep Newsletter.
The report was also well received at University committees and was referenced in
subsequent Senior Management Team meetings at the University. Following this report an
action plan has been drawn up following a meeting between the Vice President Academic
Affairs, members of staff from the Academic Quality Division and members of the University
Senior Management team. Some key outcomes from this include:
 A refocussing on taking forward the Student Engagement in Quality Policy, with
further planning meetings to take place to look at this in more detail
 Increased resourcing planned in Registry to harmonise and disseminate QE best
practice across schools and disciplines
 Partnership working groups making change on key educational priorities for the
Students’ Union, including assessment and feedback
ANNUAL QUALITY REPORTING DEVELOPMENTS
STUDENT RESEARCHERS
Brighton Students’ Union are now engaging in student-led research as a strategic driver for
our work on academic quality. This year we are recruiting a team of student researchers
who will lead and define the research project topics by analysis of previous data and
research. This is part of our overall strategy to develop student-leadership within the union
and making decisions based on research and evidence with regards to our work on
academic quality.
Our student researchers will work
collaboratively to create a research proposal
on an aspect of the Student Experience based
on the evidence from a number of sources
such as NSS, student focus groups and
university reports. They then have the
opportunity to conduct this research and
analyse the findings. Support, supervision
and training jointly delivered by the Brighton
Students’ Union and the University of Brighton
Centre for Learning and Teaching ensures that
they are developing the skills and working in a
way that is reflective, constructive and
developmental.
Students will be given the space to form the
research question, methodology and instruments used to gather data. Support, supervision
and training jointly delivered by the Brighton Students’ Union and the University of Brighton
Centre for Learning and Teaching ensures that they are developing the skills and working in
a way that is reflective, constructive and developmental. Our student researchers are able
to explore the reality of learning within an institution collaboratively, they benefit by
8 | P a g e
developing research skills and engaging in a genuine research project which they take
ownership of that enhances their CV and confidence.
Student researchers are uniquely equipped to explore the issues at hand in how they impact
on students. By engaging students as researchers we move away from merely gathering of
information on student experience and satisfaction; towards engaging with students directly
on enhancement methods and impact. As a consequence of this the understanding required
to drive enhancement is strengthened; the survey feedback question which often results with
a “this is good, this is bad” duality is replaced with an interpersonal “this is why, this is how”
approach, fuelling and informing change. It places students as leaders in the enhancement
process.
The project itself will start to ensure that it is students that decide what constitutes the
enhancement process from a Students’ Union perspective. We will present on how we have
progressed from surveying, highlighting and logging issues through to engaging a team of
students in systematically identifying opportunities for enhancement, uncovering
understanding of those opportunities, and creating different ways to engage in enhancement
within that context.
In addition our programme is focussed on preparing students at a range of skill levels and
from a multi-disciplinary background to become researchers able to independently set and
conduct the scope of their research. The Student Researcher programme will aim to support
undergraduates and postgraduate taught students in their transition into becoming career
researchers. Our Student Researchers programme is designed to bring in students at all
level with an interest in research and guide them step by step through the process of setting
their research question, methodology and instruments.
We will be presenting on this project at the Quality Assurance Agency Enhancement
Themes Conference 2015.
WORKING WITH PARTNER COLLEGES
We are working with four partner colleges that all have upcoming partnership reviews
(internal) and QAA Reviews this year and next. The Academic Quality Division has provided
training to students’ union staff working with these colleges about the reporting processes.
Further support has been provided to Northbrook college between the Academic Quality
Division and the Northbrook college organiser who has recently produced a Student Written
Submission for the partnership review that will be updated for the QAA Review the following
year.
9 | P a g e
For further information please contact
Brighton Students’ Union Academic Quality Division
Vice President Academic Affairs
Maggie Garabedyan
m.garabedyan2@brighton.ac.uk
Course Rep Coordinator
Katina Mayo
K.Mayo@brighton.ac.uk
Academic Communities Coordinator
Rich Stewart
r.stewart@brighton.ac.uk

More Related Content

What's hot

Convocation Day Presentation on Planning and Budget Workgroup
Convocation Day Presentation on Planning and Budget WorkgroupConvocation Day Presentation on Planning and Budget Workgroup
Convocation Day Presentation on Planning and Budget WorkgroupBradley Vaden
 
Campus Safety and Violence Prevention Task Force
Campus Safety and Violence Prevention Task ForceCampus Safety and Violence Prevention Task Force
Campus Safety and Violence Prevention Task Force
Massachusetts Department of Higher Education
 
Alp presentation
Alp presentationAlp presentation
Alp presentation
cccscoetc
 
Evaluating an Integrated Family Planning and Mother/Child Health Program
Evaluating an Integrated Family Planning and Mother/Child Health ProgramEvaluating an Integrated Family Planning and Mother/Child Health Program
Evaluating an Integrated Family Planning and Mother/Child Health Program
MEASURE Evaluation
 
FTCC - Executive Leadership Track
FTCC - Executive Leadership TrackFTCC - Executive Leadership Track
FTCC - Executive Leadership Track
Pearson North America
 
Postgraduate Experience Report Final
Postgraduate Experience Report FinalPostgraduate Experience Report Final
Postgraduate Experience Report Final
Association of University Administrators
 
Performance Measurement: Ensuring Accuracy, Transparency and Relevance
Performance Measurement: Ensuring Accuracy, Transparency and RelevancePerformance Measurement: Ensuring Accuracy, Transparency and Relevance
Performance Measurement: Ensuring Accuracy, Transparency and Relevance
Massachusetts Department of Higher Education
 
Enhancing the Student Experience through Partnership Working
Enhancing the Student Experience through Partnership Working Enhancing the Student Experience through Partnership Working
Enhancing the Student Experience through Partnership Working
Association of University Administrators
 
Charter project kick off final 3 29 11
Charter project kick off final 3 29 11Charter project kick off final 3 29 11
Charter project kick off final 3 29 11TXWes_PMO
 
PolicyOptions 101
PolicyOptions 101PolicyOptions 101
PolicyOptions 101
Bonner Foundation
 
Early College Programming in Massachusetts
Early College Programming in MassachusettsEarly College Programming in Massachusetts
Early College Programming in Massachusetts
Massachusetts Department of Higher Education
 
Research In Action #2
Research In Action #2Research In Action #2
Research In Action #2
Mentoring Partnership of Minnesota
 
Niloa webinar on survey final
Niloa webinar on survey finalNiloa webinar on survey final
Niloa webinar on survey final
Suhad Aljundi
 
Charting the Future
Charting the Future Charting the Future
Charting the Future
MSCSA
 
Massachusetts Early College Initiative
Massachusetts Early College InitiativeMassachusetts Early College Initiative
Massachusetts Early College Initiative
Massachusetts Department of Higher Education
 
Research In Action #2
Research In Action #2Research In Action #2
Research In Action #2
guestea0a10
 
Massachusetts Early College Designation
Massachusetts Early College DesignationMassachusetts Early College Designation
Massachusetts Early College Designation
Massachusetts Department of Higher Education
 

What's hot (20)

Convocation Day Presentation on Planning and Budget Workgroup
Convocation Day Presentation on Planning and Budget WorkgroupConvocation Day Presentation on Planning and Budget Workgroup
Convocation Day Presentation on Planning and Budget Workgroup
 
Campus Safety and Violence Prevention Task Force
Campus Safety and Violence Prevention Task ForceCampus Safety and Violence Prevention Task Force
Campus Safety and Violence Prevention Task Force
 
Research panel
Research panelResearch panel
Research panel
 
Alp presentation
Alp presentationAlp presentation
Alp presentation
 
Evaluating an Integrated Family Planning and Mother/Child Health Program
Evaluating an Integrated Family Planning and Mother/Child Health ProgramEvaluating an Integrated Family Planning and Mother/Child Health Program
Evaluating an Integrated Family Planning and Mother/Child Health Program
 
FTCC - Executive Leadership Track
FTCC - Executive Leadership TrackFTCC - Executive Leadership Track
FTCC - Executive Leadership Track
 
Postgraduate Experience Report Final
Postgraduate Experience Report FinalPostgraduate Experience Report Final
Postgraduate Experience Report Final
 
Performance Measurement: Ensuring Accuracy, Transparency and Relevance
Performance Measurement: Ensuring Accuracy, Transparency and RelevancePerformance Measurement: Ensuring Accuracy, Transparency and Relevance
Performance Measurement: Ensuring Accuracy, Transparency and Relevance
 
Enhancing the Student Experience through Partnership Working
Enhancing the Student Experience through Partnership Working Enhancing the Student Experience through Partnership Working
Enhancing the Student Experience through Partnership Working
 
Charter project kick off final 3 29 11
Charter project kick off final 3 29 11Charter project kick off final 3 29 11
Charter project kick off final 3 29 11
 
PolicyOptions 101
PolicyOptions 101PolicyOptions 101
PolicyOptions 101
 
Early College Programming in Massachusetts
Early College Programming in MassachusettsEarly College Programming in Massachusetts
Early College Programming in Massachusetts
 
Research In Action #2
Research In Action #2Research In Action #2
Research In Action #2
 
1410 young
1410 young1410 young
1410 young
 
KARVI_1216
KARVI_1216KARVI_1216
KARVI_1216
 
Niloa webinar on survey final
Niloa webinar on survey finalNiloa webinar on survey final
Niloa webinar on survey final
 
Charting the Future
Charting the Future Charting the Future
Charting the Future
 
Massachusetts Early College Initiative
Massachusetts Early College InitiativeMassachusetts Early College Initiative
Massachusetts Early College Initiative
 
Research In Action #2
Research In Action #2Research In Action #2
Research In Action #2
 
Massachusetts Early College Designation
Massachusetts Early College DesignationMassachusetts Early College Designation
Massachusetts Early College Designation
 

Viewers also liked

Mi vida
Mi vidaMi vida
News SSL 08 2016
News SSL 08 2016News SSL 08 2016
News SSL 08 2016
Roberta Culiersi
 
Afh 2012 09-05-aiasf_kj-zt
Afh 2012 09-05-aiasf_kj-ztAfh 2012 09-05-aiasf_kj-zt
Afh 2012 09-05-aiasf_kj-zt
Karl Johnson
 
Peyton's Waterford3 Refueling presentation
Peyton's Waterford3 Refueling presentation Peyton's Waterford3 Refueling presentation
Peyton's Waterford3 Refueling presentation
persivle
 
Lunch&LearnPoster_newADD
Lunch&LearnPoster_newADDLunch&LearnPoster_newADD
Lunch&LearnPoster_newADDAlison Henry
 
The BIG BOSS TURKEY
The BIG BOSS TURKEYThe BIG BOSS TURKEY
The BIG BOSS TURKEY
TAYFUN BIRAKOĞLU
 
Las responsabilidades del ingeniero parte 3
Las responsabilidades del ingeniero parte 3 Las responsabilidades del ingeniero parte 3
Las responsabilidades del ingeniero parte 3
Danfer De la Cruz
 
Analysis of Truss
Analysis of TrussAnalysis of Truss
Analysis of Truss
DHA Suffa University
 
News SSL 12 2017
News SSL 12 2017News SSL 12 2017
News SSL 12 2017
Roberta Culiersi
 

Viewers also liked (10)

Mi vida
Mi vidaMi vida
Mi vida
 
News SSL 08 2016
News SSL 08 2016News SSL 08 2016
News SSL 08 2016
 
Afh 2012 09-05-aiasf_kj-zt
Afh 2012 09-05-aiasf_kj-ztAfh 2012 09-05-aiasf_kj-zt
Afh 2012 09-05-aiasf_kj-zt
 
Peyton's Waterford3 Refueling presentation
Peyton's Waterford3 Refueling presentation Peyton's Waterford3 Refueling presentation
Peyton's Waterford3 Refueling presentation
 
Lunch&LearnPoster_newADD
Lunch&LearnPoster_newADDLunch&LearnPoster_newADD
Lunch&LearnPoster_newADD
 
The BIG BOSS TURKEY
The BIG BOSS TURKEYThe BIG BOSS TURKEY
The BIG BOSS TURKEY
 
Las responsabilidades del ingeniero parte 3
Las responsabilidades del ingeniero parte 3 Las responsabilidades del ingeniero parte 3
Las responsabilidades del ingeniero parte 3
 
Indicadores LATAM_ESPFIN
Indicadores LATAM_ESPFINIndicadores LATAM_ESPFIN
Indicadores LATAM_ESPFIN
 
Analysis of Truss
Analysis of TrussAnalysis of Truss
Analysis of Truss
 
News SSL 12 2017
News SSL 12 2017News SSL 12 2017
News SSL 12 2017
 

Similar to BSU-AQR-Case-Study

Running head ACADEMIC PROGRAM 4ACAD.docx
Running head ACADEMIC PROGRAM 4ACAD.docxRunning head ACADEMIC PROGRAM 4ACAD.docx
Running head ACADEMIC PROGRAM 4ACAD.docx
healdkathaleen
 
How do you think naac is ensuring external and internal quality at higher edu...
How do you think naac is ensuring external and internal quality at higher edu...How do you think naac is ensuring external and internal quality at higher edu...
How do you think naac is ensuring external and internal quality at higher edu...
Abhishek Nayan
 
Alan Roberts: Student engagement in shaping Higher Education
Alan Roberts: Student engagement in shaping Higher EducationAlan Roberts: Student engagement in shaping Higher Education
Alan Roberts: Student engagement in shaping Higher Education
Educational Development Division, University of Liverpool
 
Quality matters 2013 working with your institution
Quality matters 2013   working with your institutionQuality matters 2013   working with your institution
Quality matters 2013 working with your institutionDan Derricott
 
Academic Recruitment Best Practices -Project Report-Final 7.8.15
Academic Recruitment Best Practices -Project Report-Final 7.8.15Academic Recruitment Best Practices -Project Report-Final 7.8.15
Academic Recruitment Best Practices -Project Report-Final 7.8.15Brian Groeschel, MA
 
Using a standards alignment model as a framework for doctoral candidate asses...
Using a standards alignment model as a framework for doctoral candidate asses...Using a standards alignment model as a framework for doctoral candidate asses...
Using a standards alignment model as a framework for doctoral candidate asses...CPEDInitiative
 
Fall Directors 2014: Making the Connection
Fall Directors 2014: Making the ConnectionFall Directors 2014: Making the Connection
Fall Directors 2014: Making the Connection
Bonner Foundation
 
A three tier model to promote the institutional adoption of learning analytics
A three tier model to promote the institutional adoption of learning analyticsA three tier model to promote the institutional adoption of learning analytics
A three tier model to promote the institutional adoption of learning analytics
University of Newcastle, NSW.
 
39. social and student engagement and support
39. social and student engagement and support39. social and student engagement and support
39. social and student engagement and support
Anton Lebedev
 
Assessment Matters Newsletter_November 2015 (3)
Assessment Matters Newsletter_November 2015 (3)Assessment Matters Newsletter_November 2015 (3)
Assessment Matters Newsletter_November 2015 (3)Tom Kohntopp
 
2014 Action Research IAEVG ppt
2014 Action Research IAEVG ppt2014 Action Research IAEVG ppt
2014 Action Research IAEVG pptDavid Trought
 
Effective Course Evaluation
Effective Course EvaluationEffective Course Evaluation
Effective Course EvaluationEric Bohms
 
How Did WE Do? Evaluating the Student Experience
How Did WE Do? Evaluating the Student Experience How Did WE Do? Evaluating the Student Experience
How Did WE Do? Evaluating the Student Experience
CHC Connecticut
 
Making Resilient Students 2015
Making Resilient Students 2015Making Resilient Students 2015
Making Resilient Students 2015Nikki Brannigan
 
Peer Review: Promoting a Quality Culture
Peer Review: Promoting a Quality CulturePeer Review: Promoting a Quality Culture
Peer Review: Promoting a Quality Culture
Mark Brown
 
Academic audit presentation_-_introduction
Academic audit presentation_-_introductionAcademic audit presentation_-_introduction
Academic audit presentation_-_introductionDurgesh Ahirwar
 
EDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINALEDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINALEllen Wagner
 

Similar to BSU-AQR-Case-Study (20)

Running head ACADEMIC PROGRAM 4ACAD.docx
Running head ACADEMIC PROGRAM 4ACAD.docxRunning head ACADEMIC PROGRAM 4ACAD.docx
Running head ACADEMIC PROGRAM 4ACAD.docx
 
Encl C - Alumni Engagement Plan 2015-2017 excerpt for the Alumni Board
Encl C - Alumni Engagement Plan 2015-2017 excerpt for the Alumni BoardEncl C - Alumni Engagement Plan 2015-2017 excerpt for the Alumni Board
Encl C - Alumni Engagement Plan 2015-2017 excerpt for the Alumni Board
 
How do you think naac is ensuring external and internal quality at higher edu...
How do you think naac is ensuring external and internal quality at higher edu...How do you think naac is ensuring external and internal quality at higher edu...
How do you think naac is ensuring external and internal quality at higher edu...
 
Alan Roberts: Student engagement in shaping Higher Education
Alan Roberts: Student engagement in shaping Higher EducationAlan Roberts: Student engagement in shaping Higher Education
Alan Roberts: Student engagement in shaping Higher Education
 
Quality matters 2013 working with your institution
Quality matters 2013   working with your institutionQuality matters 2013   working with your institution
Quality matters 2013 working with your institution
 
Academic Recruitment Best Practices -Project Report-Final 7.8.15
Academic Recruitment Best Practices -Project Report-Final 7.8.15Academic Recruitment Best Practices -Project Report-Final 7.8.15
Academic Recruitment Best Practices -Project Report-Final 7.8.15
 
Using a standards alignment model as a framework for doctoral candidate asses...
Using a standards alignment model as a framework for doctoral candidate asses...Using a standards alignment model as a framework for doctoral candidate asses...
Using a standards alignment model as a framework for doctoral candidate asses...
 
Fall Directors 2014: Making the Connection
Fall Directors 2014: Making the ConnectionFall Directors 2014: Making the Connection
Fall Directors 2014: Making the Connection
 
A three tier model to promote the institutional adoption of learning analytics
A three tier model to promote the institutional adoption of learning analyticsA three tier model to promote the institutional adoption of learning analytics
A three tier model to promote the institutional adoption of learning analytics
 
39. social and student engagement and support
39. social and student engagement and support39. social and student engagement and support
39. social and student engagement and support
 
Assessment Matters Newsletter_November 2015 (3)
Assessment Matters Newsletter_November 2015 (3)Assessment Matters Newsletter_November 2015 (3)
Assessment Matters Newsletter_November 2015 (3)
 
2014 Action Research IAEVG ppt
2014 Action Research IAEVG ppt2014 Action Research IAEVG ppt
2014 Action Research IAEVG ppt
 
Effective Course Evaluation
Effective Course EvaluationEffective Course Evaluation
Effective Course Evaluation
 
How Did WE Do? Evaluating the Student Experience
How Did WE Do? Evaluating the Student Experience How Did WE Do? Evaluating the Student Experience
How Did WE Do? Evaluating the Student Experience
 
Making Resilient Students 2015
Making Resilient Students 2015Making Resilient Students 2015
Making Resilient Students 2015
 
Peer Review: Promoting a Quality Culture
Peer Review: Promoting a Quality CulturePeer Review: Promoting a Quality Culture
Peer Review: Promoting a Quality Culture
 
Academic audit presentation_-_introduction
Academic audit presentation_-_introductionAcademic audit presentation_-_introduction
Academic audit presentation_-_introduction
 
Ldp presentation -assessment
Ldp presentation -assessmentLdp presentation -assessment
Ldp presentation -assessment
 
EDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINALEDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINAL
 
SU-Proposal-Student-Experience
SU-Proposal-Student-ExperienceSU-Proposal-Student-Experience
SU-Proposal-Student-Experience
 

BSU-AQR-Case-Study

  • 1. 1 | P a g e Brighton Students’ Union Academic Quality Reporting Project Case Study 2014
  • 2. 2 | P a g e Contents Introduction ....................................................................................................................... 3 Background Brighton Students’ Union............................................................................ 3 Project Aims ...................................................................................................................... 3 Methodology...................................................................................................................... 4 Quality and Enhancement.............................................................................................. 4 Language....................................................................................................................... 4 Benchmarking................................................................................................................ 4 Thematic Approach........................................................................................................ 4 Our Evidence Collection................................................................................................. 5 Structuring the report ..................................................................................................... 6 Engaging with the Institution.............................................................................................. 6 Challenges Faced ............................................................................................................. 6 Impact of the Report ...................................................................................................... 6 Annual Quality Reporting Developments ........................................................................... 7 Student Researchers ..................................................................................................... 7 Working with partner Colleges ....................................................................................... 8
  • 3. 3 | P a g e INTRODUCTION BACKGROUND BRIGHTON STUDENTS’ UNION Brighton Students’ Union works with a university population of around 22,000 across five campuses in Brighton, Eastbourne and Hastings, alongside our partner colleges as far afield as Worthing. We have offices across our five main campuses and in two of our partner colleges but have a core team of central dedicated staff that work on matters of Academic Quality. In 2014 Brighton Students’ Union restructured creating a specific division for looking at Academic Quality and covering three main areas: This would allow us over the academic year increase our ability to engage students in enhancing the quality of their education and influencing University decision making. At the core of this we will be working to provide greater support to Course Reps and School Reps and student-led enhancement activities. Changes to current activity include increased support and resources for School Reps and through this for Course Reps and a focus on more in-depth studies of the student experience. We will also be developing our networks of university staff outside of the Senior Management of the university to raise awareness of what we do an increase our credibility with them to influence how they communicate the union to students. There will also be a greater focus on promoting and supporting students to access ‘What’s Going On?’, Agency funding and other funding streams within and out with the University relating to their academic experience. PROJECT AIMS Our main aims as set out in the Annual Quality Reporting project were to:  Create Sustainable annual reporting process and policy to measure impact of SU and University enhancement and engagement activity and identify issues  Create links with university reporting processes where this report will be seen as a valid part of QA and QE institutionally Student Representation and Leadership: Capacity for Doing and Changing Reporting and Research: Evidencing and Informing Decisions Staff Networks for Change: Developing Relationships and Credibility
  • 4. 4 | P a g e  Use report to move university language and policy closer to sector in terms of QE and student partnership The Annual Quality Report project was intended to enable a partnership between the Students' Union and the institution to drive positive, well-researched change and strengthen our ability to communicate and collaborate. Student Written Submissions are produced as part of the QAA Higher Education review process, providing a valuable and well-informed tool for both the institution and the Students' Union to understand the student perspective and how to drive quality. Incorporating elements of a SWS into a rolling programme of Annual Quality Reporting reduces the once-off burden of producing a SWS, raises the professionalism and utility of the Students' Union's involvement in quality processes. Brighton Students’ Union is highly regarded within this project and is being used as a case study. METHODOLOGY QUALITY AND ENHANCEMENT We wanted out report to will be critical in tone with a view to driving change and enhancing the student experience. We wanted the project drive change but also to measure the impact of this change. As such the use of Qualitative data was key, this was also time consuming so focus needed to be refined and reliability of collection process assured. We also were keen to have the student voice come through strongly in the report and as such decided that use of direct quotations from students was more powerful than the use of statistics that can be seen as arbitrary and risk dehumanising the issues that are having a direct impact on the lives and academic progress of students. LANGUAGE We are in the process of trying to actively change the discourse of the university to reflect where the sector stands in presently in terms of Quality Enhancement and Student Engagement and Partnership. Ensuring we are using this language to frame the quality processes we use is central. We wanted our approach needs to be Quality Enhancement focused, even through some of our data could flag up assurance issues for the university. We want to avoid duplicating existing reporting streams where possible. BENCHMARKING We decided to benchmark against the recommendations made in the Student Written Submission from the 2013 QAA Review. We would seek out examples of progress that have been made towards the recommendations from the Student Written Submission, not aiming to cover all activity that has taken place but to share best practice by giving an example of the changes that have been made that relate directly to the previous recommendations. THEMATIC APPROACH While not being able to cover all areas of the student experience in this report but decided to tackle thematic issues that impact on students across the University. Through examination of the evidence from our Keep, Stop, Start Survey, the National Student Survey, the Course Rep Impact report and discussions with sabbatical officers and students we identified areas where we felt there was the greatest need for change:
  • 5. 5 | P a g e  Student Engagement: Specifically Course Rep Recruitment and Student Staff Meetings  Organisation: Timetabling, Reading Lists  Resources: IT, Libraries and Specialist We also identified the three topics for the following year that we would focus on so evidence collection could begin at the start of the academic year. This will be:  Assessment Practices  Feedback to Students  Student Engagement in Quality Processes – specifically looking at progress on the Student Engagement in Quality Policy that has been recently implemented. OUR EVIDENCE COLLECTION We took a tailored collection approach to each topic area, using slightly different sources. We did not carry out any additional surveys of students as we already conduct a lot of surveys and had a lot of information to draw from. Our sources included: Keep, Stop, Start Data – This is data we collected during our student engagement week where we did outreach work on every campus, every day for a week asking students what the University should keep, stop and start doing. Course Rep Survey - Our main mechanism for evaluating the course representative system is the Course Rep Survey. This year the names of 966 course representatives were passed to the Students’ Union. The response rate for this year’s Course Rep survey was 35%, with 337 reps taking part. The course rep report has a huge resource of qualitative commentary from course reps on not just their own experience of being a rep but also of the issues faced by students on their course. Course Rep Benchmarking Exercise – The NUS benchmarking tool for course rep systems is designed to enable students’ unions to measure the effectiveness of their course reps system and identify areas in which it could be improved. It aims to facilitate self- reflection and consideration of structures within the university and it is also proposed that it can be used to track developments and improvements over time, we were able to make reference to our latest benchmarking exercise to show progress that had been made. National Student Survey Comments – rather than focusing on the numbers we focused on the student commentary, trying to understand the specifics of what students were experiencing. Papers from Boards and Committees – We used these to source specific updates and progress that had been made against specific recommendations from the previous Student Written Submission. Case Studies – We were able to provide specific examples where we had worked with students and had seen improvements made or serious issues raised. Sources we did not include:
  • 6. 6 | P a g e Commentary from the Excellence Awards Nominations – while this is a rich data source we were did not have the capacity to analyse this fully for inclusion this year. STRUCTURING THE REPORT Our report was structured to highlight recommendations from previous reports, progress made against these, to highlight the current situation and to make further recommendations. This way we can trace progress and ensure that we are always pushing from change. ENGAGING WITH THE INSTITUTION Engagement with this project was well received by the University Senior Management. A paper to Academic Standards Committee in February 2014 set out how this report and the other reports produced by the Students’ Union were to fit into the quality processes of the University. This paper sought to formalise and extend this process and align Students’ Union quality processes with those of the University in a way that drives enhancement, specifically supporting the implementation of the Student Engagement in Quality Policy and seek to provide some mechanisms to monitor the impact of changes and developments as a result of this policy. Members of the board to agreed that where the reports are tied to specific committees they are now included in the terms of reference to those committees when they are next approved and that reports are referred to in both Academic Health and/or the implementation plan for the Student Engagement in Quality Policy as appropriate to formalise the process. Overall engagement in the process has been very positive, particularly from Information Services who were keen to highlight the progress they had made but also to strengthen communication with the union where students have raised issues so they could be resolved efficiently. CHALLENGES FACED One of the key challenges was to streamlining the data that we had and to decide on what areas the report will focus on. At present even when we have looked at doing an academic policy we end up with such a huge amount of issues we want to tackle that everything ends up looking like an impossible task. It will also be a challenge to prioritise recommendations from the Student Written Submission which have all been researched in detail. We are also given additional funding from the University to look at retention and it is are area we would definitely look at reporting on, tracking our impact on this is extremely difficult as we can only suggest the correlation between any improvements and it is difficult to estimate the genuine value of our contribution. At present there is no way of evaluating exactly what impact reps are having in each school as this data is not being collected at a school level. Work also needs to be done exploring the effectiveness of current meetings as places where Reps feel empowered to express the student view and for change to occur. The following report contains evidence of the nature of the issues that Course Reps resolve and their experience of their role. In addition it will indicate how the union will work to enhance the Course Rep Experience and recommendations for how the Union and the University can work in partnership on this over the coming year. IMPACT OF THE REPORT
  • 7. 7 | P a g e The report was widely shared. It was posted on StudentCentral for all students to see, featured in the all student newsletter sent out from the union, shared via the front pages of StaffCentral and in the Course Rep Newsletter. The report was also well received at University committees and was referenced in subsequent Senior Management Team meetings at the University. Following this report an action plan has been drawn up following a meeting between the Vice President Academic Affairs, members of staff from the Academic Quality Division and members of the University Senior Management team. Some key outcomes from this include:  A refocussing on taking forward the Student Engagement in Quality Policy, with further planning meetings to take place to look at this in more detail  Increased resourcing planned in Registry to harmonise and disseminate QE best practice across schools and disciplines  Partnership working groups making change on key educational priorities for the Students’ Union, including assessment and feedback ANNUAL QUALITY REPORTING DEVELOPMENTS STUDENT RESEARCHERS Brighton Students’ Union are now engaging in student-led research as a strategic driver for our work on academic quality. This year we are recruiting a team of student researchers who will lead and define the research project topics by analysis of previous data and research. This is part of our overall strategy to develop student-leadership within the union and making decisions based on research and evidence with regards to our work on academic quality. Our student researchers will work collaboratively to create a research proposal on an aspect of the Student Experience based on the evidence from a number of sources such as NSS, student focus groups and university reports. They then have the opportunity to conduct this research and analyse the findings. Support, supervision and training jointly delivered by the Brighton Students’ Union and the University of Brighton Centre for Learning and Teaching ensures that they are developing the skills and working in a way that is reflective, constructive and developmental. Students will be given the space to form the research question, methodology and instruments used to gather data. Support, supervision and training jointly delivered by the Brighton Students’ Union and the University of Brighton Centre for Learning and Teaching ensures that they are developing the skills and working in a way that is reflective, constructive and developmental. Our student researchers are able to explore the reality of learning within an institution collaboratively, they benefit by
  • 8. 8 | P a g e developing research skills and engaging in a genuine research project which they take ownership of that enhances their CV and confidence. Student researchers are uniquely equipped to explore the issues at hand in how they impact on students. By engaging students as researchers we move away from merely gathering of information on student experience and satisfaction; towards engaging with students directly on enhancement methods and impact. As a consequence of this the understanding required to drive enhancement is strengthened; the survey feedback question which often results with a “this is good, this is bad” duality is replaced with an interpersonal “this is why, this is how” approach, fuelling and informing change. It places students as leaders in the enhancement process. The project itself will start to ensure that it is students that decide what constitutes the enhancement process from a Students’ Union perspective. We will present on how we have progressed from surveying, highlighting and logging issues through to engaging a team of students in systematically identifying opportunities for enhancement, uncovering understanding of those opportunities, and creating different ways to engage in enhancement within that context. In addition our programme is focussed on preparing students at a range of skill levels and from a multi-disciplinary background to become researchers able to independently set and conduct the scope of their research. The Student Researcher programme will aim to support undergraduates and postgraduate taught students in their transition into becoming career researchers. Our Student Researchers programme is designed to bring in students at all level with an interest in research and guide them step by step through the process of setting their research question, methodology and instruments. We will be presenting on this project at the Quality Assurance Agency Enhancement Themes Conference 2015. WORKING WITH PARTNER COLLEGES We are working with four partner colleges that all have upcoming partnership reviews (internal) and QAA Reviews this year and next. The Academic Quality Division has provided training to students’ union staff working with these colleges about the reporting processes. Further support has been provided to Northbrook college between the Academic Quality Division and the Northbrook college organiser who has recently produced a Student Written Submission for the partnership review that will be updated for the QAA Review the following year.
  • 9. 9 | P a g e For further information please contact Brighton Students’ Union Academic Quality Division Vice President Academic Affairs Maggie Garabedyan m.garabedyan2@brighton.ac.uk Course Rep Coordinator Katina Mayo K.Mayo@brighton.ac.uk Academic Communities Coordinator Rich Stewart r.stewart@brighton.ac.uk