Digital experience insights
Webinar
19 March 2019
https://digitalinsights.jisc.ac.uk #digitalstudent
Welcome from the digital experience insights team
Ruth Drysdale –
service manager
Mark Langer-Crame – senior
analyst
Sarah Knight – service owner
Clare Killen – content manager Darren Colquhoun –
client support officer
Lola Harre – research manager
• Introduction and background to
insights, Sarah
• Setting up your institutional insights
project, Mark
• Getting started with insights, Mark
• New developments, Sarah
• Next steps
Agenda
Introduction and background to the
Digital experience insights service
Sarah Knight
Digital experience insights https://digitalinsights.jisc.ac.uk
Digital experience insights provides
you with evidence of:
https://digitalinsights.jisc.ac.uk
1. Return on investment
2. Impact of the implementation of institutional digital strategy
3. Identification of digital skills gap
4. Benchmarking
Which can feed into:
1. TEF and NSS
2. Ofsted
‘Not just another survey…’
https://digitalinsights.jisc.ac.uk
Digital experience insights https://digitalinsights.jisc.ac.uk
Who is using or has used digital experience
insights (was previously known as tracker)?
A. Yes, running 2018-19 survey for students only
B. Yes, running 2018-19 survey for staff only
C. Yes, running 2018-19 surveys for both staff and students
D. Yes, participated in previous pilots but not signed up yet for
2018-19
E. Never participated
Digital experience insights https://digitalinsights.jisc.ac.uk
What is digital experience insights?
1. A tried and tested (over three years) student
and staff survey, made up of:
• Closed questions that can be
benchmarked
• Open questions for local analysis
• Add or customise further questions
2. A student and staff engagement process,
supported by our guidance
3. A community of practice around the
insights process and findings (including
student representatives)
4. Compare student feedback with teaching
staff views and organisational factors
5. Professional services staff pilot survey, TNE
and research insights pilots for 2019
Digital experience insights https://digitalinsights.jisc.ac.uk
Insights report 2018
• Our 2017-18 student survey collected data
from a total of 37,720 students
- 14,292 FE learners
- 23,428 HE students
• 36 FE colleges,4 sixth form colleges and 43 universities
– approximately 16% of UK colleges and 30% of UK
universities
• Report of 2018 insights findings: ji.sc/dig-exp-insights-
survey-18
• At a glance: summary of 2018 insights findings: ji.sc/dig-
exp-insights-summary-18
37,720 students surveyed
across 83 UK institutions
Digital experience insights https://digitalinsights.jisc.ac.uk
Staff insights 2018 pilot report
http://bit.ly/DEI-reports
• Four colleges and 11 universities across England,
Scotland and Wales piloted the surveys
• 376 college responses
• 1,545 university responses
• The survey contained 17 items (mini-survey) or 47 items
(full version)
• Core questions were benchmarkable
• Customisable questions
1,921 teachers surveyed
across 15 institutions as a pilot
Digital experience insights 2018: ANZ
http://bit.ly/DEI-reports
• 30% of universities across the 2 countries
• A mean average of 864 responses per university
• Students studying in ANZ universities, have very similar
expectations and experiences of technology to those of
our UK students
• Some differences:
• ANZ students take part in significantly more digital
activities than UK students
• However, they want digital technologies to be used
less on their course
21,095 students surveyed across 13
universities in Australia and New Zealand
New reports and guidance
1. Exploring the student digital experience:
student, staff and organisational factors –
Tabetha Newman
2. Jisc NUS Roadmap for supporting students
to improve their digital experience and
university
3. Enabling an excellent digital experience
guidance for engaging senior leaders and
informing digital (FE and HE versions)
Digital experience insights https://digitalinsights.jisc.ac.uk
http://bit.ly/DEI-reports
Any questions?
Digital experience insights https://digitalinsights.jisc.ac.uk
Setting up your insights project
Mark Langer-Crame
Digital experience insights https://digitalinsights.jisc.ac.uk
Institutional insights project
4. Enhance student
digital experience
1. Plan
3. Analyse
Digital Experience
Insights
 Student
 Teaching Staff
Senior Champion
Project team
Working group
Stakeholders: SU , IT,
library, academics
Benchmark
Recommendations
Change initiated
Feedback to
respondents on
changes
Enhance services
3. Survey
Governance
Survey set up
in BOS
Design local
questions
Lunch surveys
BOS or export
Into Excel/
SPSS/NVIVO
Quantitative and
Qualitative analysis
Monitor responses
Report to SE
Governance
groups Surveys start
& end dates
Sampling cohort
Budget
Communication plan
Prizes?
Link to other SE
Datasets NSS,
modular feedback
Digital experience insights service and institutional activities
Any questions?
Digital experience insights https://digitalinsights.jisc.ac.uk
Insights process and quick guide to
getting started and running your
project
Mark Langer-Crame
Digital experience insights https://digitalinsights.jisc.ac.uk
Insights process 2018-19
You:
Submit
‘expression
of interest’
online
We: Send
quote for
cost, ‘sign-
up’ form
and ‘terms
and
conditions’
You:
Return
completed
‘sign-up’
form (and
purchase
order, if
applicable)
We: Send
you the
‘getting
started’
form asking
about your
current
digital
experience
and which
surveys
you want
You:
Return the
‘getting
started’
form
We:
provide
access to
Jisc online
surveys
and master
copies of
surveys
you want
You:
Copy,
customise,
launch
your
surveys
(full
guidance
provided)
We: Close
surveys
(30 April for
students
and 28
June for
staff),
benchmark
-ing data
available
shortly
after
Quick guide to getting started & running your project
• Log into Jisc online surveys and make copies of the survey(s) you require
• Customise your additional questions (if you wish to) – main questions
cannot be changed to allow benchmarking
• Prepare engagement strategy with students and staff to ensure high
response rate
• Decide who want to survey – all students/staff or sample?
• Check survey(s) and launch
Quick guide to getting started & running your project
• Monitor survey response and send reminders to complete
• Close survey(s) and download data from Jisc online surveys into Excel,
SPSS etc (and also download benchmarking results)
• Carry out analysis - review statistical data and charts for key messages
• Report and communicate – produce reports and present findings to
students, staff and key stakeholders – with key recommendations
• Full guidance on all these steps and more can be found at
https://digitalinsights.jisc.ac.uk/our-service/advice-and-guidance/
Any questions?
Digital experience insights https://digitalinsights.jisc.ac.uk
• Have you launched your surveys?
• Any challenges?
• How are you engaging your staff and students?
New developments
Sarah Knight
Digital experience insights https://digitalinsights.jisc.ac.uk
• Eight new institutional case studies see
https://digitalinsights.jisc.ac.uk/case-study-listing/
• Three video case studies –University of Stirling,
Canterbury Christ Church University and City of
Wolverhampton College
• Service animation
• Professional services staff pilot
• Research insights pilot
• See https://digitalinsights.jisc.ac.uk
• Contact Ruth Drysdale ruth.Drysdale@jisc.ac.uk
for further information on how to participate
New guidance & support
Digital experience insights https://digitalinsights.jisc.ac.uk
Any questions?
#digitalstudent
https://digitalinsights.jisc.ac.uk
Join us for the next community of practice event
on 22 May 2019 at the Studio, Birmingham
#digitalstudent
Join our community of practice:
https://www.jiscmail.ac.uk/JISC-DIGITALINSIGHTS-
COP
Follow our blog: https://digitalstudent.jiscinvolve.org
https://digitalinsights.jisc.ac.uk
Follow developments
•Digital experience insights https://digitalinsights.jisc.ac.uk
•Sign up to run insights surveys: bit.ly/DEI-EOI
•Reports of 2018 insights findings: http://bit.ly/insightsreports
• Jisc NUS Roadmap for supporting students to improve their digital experience
and university: http://bit.ly/insightsreports
• Enabling an excellent digital experience guidance for engaging senior leaders
and informing digital: http://bit.ly/insightsreports
• Case studies on institutional use: http://bit.ly/insightscase
• Join the insights community of practice with next event on 22 May:
https://digitalinsights.jisc.ac.uk/our-service/community-of-practice/
Digital experience insights https://digitalinsights.jisc.ac.uk
Get in
touch…
Except where otherwise noted,
this work is licensed under CC-BY
Digital experience insights
Sarah Knight
Sarah.knight@jisc.ac.uk
Ruth Drysdale
Ruth.Drysdale@jisc.ac.uk
https://digitalinsights.jisc.ac.uk
#digitalstudent
Digital experience insights https://digitalinsights.jisc.ac.uk

Insightswebinar19 march19

  • 1.
    Digital experience insights Webinar 19March 2019 https://digitalinsights.jisc.ac.uk #digitalstudent
  • 2.
    Welcome from thedigital experience insights team Ruth Drysdale – service manager Mark Langer-Crame – senior analyst Sarah Knight – service owner Clare Killen – content manager Darren Colquhoun – client support officer Lola Harre – research manager
  • 3.
    • Introduction andbackground to insights, Sarah • Setting up your institutional insights project, Mark • Getting started with insights, Mark • New developments, Sarah • Next steps Agenda
  • 4.
    Introduction and backgroundto the Digital experience insights service Sarah Knight Digital experience insights https://digitalinsights.jisc.ac.uk
  • 5.
    Digital experience insightsprovides you with evidence of: https://digitalinsights.jisc.ac.uk 1. Return on investment 2. Impact of the implementation of institutional digital strategy 3. Identification of digital skills gap 4. Benchmarking Which can feed into: 1. TEF and NSS 2. Ofsted
  • 6.
    ‘Not just anothersurvey…’ https://digitalinsights.jisc.ac.uk Digital experience insights https://digitalinsights.jisc.ac.uk
  • 7.
    Who is usingor has used digital experience insights (was previously known as tracker)? A. Yes, running 2018-19 survey for students only B. Yes, running 2018-19 survey for staff only C. Yes, running 2018-19 surveys for both staff and students D. Yes, participated in previous pilots but not signed up yet for 2018-19 E. Never participated Digital experience insights https://digitalinsights.jisc.ac.uk
  • 8.
    What is digitalexperience insights? 1. A tried and tested (over three years) student and staff survey, made up of: • Closed questions that can be benchmarked • Open questions for local analysis • Add or customise further questions 2. A student and staff engagement process, supported by our guidance 3. A community of practice around the insights process and findings (including student representatives) 4. Compare student feedback with teaching staff views and organisational factors 5. Professional services staff pilot survey, TNE and research insights pilots for 2019 Digital experience insights https://digitalinsights.jisc.ac.uk
  • 9.
    Insights report 2018 •Our 2017-18 student survey collected data from a total of 37,720 students - 14,292 FE learners - 23,428 HE students • 36 FE colleges,4 sixth form colleges and 43 universities – approximately 16% of UK colleges and 30% of UK universities • Report of 2018 insights findings: ji.sc/dig-exp-insights- survey-18 • At a glance: summary of 2018 insights findings: ji.sc/dig- exp-insights-summary-18 37,720 students surveyed across 83 UK institutions Digital experience insights https://digitalinsights.jisc.ac.uk
  • 10.
    Staff insights 2018pilot report http://bit.ly/DEI-reports • Four colleges and 11 universities across England, Scotland and Wales piloted the surveys • 376 college responses • 1,545 university responses • The survey contained 17 items (mini-survey) or 47 items (full version) • Core questions were benchmarkable • Customisable questions 1,921 teachers surveyed across 15 institutions as a pilot
  • 11.
    Digital experience insights2018: ANZ http://bit.ly/DEI-reports • 30% of universities across the 2 countries • A mean average of 864 responses per university • Students studying in ANZ universities, have very similar expectations and experiences of technology to those of our UK students • Some differences: • ANZ students take part in significantly more digital activities than UK students • However, they want digital technologies to be used less on their course 21,095 students surveyed across 13 universities in Australia and New Zealand
  • 12.
    New reports andguidance 1. Exploring the student digital experience: student, staff and organisational factors – Tabetha Newman 2. Jisc NUS Roadmap for supporting students to improve their digital experience and university 3. Enabling an excellent digital experience guidance for engaging senior leaders and informing digital (FE and HE versions) Digital experience insights https://digitalinsights.jisc.ac.uk http://bit.ly/DEI-reports
  • 13.
    Any questions? Digital experienceinsights https://digitalinsights.jisc.ac.uk
  • 14.
    Setting up yourinsights project Mark Langer-Crame Digital experience insights https://digitalinsights.jisc.ac.uk
  • 15.
    Institutional insights project 4.Enhance student digital experience 1. Plan 3. Analyse Digital Experience Insights  Student  Teaching Staff Senior Champion Project team Working group Stakeholders: SU , IT, library, academics Benchmark Recommendations Change initiated Feedback to respondents on changes Enhance services 3. Survey Governance Survey set up in BOS Design local questions Lunch surveys BOS or export Into Excel/ SPSS/NVIVO Quantitative and Qualitative analysis Monitor responses Report to SE Governance groups Surveys start & end dates Sampling cohort Budget Communication plan Prizes? Link to other SE Datasets NSS, modular feedback
  • 16.
    Digital experience insightsservice and institutional activities
  • 17.
    Any questions? Digital experienceinsights https://digitalinsights.jisc.ac.uk
  • 18.
    Insights process andquick guide to getting started and running your project Mark Langer-Crame Digital experience insights https://digitalinsights.jisc.ac.uk
  • 19.
    Insights process 2018-19 You: Submit ‘expression ofinterest’ online We: Send quote for cost, ‘sign- up’ form and ‘terms and conditions’ You: Return completed ‘sign-up’ form (and purchase order, if applicable) We: Send you the ‘getting started’ form asking about your current digital experience and which surveys you want You: Return the ‘getting started’ form We: provide access to Jisc online surveys and master copies of surveys you want You: Copy, customise, launch your surveys (full guidance provided) We: Close surveys (30 April for students and 28 June for staff), benchmark -ing data available shortly after
  • 20.
    Quick guide togetting started & running your project • Log into Jisc online surveys and make copies of the survey(s) you require • Customise your additional questions (if you wish to) – main questions cannot be changed to allow benchmarking • Prepare engagement strategy with students and staff to ensure high response rate • Decide who want to survey – all students/staff or sample? • Check survey(s) and launch
  • 21.
    Quick guide togetting started & running your project • Monitor survey response and send reminders to complete • Close survey(s) and download data from Jisc online surveys into Excel, SPSS etc (and also download benchmarking results) • Carry out analysis - review statistical data and charts for key messages • Report and communicate – produce reports and present findings to students, staff and key stakeholders – with key recommendations • Full guidance on all these steps and more can be found at https://digitalinsights.jisc.ac.uk/our-service/advice-and-guidance/
  • 22.
    Any questions? Digital experienceinsights https://digitalinsights.jisc.ac.uk • Have you launched your surveys? • Any challenges? • How are you engaging your staff and students?
  • 23.
    New developments Sarah Knight Digitalexperience insights https://digitalinsights.jisc.ac.uk
  • 24.
    • Eight newinstitutional case studies see https://digitalinsights.jisc.ac.uk/case-study-listing/ • Three video case studies –University of Stirling, Canterbury Christ Church University and City of Wolverhampton College • Service animation • Professional services staff pilot • Research insights pilot • See https://digitalinsights.jisc.ac.uk • Contact Ruth Drysdale ruth.Drysdale@jisc.ac.uk for further information on how to participate New guidance & support Digital experience insights https://digitalinsights.jisc.ac.uk
  • 25.
  • 26.
    Join us forthe next community of practice event on 22 May 2019 at the Studio, Birmingham #digitalstudent Join our community of practice: https://www.jiscmail.ac.uk/JISC-DIGITALINSIGHTS- COP Follow our blog: https://digitalstudent.jiscinvolve.org https://digitalinsights.jisc.ac.uk
  • 27.
    Follow developments •Digital experienceinsights https://digitalinsights.jisc.ac.uk •Sign up to run insights surveys: bit.ly/DEI-EOI •Reports of 2018 insights findings: http://bit.ly/insightsreports • Jisc NUS Roadmap for supporting students to improve their digital experience and university: http://bit.ly/insightsreports • Enabling an excellent digital experience guidance for engaging senior leaders and informing digital: http://bit.ly/insightsreports • Case studies on institutional use: http://bit.ly/insightscase • Join the insights community of practice with next event on 22 May: https://digitalinsights.jisc.ac.uk/our-service/community-of-practice/ Digital experience insights https://digitalinsights.jisc.ac.uk
  • 28.
    Get in touch… Except whereotherwise noted, this work is licensed under CC-BY Digital experience insights Sarah Knight Sarah.knight@jisc.ac.uk Ruth Drysdale Ruth.Drysdale@jisc.ac.uk https://digitalinsights.jisc.ac.uk #digitalstudent Digital experience insights https://digitalinsights.jisc.ac.uk

Editor's Notes

  • #6 Nearly a million pounds a year is spent by colleges on supporting infrasture/ 4 – AoC survey % of annual college budget Significant investment in technology Expectations from students that universities and colleges will offer an authentic and relevant learning environment In the next 20 years, 90% of all jobs need digital skills To maintain a competitive advantage 5. To inform institutional strategies
  • #7 Ruth to pre
  • #10 As an outcome of the digital student work and the need to gather quantitative data on students digital experience at an organisational level and at a sector level, we developed the student digital experience tracker as a survey tool with a robust set of student tested questions delivered in BOS. See http://bit.ly/jiscdigidataservice This evidence supports discussions with senior managers The report containing the summary findings from 2017 surveys will be available from 20th June from web link on this slide.
  • #11 Sarah to present
  • #12 Sarah to present
  • #26 Mark to collate and chair questions
  • #27 Mark to collate and chair questions