SlideShare a Scribd company logo
How to go about analysing your
survey data webinar
14 May 2020
Agenda
• Introduction (Sarah Knight) – 5 mins
• Top tips for carrying out quantitative and qualitative analysis (Mark LC) – 10 mins
• COVID-19 – updates in relation to analysis (Mark LC) – 10 mins
• Presentations from institutions (10 mins each):
• Laura Hollingshead (University of Derby) - ‘My data analysis journey’
• Rod Cullen (Manchester Metropolitan University) – ‘The use of added free text
questions to allow richer insight of the data’
• Community of practice (Ruth Drysdale) – 5 mins
• Open questions – (10 mins)
Introduction
Sarah Knight – Head of Data and Digital Capability (Jisc)
Top tips for carrying out quantitative and
qualitative analysis
Mark Langer-Crame – Senior Data Intelligence Analyst
(Jisc)
Top analysis tips – quantitative data
• Comparing across your different surveys really add value to your findings – use the
question mapping document!
• If you completed the same survey last year, also really add value to compare on same
questions - to measure progress
• Use data in Jisc online surveys (after national survey closes) to benchmark your scores
against your sector – will help get attention of senior management to the data
• Use the analysis templates we provide – they make it much easier to analyse and
present your data - they can be found here
• How well do your responses reflect your target population? – using confidence intervals
• Are the differences you see in response to a question statistically significant? – z-tests
Top analysis tips – qualitative data
• Qualitative analysis software will allow you to code the responses –
but it won’t do the ‘thinking’ for you as to how and what you decide to
code!
• Many software packages, i.e. Nvivo (has to be paid for) and QDA
Miner Lite (which is free) – but specialist packages not necessary
• Will be overwhelmed if try to analyse all your qualitative data – look at
sample a random sample of the responses, i.e. around 10%
• Carry out word frequency analysis or Word clouds (using Wordsift,
Wordle or WordClouds)
• Free text responses allow you to use staff and students' own words to
illustrate and support key findings
Our official online guidance
For more information you can
find our official guidance on
‘analysing and understanding
your insights survey data’ here
COVID-19 – updates in relation to analysis
Mark Langer-Crame – Senior Data Intelligence Analyst
(Jisc)
Running your insights surveys again
• Many of you may want to run your insights survey(s) again if you ran your previous
survey(s) pre-COVID
• You can run your survey(s) again so you can compare your student/staff responses pre
and post-COVID
• You can simply make a copy of your original survey in Jisc online surveys, reset
open/close dates (and maybe change your customised questions) and launch
• Please can you include in survey name for second surveys the words ‘POST C19
RERUN’ - this is essential
• Note the responses to these second surveys will not be included in the national reports
Close dates for the second surveys
• For those who have already signed up for 2020-21, you can run your second
survey up to the end of August this year
• For those who have not signed up for 2020-21, you will need to ensure any second
survey is closed by the end of July this year
For those who already have insights surveys
open
• For those who currently have your insights surveys open, once closed you can split the
responses by a specified date (pre and post-COVID) as all responses are date stamped
when they were submitted
• To get the date stamp download into Excel, when carrying out the survey export, you will
need to select the option ‘include date of response submission’ from the customisation
options on the export screen to include the date stamp data
• Once the data is separated out by date of submission, you can compare your responses
pre and post the date you choose
New analysis template for those running
second surveys
• We will be creating an analysis templates in Excel so you can create charts to
visualise your survey responses from the original and any second survey you run
• These will be on the resources page of the website, alongside the other standard
analysis templates (which can be found here)
• These will be available by the end of this month (May)
Laura Hollingshead – University of Derby
My data analysis journey
My data
analysis
journey
Laura Hollinshead,
University of Derby
Novice
Simple
Approach
Stages of
analysis
Match questions to last year
Identify areas where there is a
difference
Compare sector data in previous year
Identify key areas of priority for
organisation
In June, compare this year's sector
data and update report
Looking at data
more closely
Future plans
Rod Cullen - Manchester Metropolitan University
The use of added free text questions to allow richer
insight of the data
Custom Questions: Thematic Analysis and Use
Dr Rod Cullen
Engaging with staff and students: What are we trying to achieve?
• Gain a greater understanding of how digital technologies are employed in teaching and
how our teaching staff engage with key aspects of the digital environment provided by
the institution.
• Support ISDS’ ongoing aim to work collaboratively with our teaching staff to improve
and shape both their and our students’ digital experience.
Staff Insights Survey: Custom Questions
21. How can Moodle, the university Virtual Leaning Environment,
be improved to better support your teaching and assessment
practice?
22. How can the universities formal teaching spaces be improved
(with or without technology) to better support your teaching?
23. Do you think student learning is enhanced by the use of
technology? Y/N
a. Please explain your answer?
Thematic Analysis
Overview of data sources
JISC Staff Digital Insights
Survey
22nd April – 12th May 2019
333 Responses
(21% response rate)
Insights Survey Follow-up
June 2019
4 - Focus Groups
Classroom Tech Review
June/July 2018
20 user scenarios from TELAs
Internal Student Survey
TEL free text comments
20k comments over 6 years
• A lot of data
• Common &
Conflicting
Narratives
• Complex
picture
Main Narratives
Narrative 1
Overall
satisfaction
and reliability
of technology
Narrative 2
Teaching
spaces and
technology
Narrative 3
The
Moodle
Ecosystem
Narrative 4
The desire to
use
technology
Narrative 5
The need for
strategic
guidance
Narrative 6
The perceived
value of
technology to
support
learning
Narrative 3 - Moodle
I rely on the VLE for my teaching
Man Met 78% Agree
Sector 73% Agree
Insights
• 83% consider access to Moodle
is reliable (sector 85%)
• 51% agree it is easy to design
and organise course materials
(sector 49%)
• 26% regularly use it for student
collaboration and only (sector
27%)
• 21% agree it encourages
experimentation (sector 24%)
Student perspective from
ISS:
• Moodle highly valued -
how it is used is more
important that how it
looks
• Materials in advance of
teaching
• Areas well organised
and clearly labelled
• Consistent approach
across all of their units.
Free text questions and follow-up focus
groups:
• Some academics are happy with Moodle
• Many consider it to be “Clunky”
• Inflexible
• Content driven/non-collaborative
• Too linear
• Difficult to navigate
• Unattractive to students/dated
• Requests for additional features
• Better integration with other infrastructure
• Office 365
• Teams (enhanced collaborative tools)
• Marks transfer to SRS
• Some features that already exist
• Assessment dates and deadlines
Community of practice
Ruth Drysdale – Senior Consultant (Data and Digital Capability)
(Jisc)
Digital experience insights community of practice
• Launched in May 2018 and runs twice
yearly
• Next event – 21st May online in
partnership with University of
Northampton
• Join our Community of Practice mailing
list: JISC-DIGITALINSIGHTS-COP@JISCMAIL.AC.UK
‘Valuable for inspiring new ideas and
making new contacts, for sharing
resources.’
Register: https://www.jisc.ac.uk/events/building-digital-capability-and-digital-experience-
insights-community-of-practice-21-may-2020
More details: https://digitalinsights.jisc.ac.uk/our-service/community-of-practice/
Open Questions
customerservices@jisc.ac.uk
jisc.ac.uk
help@jisc.ac.uk (putting
‘insights surveys’ in subject title)
Digital experience insights
https://digitalinsights.jisc.ac.uk

More Related Content

Recently uploaded

一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
ytypuem
 
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
z6osjkqvd
 
End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024
Lars Albertsson
 
Template xxxxxxxx ssssssssssss Sertifikat.pptx
Template xxxxxxxx ssssssssssss Sertifikat.pptxTemplate xxxxxxxx ssssssssssss Sertifikat.pptx
Template xxxxxxxx ssssssssssss Sertifikat.pptx
TeukuEriSyahputra
 
Experts live - Improving user adoption with AI
Experts live - Improving user adoption with AIExperts live - Improving user adoption with AI
Experts live - Improving user adoption with AI
jitskeb
 
一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理
一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理
一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理
1tyxnjpia
 
一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理
一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理
一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理
eoxhsaa
 
一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理
一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理
一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理
actyx
 
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docxDATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
SaffaIbrahim1
 
一比一原版美国帕森斯设计学院毕业证(parsons毕业证书)如何办理
一比一原版美国帕森斯设计学院毕业证(parsons毕业证书)如何办理一比一原版美国帕森斯设计学院毕业证(parsons毕业证书)如何办理
一比一原版美国帕森斯设计学院毕业证(parsons毕业证书)如何办理
asyed10
 
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Kaxil Naik
 
一比一原版马来西亚博特拉大学毕业证(upm毕业证)如何办理
一比一原版马来西亚博特拉大学毕业证(upm毕业证)如何办理一比一原版马来西亚博特拉大学毕业证(upm毕业证)如何办理
一比一原版马来西亚博特拉大学毕业证(upm毕业证)如何办理
eudsoh
 
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
Timothy Spann
 
一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理
aqzctr7x
 
How To Control IO Usage using Resource Manager
How To Control IO Usage using Resource ManagerHow To Control IO Usage using Resource Manager
How To Control IO Usage using Resource Manager
Alireza Kamrani
 
Build applications with generative AI on Google Cloud
Build applications with generative AI on Google CloudBuild applications with generative AI on Google Cloud
Build applications with generative AI on Google Cloud
Márton Kodok
 
一比一原版(uom毕业证书)曼彻斯特大学毕业证如何办理
一比一原版(uom毕业证书)曼彻斯特大学毕业证如何办理一比一原版(uom毕业证书)曼彻斯特大学毕业证如何办理
一比一原版(uom毕业证书)曼彻斯特大学毕业证如何办理
osoyvvf
 
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
agdhot
 
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
ihavuls
 
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
xclpvhuk
 

Recently uploaded (20)

一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
 
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
 
End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024
 
Template xxxxxxxx ssssssssssss Sertifikat.pptx
Template xxxxxxxx ssssssssssss Sertifikat.pptxTemplate xxxxxxxx ssssssssssss Sertifikat.pptx
Template xxxxxxxx ssssssssssss Sertifikat.pptx
 
Experts live - Improving user adoption with AI
Experts live - Improving user adoption with AIExperts live - Improving user adoption with AI
Experts live - Improving user adoption with AI
 
一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理
一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理
一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理
 
一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理
一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理
一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理
 
一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理
一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理
一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理
 
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docxDATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
 
一比一原版美国帕森斯设计学院毕业证(parsons毕业证书)如何办理
一比一原版美国帕森斯设计学院毕业证(parsons毕业证书)如何办理一比一原版美国帕森斯设计学院毕业证(parsons毕业证书)如何办理
一比一原版美国帕森斯设计学院毕业证(parsons毕业证书)如何办理
 
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
 
一比一原版马来西亚博特拉大学毕业证(upm毕业证)如何办理
一比一原版马来西亚博特拉大学毕业证(upm毕业证)如何办理一比一原版马来西亚博特拉大学毕业证(upm毕业证)如何办理
一比一原版马来西亚博特拉大学毕业证(upm毕业证)如何办理
 
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
 
一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理
 
How To Control IO Usage using Resource Manager
How To Control IO Usage using Resource ManagerHow To Control IO Usage using Resource Manager
How To Control IO Usage using Resource Manager
 
Build applications with generative AI on Google Cloud
Build applications with generative AI on Google CloudBuild applications with generative AI on Google Cloud
Build applications with generative AI on Google Cloud
 
一比一原版(uom毕业证书)曼彻斯特大学毕业证如何办理
一比一原版(uom毕业证书)曼彻斯特大学毕业证如何办理一比一原版(uom毕业证书)曼彻斯特大学毕业证如何办理
一比一原版(uom毕业证书)曼彻斯特大学毕业证如何办理
 
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
 
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
 
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
 

Featured

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
Marius Sescu
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
Expeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
Pixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
marketingartwork
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
Skeleton Technologies
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
SpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Lily Ray
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
Rajiv Jayarajah, MAppComm, ACC
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
Christy Abraham Joy
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
Vit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
MindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
RachelPearson36
 

Featured (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Jisc - how to go about analysing your survey data webinar 14 May 2020

  • 1. How to go about analysing your survey data webinar 14 May 2020
  • 2. Agenda • Introduction (Sarah Knight) – 5 mins • Top tips for carrying out quantitative and qualitative analysis (Mark LC) – 10 mins • COVID-19 – updates in relation to analysis (Mark LC) – 10 mins • Presentations from institutions (10 mins each): • Laura Hollingshead (University of Derby) - ‘My data analysis journey’ • Rod Cullen (Manchester Metropolitan University) – ‘The use of added free text questions to allow richer insight of the data’ • Community of practice (Ruth Drysdale) – 5 mins • Open questions – (10 mins)
  • 3. Introduction Sarah Knight – Head of Data and Digital Capability (Jisc)
  • 4. Top tips for carrying out quantitative and qualitative analysis Mark Langer-Crame – Senior Data Intelligence Analyst (Jisc)
  • 5. Top analysis tips – quantitative data • Comparing across your different surveys really add value to your findings – use the question mapping document! • If you completed the same survey last year, also really add value to compare on same questions - to measure progress • Use data in Jisc online surveys (after national survey closes) to benchmark your scores against your sector – will help get attention of senior management to the data • Use the analysis templates we provide – they make it much easier to analyse and present your data - they can be found here • How well do your responses reflect your target population? – using confidence intervals • Are the differences you see in response to a question statistically significant? – z-tests
  • 6. Top analysis tips – qualitative data • Qualitative analysis software will allow you to code the responses – but it won’t do the ‘thinking’ for you as to how and what you decide to code! • Many software packages, i.e. Nvivo (has to be paid for) and QDA Miner Lite (which is free) – but specialist packages not necessary • Will be overwhelmed if try to analyse all your qualitative data – look at sample a random sample of the responses, i.e. around 10% • Carry out word frequency analysis or Word clouds (using Wordsift, Wordle or WordClouds) • Free text responses allow you to use staff and students' own words to illustrate and support key findings
  • 7. Our official online guidance For more information you can find our official guidance on ‘analysing and understanding your insights survey data’ here
  • 8. COVID-19 – updates in relation to analysis Mark Langer-Crame – Senior Data Intelligence Analyst (Jisc)
  • 9. Running your insights surveys again • Many of you may want to run your insights survey(s) again if you ran your previous survey(s) pre-COVID • You can run your survey(s) again so you can compare your student/staff responses pre and post-COVID • You can simply make a copy of your original survey in Jisc online surveys, reset open/close dates (and maybe change your customised questions) and launch • Please can you include in survey name for second surveys the words ‘POST C19 RERUN’ - this is essential • Note the responses to these second surveys will not be included in the national reports
  • 10. Close dates for the second surveys • For those who have already signed up for 2020-21, you can run your second survey up to the end of August this year • For those who have not signed up for 2020-21, you will need to ensure any second survey is closed by the end of July this year
  • 11. For those who already have insights surveys open • For those who currently have your insights surveys open, once closed you can split the responses by a specified date (pre and post-COVID) as all responses are date stamped when they were submitted • To get the date stamp download into Excel, when carrying out the survey export, you will need to select the option ‘include date of response submission’ from the customisation options on the export screen to include the date stamp data • Once the data is separated out by date of submission, you can compare your responses pre and post the date you choose
  • 12. New analysis template for those running second surveys • We will be creating an analysis templates in Excel so you can create charts to visualise your survey responses from the original and any second survey you run • These will be on the resources page of the website, alongside the other standard analysis templates (which can be found here) • These will be available by the end of this month (May)
  • 13. Laura Hollingshead – University of Derby My data analysis journey
  • 17. Stages of analysis Match questions to last year Identify areas where there is a difference Compare sector data in previous year Identify key areas of priority for organisation In June, compare this year's sector data and update report
  • 20. Rod Cullen - Manchester Metropolitan University The use of added free text questions to allow richer insight of the data
  • 21. Custom Questions: Thematic Analysis and Use Dr Rod Cullen Engaging with staff and students: What are we trying to achieve? • Gain a greater understanding of how digital technologies are employed in teaching and how our teaching staff engage with key aspects of the digital environment provided by the institution. • Support ISDS’ ongoing aim to work collaboratively with our teaching staff to improve and shape both their and our students’ digital experience.
  • 22. Staff Insights Survey: Custom Questions 21. How can Moodle, the university Virtual Leaning Environment, be improved to better support your teaching and assessment practice? 22. How can the universities formal teaching spaces be improved (with or without technology) to better support your teaching? 23. Do you think student learning is enhanced by the use of technology? Y/N a. Please explain your answer?
  • 24. Overview of data sources JISC Staff Digital Insights Survey 22nd April – 12th May 2019 333 Responses (21% response rate) Insights Survey Follow-up June 2019 4 - Focus Groups Classroom Tech Review June/July 2018 20 user scenarios from TELAs Internal Student Survey TEL free text comments 20k comments over 6 years • A lot of data • Common & Conflicting Narratives • Complex picture
  • 25. Main Narratives Narrative 1 Overall satisfaction and reliability of technology Narrative 2 Teaching spaces and technology Narrative 3 The Moodle Ecosystem Narrative 4 The desire to use technology Narrative 5 The need for strategic guidance Narrative 6 The perceived value of technology to support learning
  • 26. Narrative 3 - Moodle I rely on the VLE for my teaching Man Met 78% Agree Sector 73% Agree Insights • 83% consider access to Moodle is reliable (sector 85%) • 51% agree it is easy to design and organise course materials (sector 49%) • 26% regularly use it for student collaboration and only (sector 27%) • 21% agree it encourages experimentation (sector 24%) Student perspective from ISS: • Moodle highly valued - how it is used is more important that how it looks • Materials in advance of teaching • Areas well organised and clearly labelled • Consistent approach across all of their units. Free text questions and follow-up focus groups: • Some academics are happy with Moodle • Many consider it to be “Clunky” • Inflexible • Content driven/non-collaborative • Too linear • Difficult to navigate • Unattractive to students/dated • Requests for additional features • Better integration with other infrastructure • Office 365 • Teams (enhanced collaborative tools) • Marks transfer to SRS • Some features that already exist • Assessment dates and deadlines
  • 27. Community of practice Ruth Drysdale – Senior Consultant (Data and Digital Capability) (Jisc)
  • 28. Digital experience insights community of practice • Launched in May 2018 and runs twice yearly • Next event – 21st May online in partnership with University of Northampton • Join our Community of Practice mailing list: JISC-DIGITALINSIGHTS-COP@JISCMAIL.AC.UK ‘Valuable for inspiring new ideas and making new contacts, for sharing resources.’ Register: https://www.jisc.ac.uk/events/building-digital-capability-and-digital-experience- insights-community-of-practice-21-may-2020 More details: https://digitalinsights.jisc.ac.uk/our-service/community-of-practice/
  • 30. customerservices@jisc.ac.uk jisc.ac.uk help@jisc.ac.uk (putting ‘insights surveys’ in subject title) Digital experience insights https://digitalinsights.jisc.ac.uk

Editor's Notes

  1. Carrying out analysis since 2017 Each year I have developed my approach further
  2. Limited research background Math's anxiety Qualitative data in BSc and Masters Really interested in doing research but not sure where to start
  3. No fancy spreadsheets Use the data provided in the survey tool via the PDF documents Have a draft report which I reuse every year where I transfer data into
  4. Start analysis in January as survey is carried out December of previous year Highlight difference of more than 5%
  5. Questions related to Covid-19 Questions related to NSS Main report helps me repurpose this
  6. Statistical analysis – comparisons between groups e.g. first years vs others Need to overcome more of my Maths anxiety This year and last year could show significant differences with digital learning opportunities increasing Would like to publish off the back of this work. Unsure what this might look like at the moment.
  7. The JISC Teaching Staff Insight survey is a national survey to find out more about the experiences of teaching staff involved in the delivery of learning.
  8. Our digital capabilities community of practice with over 100 active participants is an open community that welcomes both experienced participants and those who have not previously engaged in this field but who would like to find out more. So if this interests you and you are not already a participant, please do join our Community of Practice. We run events twice a year in partnership with universities and colleges with the focus on sharing experiences, solutions and challenges. This, along with the mailing list provides opportunities for members be kept up to date with news and events and to work together on all aspects of digital capability for staff and students Our next event will be taking place in November in Edinburgh, the date of which will be shared via the mailing list and on the community of practice website. We are always looking for volunteers to share their practice at these events - so do let us know if you are interested in being involved.