A workshop presentation from Connect More in Wales 2017
Speakers:
- Lisa Gray, senior co-design manager, Jisc
- Joseph Pilgrim, digital learning coordinator, ACT Training
- Heather Price, senior co-design manager, Jisc
- Ian Upton, lecturer in technology enhanced learning, Coventry University
3. Overview of the session
»Overview of the Building digital capabilities service and
Discovery tool
»A skills perspective:
› Joe Pilgrim, Digital Learning Co-ordinator, ACT Training
»A university perspective:
› Ian Upton, Academic Development, Coventry University
»Q&A
»Discussion tables
»Feedback
4. What is your digital superpower?
»Your digital super-power
› What one digital thing are you really
good at? What do your friends ask
you to help them with?
› Add in your superpower to our word
cloud
»Go to menti.com
»Enter the code 815794
»Enter up to 3!
6. What is it and why is digital capability important?
» We need all staff and students’; to
acquire the digital skills and
capabilities for living, learning
and working in a digital world
› Changing world and working
landscape
› Changing expectations of
learners
› Digital capabilities are key
employability skills – and we
need to go further
» Graduate work is being
transformed by digital
technologies and data (IPPR
2017: Managing automation)
» 72% of large firms are struggling
to recruit workers with digital
skills (ECORYS UK 2016: Digital
skills for the UK Economy)
» Young people in the UK are less
digitally literate than in many
OECD countries (OECD 2016:
Survey of Adult Skills).
7. What the students are telling us
80% of HE learners feel that digital skills will be
important in their chosen career...
… but only 50% agree that their course prepares
them well for the digital workplace
Half of learners didn’t know or weren’t sure what
digital skills their course required before they started
it
40% agreed that they have been told what digital
skills they need to improve
8. What is the Discovery tool?
It is:
»A self-administered quiz
about digital practices in
education
»Designed to give useful
feedback including 'next
steps' and links to resources
» Reflective, informative and
developmental
»Still in development.
It isn’t:
»An objective measure of
digital competence or
performance
» A complete learning
resource or course of study
»Validated and proven in
practice (we are still
learning!)
9. Navigating the user dashboard
Menu
Evaluation
feedback
form link
here
This icon takes the user to the six-
elements of digital capability framework
where all the elements are explained
Data
dashboard
10. Each assessment has three question types
1
2
3
Confidence
Best fit/Depth
Breadth
11. Each element has:
» Level: developing | capable | proficient
» Score: how you assessed yourself to
achieve this level
» Next steps: what people at this level
can try to develop further
» Resources: links to selected resources
for further exploration
Individual report
PDF
download
Report
navigation
12. Institutional data dashboards
»Provides institutional leads with
anonymised data on:
› Overall number of staff that have
completed assessments (by
department)
› Scoring bands by organisation
(developing / capable / proficient)
› Scoring bands by department
› Sector comparisons for both
13. Discovery tool – where are we now?
» Over 100 organisations participating in
our Digital discovery tool pilot –
recently closed on the 31st May 18
» Access for the pilots continues until
Friday 13th July
» The discovery tool, as part of the
Building digital capabilities service will
continue to run as a full Jisc service
from September
» If you are interested – register your
interest at: ji.sc/register-digital-
capabilities
14. Evaluation – headline findings
» Total completions for staff stand at
4,812 (as at 31st May), made up of:
› 1352 FE and skills
› 3042 HE
› 418 Other
› From 66 institutions (staff pilot), 11
institutions (learner pilot)
» Total completions for students stand
at 413 (from April – May)
» Overall experience of the tool
› HE and FE staff and student
feedback broadly similar
› 8 out of 10 felt tool was easy to
use and the interface was well
designed.
› Over 7 out of 10 staff rated the
tool as either ‘good’ (median) or
‘excellent’
› Students were slightly more
negative, median judgement
was also ‘good’ but more likely
than staff to say it was ‘average’
15. Positive comments
‘Did give me an idea
of specific areas
which would be
worth working on’
‘I enjoyed using it.The
report accurately
recorded my strengths
and weaknesses’
‘it really makes you
think about what you
actually do, as
opposed to what you
think you do’
‘Made me think about
things in more detail, and
actually assess responses
Really useful, and I
particularly like how it is
relevant to skills for both
my course and my future
career
[I’ve] shied away from
this area, so having an
abundance of help/
feedback was great.
‘I thought the
data and insights
it provided just
based on a quick
assessment was
really good’
15
16. Organisational perspectives
»A skills journey:
› Joe Pilgrim, Digital Learning Co-ordinator, ACT Training
»A university journey:
› Ian Upton, Academic Development, Coventry University
18. »There is no industry standardised measure for digital
confidence and competence.
»Our Staff Training department, need to know the skill gaps we
have in our organisation, so that they can create tailored
training sessions and courses.
The Challenge
19. »Looked at various
options:
- Microsoft Digital Literacy
Certificate Test
- i-Test: University of Exeter
- Various commercial
(expensive) options
Previous Attempts
20. Jisc Discovery Tool Pilot
» Attended webinar sessions to check
whether the system would meet our
needs.
» Hosted JISC for a pre-pilot session.
» Promoted the tool internally with staff.
Engagement/Planning
» Piloted with 15 staff.
» 14 completed assessments.
» General Feedback:
“Easy to use.”
“Resources pointers are good.”
“Good start to assessing capability.”
Experience
21. “ It gives you something to think
about in terms of investigating
tech you had no idea existed!”
22. The Results
»ACT pilot staff scoring bands…
» We have highlighted
capabilities that we
are weaker in as a
company, and are in
the process of
developing training to
upskill staff in these
areas.
23. Next Steps
»We aim to use the pilot data
to inform our next set of
training sessions.
»Currently waiting for the full
pricing model of the
Discovery Tool to decide
which tier version to use.
»Will use the data as a
benchmark to assess
success of staff training on a
yearly basis.
25. Except where otherwise noted, this work is licensed under CC-BY-NC-ND.
Joe Pilgrim
Digital Learning Co-ordinator
josephpilgrim@acttraining.org.uk
ACT Training: Building Digital
Capability
Head Office, Ocean Park House,
East Tyndall Street, Cardiff, CF24 5ET
029 2046 4727
26. How Coventry University are building digital
capability, and using the framework,
discovery tool and other resources in their
journey…
Ian Upton
27. The Coventry Context
“Innovation and digital fluency creates rich
experiences and enhances learning environments
from course design through to interactive student
learning.” Coventry University Education Strategy
33. Except where otherwise noted, this work is licensed under CC-BY-NC-ND.
Ian Upton
Academic Development
ian.upton@coventry.ac.uk
34. Group discussions
»On your tables, discuss ‘one
thing we can do to help
you move forward?’
»Share your journeys so far
»Plenary discussion and
feedback / questions from
tables – what one thing will
you take away?
35. Next steps
» Building digital capability service,
including discovery tool
› Approval to run as a full service from
September 2018
» The full service will include for the tool
(as part of the wider service):
› Free (reduced) version available to
staff
› Full version of the tool at a charge to
institutions
» If you are interested, register your
interest at: ji.sc/register-digital-
capabilities
36. New digital capability resources
» Senior leaders briefing paper on
Delivering digital change:
strategy, practice and process
http://bit.ly/jisc-leaders
» How are HR departments
supporting the development of
staff digital capabilities?
https://bit.ly/2ImZY4o
» Four new institutional case study
videos: https://ji.sc/digicap_films
37. Community of Practice
» Launched in May 2017, ran again in
November 2017 & May 2018 with 100
delegates at from across FE and HE
» Next event – November 2018
» See our summaries of these events
at:
› May 2018: http://bit.ly/digicap-cop3
› Nov 2017: http://ji.sc/community-of-
practice
› May 2017: http://bit.ly/2CKZu1e
» Join CoP mailing list
www.jiscmail.ac.uk/jisc-digcap-ug
‘Valuable for inspiring new ideas
and making new contacts, for
sharing resources.’
38. Follow developments
» Interested in the service?
› Sign up at: ji.sc/register-digital-
capabilities
» Follow developments
› Project blog:
https://digitalcapability.jiscinvolve.org
› Visit project page
http://bit.ly/jiscdigcap
Communication
› Email the project team at:
digitalcapability@jisc.ac.uk
› Follow #digitalcapability on Twitter
» Resources
› Online guide – Developing
organisational approaches to digital
capability
http://bit.ly/digcapguide
› Six elements framework:
http://ji.sc/digicap_ind_frame
› Digital capability institutional videos
https://ji.sc/digicap_films
› Senior leaders briefing
http://bit.ly/jisc-leaders
› Digital leaders programme
http://jisc.ac.uk/training/digital-
leaders-programme
Editor's Notes
Use for Northern Ireland
Scotland
Before we start ….
We all know that world is changing and is increasingly digital, the working landscapes are similarly changing.
We now need to prepare learners for a future that may look very different from today – with jobs that don’t currently exist. Students expectations of their educational experiences are also changing.
To be employable in the modern world we need to develop students as digitally capable lifelong learners – And we need to go further, in developing digital entrepreneurs that can help shape their future employment.
These findings from our 2017 Jisc digital experience insights report provide the evidence of what students are telling us - although 80% of learners recognise that digital skills are important in their future career, only 50% feel that their course is preparing them for the digital worksplace. And only 40% felt that they were aware of their skills and where they needed to improve.
Digital insights is a way of capturing the learners experiences and expectations of digital. It contains robust set of student tested questions delivered in BOS.
The full report contains the summary findings from 2017 surveys, which had 22,500 responses in total, including 8,190 respondents from higher education, across 38 different higher education providers. Responses were from 74 providers across HE, FE, skills and online learners.
So the Jisc building digital capabilities service is aiming to provide a range of tools and resources to support institutions moving towards organisational digital capabilities. From the organisational perspective (the extent to which the culture, policies and infrastructure of an organisation enable and support digital practices’) down to supporting individual staff and students.
One element of the service which we’ll be focusing on today is the discovery tool, which is aimed at individual staff and students and enables them to self-assess their skills.
It provides a series of reflective questions that relate to the different elements of digital capability we have defined in the the six elements of digital capability model (organised by the 15 sub-elements). Buy answering the questions staff are made aware of the skills they already have and new ones they might like to try. The results show a visual summary of where you, next steps and further resources.
As it’s designed to be primarily a developmental tool, it hasn’t been designed to be an objective measure of digital competence, and isn’t designed to be a full course of study – instead it provides a range of pointers to relevant resources.
Highlight the question sets – currently three possible – FE teachres, HE teachers and students. More role-focused question sets in development around library roles, apprenticeships. Two new ones around research area in the planning.
Within each assessment there are 3 question types for each element of the quiz:
There is a Confidence question: where the user rates their confidence with a digital practice or skill
There is a ‘Best fit’ or ‘Depth’ question: where the user needs to select one response out of four that best describes their approach to a digital task
And finally there is a ‘Grid’ or ‘Breadth’ question: where the user can select all the digital activities they do, from a choice of six
All of the questions are intended to nudge the user to question themselves, clarify their understanding or help them think of examples of their digital skills
And the questions either have been user tested and will be reviewed further before the full service version goes live in the Autumn
Once a user has completed all the questions within an assessment they are provided with a tailored report that for each element provides:
Confidence level (developing | capable | proficient)
Score
Suggested next steps
And useful resources
They can download their report.
All anonymous – no individual data is identifiable. For benchmarking, institutions aren’t identified. Aimed at institutional leads to support organisational planning.
Care needs to be taken around how this data is used – we have guidance to help institutions make sense of their data.
So following a small pilot with 15 organisations early last year, we’ve been working with over 100 HE, FE and independent training providers in wider pilot from Dec 17 that has just finished at the end of May. For all pilot institutions they have continued access to the tool till the 13th July, and many are making the most of the opportunity to use the tool as part of staff development events in June.
We’ve captured feedback data from staff, students and institutional leads and will be analysing how well the tool is meeting their needs to inform our future planning over the next couple of months. I’ll share some of the data from the interim analysis in April with you shortly.
Staff can access questions sets tailored to whether they are teaching in an FE or HE context, and a new version for studetns was launched in April for pilots to test. Over the summer we are developing new sets for library roles, and those delivering in a work-based apprenticeships context.
We have just started the final analysis of findings from feedback from staff, students and institutional leads about how well the tool meets their needs which will inform our planning going forwards, here are some of the key findings. Preliminary data is looking positive, and has provided some key themes to improve on which have fed into content changes in April.
Completions for students lower as this only came online for testing in April.
Yes it was relevant and it confirmed what I thought my strengths and weakness are.
Made me think about things in more detail, and actually assess responses.
I think the report is really useful and I particularly like how it is relevant to skills for both my course and future career.
Shied away from this area, so having an ‘abundance’ of help/feedback was great. You can be unsure of the relevance of the questions until the question appears, then you realise how relevant they can be.
It made me reflect on my own skills and how I could develop them further.
Use for Wales
Reposition /resize /remove text box as required
Use for Wales
Reposition /resize /remove text box as required
Reposition /resize /remove text box as required
Reposition /resize /remove text box as required
Reposition /resize /remove text box as required
Reposition /resize /remove text box as required
Reposition /resize /remove text box as required
We have now had approval to run the digital capability service, including the discovery tool, as a full service from September 18.
If you are not a pilot institution and would like to get access to the tool before registering interest, please contact the project team at: digitalcapability@jisc.ac.uk
Volunteers needed – user testing the site
Link to register your interest in the service. Or contact the project team for access if you haven’t already got access to it. And come to see us in the meet the speaker session and we can support you to get in.
And full resource set available from the project page including the six elements framework.
Community of practice – join mailing list. Next gathering in November, date tbc.