Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
London Oslo Rotterdam São Paulowww.liveworkstudio.com
& Analysis Project
Digital Student Data
JISC
WORKSHOP
Students’ expe...
10:30 Welcome & Warm-up exercise
11:00 Framing & Problem setting
11:40 Short pause
12:05 What-if’s
12:25 Present What if’s...
Livework © 2015 3
Who we’ve spoken to
13 Representatives from educational institutions in e-learning, IT,
library, custome...
Livework © 2015 4
What we’ve heard &
learned
Livework © 2015 5
“Universities spend years
not responding to stuff
they already know.”
Livework © 2015 6
Expectations
INSIGHTS
Most students have low expectations of
what will be provided. As long as they have...
Livework © 2015 7
Experience
INSIGHTS
Experience is relative –personal digital
skillset may not transfer into the academic...
Livework © 2015 8
Benchmarking I
INSIGHTS
Institutions are all worried they are not
tackling this as well as others. But a...
Livework © 2015 9
Benchmarking II
INSIGHTS
Institutions would also benefit from being
able to benchmark students’ capabili...
Livework © 2015 10
Survey fatigue
INSIGHTS
Everyone is suffering from survey fatigue.
The students get too many emails (in...
Livework © 2015 11
Data
INSIGHTS
No institutions are doing anything much with
big data yet. Whether this is capturing and
...
Livework © 2015 12
Participation and platforms
INSIGHTS
For all the talk about survey fatigue, students
are willing to par...
Livework © 2015 13
Output
INSIGHTS
Institutions want output from any data
gathering to be immediate and/or automated
becau...
Livework © 2015 14
Engagement
INSIGHTS
Notwithstanding all of the above, all
institutions are keen to foster better use of...
Livework © 2015 15
Level playing fields?
INSIGHTS
Different institutions are in different places
when it comes to the digi...
Livework © 2015 16
Hierarchies
INSIGHTS
All surveying received by students is in the
same channels and therefore treated a...
Livework © 2015 17
So What?
Livework © 2015 18
Our conclusions
INSIGHTS
Jisc has an abundance of research and
knowledge in this area.
There seem to be...
Livework © 2015 19
Our recommendation
INSIGHTS
It's not the ‘What’ but the ‘How’ that we
need to investigate in this proje...
Livework © 2015 20
What does this mean for this project?
INSIGHTS
1.  Fatigue
2.  Timing
3.  Appetite
4.  Immediacy
5.  Ch...
Livework © 2015 21
Warm up
Where is this?
UZBEKISTAN
Is the population of
Uzbekistan
more or less than 8m?
Without discussing it just think about it,
then write your answer on a post it…
Livework © 2015 27
Framing &
problem setting
Livework © 2015 28
STUDENT’S USER JOURNEY
Before During After
In all instances today we want to be thinking about the:
How can we help?
Livework © 2015 29
EXERCISE
¿  15 min
How can we help?
Livework © 2015 30
EXERCISE
First Year Student Mike
Being able to know what’s going on with his course sc...
How can we help?
Livework © 2015 31
EXERCISE
Geoff – Senior Lecturer
Knowing what he can and can’t set his students in
ter...
Analogy Cards
Livework © 2015 32
EXERCISE
¿  15 min
Analogy Cards
Livework © 2015 33
EXERCISE
Ebay rating requests
The organisation specifically asks for &
reminds you to lea...
Analogy Cards
Livework © 2015 34
EXERCISE
Mystery Shopper for a brand
Information is gathered incognito by
someone going u...
10:30 Welcome & Warm-up exercise
11:00 Framing & Problem setting
11:40 Short pause
12:05 What-if’s
12:25 Present What if’s...
Livework © 2015 36
What if’s
What if…?
Livework © 2015 37
EXERCISE
¿  20 min
What if…?
Livework © 2015 38
EXERCISE
There was a monthly meet-up
to gather feedback through
a face to face activity with ...
What if…?
Livework © 2015 39
EXERCISE
We ran our survey system like
Amazon runs its feedback system?
¿  5 min
individual
What if…?
Livework © 2015 40
EXERCISE
We ran our survey system like
Amazon runs its feedback system?
¿  5 min
talk
What if…?
Livework © 2015 41
EXERCISE
We ran our survey system like
Amazon runs its feedback system?
¿  5 min
group
Share the
”What if’s”
&
hang them
on the wall
Livework © 2015
We ran our survey
system like Amazon
runs its feedback
syste...
10:30 Welcome & Warm-up exercise
11:00 Framing & Problem setting
11:40 Short pause
12:05 What-if’s
12:25 Present What if’s...
Livework © 2015 44
Concept development
Concept proposition
Livework © 2015 45
EXERCISE
Concept proposition
Livework © 2015 46
EXERCISE
The weigh-in
To create an initiation day to test the digital capabilitieso...
Concept proposition
Livework © 2015 47
EXERCISE
- Manpower pre-term
-  Communication with students
Concept proposition
Livework © 2015 48
EXERCISE
The Skill Hub
An online platform that allows students eager to learnnew sk...
Concept proposition
Livework © 2015 49
EXERCISE
- Cross-departmental coordination
-  IT management and update of data.
- S...
1st Round – Individual ideation
Livework © 2015 50
EXERCISE
¿  10 min
To create an initiation day to test the digital
cap...
1st Round – Group discussion
Livework © 2015 51
EXERCISE
¿  10 min
Build on your ideas
Livework © 2015 52
EXERCISE
¿  10 min
To create an initiation day to test the digital
capabilities of...
Group discussion
Livework © 2015 53
EXERCISE
¿  10 min
Group ideation
Livework © 2015 54
EXERCISE
¿  10 min
3rd Round – Prioritise & choose Top 2
Livework © 2015 55
EXERCISE
¿  10 min
-  Manpower pre-term
-  Communication with st...
10:30 Welcome & Warm-up exercise
11:00 Framing & Problem setting
11:40 Short pause
12:05 What-if’s
12:25 Present What if’s...
Livework © 2015 57
Present concepts
Before During After
Present and place into user journey
Livework © 2015 58
EXERCISE
¿  1 min
per. concept
-  Manpower pre...
Livework © 2015 59
Vote
Vote upon the concepts
Livework © 2015 60
EXERCISE
¿  10 min
Most desirable conceptMost feasible concept
Livework © 2015 61
Summary & discussion
Livework © 2015 62
London Oslo Rotterdam São Paulowww.liveworkstudio.com
CONTACT
www.liveworkstudio.com
Cathrine Einarsson
Livework © 2015 30...
Jisc Digital Student Data Workshop Materials
Upcoming SlideShare
Loading in …5
×

Jisc Digital Student Data Workshop Materials

434 views

Published on

This presentation contains the materials used by Livework to facilitate discussions at the Jisc Digital Student data collection and analysis workshop on 29 April 2015.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Jisc Digital Student Data Workshop Materials

  1. 1. London Oslo Rotterdam São Paulowww.liveworkstudio.com & Analysis Project Digital Student Data JISC WORKSHOP Students’ expectations & experiences of technology 30 april 2015Livework © 2015
  2. 2. 10:30 Welcome & Warm-up exercise 11:00 Framing & Problem setting 11:40 Short pause 12:05 What-if’s 12:25 Present What if’s 12:50 Lunch 13:20 Concept development 14:20 Short pause 14:30 Present concepts 14:50 Vote over concepts 15:00 Summary & discussion Agenda of the day
  3. 3. Livework © 2015 3 Who we’ve spoken to 13 Representatives from educational institutions in e-learning, IT, library, customer services, and those involved in: FELTAG research, HE Digital student, and UCISA Digital Capabilities Of these 4 representatives from FE and 9 from HE 7 students ranging from first year, end of BA, MA, Ph.D. and a mature student returning to learning.
  4. 4. Livework © 2015 4 What we’ve heard & learned
  5. 5. Livework © 2015 5 “Universities spend years not responding to stuff they already know.”
  6. 6. Livework © 2015 6 Expectations INSIGHTS Most students have low expectations of what will be provided. As long as they have the basics they seem happy. This is because younger more inexperienced students don't know what to expect, and older more experienced students are more independent.
  7. 7. Livework © 2015 7 Experience INSIGHTS Experience is relative –personal digital skillset may not transfer into the academic. They don’t know what they don’t know - only by undertaking a course do they understand what they’re lacking or may need.
  8. 8. Livework © 2015 8 Benchmarking I INSIGHTS Institutions are all worried they are not tackling this as well as others. But actually everyone is pretty much in the same boat. Having said that, everyone would like to know where they stand, and everyone would like some benchmarking. The desire for effective benchmarking comes in two flavours: how the institution fares against other comparable institutions nationally, but also how faculties and schools within an institution compare with one another.
  9. 9. Livework © 2015 9 Benchmarking II INSIGHTS Institutions would also benefit from being able to benchmark students’ capabilities at the start of a course - and longitudinally throughout their study. There is also not much intelligence or evidence about how students’ digital capabilities equip them for the world of work once they leave. Institutions would like to know more about this area of experience. So there is a desire for longitudinal study to better understand students’ digital experience.
  10. 10. Livework © 2015 10 Survey fatigue INSIGHTS Everyone is suffering from survey fatigue. The students get too many emails (including surveys and questionnaires). Institutions are getting diminishing returns when they send out remote surveys. There’s a question mark over how much appetite and resource there is to digest and analyse the results of surveys anyway. And there’s no consistency between different faculties, let alone institutions around such surveys.
  11. 11. Livework © 2015 11 Data INSIGHTS No institutions are doing anything much with big data yet. Whether this is capturing and analysing the data footprints of students’ through their learning journeys or whether it’s a wider big data catchment. The issue here is not just the resources needed to undertake this, but the policy debate about integrating data and learning technologies together.
  12. 12. Livework © 2015 12 Participation and platforms INSIGHTS For all the talk about survey fatigue, students are willing to participate in research if the timing is right, and especially if it makes a difference to the learning experience for their successors at the institution. Interestingly (though perhaps unsurprisingly) the best responses got by institutions are where information is gathered in person, either face to face or by longitudinal self- capture methods.
  13. 13. Livework © 2015 13 Output INSIGHTS Institutions want output from any data gathering to be immediate and/or automated because most people don’t have the time or resources to read through lengthy reports let alone undertake analysis of data. However, immediate doesn’t necessarily mean quick, it can just as much mean accessible and consumable. In addition, institutions want outputs that help them make strategic decisions and spending decisions related to technology and how it can beneficially impact the students’ learning.
  14. 14. Livework © 2015 14 Engagement INSIGHTS Notwithstanding all of the above, all institutions are keen to foster better use of and engagement with technology in the learning environment. Many want to encourage better imagination about digital engagement, openness, and innovation. Currently this ambition seems hampered by different kinds of issues around permissions & policy, resources & commitment, and vision & ambition.
  15. 15. Livework © 2015 15 Level playing fields? INSIGHTS Different institutions are in different places when it comes to the digital technology agenda in learning. FE & HE have very different resources to call upon. Even within similar institution types there seem to be different attitudes, capabilities, and resources to address this agenda. Lastly different people (staff and students) have very different attitudes and capabilities not necessarily related to their level of experience. For example ‘digital dyslexia’ or level of ‘digital confidence’ can be a condition that affects people irrespective of age or stage.
  16. 16. Livework © 2015 16 Hierarchies INSIGHTS All surveying received by students is in the same channels and therefore treated as equal by them. More thought about the prioritisation and hierarchy of the surveying effort, could help participants to understand the importance of a survey. This would encourage students to participate more, through a variety of channels, platforms and participation typologies.
  17. 17. Livework © 2015 17 So What?
  18. 18. Livework © 2015 18 Our conclusions INSIGHTS Jisc has an abundance of research and knowledge in this area. There seem to be large overlaps in various initiatives reaching similar conclusions. Institutions already have a wealth of materials around this knowledge domain and they don’t need more of the same - especially if it just stays on the shelf.
  19. 19. Livework © 2015 19 Our recommendation INSIGHTS It's not the ‘What’ but the ‘How’ that we need to investigate in this project. Everyone knows what needs to be done but there seems to be less of a view on how to implement it. That’s what we want to investigate today… What NeedHOW
  20. 20. Livework © 2015 20 What does this mean for this project? INSIGHTS 1.  Fatigue 2.  Timing 3.  Appetite 4.  Immediacy 5.  Channels 6.  Hierarchies 7.  Understanding Why 8.  Contextualisation & comparison 9.  Enabling & Actionable 10.  Post course We believe the following themes are relevant to the HOW rather than the WHAT
  21. 21. Livework © 2015 21 Warm up
  22. 22. Where is this?
  23. 23. UZBEKISTAN
  24. 24. Is the population of Uzbekistan more or less than 8m?
  25. 25. Without discussing it just think about it, then write your answer on a post it…
  26. 26. Livework © 2015 27 Framing & problem setting
  27. 27. Livework © 2015 28 STUDENT’S USER JOURNEY Before During After In all instances today we want to be thinking about the:
  28. 28. How can we help? Livework © 2015 29 EXERCISE ¿  15 min
  29. 29. How can we help? Livework © 2015 30 EXERCISE First Year Student Mike Being able to know what’s going on with his course schedule He’s using a temporary phone as he lost his own one with all his course apps ¿  15 min
  30. 30. How can we help? Livework © 2015 31 EXERCISE Geoff – Senior Lecturer Knowing what he can and can’t set his students in terms of their capabilities around certain applications He doesn’t have a specific grading of each of his student’s capabilities ¿  15 min
  31. 31. Analogy Cards Livework © 2015 32 EXERCISE ¿  15 min
  32. 32. Analogy Cards Livework © 2015 33 EXERCISE Ebay rating requests The organisation specifically asks for & reminds you to leave feedback after a transaction. Certain transactions could ‘trigger’ a quick response evaluation request from the user ¿  15 min
  33. 33. Analogy Cards Livework © 2015 34 EXERCISE Mystery Shopper for a brand Information is gathered incognito by someone going undercover. We could send an undercover Jisc tester or recruit secret agent students to report back on their experience. ¿  15 min
  34. 34. 10:30 Welcome & Warm-up exercise 11:00 Framing & Problem setting 11:40 Short pause 12:05 What-if’s 12:25 Present What if’s 12:50 Lunch 13:20 Concept development 14:20 Short pause 14:30 Present concepts 14:50 Vote over concepts 15:00 Summary & discussion Agenda of the day
  35. 35. Livework © 2015 36 What if’s
  36. 36. What if…? Livework © 2015 37 EXERCISE ¿  20 min
  37. 37. What if…? Livework © 2015 38 EXERCISE There was a monthly meet-up to gather feedback through a face to face activity with students ¿  20 min
  38. 38. What if…? Livework © 2015 39 EXERCISE We ran our survey system like Amazon runs its feedback system? ¿  5 min individual
  39. 39. What if…? Livework © 2015 40 EXERCISE We ran our survey system like Amazon runs its feedback system? ¿  5 min talk
  40. 40. What if…? Livework © 2015 41 EXERCISE We ran our survey system like Amazon runs its feedback system? ¿  5 min group
  41. 41. Share the ”What if’s” & hang them on the wall Livework © 2015 We ran our survey system like Amazon runs its feedback system? ¿  5 min per. group We ran our survey system like Amazon runs its feedback system?
  42. 42. 10:30 Welcome & Warm-up exercise 11:00 Framing & Problem setting 11:40 Short pause 12:05 What-if’s 12:25 Present What if’s 12:50 Lunch 13:20 Concept development 14:20 Short pause 14:30 Present concepts 14:50 Vote over concepts 15:00 Summary & discussion Agenda of the day
  43. 43. Livework © 2015 44 Concept development
  44. 44. Concept proposition Livework © 2015 45 EXERCISE
  45. 45. Concept proposition Livework © 2015 46 EXERCISE The weigh-in To create an initiation day to test the digital capabilitiesof student and assess their comfort level - Students -  Head of IT -  Head of Library
  46. 46. Concept proposition Livework © 2015 47 EXERCISE - Manpower pre-term -  Communication with students
  47. 47. Concept proposition Livework © 2015 48 EXERCISE The Skill Hub An online platform that allows students eager to learnnew skills to access an overview of all the support and services available across the departments.
  48. 48. Concept proposition Livework © 2015 49 EXERCISE - Cross-departmental coordination -  IT management and update of data. - Students -  Head of IT -  Head of Library
  49. 49. 1st Round – Individual ideation Livework © 2015 50 EXERCISE ¿  10 min To create an initiation day to test the digital capabilities of student and assess their comfort level
  50. 50. 1st Round – Group discussion Livework © 2015 51 EXERCISE ¿  10 min
  51. 51. Build on your ideas Livework © 2015 52 EXERCISE ¿  10 min To create an initiation day to test the digital capabilities of student and assess their comfort level
  52. 52. Group discussion Livework © 2015 53 EXERCISE ¿  10 min
  53. 53. Group ideation Livework © 2015 54 EXERCISE ¿  10 min
  54. 54. 3rd Round – Prioritise & choose Top 2 Livework © 2015 55 EXERCISE ¿  10 min -  Manpower pre-term -  Communication with students -  Database -  Digital strategy
  55. 55. 10:30 Welcome & Warm-up exercise 11:00 Framing & Problem setting 11:40 Short pause 12:05 What-if’s 12:25 Present What if’s 12:50 Lunch 13:20 Concept development 14:20 Short pause 14:30 Present concepts 14:50 Vote over concepts 15:00 Summary & discussion Agenda of the day
  56. 56. Livework © 2015 57 Present concepts
  57. 57. Before During After Present and place into user journey Livework © 2015 58 EXERCISE ¿  1 min per. concept -  Manpower pre-term -  Communication with students Our concept is about….
  58. 58. Livework © 2015 59 Vote
  59. 59. Vote upon the concepts Livework © 2015 60 EXERCISE ¿  10 min Most desirable conceptMost feasible concept
  60. 60. Livework © 2015 61 Summary & discussion
  61. 61. Livework © 2015 62
  62. 62. London Oslo Rotterdam São Paulowww.liveworkstudio.com CONTACT www.liveworkstudio.com Cathrine Einarsson Livework © 2015 30 april 2015 cathrine@liveworkstudio.com +47 952 81 410

×