Successfully reported this slideshow.
A visitors and residents approach
Evaluating online behaviours15/07/2014
#vandr
Welcome!
15/07/2014 Evaluating online behaviours | A visitors and residents approach 2
Lynn SilipigniConnaway, Ph.D.
Senio...
About DigitalVisitors and Residents
» Identify how individuals engage
» How they acquire their information
» Why they make...
V&R Framework
15/07/2014 Evaluating online behaviours | A visitors and residents approach 4
(White and Le Cornu 2011)
#van...
Educational Stages
15/07/2014 Evaluating online behaviours | A visitors and residents approach 5
Data CollectionTools
» 4 Project Phases
» Semi-structured interviews
» Diaries/monthly semi-
structured interviews
» Writt...
Project Phases
» Phase 1: Interviews
» 31 (16 US/15 UK) Emerging (Last year
of secondary/high school & first year
of unive...
Participant Interview Questions
Selected Questions
2.Think of the ways you have used technology and the web for your
studi...
Diarists
Phase 2: Diaries & Follow-Up
Interviews
22 Diarists (10UK/12 US):
» 66 diaries collected
» 53 follow-up diarist i...
Diarist Monthly Interview Questions
Selected Questions
2.Think of a time fairly recently when you
struggled to find approp...
Diary Submission Example
15/07/2014 Evaluating online behaviours | A visitors and residents approach 11
(White and Connawa...
Project Phases
» Phase 3
» Interviews of second group of 12
Emerging stage students (6 US/6 UK)
» Phase 4
» In-depth onlin...
Phases 1-3 Demographics
15/07/2014 Evaluating online behaviours | A visitors and residents approach 13
» Ages of Interview...
Phase 4 Demographics
15/07/2014 Evaluating online behaviours | A visitors and residents approach 14
» Ages of Online Surve...
Why is this important?
» Traditional stats don’t tell whole story
» Answers questions:
» What do users/stakeholders want &...
infoKit
» What is it?
» Contains advice on evaluating digital/online services within
the broader context of traditional se...
Selected Findings
15/07/2014 Evaluating online behaviours | A visitors and residents approach 17
“Like, if two of them say the same thing then that
must be right.”
Assessing Non-Traditional Sources:
Determining Credibil...
“It’s like a taboo I guess with all teachers, they just all
say – you know, when they explain the paper they
always say, ‘...
Convenience
(Connaway, Lanclos, & Hood 2013)
Convenience trumps all other reasons for selecting and using a source
“Conven...
“And so like my parents will always go, ‘Well look it
up in a book, go to the library.’ And I’ll go, ‘Well
there’s the int...
Graduate School
15/07/2014 Evaluating online behaviours | A visitors and residents approach 22
ImageCC http://goo.gl/KbRY9W
Contact and Educational Stages
15/07/2014 Evaluating online behaviours | A visitors and residents approach 23
Human Sources and Educational Stages
15/07/2014 Evaluating online behaviours | A visitors and residents approach 24
Place and Educational Stages
15/07/2014 Evaluating online behaviours | A visitors and residents approach 25
15/07/2014 Evaluating online behaviours | A visitors and residents approach 26
Response?
MappingVisitor
and Resident
Behavior
15/07/2014 Evaluating online behaviours | A visitors and residents approach 27
Mapping
15/07/2014 Evaluating online behaviours | A visitors and residents approach 28
Mapping
15/07/2014 Evaluating online behaviours | A visitors and residents approach 29
Mapping
15/07/2014 Evaluating online behaviours | A visitors and residents approach 30
Mapping
15/07/2014 Evaluating online behaviours | A visitors and residents approach 31
Infokit
15/07/2014 Evaluating online behaviours | A visitors and residents approach 32
http://bit.ly/evaldigservs-infokit
Workshops
15/07/2014 Evaluating online behaviours | A visitors and residents approach 33
http://goo.gl/KfrbrY
15/07/2014 Evaluating online behaviours | A visitors and residents approach 34
Younger students (18-25) layered map
15/07/2014 Evaluating online behaviours | A visitors and residents approach 35
Older students (35-45) layered map
15/07/2014 Evaluating online behaviours | A visitors and residents approach 36
15/07/2014 Evaluating online behaviours | A visitors and residents approach 37
» “We would like to use this exercise as a ...
University of the Arts London
15/07/2014 Evaluating online behaviours | A visitors and residents approach 38
Questions and Discussion
Lynn Silipigni Connaway
connawal@oclc.org
@LynnConnaway
15/07/2014 Evaluating online behaviours |...
References
White, David S., and Lynn SilipigniConnaway. 2011-2014. Visitors & Residents:What Motivates Engagement with the...
Upcoming SlideShare
Loading in …5
×

Evaluating online behaviours: a visitors and residents approach

1,232 views

Published on

Online technology has changed the way individuals engage with each other for teaching, learning and research. This brings new challenges for the provision of academic services based on individuals’ service expectations and online behaviours.

This presentation accompanies the 'Evaluating online behaviours' event which took place on 15th July 2014

Published in: Education
  • Be the first to comment

  • Be the first to like this

Evaluating online behaviours: a visitors and residents approach

  1. 1. A visitors and residents approach Evaluating online behaviours15/07/2014 #vandr
  2. 2. Welcome! 15/07/2014 Evaluating online behaviours | A visitors and residents approach 2 Lynn SilipigniConnaway, Ph.D. Senior Research Scientist OCLC Research connawal@oclc.org @LynnConnaway DavidWhite Head ofTechnology Enhanced Learning University of Arts London david.white@arts.ac.uk @daveowhite Donna M. Lanclos, Ph.D. Associate Professor for Anthropological Research University of North Carolina,Charlotte dlanclos@uncc.edu @DonnaLanclos #vandr Visitors and Residents resources http://goo.gl/vxUMRD
  3. 3. About DigitalVisitors and Residents » Identify how individuals engage » How they acquire their information » Why they make their choices 15/07/2014 Evaluating online behaviours | A visitors and residents approach 3 (White, Connaway, Lanclos, Hood, and Vass 2014) #vandr Visitors and Residents resources http://goo.gl/vxUMRD
  4. 4. V&R Framework 15/07/2014 Evaluating online behaviours | A visitors and residents approach 4 (White and Le Cornu 2011) #vandr Visitors and Residents resources http://goo.gl/vxUMRD
  5. 5. Educational Stages 15/07/2014 Evaluating online behaviours | A visitors and residents approach 5
  6. 6. Data CollectionTools » 4 Project Phases » Semi-structured interviews » Diaries/monthly semi- structured interviews » Written » Video » Skype or telephone » Second group of semi- structured interviews » Online survey 15/07/2014 Evaluating online behaviours | A visitors and residents approach 6 (White and Connaway 2011-2014)
  7. 7. Project Phases » Phase 1: Interviews » 31 (16 US/15 UK) Emerging (Last year of secondary/high school & first year of university) » 10 (5 US, 5 UK) Establishing (2nd-3rd year undergraduates) » 10 (5 US, 5 UK) Embedding (Postgraduates, PhD students) » 10 (5 US, 5 UK) Experiencing (scholars) Some Phase 1 participants agreed to submit monthly diaries 15/07/2014 Evaluating online behaviours | A visitors and residents approach 7 (White and Connaway 2011-2014)
  8. 8. Participant Interview Questions Selected Questions 2.Think of the ways you have used technology and the web for your studies. Describe a typical week. 4.Think of a time when you had a situation where you needed answers or solutions and you did a quick search and made do with it. You knew there were other sources but you decided not to use them. Please include sources such as friends, family, teachers, coaches, etc. 15/07/2014 Evaluating online behaviours | A visitors and residents approach 8 (White and Connaway 2011-2014)
  9. 9. Diarists Phase 2: Diaries & Follow-Up Interviews 22 Diarists (10UK/12 US): » 66 diaries collected » 53 follow-up diarist interviews conducted » Conducted and collected from April 2011 through October 2013 15/07/2014 Evaluating online behaviours | A visitors and residents approach 9 (White and Connaway 2011-2014)
  10. 10. Diarist Monthly Interview Questions Selected Questions 2.Think of a time fairly recently when you struggled to find appropriate resources to help you complete an ACADEMIC assignment. What happened? 3. Explain a time in the past month when you were successful in getting what you needed in a PERSONAL situation. What steps did you take? 15/07/2014 Evaluating online behaviours | A visitors and residents approach 10 (White and Connaway 2011-2014)
  11. 11. Diary Submission Example 15/07/2014 Evaluating online behaviours | A visitors and residents approach 11 (White and Connaway 2011-2014)
  12. 12. Project Phases » Phase 3 » Interviews of second group of 12 Emerging stage students (6 US/6 UK) » Phase 4 » In-depth online survey – 50 participants representing each educational stage (100 US/100 UK) 15/07/2014 Evaluating online behaviours | A visitors and residents approach 12 (White and Connaway 2011-2014)
  13. 13. Phases 1-3 Demographics 15/07/2014 Evaluating online behaviours | A visitors and residents approach 13 » Ages of Interview and Diary Participants (White and Connaway 2011- 2014) 25 14 2 1 1 1 5 3 1 6 1 3 3 5 2 0 5 10 15 20 25 30 12-18 19-25 26-34 35-44 45-54 55-64 Experiencing Embedding Establishing Emerging
  14. 14. Phase 4 Demographics 15/07/2014 Evaluating online behaviours | A visitors and residents approach 14 » Ages of Online Survey Participants (White and Connaway 2011- 2014) 23 15 4 1 46 2 1 17 18 4 1 2 1 3 7 6 5 2 0 10 20 30 40 50 60 70 80 90 12-18 19-25 26-34 35-44 45-54 55-64 64+ Experiencing Embedding Establishing Emerging
  15. 15. Why is this important? » Traditional stats don’t tell whole story » Answers questions: » What do users/stakeholders want & need? » How can services/programs better meet needs? » Is what we do working? » Could we do better? » What are problem areas? 15/07/2014 Evaluating online behaviours | A visitors and residents approach 15
  16. 16. infoKit » What is it? » Contains advice on evaluating digital/online services within the broader context of traditional services. » Why did we create it? » To understand the contexts surrounding individual engagement with digital resources, spaces and tools. » Who will use it? » Librarians and information technology staff 15/07/2014 Evaluating online behaviours | A visitors and residents approach 16
  17. 17. Selected Findings 15/07/2014 Evaluating online behaviours | A visitors and residents approach 17
  18. 18. “Like, if two of them say the same thing then that must be right.” Assessing Non-Traditional Sources: Determining Credibility and Authority
  19. 19. “It’s like a taboo I guess with all teachers, they just all say – you know, when they explain the paper they always say, ‘Don’t use Wikipedia.’” (DigitalVisitors and Residents, USU7, Female, Age 19, Political Science) The Learning Black Market
  20. 20. Convenience (Connaway, Lanclos, & Hood 2013) Convenience trumps all other reasons for selecting and using a source “Convenient” Isn’t Always Simple
  21. 21. “And so like my parents will always go, ‘Well look it up in a book, go to the library.’ And I’ll go, ‘Well there’s the internet just there.’” (Digital Visitors and Residents, UKU5, Emerging, Female, Age 19, Chemistry)
  22. 22. Graduate School 15/07/2014 Evaluating online behaviours | A visitors and residents approach 22 ImageCC http://goo.gl/KbRY9W
  23. 23. Contact and Educational Stages 15/07/2014 Evaluating online behaviours | A visitors and residents approach 23
  24. 24. Human Sources and Educational Stages 15/07/2014 Evaluating online behaviours | A visitors and residents approach 24
  25. 25. Place and Educational Stages 15/07/2014 Evaluating online behaviours | A visitors and residents approach 25
  26. 26. 15/07/2014 Evaluating online behaviours | A visitors and residents approach 26 Response?
  27. 27. MappingVisitor and Resident Behavior 15/07/2014 Evaluating online behaviours | A visitors and residents approach 27
  28. 28. Mapping 15/07/2014 Evaluating online behaviours | A visitors and residents approach 28
  29. 29. Mapping 15/07/2014 Evaluating online behaviours | A visitors and residents approach 29
  30. 30. Mapping 15/07/2014 Evaluating online behaviours | A visitors and residents approach 30
  31. 31. Mapping 15/07/2014 Evaluating online behaviours | A visitors and residents approach 31
  32. 32. Infokit 15/07/2014 Evaluating online behaviours | A visitors and residents approach 32 http://bit.ly/evaldigservs-infokit
  33. 33. Workshops 15/07/2014 Evaluating online behaviours | A visitors and residents approach 33 http://goo.gl/KfrbrY
  34. 34. 15/07/2014 Evaluating online behaviours | A visitors and residents approach 34
  35. 35. Younger students (18-25) layered map 15/07/2014 Evaluating online behaviours | A visitors and residents approach 35
  36. 36. Older students (35-45) layered map 15/07/2014 Evaluating online behaviours | A visitors and residents approach 36
  37. 37. 15/07/2014 Evaluating online behaviours | A visitors and residents approach 37 » “We would like to use this exercise as a tool in the induction of all new students beginning in September 2014.This will allow us to monitor any changes in technologies and use this to enhance both communications with the students as well as our teaching strategies.” » “We would be interested in exploring more comprehensively how web residency can inform modern pedagogies and vice versa.” » “It has already had a massive impact on students within PR and Marketing.The challenge is now to roll out in other disciplines.” » “A project aim is to set up a means of scoring future staff job descriptions for their digital literacy requirements. Mapping current activity/knowledge this way would be an excellent start.”
  38. 38. University of the Arts London 15/07/2014 Evaluating online behaviours | A visitors and residents approach 38
  39. 39. Questions and Discussion Lynn Silipigni Connaway connawal@oclc.org @LynnConnaway 15/07/2014 Evaluating online behaviours | A visitors and residents approach 39 Donna M. Lanclos dlanclos@uncc.edu @DonnaLanclos David White david.white@arts.ac.uk @daveowhite #vandr Visitors and Residents resources http://goo.gl/vxUMRD
  40. 40. References White, David S., and Lynn SilipigniConnaway. 2011-2014. Visitors & Residents:What Motivates Engagement with the Digital Information Environment. Funded by JISC,OCLC, and Oxford University. http://www.oclc.org/research/activities/vandr/. White, David, Lynn SilipigniConnaway, Donna Lanclos, Erin M. Hood, andCarrieVass. 2014. Evaluating Digital Services: AVisitors and Residents Approach. http://www.jiscinfonet.ac.uk/infokits/evaluating-services/. 15/07/2014 Evaluating online behaviours | A visitors and residents approach 40

×