UX at Imperial Library
a case study of qualitative approaches to Primo usability
studies
Karine Larose
Systems Librarian
@karinenrose #igelu15
Slides and notes
These slides:
http://bit.ly/karineUX
Background: Library Services
UX in Libraries
‘User experience design testing’ by Flickr user: Andy Bright.
Why: UX at Imperial
To support our strategic
priority of reviewing and
improving user
experience, we carried
out 2 rounds of usability
research of Primo.
How - Primo UX work at Imperial Library
Round 1:
• Primo discount usability testing (Pilot project)
• Student Placement: Sherif Khedry from UCL Qatar
Round 2:
• Primo usability testing – Focus of qualitative/iterative
approach
• Student Placement: George Bray from UCL @NexGenGB
UX round 1 - pilot
• Review the literature
• Usability research
• Central Library
• Interviews
What did we find?
Library Search
meets user
expectations
What did we find?
• Library Search meets
expectations
• Discovery happens elsewhere
Discovery happens elsewhere
• Google et al.
• Library databases
• Citations
• Lecturers
• Friends
What did we find?
• Library Search meets
expectations
• Discovery happens elsewhere
• Issues in ‘discovery to
delivery’
Issues in ‘discovery to delivery’
Issues in ‘discovery to delivery’
Where is
the book?
Issues in ‘discovery to delivery’
?!
Issues in ‘discovery to delivery’ #2
1. Extra click
2. No emphasis
What did we find?
• Library Search meets
expectations
• Discovery happens elsewhere
• Issues in ‘discovery to
delivery’
• ‘…& more’
‘…and more’
Summary Findings
• Single search box
• Improve discoverability
• Primo look and feel
How: UX round 2 timeline
• April 14: planning
• April 27: UCL placement student
• First week of May: interviews
and data analysis
How -Planning 2nd Round UX
• Primo UX team
• UX workshops
• Selecting Interviewees
• Interviews at Central and
Chelsea and Westminster
Research Questions – Main Themes
• Purpose, construction, and use
of search and resources
• Presentation of information:
what matters to the user when
selecting the right results?
How - Research Methodology
• Grounded theory approach
• Qualitative data from
1. Interviews
2. Card Sorting
Data – Notes from Interviews
Facet card sorting
Results: card sorting
‘Books’ sort order
1. Resource Type
2. Topic/Subject
3. Availability
4. Date
5. Author
6. New search on Subject
7. Library
8. New search on Author
‘Articles’ sort order
1. Resource Type
2. Topic/Subject
3. Date
4. Author
5. Availability
6. Collection
7. Language
8. Expand Search
9. New search on Author
Primo Reports Jan-May 15
1. Resource Type
2. Availability
3. Date
4. Library
5. Author
6. Topic/Subject
7. Collection
8. Language
Primo reports facet summary
Primo Reports Jan-May 15
1. Resource Type
2. Availability
3. Date
4. Library
5. Author
6. Topic/Subject
7. Collection
8. Language
Resource
Type
36%
Availability
21%
Date
20%
Library
11%
Author
5%
Subject
4%
Collection
2%
Language
1%
Facet clicks by % of total
Outcomes of ux investigation
• Improve search and
browse speed; simplify
presentation
Outcomes of ux investigation
• Improve search and
browse speed; simplify
presentation
• Make Primo typography
beautiful
Outcomes of ux investigation
• Improve search and
browse speed; simplify
presentation
• Make Primo typography
beautiful
• Outstanding issues…
Results I: main themes
• Searching should be as
fast as possible
Results: main themes
• Searching should be as
fast as possible
• Searching should be
painless
Results: main themes
• Searching should be as
fast as possible
• Searching should be
painless
• Information is prioritised
in selecting results
Switch over Timeline
• July - Complete work on Primo SB
• 3rd August - Acceptance testing
• 6th August - Switch Over
• 6th August onwards - Working
through Bugs and Issues
New Primo: Single Search box
New Primo: Search results
New Primo: Facets
New Primo: Terminology
New Primo – more options
Key Issues after Switchover
• Changes in Scope and Schedule
• Advanced Search
• The A-Z dilemma
• Prioritising search results
• Inconsistent Metadata
The A-Z dilemma
Find E-journal by Title
Key Issues after Switchover (Cont…)
• Changes in Scope and Schedule
• Advanced Search
• The A-Z dilemma
• Prioritising search results
• Inconsistent Metadata
Lessons learned
• Involve staff early in UX Project
• Opportunity for staff development
• Acceptance testing
• Going live success.
• Be prepare to justify design decisions
• Open Communication
Switch over feedback
Future development
• Quantitative studies
• UX investigation in October
with Oxford University
Read these:
• Andrew Preater blog post: “UX for the win”
https://www.preater.com/2015/06/11/ux-for-the-win-at-citymash-open-
coding/
• Ex-Libris research: How Do Users Search and Discover? Christine Stohn
• Pickard, A.J. (2004) Research methods in information. 2nd edn. London:
Facet
• Krug, S. (2006) Don’t make me think! 2nd edn. Berkeley, CA: New Riders
• Charmaz, K. (2014) Constructing grounded theory. 2nd edn. London: Sage
• Glaser, B.G. & Strass, A.L. (1967) The discovery of grounded theory.
Chicago, IL: de Gruyter
Library and Information Systems Team
Andrew Preater @preater
Simon Barron @SimonXIX
Simon Mackenzie
Karine Larose @karinenrose
Email us: library-systems@imperial.ac.uk

Ux at imperial

  • 1.
    UX at ImperialLibrary a case study of qualitative approaches to Primo usability studies Karine Larose Systems Librarian @karinenrose #igelu15
  • 2.
    Slides and notes Theseslides: http://bit.ly/karineUX
  • 3.
  • 4.
    UX in Libraries ‘Userexperience design testing’ by Flickr user: Andy Bright.
  • 5.
    Why: UX atImperial To support our strategic priority of reviewing and improving user experience, we carried out 2 rounds of usability research of Primo.
  • 6.
    How - PrimoUX work at Imperial Library Round 1: • Primo discount usability testing (Pilot project) • Student Placement: Sherif Khedry from UCL Qatar Round 2: • Primo usability testing – Focus of qualitative/iterative approach • Student Placement: George Bray from UCL @NexGenGB
  • 8.
    UX round 1- pilot • Review the literature • Usability research • Central Library • Interviews
  • 9.
    What did wefind? Library Search meets user expectations
  • 10.
    What did wefind? • Library Search meets expectations • Discovery happens elsewhere
  • 12.
    Discovery happens elsewhere •Google et al. • Library databases • Citations • Lecturers • Friends
  • 13.
    What did wefind? • Library Search meets expectations • Discovery happens elsewhere • Issues in ‘discovery to delivery’
  • 14.
    Issues in ‘discoveryto delivery’
  • 15.
    Issues in ‘discoveryto delivery’ Where is the book?
  • 16.
    Issues in ‘discoveryto delivery’ ?!
  • 17.
    Issues in ‘discoveryto delivery’ #2 1. Extra click 2. No emphasis
  • 18.
    What did wefind? • Library Search meets expectations • Discovery happens elsewhere • Issues in ‘discovery to delivery’ • ‘…& more’
  • 19.
  • 20.
    Summary Findings • Singlesearch box • Improve discoverability • Primo look and feel
  • 21.
    How: UX round2 timeline • April 14: planning • April 27: UCL placement student • First week of May: interviews and data analysis
  • 22.
    How -Planning 2ndRound UX • Primo UX team • UX workshops • Selecting Interviewees • Interviews at Central and Chelsea and Westminster
  • 23.
    Research Questions –Main Themes • Purpose, construction, and use of search and resources • Presentation of information: what matters to the user when selecting the right results?
  • 24.
    How - ResearchMethodology • Grounded theory approach • Qualitative data from 1. Interviews 2. Card Sorting
  • 25.
    Data – Notesfrom Interviews
  • 26.
  • 27.
    Results: card sorting ‘Books’sort order 1. Resource Type 2. Topic/Subject 3. Availability 4. Date 5. Author 6. New search on Subject 7. Library 8. New search on Author ‘Articles’ sort order 1. Resource Type 2. Topic/Subject 3. Date 4. Author 5. Availability 6. Collection 7. Language 8. Expand Search 9. New search on Author Primo Reports Jan-May 15 1. Resource Type 2. Availability 3. Date 4. Library 5. Author 6. Topic/Subject 7. Collection 8. Language
  • 28.
    Primo reports facetsummary Primo Reports Jan-May 15 1. Resource Type 2. Availability 3. Date 4. Library 5. Author 6. Topic/Subject 7. Collection 8. Language Resource Type 36% Availability 21% Date 20% Library 11% Author 5% Subject 4% Collection 2% Language 1% Facet clicks by % of total
  • 29.
    Outcomes of uxinvestigation • Improve search and browse speed; simplify presentation
  • 30.
    Outcomes of uxinvestigation • Improve search and browse speed; simplify presentation • Make Primo typography beautiful
  • 31.
    Outcomes of uxinvestigation • Improve search and browse speed; simplify presentation • Make Primo typography beautiful • Outstanding issues…
  • 32.
    Results I: mainthemes • Searching should be as fast as possible
  • 33.
    Results: main themes •Searching should be as fast as possible • Searching should be painless
  • 34.
    Results: main themes •Searching should be as fast as possible • Searching should be painless • Information is prioritised in selecting results
  • 35.
    Switch over Timeline •July - Complete work on Primo SB • 3rd August - Acceptance testing • 6th August - Switch Over • 6th August onwards - Working through Bugs and Issues
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
    New Primo –more options
  • 41.
    Key Issues afterSwitchover • Changes in Scope and Schedule • Advanced Search • The A-Z dilemma • Prioritising search results • Inconsistent Metadata
  • 42.
  • 43.
  • 44.
    Key Issues afterSwitchover (Cont…) • Changes in Scope and Schedule • Advanced Search • The A-Z dilemma • Prioritising search results • Inconsistent Metadata
  • 45.
    Lessons learned • Involvestaff early in UX Project • Opportunity for staff development • Acceptance testing • Going live success. • Be prepare to justify design decisions • Open Communication
  • 46.
  • 47.
    Future development • Quantitativestudies • UX investigation in October with Oxford University
  • 48.
    Read these: • AndrewPreater blog post: “UX for the win” https://www.preater.com/2015/06/11/ux-for-the-win-at-citymash-open- coding/ • Ex-Libris research: How Do Users Search and Discover? Christine Stohn • Pickard, A.J. (2004) Research methods in information. 2nd edn. London: Facet • Krug, S. (2006) Don’t make me think! 2nd edn. Berkeley, CA: New Riders • Charmaz, K. (2014) Constructing grounded theory. 2nd edn. London: Sage • Glaser, B.G. & Strass, A.L. (1967) The discovery of grounded theory. Chicago, IL: de Gruyter
  • 49.
    Library and InformationSystems Team Andrew Preater @preater Simon Barron @SimonXIX Simon Mackenzie Karine Larose @karinenrose Email us: library-systems@imperial.ac.uk