SlideShare a Scribd company logo
“More than Meets the Eye”
Analyzing the Success of
User Queries in Oria
Hugo Huurdeman, Mikaela Aamodt, Dan Michael Heggø
University of Oslo Library
VIRAK conference, 2017-06-13
1. Introduction
• More insights are needed into library search
issues, what goes right and what goes wrong
• Opportunity: analyze data gathered at UiO during
the last two years
Research Questions
1. Which insights can we gain from classifying user
queries within Oria by their popularity, specificity
and intended target resources?
2. To what extent are the most popular user queries
successful?
3. What underlying reasons for unsuccessful queries
can be determined?
2. Data: Primo Analytics
• Actions
• Device usage
• Facets
• Popular Searches (monthly)
• Timeframes: Jan-Jun 2015; Nov-Dec 2015; Jan-Sep 2016
• Sessions
• Zero result queries (daily)
• Aug 7 2015-Sep 30 2016
2. Processing & Analysis
• Basic normalization of queries
• "stanislav andreski" -- stanislav andreski
• Manual annotation of
• (1) top 50 popular queries
• (2) random selection of 50 "zero result" queries
• If derivable from query, determine
• nature of query?
• for which resource type?
• curriculum-related? [in pensum lists UiO]
• successful? [result on first results page]
3. Previous work
• Dominance of commercial search engines in
students’ information seeking (Griffiths & Brophy,
2005)
• Students adopting search behavior from
commercial search engines in library OPACs
(Shiv, 2012), Willson & Given, 2010)
• In particular, undergraduates just entering
academia (Novotny, 2014)
4. Nature of user queries
RQ1 Which insights can we gain from classifying
user queries within Oria by their popularity,
specificity and intended target resources?
• Popular Searches and Zero Result Searches
4.1 Popular Searches dataset
• 5,776 different
queries, 115,590
searches (UiO)
• monthly totals (500)
• 2015 & 2016
• 4.9% of all search actions
• Analyzing top 50
• Together issued
almost 20,000 times
Top 50
• What types of queries are most popular?
titles (33x, 66%)
• det kvalitative
forskningsintervju
• books, journals, databases
topics / titles (6x, 12%)
• spesialpedagogikk
• neurology
topics (4x, 8%)
• cessio legis
Top 50
• What resource types are sought for?
Books (50%)
• det kvalitative
forskningsintervju
• det norske samfunn
Journals (12%)
• science
• lancet
Databases (10%)
• atekst
• pubmed
• duo
Curriculum?
• Were the queries related to pensum books?
• Quite often: at least 58%!
• menneskets fysiologi
• det kvalitative
forskningsintervju
• Or other things (9%) :)
• aftenposten;
morgenbladet
• harry potter
Curriculum?
• Were the queries related to pensum materials?
• Quite often: at least
58%!
• menneskets fysiologi
• det kvalitative
forskningsintervju
• Or other things (34%) :)
• aftenposten;
morgenbladet
4.2 “Zero result” queries
• 39,925 different
queries
• In total 52,257
searches
• Aug 2015-Sep
2016
• 2.2% of all search
actions
• Annotating
random sample
(50)
al azm sadik «orientalisme og omvendt orientalisme» 28
curr eye res 27
allmenningen olaf 24
12136173x 22
am j ophthalmol 21
821017268 21
askim j. 19
900317809 19
cheng 19
(direkte krav or direktekrav) and subrogasjon 17
151582998 16
142734500 16
direkte krav or direktekrav 16
961675616 16
9780549547303 16
agirdag phalet 16
andresen steinar elin l. boasson og geir hønneland (2012) international environmental agreements 15
Queries without results
What is the nature of the “zero result” queries performed in Oria?
• Pasted reference (20x, 40%)
• Browning, N. (2015). The
ethics of two-way symmetry
and the dilemmas of dialogic
kantianism. Journal of Media
Ethics
• Title (15x, 30%)
• Sentralbankens oppgaver i
dag og i fremtiden
• Author (8x, 16%)
• Christopher Hotchens
Queries without results
• Book (28%)
• Prcopius Secret History
• Book Chapter (12%)
• Solhaug, (2006). Kapittel 13:
Strategisk læring i
samfunnsfag. I
• Article (24%)
• E.g., pasted references
Which resource types are not found?
Degree of pensum queries?
At least 28% of the
unsuccessful queries
are for pensum
materials
• Fukuyama, F. (2013): What Is
Governance? Governance,
Vol. 26, No. 3, July 2013 (s.
347–368).
• basic immubology
5. Search Success
RQ2 To what extent are the most popular user
queries successful?
Top queries
1. atekst 1425
2. pubmed 1221
3. exphil 719
4. det kvalitative forskningsintervju 711
5. nature 669
6. medical genetics 598
7. direktekrav 562
8. menneskets fysiologi 540
9. 998903677444702000 500
10. science 483
11. spesialpedagogikk 475
12. lancet 438
13. jussens venner 369
14. 991645464 364
1. atekst 1425
2. pubmed 1221
3. exphil 719
4. det kvalitative forskningsintervju 711
5. nature 669
6. medical genetics 598
7. direktekrav 562
8. menneskets fysiologi 540
9. 998903677444702000 500
10. science 483
11. spesialpedagogikk 475
12. lancet 438
13. jussens venner 369
1. atekst 1425
2. pubmed 1221
3. exphil 719
4. det kvalitative forskningsintervju 711
5. nature 669
6. medical genetics 598
7. direktekrav 562
8. menneskets fysiologi 540
9. 998903677444702000 500
10. science 483
11. spesialpedagogikk 475
12. lancet 438
13. jussens venner 369
1. atekst 1425
2. pubmed 1221
3. exphil 719
4. det kvalitative forskningsintervju 711
5. nature 669
6. medical genetics 598
7. direktekrav 562
8. menneskets fysiologi 540
9. 998903677444702000 500
10. science 483
11. spesialpedagogikk 475
12. lancet 438
13. jussens venner 369 Alma
Were the queries successful?
• Often, yes:
• main result in first 10
results: 58%
• not (easily) found: 20%
• For example:
• pubmed
• nature
• science
What are causes for
unsuccessful queries?
• Ambiguous names
• nature, science
• At the time of writing, no entries for
some databases
• pubmed
6. Queries without results
RQ3 What underlying reasons for zero result
queries can be determined?
Why no results?
Pasted reference
Why no results?
• Query being too specific (pasted reference, pasting quote) (22%)
• Browning, N. (2015). The ethics of two-way symmetry and the
dilemmas of dialogic kantianism. Journal of Media Ethics
• Misspellings, reference mistakes (e.g. wrong year) (20%)
• svennevig j.: ledelsesretorikk i nedbemanningssituasjoner 2009
• Using incorrect query syntax (2%)
• "McLuhan" AND/OR "Understanding media"
• 978-147996410-9
• Wrong scope (12%), wrong field (4%)
Why no results (2)
• Searching for an ISBN number (specific edition not in library)
• 9780618721566
• Searching for journal titles, ISSNs, DOIs
• journal of speech and hearing disorders
• Searching for course codes
• MED1100
• Resource not (indexed) in Oria (16%)
• Haugianerliberalistene: En analyse av haugianere som politikere
og næringslivsaktører
Suggestions for misspellings?
• 10 out of 50 queries
(20%) were caused by
misspellings.
•For half, a correct spelling
suggestion exists
•(April 17)
Do queries still return 0 results?
• In 72% of the cases, no
improvement, but 28% is
now resolved.
• April ’17
7. Conclusion & discussion
• Library catalog containing more than
meets the eye
• Even though materials are available,
they do not always show in searches
• Issues in:
• query formulation
• system support...
Discussion
• Refine and extend search suggestions
• Enhanced spell check / query corrections
• why students underacheive → 0 results
• why students underachieve → 463 results
• Query suggestions and autocomplete
• Could be based on previous (successful) queries
• especially recurring queries should be supported (50% of
popular queries!)
• ISBN suggestions
• Automatically search for the book title and author
(using information derived from ISBN number?)
Discussion
• 0 results: get more helpful information
• Requesting assistance, material
• Contextual search suggestions
• e.g. broaden search, simplify query, alternate
formulations
• Available scopes
• suggest how many searches in other scope
Discussion
• Importance of "pensum" queries
• Better integration with pensum lists
• Detecting curriculum queries
• E.g. widget which suggests pensum
materials directly // referring students to
UiO fagsider // etc.
• On the cataloging side:
• Course codes (e.g. INF2260)
"to catalog or not to catalog"
• More support for Database queries
• Atekst could be found, not pubmed
Discussion
• Monitoring searches
• Detect sudden ‘spikes’ in zero result queries
• Finding errors in curriculum lists
• Detecting ‘holes’ in collections (acquisition
staff), and e.g. popular books with too few
copies
8. Future work
• Plans for further analysis
• Comparing queries with most frequent loans
• Alma Analytics
• Current analysis: many known-item queries. Also look at
common exploratory queries
• medicine; math; united nations; economics
• how can we support those types of queries better?
• Obtaining more data (Limits Primo Analytics)
• e.g. analyzing "struggling sessions", stats location, etc
• Look at use of external databases, link resolver stats
bit.ly/the-visualisation-project
@BookNavigationFind this presentation here
“More than Meets the Eye”
Analyzing the Success of
User Queries in Oria
Hugo Huurdeman, Mikaela Aamodt, Dan Michael Heggø
2017-06-13

More Related Content

What's hot

Research Methods in Library and Information Science: Trends and Tips for Rese...
Research Methods in Library and Information Science: Trends and Tips for Rese...Research Methods in Library and Information Science: Trends and Tips for Rese...
Research Methods in Library and Information Science: Trends and Tips for Rese...
Lynn Connaway
 
Research by Design
Research by DesignResearch by Design
Research by Design
Lorie Kloda
 
Social science research methods for libraries
Social science research methods for librariesSocial science research methods for libraries
Social science research methods for libraries
CILIPScotland
 
Increase visibility of your research
Increase visibility of your researchIncrease visibility of your research
Increase visibility of your research
Berenika Webster
 
Evidence Based Librarianship in Practice
Evidence Based Librarianship in PracticeEvidence Based Librarianship in Practice
Evidence Based Librarianship in Practice
Lorie Kloda
 
Searching for Grey Literature
Searching for Grey LiteratureSearching for Grey Literature
Searching for Grey Literature
Farhad Shokraneh
 
Tim Ferris et al 2008
Tim Ferris et al 2008Tim Ferris et al 2008
Tim Ferris et al 2008
Diana Quinn
 
Librarians in Print : A Scholarly Approach to Library Research, Writing, and ...
Librarians in Print: A Scholarly Approach to Library Research, Writing, and ...Librarians in Print: A Scholarly Approach to Library Research, Writing, and ...
Librarians in Print : A Scholarly Approach to Library Research, Writing, and ...
Georgia Libraries Conference (formerly Ga COMO).
 
Finding research evidence 2016
Finding research evidence 2016 Finding research evidence 2016
Finding research evidence 2016
John Iona
 
Designing Effective Research Assignments
Designing Effective Research AssignmentsDesigning Effective Research Assignments
Designing Effective Research Assignments
Suzanne Bernsten
 
Econ708 intro
Econ708   intro Econ708   intro
Econ708 intro
Chiang Mai University
 
Teaching research methods in LIS programs: Approaches, formats, and innovativ...
Teaching research methods in LIS programs: Approaches, formats, and innovativ...Teaching research methods in LIS programs: Approaches, formats, and innovativ...
Teaching research methods in LIS programs: Approaches, formats, and innovativ...
Lynn Connaway
 
Qualitative Research Methods in LIS
Qualitative Research Methods in LISQualitative Research Methods in LIS
Qualitative Research Methods in LIS
Lynn Connaway
 
Crafting a research agenda (in memes)
Crafting a research agenda (in memes) Crafting a research agenda (in memes)
Crafting a research agenda (in memes)
George Veletsianos
 
Survey Research Methods with Lynn Silipigni Connaway
Survey Research Methods with Lynn Silipigni ConnawaySurvey Research Methods with Lynn Silipigni Connaway
Survey Research Methods with Lynn Silipigni Connaway
Lynn Connaway
 
Retraction of papers in journals and Predatory journals .pptx
Retraction of papers in journals and Predatory journals .pptxRetraction of papers in journals and Predatory journals .pptx
Retraction of papers in journals and Predatory journals .pptx
university of chinese academy of sciences
 
Analysis of the attitude within academic and research communities toward open...
Analysis of the attitude within academic and research communities toward open...Analysis of the attitude within academic and research communities toward open...
Analysis of the attitude within academic and research communities toward open...
Platforma Otwartej Nauki
 
Methodology in scientific writing
Methodology in scientific writingMethodology in scientific writing
Methodology in scientific writing
university of chinese academy of sciences
 
Libraries: How Users Search and Discover - Ex Libris User Studies
Libraries: How Users Search and Discover - Ex Libris User StudiesLibraries: How Users Search and Discover - Ex Libris User Studies
Libraries: How Users Search and Discover - Ex Libris User Studies
Dani GUZMAN
 
Bibliometrics in higher education: the impact on libraries
Bibliometrics in higher education: the impact on librariesBibliometrics in higher education: the impact on libraries
Bibliometrics in higher education: the impact on libraries
Berenika Webster
 

What's hot (20)

Research Methods in Library and Information Science: Trends and Tips for Rese...
Research Methods in Library and Information Science: Trends and Tips for Rese...Research Methods in Library and Information Science: Trends and Tips for Rese...
Research Methods in Library and Information Science: Trends and Tips for Rese...
 
Research by Design
Research by DesignResearch by Design
Research by Design
 
Social science research methods for libraries
Social science research methods for librariesSocial science research methods for libraries
Social science research methods for libraries
 
Increase visibility of your research
Increase visibility of your researchIncrease visibility of your research
Increase visibility of your research
 
Evidence Based Librarianship in Practice
Evidence Based Librarianship in PracticeEvidence Based Librarianship in Practice
Evidence Based Librarianship in Practice
 
Searching for Grey Literature
Searching for Grey LiteratureSearching for Grey Literature
Searching for Grey Literature
 
Tim Ferris et al 2008
Tim Ferris et al 2008Tim Ferris et al 2008
Tim Ferris et al 2008
 
Librarians in Print : A Scholarly Approach to Library Research, Writing, and ...
Librarians in Print: A Scholarly Approach to Library Research, Writing, and ...Librarians in Print: A Scholarly Approach to Library Research, Writing, and ...
Librarians in Print : A Scholarly Approach to Library Research, Writing, and ...
 
Finding research evidence 2016
Finding research evidence 2016 Finding research evidence 2016
Finding research evidence 2016
 
Designing Effective Research Assignments
Designing Effective Research AssignmentsDesigning Effective Research Assignments
Designing Effective Research Assignments
 
Econ708 intro
Econ708   intro Econ708   intro
Econ708 intro
 
Teaching research methods in LIS programs: Approaches, formats, and innovativ...
Teaching research methods in LIS programs: Approaches, formats, and innovativ...Teaching research methods in LIS programs: Approaches, formats, and innovativ...
Teaching research methods in LIS programs: Approaches, formats, and innovativ...
 
Qualitative Research Methods in LIS
Qualitative Research Methods in LISQualitative Research Methods in LIS
Qualitative Research Methods in LIS
 
Crafting a research agenda (in memes)
Crafting a research agenda (in memes) Crafting a research agenda (in memes)
Crafting a research agenda (in memes)
 
Survey Research Methods with Lynn Silipigni Connaway
Survey Research Methods with Lynn Silipigni ConnawaySurvey Research Methods with Lynn Silipigni Connaway
Survey Research Methods with Lynn Silipigni Connaway
 
Retraction of papers in journals and Predatory journals .pptx
Retraction of papers in journals and Predatory journals .pptxRetraction of papers in journals and Predatory journals .pptx
Retraction of papers in journals and Predatory journals .pptx
 
Analysis of the attitude within academic and research communities toward open...
Analysis of the attitude within academic and research communities toward open...Analysis of the attitude within academic and research communities toward open...
Analysis of the attitude within academic and research communities toward open...
 
Methodology in scientific writing
Methodology in scientific writingMethodology in scientific writing
Methodology in scientific writing
 
Libraries: How Users Search and Discover - Ex Libris User Studies
Libraries: How Users Search and Discover - Ex Libris User StudiesLibraries: How Users Search and Discover - Ex Libris User Studies
Libraries: How Users Search and Discover - Ex Libris User Studies
 
Bibliometrics in higher education: the impact on libraries
Bibliometrics in higher education: the impact on librariesBibliometrics in higher education: the impact on libraries
Bibliometrics in higher education: the impact on libraries
 

Similar to “More than Meets the Eye” - Analyzing the Success of User Queries in Oria

A brief introduction to research in medical field.pptx
A brief introduction to research in medical field.pptxA brief introduction to research in medical field.pptx
A brief introduction to research in medical field.pptx
NommanNaibkhil1
 
NHS London Libraries Games and Info Lit w'shop Sept '14
NHS London Libraries Games and Info Lit w'shop Sept '14NHS London Libraries Games and Info Lit w'shop Sept '14
NHS London Libraries Games and Info Lit w'shop Sept '14EISLibrarian
 
‘Are we communicating effectively, and fully engaging with our research commu...
‘Are we communicating effectively, and fully engaging with our research commu...‘Are we communicating effectively, and fully engaging with our research commu...
‘Are we communicating effectively, and fully engaging with our research commu...
CONUL Conference
 
5.chapter 3
5.chapter 35.chapter 3
5.chapter 3
Nazrin Nazdri
 
HN313 Library Lecture Jan 26
HN313 Library Lecture Jan 26HN313 Library Lecture Jan 26
HN313 Library Lecture Jan 26
jamieduic
 
KN Study Abroad 2016 Library Research
KN Study Abroad 2016 Library ResearchKN Study Abroad 2016 Library Research
KN Study Abroad 2016 Library Research
jamieduic
 
October 28, 2015 NISO Virtual Conference Interacting with Content: Improving ...
October 28, 2015 NISO Virtual Conference Interacting with Content: Improving ...October 28, 2015 NISO Virtual Conference Interacting with Content: Improving ...
October 28, 2015 NISO Virtual Conference Interacting with Content: Improving ...
National Information Standards Organization (NISO)
 
Managing Ireland's Research Data - 3 Research Methods
Managing Ireland's Research Data - 3 Research MethodsManaging Ireland's Research Data - 3 Research Methods
Managing Ireland's Research Data - 3 Research Methods
Rebecca Grant
 
The student search experience
The student search experience The student search experience
The student search experience
Katherine Rose
 
Responsive and Responsible Use of Digital Resources for Research
Responsive and Responsible Use of Digital Resources  for Research Responsive and Responsible Use of Digital Resources  for Research
Responsive and Responsible Use of Digital Resources for Research
Shang Genon-Sieras
 
Introduction & Literature Review Webinar
Introduction & Literature Review WebinarIntroduction & Literature Review Webinar
Introduction & Literature Review Webinar
Statistics Solutions
 
Lecture 9.28.10
Lecture 9.28.10Lecture 9.28.10
Lecture 9.28.10VMRoberts
 
Database Searching Skills
Database Searching SkillsDatabase Searching Skills
Database Searching Skillswendy0315
 
Database searching jan 2015
Database searching jan 2015Database searching jan 2015
Database searching jan 2015
wendy0315
 
information-skills-for-researchers-v3
information-skills-for-researchers-v3information-skills-for-researchers-v3
information-skills-for-researchers-v3Jacqueline Thomas
 
Exds 2001 international projects
Exds 2001 international projectsExds 2001 international projects
Exds 2001 international projectsTraciwm
 
Techniques d’etudes et de recherche
Techniques d’etudes et de rechercheTechniques d’etudes et de recherche
Techniques d’etudes et de rechercheMohamed Diallo
 
RM lecture.pptx
RM lecture.pptxRM lecture.pptx
RM lecture.pptx
PradhyumnPurohit2
 
Assessing user experience of e-books in academic libraries
Assessing user experience of e-books in academic librariesAssessing user experience of e-books in academic libraries
Assessing user experience of e-books in academic libraries
Tao Zhang
 
Proposal writing fms research seminar series
Proposal writing   fms research seminar seriesProposal writing   fms research seminar series
Proposal writing fms research seminar seriesShameem Ali
 

Similar to “More than Meets the Eye” - Analyzing the Success of User Queries in Oria (20)

A brief introduction to research in medical field.pptx
A brief introduction to research in medical field.pptxA brief introduction to research in medical field.pptx
A brief introduction to research in medical field.pptx
 
NHS London Libraries Games and Info Lit w'shop Sept '14
NHS London Libraries Games and Info Lit w'shop Sept '14NHS London Libraries Games and Info Lit w'shop Sept '14
NHS London Libraries Games and Info Lit w'shop Sept '14
 
‘Are we communicating effectively, and fully engaging with our research commu...
‘Are we communicating effectively, and fully engaging with our research commu...‘Are we communicating effectively, and fully engaging with our research commu...
‘Are we communicating effectively, and fully engaging with our research commu...
 
5.chapter 3
5.chapter 35.chapter 3
5.chapter 3
 
HN313 Library Lecture Jan 26
HN313 Library Lecture Jan 26HN313 Library Lecture Jan 26
HN313 Library Lecture Jan 26
 
KN Study Abroad 2016 Library Research
KN Study Abroad 2016 Library ResearchKN Study Abroad 2016 Library Research
KN Study Abroad 2016 Library Research
 
October 28, 2015 NISO Virtual Conference Interacting with Content: Improving ...
October 28, 2015 NISO Virtual Conference Interacting with Content: Improving ...October 28, 2015 NISO Virtual Conference Interacting with Content: Improving ...
October 28, 2015 NISO Virtual Conference Interacting with Content: Improving ...
 
Managing Ireland's Research Data - 3 Research Methods
Managing Ireland's Research Data - 3 Research MethodsManaging Ireland's Research Data - 3 Research Methods
Managing Ireland's Research Data - 3 Research Methods
 
The student search experience
The student search experience The student search experience
The student search experience
 
Responsive and Responsible Use of Digital Resources for Research
Responsive and Responsible Use of Digital Resources  for Research Responsive and Responsible Use of Digital Resources  for Research
Responsive and Responsible Use of Digital Resources for Research
 
Introduction & Literature Review Webinar
Introduction & Literature Review WebinarIntroduction & Literature Review Webinar
Introduction & Literature Review Webinar
 
Lecture 9.28.10
Lecture 9.28.10Lecture 9.28.10
Lecture 9.28.10
 
Database Searching Skills
Database Searching SkillsDatabase Searching Skills
Database Searching Skills
 
Database searching jan 2015
Database searching jan 2015Database searching jan 2015
Database searching jan 2015
 
information-skills-for-researchers-v3
information-skills-for-researchers-v3information-skills-for-researchers-v3
information-skills-for-researchers-v3
 
Exds 2001 international projects
Exds 2001 international projectsExds 2001 international projects
Exds 2001 international projects
 
Techniques d’etudes et de recherche
Techniques d’etudes et de rechercheTechniques d’etudes et de recherche
Techniques d’etudes et de recherche
 
RM lecture.pptx
RM lecture.pptxRM lecture.pptx
RM lecture.pptx
 
Assessing user experience of e-books in academic libraries
Assessing user experience of e-books in academic librariesAssessing user experience of e-books in academic libraries
Assessing user experience of e-books in academic libraries
 
Proposal writing fms research seminar series
Proposal writing   fms research seminar seriesProposal writing   fms research seminar series
Proposal writing fms research seminar series
 

More from TimelessFuture

Webmapping: maps for presentation, exploration & analysis
Webmapping: maps for presentation, exploration & analysisWebmapping: maps for presentation, exploration & analysis
Webmapping: maps for presentation, exploration & analysis
TimelessFuture
 
Experiential Interfaces: 

3D reconstructions as entry points for exploration...
Experiential Interfaces: 

3D reconstructions as entry points for exploration...Experiential Interfaces: 

3D reconstructions as entry points for exploration...
Experiential Interfaces: 

3D reconstructions as entry points for exploration...
TimelessFuture
 
Step inside the Image: 

Interpretative Interfaces for 
3D Historical Content
Step inside the Image: 

Interpretative Interfaces for 
3D Historical ContentStep inside the Image: 

Interpretative Interfaces for 
3D Historical Content
Step inside the Image: 

Interpretative Interfaces for 
3D Historical Content
TimelessFuture
 
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
TimelessFuture
 
The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...
The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...
The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...
TimelessFuture
 
Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...
Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...
Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...
TimelessFuture
 
Visualization Lecture - Clariah Summer School 2018
Visualization Lecture - Clariah Summer School 2018Visualization Lecture - Clariah Summer School 2018
Visualization Lecture - Clariah Summer School 2018
TimelessFuture
 
Outcomes Visual Navigation Project
Outcomes Visual Navigation ProjectOutcomes Visual Navigation Project
Outcomes Visual Navigation Project
TimelessFuture
 
KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...
KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...
KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...
TimelessFuture
 
Chaos&Order: Using visualization as a means to
 explore large heritage collec...
Chaos&Order: Using visualization as a means to
 explore large heritage collec...Chaos&Order: Using visualization as a means to
 explore large heritage collec...
Chaos&Order: Using visualization as a means to
 explore large heritage collec...
TimelessFuture
 
Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...
Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...
Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...
TimelessFuture
 
Webarchief & Wetenschap (Dutch)
Webarchief & Wetenschap (Dutch)Webarchief & Wetenschap (Dutch)
Webarchief & Wetenschap (Dutch)
TimelessFuture
 
From Exploration to Construction
 - How to Support the Complex Dynamics of In...
From Exploration to Construction
 - How to Support the Complex Dynamics of In...From Exploration to Construction
 - How to Support the Complex Dynamics of In...
From Exploration to Construction
 - How to Support the Complex Dynamics of In...
TimelessFuture
 
Towards Multidimensional Web Archive Access (IIPC 2016)
Towards Multidimensional Web Archive Access (IIPC 2016)Towards Multidimensional Web Archive Access (IIPC 2016)
Towards Multidimensional Web Archive Access (IIPC 2016)
TimelessFuture
 
Active & Passive Utility of Search Interface Features in different Informatio...
Active & Passive Utility of Search Interface Features in different Informatio...Active & Passive Utility of Search Interface Features in different Informatio...
Active & Passive Utility of Search Interface Features in different Informatio...
TimelessFuture
 
Supporting the Process - Adapting Search Systems To Search Stages (ECIL15)
Supporting the Process - Adapting Search Systems To Search Stages (ECIL15)Supporting the Process - Adapting Search Systems To Search Stages (ECIL15)
Supporting the Process - Adapting Search Systems To Search Stages (ECIL15)
TimelessFuture
 
The Value of Multistage Search Systems for Book Search
The Value of Multistage Search Systems for Book SearchThe Value of Multistage Search Systems for Book Search
The Value of Multistage Search Systems for Book Search
TimelessFuture
 
Towards Research Engines: Supporting Search Stages in Web Archives (2015)
Towards Research Engines: Supporting Search Stages in Web Archives (2015)Towards Research Engines: Supporting Search Stages in Web Archives (2015)
Towards Research Engines: Supporting Search Stages in Web Archives (2015)
TimelessFuture
 
WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)
WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)
WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)
TimelessFuture
 
Finding Pages on the Unarchived Web (DL 2014)
Finding Pages on the Unarchived Web (DL 2014)Finding Pages on the Unarchived Web (DL 2014)
Finding Pages on the Unarchived Web (DL 2014)
TimelessFuture
 

More from TimelessFuture (20)

Webmapping: maps for presentation, exploration & analysis
Webmapping: maps for presentation, exploration & analysisWebmapping: maps for presentation, exploration & analysis
Webmapping: maps for presentation, exploration & analysis
 
Experiential Interfaces: 

3D reconstructions as entry points for exploration...
Experiential Interfaces: 

3D reconstructions as entry points for exploration...Experiential Interfaces: 

3D reconstructions as entry points for exploration...
Experiential Interfaces: 

3D reconstructions as entry points for exploration...
 
Step inside the Image: 

Interpretative Interfaces for 
3D Historical Content
Step inside the Image: 

Interpretative Interfaces for 
3D Historical ContentStep inside the Image: 

Interpretative Interfaces for 
3D Historical Content
Step inside the Image: 

Interpretative Interfaces for 
3D Historical Content
 
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
 
The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...
The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...
The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...
 
Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...
Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...
Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...
 
Visualization Lecture - Clariah Summer School 2018
Visualization Lecture - Clariah Summer School 2018Visualization Lecture - Clariah Summer School 2018
Visualization Lecture - Clariah Summer School 2018
 
Outcomes Visual Navigation Project
Outcomes Visual Navigation ProjectOutcomes Visual Navigation Project
Outcomes Visual Navigation Project
 
KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...
KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...
KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...
 
Chaos&Order: Using visualization as a means to
 explore large heritage collec...
Chaos&Order: Using visualization as a means to
 explore large heritage collec...Chaos&Order: Using visualization as a means to
 explore large heritage collec...
Chaos&Order: Using visualization as a means to
 explore large heritage collec...
 
Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...
Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...
Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...
 
Webarchief & Wetenschap (Dutch)
Webarchief & Wetenschap (Dutch)Webarchief & Wetenschap (Dutch)
Webarchief & Wetenschap (Dutch)
 
From Exploration to Construction
 - How to Support the Complex Dynamics of In...
From Exploration to Construction
 - How to Support the Complex Dynamics of In...From Exploration to Construction
 - How to Support the Complex Dynamics of In...
From Exploration to Construction
 - How to Support the Complex Dynamics of In...
 
Towards Multidimensional Web Archive Access (IIPC 2016)
Towards Multidimensional Web Archive Access (IIPC 2016)Towards Multidimensional Web Archive Access (IIPC 2016)
Towards Multidimensional Web Archive Access (IIPC 2016)
 
Active & Passive Utility of Search Interface Features in different Informatio...
Active & Passive Utility of Search Interface Features in different Informatio...Active & Passive Utility of Search Interface Features in different Informatio...
Active & Passive Utility of Search Interface Features in different Informatio...
 
Supporting the Process - Adapting Search Systems To Search Stages (ECIL15)
Supporting the Process - Adapting Search Systems To Search Stages (ECIL15)Supporting the Process - Adapting Search Systems To Search Stages (ECIL15)
Supporting the Process - Adapting Search Systems To Search Stages (ECIL15)
 
The Value of Multistage Search Systems for Book Search
The Value of Multistage Search Systems for Book SearchThe Value of Multistage Search Systems for Book Search
The Value of Multistage Search Systems for Book Search
 
Towards Research Engines: Supporting Search Stages in Web Archives (2015)
Towards Research Engines: Supporting Search Stages in Web Archives (2015)Towards Research Engines: Supporting Search Stages in Web Archives (2015)
Towards Research Engines: Supporting Search Stages in Web Archives (2015)
 
WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)
WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)
WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)
 
Finding Pages on the Unarchived Web (DL 2014)
Finding Pages on the Unarchived Web (DL 2014)Finding Pages on the Unarchived Web (DL 2014)
Finding Pages on the Unarchived Web (DL 2014)
 

Recently uploaded

A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
Peter Windle
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
Jisc
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
Peter Windle
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 
Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
TechSoup
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
Special education needs
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
MIRIAMSALINAS13
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
camakaiclarkmusic
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
Jisc
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
Delapenabediema
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
beazzy04
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
Jean Carlos Nunes Paixão
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
GeoBlogs
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
Jheel Barad
 
Honest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptxHonest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptx
timhan337
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 

Recently uploaded (20)

A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 
Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
 
Honest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptxHonest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptx
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 

“More than Meets the Eye” - Analyzing the Success of User Queries in Oria

  • 1. “More than Meets the Eye” Analyzing the Success of User Queries in Oria Hugo Huurdeman, Mikaela Aamodt, Dan Michael Heggø University of Oslo Library VIRAK conference, 2017-06-13
  • 2. 1. Introduction • More insights are needed into library search issues, what goes right and what goes wrong • Opportunity: analyze data gathered at UiO during the last two years
  • 3. Research Questions 1. Which insights can we gain from classifying user queries within Oria by their popularity, specificity and intended target resources? 2. To what extent are the most popular user queries successful? 3. What underlying reasons for unsuccessful queries can be determined?
  • 4.
  • 5.
  • 6. 2. Data: Primo Analytics • Actions • Device usage • Facets • Popular Searches (monthly) • Timeframes: Jan-Jun 2015; Nov-Dec 2015; Jan-Sep 2016 • Sessions • Zero result queries (daily) • Aug 7 2015-Sep 30 2016
  • 7.
  • 8. 2. Processing & Analysis • Basic normalization of queries • "stanislav andreski" -- stanislav andreski • Manual annotation of • (1) top 50 popular queries • (2) random selection of 50 "zero result" queries • If derivable from query, determine • nature of query? • for which resource type? • curriculum-related? [in pensum lists UiO] • successful? [result on first results page]
  • 9. 3. Previous work • Dominance of commercial search engines in students’ information seeking (Griffiths & Brophy, 2005) • Students adopting search behavior from commercial search engines in library OPACs (Shiv, 2012), Willson & Given, 2010) • In particular, undergraduates just entering academia (Novotny, 2014)
  • 10. 4. Nature of user queries RQ1 Which insights can we gain from classifying user queries within Oria by their popularity, specificity and intended target resources? • Popular Searches and Zero Result Searches
  • 11. 4.1 Popular Searches dataset • 5,776 different queries, 115,590 searches (UiO) • monthly totals (500) • 2015 & 2016 • 4.9% of all search actions • Analyzing top 50 • Together issued almost 20,000 times
  • 12.
  • 13. Top 50 • What types of queries are most popular? titles (33x, 66%) • det kvalitative forskningsintervju • books, journals, databases topics / titles (6x, 12%) • spesialpedagogikk • neurology topics (4x, 8%) • cessio legis
  • 14. Top 50 • What resource types are sought for? Books (50%) • det kvalitative forskningsintervju • det norske samfunn Journals (12%) • science • lancet Databases (10%) • atekst • pubmed • duo
  • 15. Curriculum? • Were the queries related to pensum books? • Quite often: at least 58%! • menneskets fysiologi • det kvalitative forskningsintervju • Or other things (9%) :) • aftenposten; morgenbladet • harry potter
  • 16.
  • 17. Curriculum? • Were the queries related to pensum materials? • Quite often: at least 58%! • menneskets fysiologi • det kvalitative forskningsintervju • Or other things (34%) :) • aftenposten; morgenbladet
  • 18. 4.2 “Zero result” queries • 39,925 different queries • In total 52,257 searches • Aug 2015-Sep 2016 • 2.2% of all search actions • Annotating random sample (50) al azm sadik «orientalisme og omvendt orientalisme» 28 curr eye res 27 allmenningen olaf 24 12136173x 22 am j ophthalmol 21 821017268 21 askim j. 19 900317809 19 cheng 19 (direkte krav or direktekrav) and subrogasjon 17 151582998 16 142734500 16 direkte krav or direktekrav 16 961675616 16 9780549547303 16 agirdag phalet 16 andresen steinar elin l. boasson og geir hønneland (2012) international environmental agreements 15
  • 19. Queries without results What is the nature of the “zero result” queries performed in Oria? • Pasted reference (20x, 40%) • Browning, N. (2015). The ethics of two-way symmetry and the dilemmas of dialogic kantianism. Journal of Media Ethics • Title (15x, 30%) • Sentralbankens oppgaver i dag og i fremtiden • Author (8x, 16%) • Christopher Hotchens
  • 20. Queries without results • Book (28%) • Prcopius Secret History • Book Chapter (12%) • Solhaug, (2006). Kapittel 13: Strategisk læring i samfunnsfag. I • Article (24%) • E.g., pasted references Which resource types are not found?
  • 21. Degree of pensum queries? At least 28% of the unsuccessful queries are for pensum materials • Fukuyama, F. (2013): What Is Governance? Governance, Vol. 26, No. 3, July 2013 (s. 347–368). • basic immubology
  • 22. 5. Search Success RQ2 To what extent are the most popular user queries successful?
  • 23. Top queries 1. atekst 1425 2. pubmed 1221 3. exphil 719 4. det kvalitative forskningsintervju 711 5. nature 669 6. medical genetics 598 7. direktekrav 562 8. menneskets fysiologi 540 9. 998903677444702000 500 10. science 483 11. spesialpedagogikk 475 12. lancet 438 13. jussens venner 369 14. 991645464 364
  • 24. 1. atekst 1425 2. pubmed 1221 3. exphil 719 4. det kvalitative forskningsintervju 711 5. nature 669 6. medical genetics 598 7. direktekrav 562 8. menneskets fysiologi 540 9. 998903677444702000 500 10. science 483 11. spesialpedagogikk 475 12. lancet 438 13. jussens venner 369
  • 25. 1. atekst 1425 2. pubmed 1221 3. exphil 719 4. det kvalitative forskningsintervju 711 5. nature 669 6. medical genetics 598 7. direktekrav 562 8. menneskets fysiologi 540 9. 998903677444702000 500 10. science 483 11. spesialpedagogikk 475 12. lancet 438 13. jussens venner 369
  • 26. 1. atekst 1425 2. pubmed 1221 3. exphil 719 4. det kvalitative forskningsintervju 711 5. nature 669 6. medical genetics 598 7. direktekrav 562 8. menneskets fysiologi 540 9. 998903677444702000 500 10. science 483 11. spesialpedagogikk 475 12. lancet 438 13. jussens venner 369 Alma
  • 27. Were the queries successful? • Often, yes: • main result in first 10 results: 58% • not (easily) found: 20% • For example: • pubmed • nature • science
  • 28. What are causes for unsuccessful queries? • Ambiguous names • nature, science • At the time of writing, no entries for some databases • pubmed
  • 29. 6. Queries without results RQ3 What underlying reasons for zero result queries can be determined?
  • 31. Why no results? • Query being too specific (pasted reference, pasting quote) (22%) • Browning, N. (2015). The ethics of two-way symmetry and the dilemmas of dialogic kantianism. Journal of Media Ethics • Misspellings, reference mistakes (e.g. wrong year) (20%) • svennevig j.: ledelsesretorikk i nedbemanningssituasjoner 2009 • Using incorrect query syntax (2%) • "McLuhan" AND/OR "Understanding media" • 978-147996410-9 • Wrong scope (12%), wrong field (4%)
  • 32. Why no results (2) • Searching for an ISBN number (specific edition not in library) • 9780618721566 • Searching for journal titles, ISSNs, DOIs • journal of speech and hearing disorders • Searching for course codes • MED1100 • Resource not (indexed) in Oria (16%) • Haugianerliberalistene: En analyse av haugianere som politikere og næringslivsaktører
  • 33. Suggestions for misspellings? • 10 out of 50 queries (20%) were caused by misspellings. •For half, a correct spelling suggestion exists •(April 17)
  • 34. Do queries still return 0 results? • In 72% of the cases, no improvement, but 28% is now resolved. • April ’17
  • 35. 7. Conclusion & discussion • Library catalog containing more than meets the eye • Even though materials are available, they do not always show in searches • Issues in: • query formulation • system support...
  • 36. Discussion • Refine and extend search suggestions • Enhanced spell check / query corrections • why students underacheive → 0 results • why students underachieve → 463 results • Query suggestions and autocomplete • Could be based on previous (successful) queries • especially recurring queries should be supported (50% of popular queries!) • ISBN suggestions • Automatically search for the book title and author (using information derived from ISBN number?)
  • 37. Discussion • 0 results: get more helpful information • Requesting assistance, material • Contextual search suggestions • e.g. broaden search, simplify query, alternate formulations • Available scopes • suggest how many searches in other scope
  • 38. Discussion • Importance of "pensum" queries • Better integration with pensum lists • Detecting curriculum queries • E.g. widget which suggests pensum materials directly // referring students to UiO fagsider // etc. • On the cataloging side: • Course codes (e.g. INF2260) "to catalog or not to catalog" • More support for Database queries • Atekst could be found, not pubmed
  • 39. Discussion • Monitoring searches • Detect sudden ‘spikes’ in zero result queries • Finding errors in curriculum lists • Detecting ‘holes’ in collections (acquisition staff), and e.g. popular books with too few copies
  • 40. 8. Future work • Plans for further analysis • Comparing queries with most frequent loans • Alma Analytics • Current analysis: many known-item queries. Also look at common exploratory queries • medicine; math; united nations; economics • how can we support those types of queries better? • Obtaining more data (Limits Primo Analytics) • e.g. analyzing "struggling sessions", stats location, etc • Look at use of external databases, link resolver stats
  • 42. “More than Meets the Eye” Analyzing the Success of User Queries in Oria Hugo Huurdeman, Mikaela Aamodt, Dan Michael Heggø 2017-06-13