SlideShare a Scribd company logo
Hugo Huurdeman, Jaap Kamps, !
Marijn Koolen and Sanna Kumpulainen!
!
University of Amsterdam
!
!
!
Social Book Search Workshop, CLEF conference 2015
The Value of Multistage 

Search Systems for Book Search
1. Introduction
• Interactive Social Book Search track!
!
• Amazon / LibraryThing book data !
• focused and open search tasks!
• baseline and multistage interfaces!
!
• social-book-search.humanities.uva.nl/#/interactive
!
• Joint study 2015 iteration: [Gaede-etAl15]:
!
• 192 participants!
• 97 in baseline interface, 95 in multistage interface
1. Introduction: baseline interface
• ‘standard’ search
interface
!
• single screen
• query box
• results list
• left column: facet filters
• right column: ‘book bag’
for book selections
Baseline interface
• The multistage interface
contains three screens
!
• Aim: support different stages
in the search process:
browse, search & review
!
• Inspired by various models
of the information seeking
process [Vakkari01,Kuhlthau03]
Multistage interface: search
Multistage interface: browse
Multistage interface: review
1. Introduction: multistage
2. Our Participation
• What is the value of a multistage interface
for book search?!
!
1. influence on task duration, book
selection and interaction patterns
2. influence on user engagement
2.1 Task duration
• How much time was spent
in each task and interface?
!
• Participants spend more
time in the focused task
than the open task
!
• Participants spend
significantly more time in
the multistage interface,
regardless of the task
time spent (seconds)
2.2 Bookbag: overview
• How many books were
selected per task and
interface?
!
• More books in focused task
than open task (significant)
!
• Slightly more books were
selected in the multistage
interface, as compared to the
baseline (not significant)
number of selected books
2.2 Bookbag: overlap between the tasks
• Only 9 participants have
overlap in the book bags
for the two tasks 

(7 out of 9 just one book..)
• User may interpret some sub-
tasks of the focused task in a
similar way as the open task
(e.g. hobbies/personal interests
or fun). What is the overlap in
collected books between the
tasks?
!
!
!
!
2.2 Bookbag: overlap between participants
• What degree of selected
books is the same
across participants?
!
!
!
!
!
!
2.2 Bookbag: overlap between participants
• What degree of selected
books is the same
across participants?
!
• More overlap in
baseline (BL)
• Evidence for more
varied selections in
the multistage
interface (MS)
0
0.06
0.12
0.18
0.24
Open task Focused task
14%
7%
23%
7%
MSBL MSBL
2.3 User actions
• Paginate used more
in multistage
• deeper
exploration
!
!
!
!
!
!
!
!
!
!
!
mean frequencies of actions
2.3 User actions
• Paginate used more
in multistage
• deeper
exploration
!
• Few filters and
queries in multistage
• more options to
explore and
review results
!
!
!
!
!
mean frequencies of actions
2.3 User actions
• Paginate used more
in multistage
• deeper
exploration
!
• Few filters and
queries in multistage
• more options to
explore and
review results
!
• Less/more book
metadata views:
• triggered to view
more in open
task?
mean frequencies of actions
2.4 Use of interface panels: transition prob.
Focused task Open task
2.4 Use of interface panels: time spent
• Time spent!
• Focused task: search
screen used for longest
duration;
• open task: browse
!
!
!
!
!
!
Time spent in each panel (sec)
2.4 Use of interface panels: switches
• Time spent!
• Focused task: search
screen used for longest
duration;
• open task: browse
!
• Switches!
• Training task: participants
went “in order” through
panels”
• Other tasks: more varied
• 5 subtasks
Switches between panels
Time spent in each panel (sec)
2.5 Participants’ Perceptions
• Using multidimensional User Engagement Scale [O’Brien & Toms]
2.5 Participants’ Perceptions
• Using multidimensional User Engagement Scale [O’Brien-Toms15]
!
• Significant (Mann-Whitney):
• Felt Involvement: “how much fun users were having during the
interaction and how drawn in”
• Endurability: “the assessment of users' perception of success with a
task, and their willingness to use an application in future or recommend
it to others”
p=0.006p=0.041
* engagement did not significantly differ between age groups (18-25, 26-35, 35+)
3 Conclusion
• Longer task duration in multistage
interface
• Different use of search features
• less queries / filters in multistage
• Not necessarily more books, but more
varied sets of books
• More user engagement!
!
• Users seem to be willing to switch
interface panels and use them for different
activity types
!
• Positive evidence ‘multistage’ approach
Discussion
• Influence personal differences
participants
• motivation, location, language skills,
education, etc.
• users who frequently search for books in
(online) bookstores?
!
• Task properties
• open vs. focused task (5 subtasks),
• possible to differentiate more easily?
• task order
!
• From narrative to interactions
References
• [Gaede-etAl15] M. Gaede, M. Hall, H. Huurdeman, J. Kamps, M. Koolen, M. Skov, E.
Toms, D. Walsh. Overview of the SBS 2015 Interactive Track. CEUR-WS. 2015.
• [Hall-Toms15] M. Hall and E. Toms. Building a common framework for iir evaluation. In
P. Forner, H. Mueller, R. Paredes, P. Rosso, and B. Stein, editors, Information Access
Evaluation. Multilinguality, Multimodality, and Visualization, volume 8138 of Lecture
Notes in Computer Science, p. 17–28. Springer Berlin Heidelberg, 2013.
• [Huurdeman-etAl15] H. Huurdeman, J. Kamps, M. Koolen, S. Kumpulainen. The Value
of Multistage Search Systems for Book Search. CEUR-WS. 2015.
• [Koolen-etAl15] M. Koolen, T. Bogers, M. Gaede, M. Hall, H. Huurdeman, J. Kamps,
M. Skov, E. Toms, and D. Walsh. Overview of the CLEF 2015 Social Book Search Lab.
In CLEF'15: Experimental IR meets Multilinguality, Multimodality, and Interaction,
volume 9283 of LNCS. Springer (forthcoming).
• [Kuhlthau04] C. Kuhlthau. Seeking Meaning: A Process Approach to Library and
Information Services. Libraries Unlimited, Westport, Conn. 2004.
• [O’Brien-Toms15] H. O’Brien and E. Toms. The development and evaluation of a
survey to measure user engagement. JASIST, 61(1):50–69, 2010.
• [Vakkari01] P. Vakkari. A theory of the task-based information retrieval process: a
summary and generalisation of a longitudinal study. Journal of Documentation, 57:44–
60, 2001.
Hugo Huurdeman, Jaap Kamps, !
Marijn Koolen and Sanna Kumpulainen!
!
University of Amsterdam
!
!
!
Social Book Search Workshop, CLEF conference 2015
The Value of Multistage 

Search Systems for Book Search

More Related Content

Viewers also liked

Webarchief & Wetenschap (Dutch)
Webarchief & Wetenschap (Dutch)Webarchief & Wetenschap (Dutch)
Webarchief & Wetenschap (Dutch)
TimelessFuture
 
Towards Multidimensional Web Archive Access (IIPC 2016)
Towards Multidimensional Web Archive Access (IIPC 2016)Towards Multidimensional Web Archive Access (IIPC 2016)
Towards Multidimensional Web Archive Access (IIPC 2016)
TimelessFuture
 
Php
PhpPhp
WebART: Facilitating Scholarly Use of Web Archives (IIPC, Apr. 2013)
WebART: Facilitating Scholarly Use of Web Archives (IIPC, Apr. 2013)WebART: Facilitating Scholarly Use of Web Archives (IIPC, Apr. 2013)
WebART: Facilitating Scholarly Use of Web Archives (IIPC, Apr. 2013)
TimelessFuture
 
From multistage information seeking models to multistage search systems (IIiX...
From multistage information seeking models to multistage search systems (IIiX...From multistage information seeking models to multistage search systems (IIiX...
From multistage information seeking models to multistage search systems (IIiX...
TimelessFuture
 
特殊人群健康保护未成年人
特殊人群健康保护未成年人特殊人群健康保护未成年人
特殊人群健康保护未成年人nashiai
 
WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)
WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)
WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)
TimelessFuture
 
Towards Research Engines: Supporting Search Stages in Web Archives (2015)
Towards Research Engines: Supporting Search Stages in Web Archives (2015)Towards Research Engines: Supporting Search Stages in Web Archives (2015)
Towards Research Engines: Supporting Search Stages in Web Archives (2015)
TimelessFuture
 
Finding Pages on the Unarchived Web (DL 2014)
Finding Pages on the Unarchived Web (DL 2014)Finding Pages on the Unarchived Web (DL 2014)
Finding Pages on the Unarchived Web (DL 2014)
TimelessFuture
 
Active & Passive Utility of Search Interface Features in different Informatio...
Active & Passive Utility of Search Interface Features in different Informatio...Active & Passive Utility of Search Interface Features in different Informatio...
Active & Passive Utility of Search Interface Features in different Informatio...
TimelessFuture
 

Viewers also liked (10)

Webarchief & Wetenschap (Dutch)
Webarchief & Wetenschap (Dutch)Webarchief & Wetenschap (Dutch)
Webarchief & Wetenschap (Dutch)
 
Towards Multidimensional Web Archive Access (IIPC 2016)
Towards Multidimensional Web Archive Access (IIPC 2016)Towards Multidimensional Web Archive Access (IIPC 2016)
Towards Multidimensional Web Archive Access (IIPC 2016)
 
Php
PhpPhp
Php
 
WebART: Facilitating Scholarly Use of Web Archives (IIPC, Apr. 2013)
WebART: Facilitating Scholarly Use of Web Archives (IIPC, Apr. 2013)WebART: Facilitating Scholarly Use of Web Archives (IIPC, Apr. 2013)
WebART: Facilitating Scholarly Use of Web Archives (IIPC, Apr. 2013)
 
From multistage information seeking models to multistage search systems (IIiX...
From multistage information seeking models to multistage search systems (IIiX...From multistage information seeking models to multistage search systems (IIiX...
From multistage information seeking models to multistage search systems (IIiX...
 
特殊人群健康保护未成年人
特殊人群健康保护未成年人特殊人群健康保护未成年人
特殊人群健康保护未成年人
 
WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)
WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)
WebART: hoe maak je webarchieven bruikbaar voor de wetenschap? (Dutch)
 
Towards Research Engines: Supporting Search Stages in Web Archives (2015)
Towards Research Engines: Supporting Search Stages in Web Archives (2015)Towards Research Engines: Supporting Search Stages in Web Archives (2015)
Towards Research Engines: Supporting Search Stages in Web Archives (2015)
 
Finding Pages on the Unarchived Web (DL 2014)
Finding Pages on the Unarchived Web (DL 2014)Finding Pages on the Unarchived Web (DL 2014)
Finding Pages on the Unarchived Web (DL 2014)
 
Active & Passive Utility of Search Interface Features in different Informatio...
Active & Passive Utility of Search Interface Features in different Informatio...Active & Passive Utility of Search Interface Features in different Informatio...
Active & Passive Utility of Search Interface Features in different Informatio...
 

Similar to The Value of Multistage Search Systems for Book Search

OER made by Community. Connecting Practices in Open Online Projects
OER made by Community. Connecting Practices in Open Online ProjectsOER made by Community. Connecting Practices in Open Online Projects
OER made by Community. Connecting Practices in Open Online Projects
Open Education Global (OEGlobal)
 
Assessing user experience of e-books in academic libraries
Assessing user experience of e-books in academic librariesAssessing user experience of e-books in academic libraries
Assessing user experience of e-books in academic libraries
Tao Zhang
 
Conclusions and Learned Lessons - Visual Navigation Project Outcomes -
Conclusions and Learned Lessons - Visual Navigation Project Outcomes - Conclusions and Learned Lessons - Visual Navigation Project Outcomes -
Conclusions and Learned Lessons - Visual Navigation Project Outcomes -
Visual Navigation Project
 
Discovery on a budget
Discovery on a budgetDiscovery on a budget
Discovery on a budget
Chris Bulock
 
Discovery on a budget: Improved searching without a Web-scale discovery product
Discovery on a budget: Improved searching without a Web-scale discovery productDiscovery on a budget: Improved searching without a Web-scale discovery product
Discovery on a budget: Improved searching without a Web-scale discovery product
NASIG
 
Usability and UX at the University of Liverpool
Usability and UX at the University of LiverpoolUsability and UX at the University of Liverpool
Usability and UX at the University of Liverpool
northerncollaboration
 
Bringing Underserved Staff Online @ LMU
Bringing Underserved Staff Online @ LMUBringing Underserved Staff Online @ LMU
Bringing Underserved Staff Online @ LMU
The Conference for Entrepreneurial Librarians
 
Edinburgh 2015 peer interaction v2
Edinburgh 2015 peer interaction v2Edinburgh 2015 peer interaction v2
Edinburgh 2015 peer interaction v2
NomadWarMachine
 
UX Workshop at Startit@KBC
UX Workshop at Startit@KBCUX Workshop at Startit@KBC
UX Workshop at Startit@KBC
UXprobe
 
Redesigning the Open Access Institutional Repository
Redesigning the Open Access Institutional RepositoryRedesigning the Open Access Institutional Repository
Redesigning the Open Access Institutional Repository
Edward Luca
 
A Case Study Of An Open Online Course
A Case Study Of An Open Online CourseA Case Study Of An Open Online Course
A Case Study Of An Open Online Course
Suzan Koseoglu
 
Assessment in Space Designed for Experimentation: The University of Washingto...
Assessment in Space Designed for Experimentation: The University of Washingto...Assessment in Space Designed for Experimentation: The University of Washingto...
Assessment in Space Designed for Experimentation: The University of Washingto...
Lauren Ray
 
From Transaction to Collaboration: Scholarly Communications Design at UConn L...
From Transaction to Collaboration: Scholarly Communications Design at UConn L...From Transaction to Collaboration: Scholarly Communications Design at UConn L...
From Transaction to Collaboration: Scholarly Communications Design at UConn L...
Greg Colati
 
In front of our very eyes the value of UX research methods
In front of our very eyes  the value of UX research methodsIn front of our very eyes  the value of UX research methods
In front of our very eyes the value of UX research methods
Andy Priestner
 
Do I Have the Best Library Website on the Planet or What?
Do I Have the Best Library Website on the Planet or What?Do I Have the Best Library Website on the Planet or What?
Do I Have the Best Library Website on the Planet or What?
Rene Erlandson
 
Your data is great, but does it work for your users
Your data is great, but does it work for your usersYour data is great, but does it work for your users
Your data is great, but does it work for your users
vickybuser
 
Computer Mediated Communication in the Foreign Language class (2011)
Computer Mediated Communication in the Foreign Language class (2011)Computer Mediated Communication in the Foreign Language class (2011)
Computer Mediated Communication in the Foreign Language class (2011)
amparolallana
 
Inspirational customer dialogues
Inspirational customer dialoguesInspirational customer dialogues
Inspirational customer dialogues
InSites Consulting
 
Inspirational Customer Dialogues - IKEA Catalogue [PAPER]
Inspirational Customer Dialogues - IKEA Catalogue [PAPER]Inspirational Customer Dialogues - IKEA Catalogue [PAPER]
Inspirational Customer Dialogues - IKEA Catalogue [PAPER]Tom De Ruyck
 

Similar to The Value of Multistage Search Systems for Book Search (20)

OER made by Community. Connecting Practices in Open Online Projects
OER made by Community. Connecting Practices in Open Online ProjectsOER made by Community. Connecting Practices in Open Online Projects
OER made by Community. Connecting Practices in Open Online Projects
 
Assessing user experience of e-books in academic libraries
Assessing user experience of e-books in academic librariesAssessing user experience of e-books in academic libraries
Assessing user experience of e-books in academic libraries
 
Conclusions and Learned Lessons - Visual Navigation Project Outcomes -
Conclusions and Learned Lessons - Visual Navigation Project Outcomes - Conclusions and Learned Lessons - Visual Navigation Project Outcomes -
Conclusions and Learned Lessons - Visual Navigation Project Outcomes -
 
Discovery on a budget
Discovery on a budgetDiscovery on a budget
Discovery on a budget
 
Discovery on a budget: Improved searching without a Web-scale discovery product
Discovery on a budget: Improved searching without a Web-scale discovery productDiscovery on a budget: Improved searching without a Web-scale discovery product
Discovery on a budget: Improved searching without a Web-scale discovery product
 
Usability and UX at the University of Liverpool
Usability and UX at the University of LiverpoolUsability and UX at the University of Liverpool
Usability and UX at the University of Liverpool
 
Bringing Underserved Staff Online @ LMU
Bringing Underserved Staff Online @ LMUBringing Underserved Staff Online @ LMU
Bringing Underserved Staff Online @ LMU
 
Edinburgh 2015 peer interaction v2
Edinburgh 2015 peer interaction v2Edinburgh 2015 peer interaction v2
Edinburgh 2015 peer interaction v2
 
UX Workshop at Startit@KBC
UX Workshop at Startit@KBCUX Workshop at Startit@KBC
UX Workshop at Startit@KBC
 
Active Learning: Online Redesign IT Seminar Series 2014_06_09
Active Learning: Online Redesign IT Seminar Series 2014_06_09Active Learning: Online Redesign IT Seminar Series 2014_06_09
Active Learning: Online Redesign IT Seminar Series 2014_06_09
 
Redesigning the Open Access Institutional Repository
Redesigning the Open Access Institutional RepositoryRedesigning the Open Access Institutional Repository
Redesigning the Open Access Institutional Repository
 
A Case Study Of An Open Online Course
A Case Study Of An Open Online CourseA Case Study Of An Open Online Course
A Case Study Of An Open Online Course
 
Assessment in Space Designed for Experimentation: The University of Washingto...
Assessment in Space Designed for Experimentation: The University of Washingto...Assessment in Space Designed for Experimentation: The University of Washingto...
Assessment in Space Designed for Experimentation: The University of Washingto...
 
From Transaction to Collaboration: Scholarly Communications Design at UConn L...
From Transaction to Collaboration: Scholarly Communications Design at UConn L...From Transaction to Collaboration: Scholarly Communications Design at UConn L...
From Transaction to Collaboration: Scholarly Communications Design at UConn L...
 
In front of our very eyes the value of UX research methods
In front of our very eyes  the value of UX research methodsIn front of our very eyes  the value of UX research methods
In front of our very eyes the value of UX research methods
 
Do I Have the Best Library Website on the Planet or What?
Do I Have the Best Library Website on the Planet or What?Do I Have the Best Library Website on the Planet or What?
Do I Have the Best Library Website on the Planet or What?
 
Your data is great, but does it work for your users
Your data is great, but does it work for your usersYour data is great, but does it work for your users
Your data is great, but does it work for your users
 
Computer Mediated Communication in the Foreign Language class (2011)
Computer Mediated Communication in the Foreign Language class (2011)Computer Mediated Communication in the Foreign Language class (2011)
Computer Mediated Communication in the Foreign Language class (2011)
 
Inspirational customer dialogues
Inspirational customer dialoguesInspirational customer dialogues
Inspirational customer dialogues
 
Inspirational Customer Dialogues - IKEA Catalogue [PAPER]
Inspirational Customer Dialogues - IKEA Catalogue [PAPER]Inspirational Customer Dialogues - IKEA Catalogue [PAPER]
Inspirational Customer Dialogues - IKEA Catalogue [PAPER]
 

More from TimelessFuture

Webmapping: maps for presentation, exploration & analysis
Webmapping: maps for presentation, exploration & analysisWebmapping: maps for presentation, exploration & analysis
Webmapping: maps for presentation, exploration & analysis
TimelessFuture
 
Experiential Interfaces: 

3D reconstructions as entry points for exploration...
Experiential Interfaces: 

3D reconstructions as entry points for exploration...Experiential Interfaces: 

3D reconstructions as entry points for exploration...
Experiential Interfaces: 

3D reconstructions as entry points for exploration...
TimelessFuture
 
Step inside the Image: 

Interpretative Interfaces for 
3D Historical Content
Step inside the Image: 

Interpretative Interfaces for 
3D Historical ContentStep inside the Image: 

Interpretative Interfaces for 
3D Historical Content
Step inside the Image: 

Interpretative Interfaces for 
3D Historical Content
TimelessFuture
 
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
TimelessFuture
 
The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...
The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...
The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...
TimelessFuture
 
Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...
Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...
Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...
TimelessFuture
 
Visualization Lecture - Clariah Summer School 2018
Visualization Lecture - Clariah Summer School 2018Visualization Lecture - Clariah Summer School 2018
Visualization Lecture - Clariah Summer School 2018
TimelessFuture
 
Outcomes Visual Navigation Project
Outcomes Visual Navigation ProjectOutcomes Visual Navigation Project
Outcomes Visual Navigation Project
TimelessFuture
 
KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...
KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...
KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...
TimelessFuture
 
Chaos&Order: Using visualization as a means to
 explore large heritage collec...
Chaos&Order: Using visualization as a means to
 explore large heritage collec...Chaos&Order: Using visualization as a means to
 explore large heritage collec...
Chaos&Order: Using visualization as a means to
 explore large heritage collec...
TimelessFuture
 
Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...
Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...
Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...
TimelessFuture
 
“More than Meets the Eye” - Analyzing the Success of User Queries in Oria
“More than Meets the Eye” - Analyzing the Success of User Queries in Oria“More than Meets the Eye” - Analyzing the Success of User Queries in Oria
“More than Meets the Eye” - Analyzing the Success of User Queries in Oria
TimelessFuture
 
From Exploration to Construction
 - How to Support the Complex Dynamics of In...
From Exploration to Construction
 - How to Support the Complex Dynamics of In...From Exploration to Construction
 - How to Support the Complex Dynamics of In...
From Exploration to Construction
 - How to Support the Complex Dynamics of In...
TimelessFuture
 

More from TimelessFuture (13)

Webmapping: maps for presentation, exploration & analysis
Webmapping: maps for presentation, exploration & analysisWebmapping: maps for presentation, exploration & analysis
Webmapping: maps for presentation, exploration & analysis
 
Experiential Interfaces: 

3D reconstructions as entry points for exploration...
Experiential Interfaces: 

3D reconstructions as entry points for exploration...Experiential Interfaces: 

3D reconstructions as entry points for exploration...
Experiential Interfaces: 

3D reconstructions as entry points for exploration...
 
Step inside the Image: 

Interpretative Interfaces for 
3D Historical Content
Step inside the Image: 

Interpretative Interfaces for 
3D Historical ContentStep inside the Image: 

Interpretative Interfaces for 
3D Historical Content
Step inside the Image: 

Interpretative Interfaces for 
3D Historical Content
 
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
 
The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...
The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...
The Multi-Stage Experience: the Simulated Work Task Approach to Studying Info...
 
Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...
Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...
Op Ontdekkingsreis door het KB Webarchief - Exploratieve Visualisatie in een ...
 
Visualization Lecture - Clariah Summer School 2018
Visualization Lecture - Clariah Summer School 2018Visualization Lecture - Clariah Summer School 2018
Visualization Lecture - Clariah Summer School 2018
 
Outcomes Visual Navigation Project
Outcomes Visual Navigation ProjectOutcomes Visual Navigation Project
Outcomes Visual Navigation Project
 
KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...
KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...
KNVI 2017: De collectie in een ander licht - Creatieve inzet van nieuwe techn...
 
Chaos&Order: Using visualization as a means to
 explore large heritage collec...
Chaos&Order: Using visualization as a means to
 explore large heritage collec...Chaos&Order: Using visualization as a means to
 explore large heritage collec...
Chaos&Order: Using visualization as a means to
 explore large heritage collec...
 
Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...
Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...
Workshop: Inspirational Journeys - Challenges and Solutions for Visual Naviga...
 
“More than Meets the Eye” - Analyzing the Success of User Queries in Oria
“More than Meets the Eye” - Analyzing the Success of User Queries in Oria“More than Meets the Eye” - Analyzing the Success of User Queries in Oria
“More than Meets the Eye” - Analyzing the Success of User Queries in Oria
 
From Exploration to Construction
 - How to Support the Complex Dynamics of In...
From Exploration to Construction
 - How to Support the Complex Dynamics of In...From Exploration to Construction
 - How to Support the Complex Dynamics of In...
From Exploration to Construction
 - How to Support the Complex Dynamics of In...
 

Recently uploaded

How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
Celine George
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
Excellence Foundation for South Sudan
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
GeoBlogs
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
Col Mukteshwar Prasad
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
bennyroshan06
 
Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
GeoBlogs
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxStudents, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
EduSkills OECD
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
DeeptiGupta154
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 
How to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERPHow to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERP
Celine George
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
TechSoup
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
kaushalkr1407
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
Jisc
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
EverAndrsGuerraGuerr
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
beazzy04
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
PedroFerreira53928
 

Recently uploaded (20)

How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
 
Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
 
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxStudents, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 
How to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERPHow to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERP
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
 

The Value of Multistage Search Systems for Book Search

  • 1. Hugo Huurdeman, Jaap Kamps, ! Marijn Koolen and Sanna Kumpulainen! ! University of Amsterdam ! ! ! Social Book Search Workshop, CLEF conference 2015 The Value of Multistage 
 Search Systems for Book Search
  • 2.
  • 3. 1. Introduction • Interactive Social Book Search track! ! • Amazon / LibraryThing book data ! • focused and open search tasks! • baseline and multistage interfaces! ! • social-book-search.humanities.uva.nl/#/interactive ! • Joint study 2015 iteration: [Gaede-etAl15]: ! • 192 participants! • 97 in baseline interface, 95 in multistage interface
  • 4. 1. Introduction: baseline interface • ‘standard’ search interface ! • single screen • query box • results list • left column: facet filters • right column: ‘book bag’ for book selections Baseline interface
  • 5. • The multistage interface contains three screens ! • Aim: support different stages in the search process: browse, search & review ! • Inspired by various models of the information seeking process [Vakkari01,Kuhlthau03] Multistage interface: search Multistage interface: browse Multistage interface: review 1. Introduction: multistage
  • 6. 2. Our Participation • What is the value of a multistage interface for book search?! ! 1. influence on task duration, book selection and interaction patterns 2. influence on user engagement
  • 7. 2.1 Task duration • How much time was spent in each task and interface? ! • Participants spend more time in the focused task than the open task ! • Participants spend significantly more time in the multistage interface, regardless of the task time spent (seconds)
  • 8. 2.2 Bookbag: overview • How many books were selected per task and interface? ! • More books in focused task than open task (significant) ! • Slightly more books were selected in the multistage interface, as compared to the baseline (not significant) number of selected books
  • 9. 2.2 Bookbag: overlap between the tasks • Only 9 participants have overlap in the book bags for the two tasks 
 (7 out of 9 just one book..) • User may interpret some sub- tasks of the focused task in a similar way as the open task (e.g. hobbies/personal interests or fun). What is the overlap in collected books between the tasks? ! ! ! !
  • 10. 2.2 Bookbag: overlap between participants • What degree of selected books is the same across participants? ! ! ! ! ! !
  • 11. 2.2 Bookbag: overlap between participants • What degree of selected books is the same across participants? ! • More overlap in baseline (BL) • Evidence for more varied selections in the multistage interface (MS) 0 0.06 0.12 0.18 0.24 Open task Focused task 14% 7% 23% 7% MSBL MSBL
  • 12. 2.3 User actions • Paginate used more in multistage • deeper exploration ! ! ! ! ! ! ! ! ! ! ! mean frequencies of actions
  • 13. 2.3 User actions • Paginate used more in multistage • deeper exploration ! • Few filters and queries in multistage • more options to explore and review results ! ! ! ! ! mean frequencies of actions
  • 14. 2.3 User actions • Paginate used more in multistage • deeper exploration ! • Few filters and queries in multistage • more options to explore and review results ! • Less/more book metadata views: • triggered to view more in open task? mean frequencies of actions
  • 15. 2.4 Use of interface panels: transition prob. Focused task Open task
  • 16. 2.4 Use of interface panels: time spent • Time spent! • Focused task: search screen used for longest duration; • open task: browse ! ! ! ! ! ! Time spent in each panel (sec)
  • 17. 2.4 Use of interface panels: switches • Time spent! • Focused task: search screen used for longest duration; • open task: browse ! • Switches! • Training task: participants went “in order” through panels” • Other tasks: more varied • 5 subtasks Switches between panels Time spent in each panel (sec)
  • 18. 2.5 Participants’ Perceptions • Using multidimensional User Engagement Scale [O’Brien & Toms]
  • 19. 2.5 Participants’ Perceptions • Using multidimensional User Engagement Scale [O’Brien-Toms15] ! • Significant (Mann-Whitney): • Felt Involvement: “how much fun users were having during the interaction and how drawn in” • Endurability: “the assessment of users' perception of success with a task, and their willingness to use an application in future or recommend it to others” p=0.006p=0.041 * engagement did not significantly differ between age groups (18-25, 26-35, 35+)
  • 20. 3 Conclusion • Longer task duration in multistage interface • Different use of search features • less queries / filters in multistage • Not necessarily more books, but more varied sets of books • More user engagement! ! • Users seem to be willing to switch interface panels and use them for different activity types ! • Positive evidence ‘multistage’ approach
  • 21. Discussion • Influence personal differences participants • motivation, location, language skills, education, etc. • users who frequently search for books in (online) bookstores? ! • Task properties • open vs. focused task (5 subtasks), • possible to differentiate more easily? • task order ! • From narrative to interactions
  • 22. References • [Gaede-etAl15] M. Gaede, M. Hall, H. Huurdeman, J. Kamps, M. Koolen, M. Skov, E. Toms, D. Walsh. Overview of the SBS 2015 Interactive Track. CEUR-WS. 2015. • [Hall-Toms15] M. Hall and E. Toms. Building a common framework for iir evaluation. In P. Forner, H. Mueller, R. Paredes, P. Rosso, and B. Stein, editors, Information Access Evaluation. Multilinguality, Multimodality, and Visualization, volume 8138 of Lecture Notes in Computer Science, p. 17–28. Springer Berlin Heidelberg, 2013. • [Huurdeman-etAl15] H. Huurdeman, J. Kamps, M. Koolen, S. Kumpulainen. The Value of Multistage Search Systems for Book Search. CEUR-WS. 2015. • [Koolen-etAl15] M. Koolen, T. Bogers, M. Gaede, M. Hall, H. Huurdeman, J. Kamps, M. Skov, E. Toms, and D. Walsh. Overview of the CLEF 2015 Social Book Search Lab. In CLEF'15: Experimental IR meets Multilinguality, Multimodality, and Interaction, volume 9283 of LNCS. Springer (forthcoming). • [Kuhlthau04] C. Kuhlthau. Seeking Meaning: A Process Approach to Library and Information Services. Libraries Unlimited, Westport, Conn. 2004. • [O’Brien-Toms15] H. O’Brien and E. Toms. The development and evaluation of a survey to measure user engagement. JASIST, 61(1):50–69, 2010. • [Vakkari01] P. Vakkari. A theory of the task-based information retrieval process: a summary and generalisation of a longitudinal study. Journal of Documentation, 57:44– 60, 2001.
  • 23. Hugo Huurdeman, Jaap Kamps, ! Marijn Koolen and Sanna Kumpulainen! ! University of Amsterdam ! ! ! Social Book Search Workshop, CLEF conference 2015 The Value of Multistage 
 Search Systems for Book Search