Presentation at International Conference on Dublin Core \& Metadata Applications (DC-2016), Copenhagen, Denmark

1. School of Information Studies, Faculty of Arts and Education
University Metadata and Retrieval:
The Death of the Library Catalog?
Ying-Hsang Liu
DC-2016, Copenhagen, Denmark
14 October 2016

2. School of Information Studies, Faculty of Arts and Education
Outline
• Background
• Research Question
• Relevant Studies
• Summary of Eye-Tracking Study
• Implications for Search Interface Design

3. School of Information Studies, Faculty of Arts and Education
Dr Liu’s research research
interest lies in the area of
user-centred design and
evaluation of information
retrieval systems.
Current research projects
• Natural Search User
Interfaces for Complex
Biomedical Search
• Computational Intelligence
for Complex Structured Data
• Understanding the Role of
Social Media in Disaster
Management
Ying-Hsang Liu

4. School of Information Studies, Faculty of Arts and Education
Background: Vickery (1970)
• Can we yet say that the benefit received is
commensurate with the effort of construction?
… Even if controlled retrieval language and
thesauri are useful, is their uncontrolled
proliferation equally useful? (Vickery, 1970,
pp. 136-137)
• Vickery, B. C. (1970). Document description and
representation. Annual Review of Information Science
and Technology, 6, 113-140.

5. School of Information Studies, Faculty of Arts and Education
Background (cont’d)
• Information retrieval researchers’ views:
Salton, Sparck Jones
• Relative to automatic subject indexing,
manual indexing is not cost-effective
(Calhoun, 2006)
• Calhoun, K. (2006). The changing nature of the catalog
and its integration with other discovery tools. Retrieved
from https://www.loc.gov/catdir/calhoun-report-final.pdf

6. School of Information Studies, Faculty of Arts and Education
Research Question
• Usefulness of controlled vocabularies
• Svenonius (1986)
• Factors affecting the usefulness of controlled
vocabularies, including the nature of the
vocabulary, subject discipline, IR system, the
skill of indexers and searchers and user
requirements
• Svenonius, E. (1986). Unanswered questions in the
design of controlled vocabularies. Journal of the
American Society for Information Science, 37(5), 331-
340

7. School of Information Studies, Faculty of Arts and Education
Relevant Studies
• Hider et al. (2016)
• Search effectiveness significantly
improved after reindexing
• Hider, P., Dalgarno, B., Bennett, S., Liu, Y.-H., Gerts, C.,
Daws, C., . . . Macaulay, R. (2016). Reindexing a
research repository from the ground up: Adding and
evaluating quality metadata. Australian Academic &
Research Libraries, 47(2), 61-75.

8. School of Information Studies, Faculty of Arts and Education
Figure 1. System performance of initial and final queries
by precision.
Published in: Philip Hider; Barney Dalgarno; Sue Bennett; Ying-Hsang Liu; Carole Gerts; Carla Daws; Barbara Spiller; Pru
Mitchell; Robert Parkes; Raylee Macaulay; Australian Academic & Research Libraries 2016, 47, 61-75.
DOI: 10.1080/00048623.2016.1204589
Copyright © 2016 Australian Library & Information Association

9. School of Information Studies, Faculty of Arts and Education
Figure 2. System performance of initial and final queries
by recall.
Published in: Philip Hider; Barney Dalgarno; Sue Bennett; Ying-Hsang Liu; Carole Gerts; Carla Daws; Barbara Spiller; Pru
Mitchell; Robert Parkes; Raylee Macaulay; Australian Academic & Research Libraries 2016, 47, 61-75.
DOI: 10.1080/00048623.2016.1204589
Copyright © 2016 Australian Library & Information Association

10. School of Information Studies, Faculty of Arts and Education
Relevant Studies: Liu (2010a)
• Liu (2010a)
• Search experience overall has an overall
positive effect on the recall measure
• Liu, Y.-H. (2010a). A meta-analysis of the effects of
search experience on search performance in terms of the
recall measure in controlled IR user experiments. In F.
Scholer, A. Trotman, & A. Turpin (Eds.), Proceedings of
the Fifteenth Australasian Document Computing
Symposium (pp. 105-110). Melbourne, Australia: School
of Computer Science and IT, RMIT University.

11. School of Information Studies, Faculty of Arts and Education
Relevant Studies: Liu (2010a)

12. School of Information Studies, Faculty of Arts and Education
Relevant Studies: Liu (2010b)
• Liu (2010b)
• Assess the potential search effectiveness
of MeSH terms
• Liu, Y.-H. (2010b). On the potential search effectiveness
of MeSH (Medical Subject Headings) terms. In
Proceedings of the Third Symposium on Information
Interaction in Context (IIiX '10) (pp. 225-234). New York:
ACM.

13. School of Information Studies, Faculty of Arts and Education
Relevant Studies: Liu et al. (2016)

14. School of Information Studies, Faculty of Arts and Education
Visual Search Behaviour

15. School of Information Studies, Faculty of Arts and Education
GazeSpot on Search Interface

16. School of Information Studies, Faculty of Arts and Education
Search Interfaces and Gaze

17. School of Information Studies, Faculty of Arts and Education
BeeSwarm Visualisation of Cognitive Styles
The video is available at:
https://vimeo.com/182044662#t=203s

18. School of Information Studies, Faculty of Arts and Education
Implications for Interface Design
• Search interfaces have significant effect on
eye gaze behavior for complex search tasks
• Experienced searchers attracted to suggested
keywords, displayed alongside each
document
• Domain experts and analytic users attracted to
suggested keywords, displayed under a
search box

19. School of Information Studies, Faculty of Arts and Education
Questions or comments?
Thank You!
Email: yingliu@csu.edu.au
Web: http://csusap.csu.edu.au/~yingliu