SlideShare a Scribd company logo
1 of 24
Evaluating the Quality of Instant Messaging Reference Service through Transcript Analysis 13th Annual Reference Research Forum  Sunday, June 24th Sarah Maximiek [email_address]   Erin Rushton [email_address] . edu   Binghamton University
Binghamton University   ,[object Object],[object Object],[object Object]
Background ,[object Object],[object Object],[object Object],[object Object]
Background ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Transcript Analysis Objectives ,[object Object],[object Object],[object Object]
Methodology ,[object Object],[object Object],[object Object]
Methodology ,[object Object],[object Object],[object Object]
Demographics   ,[object Object]
Session Length
Sessions by Day
Sessions by Day and Time ,[object Object]
Sessions by Month
Types of Reference Questions *More than one question type could be selected per transcript
Instructional Questions   ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],For further discussion see:  Stephanie Graves and Christina M. Desai.  Instruction via chat reference: does co-browse help? Reference Services Review,  Vol. 34 No. 3, 2006, pp. 340-357
Research/Quick Reference ,[object Object],[object Object],[object Object]
Resources Used to Answer Question *More than one question type could be selected per transcript
RUSA   Guidelines for Behavioral Performance ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],finds out what patrons have already tried, and encourages patrons to contribute ideas  explains the search strategy and sequence to the user
Correctness and Completeness Not complete :  incomplete reference interview OR no referral/follow-up  Not correct  :  used for incorrect answers  Model adapted from “Evaluating the Quality of a Chat Service. Julie Arnold. Neal Kaske.  portal: Libraries and the Academy  5.2 (2005) 177-193
Next Steps ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Findings ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Sample Transcript ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Sample Transcript ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

More Related Content

Viewers also liked (8)

Impacto do marketing nas organizações
Impacto do marketing nas organizaçõesImpacto do marketing nas organizações
Impacto do marketing nas organizações
 
Presentación BizForm Gestión de Documentos
Presentación BizForm Gestión de DocumentosPresentación BizForm Gestión de Documentos
Presentación BizForm Gestión de Documentos
 
Marketing & Empreendedorismo - Vida Económica
Marketing & Empreendedorismo - Vida EconómicaMarketing & Empreendedorismo - Vida Económica
Marketing & Empreendedorismo - Vida Económica
 
31.111+ข้..
31.111+ข้..31.111+ข้..
31.111+ข้..
 
9781423903055 ppt ch08
9781423903055 ppt ch089781423903055 ppt ch08
9781423903055 ppt ch08
 
Energy
EnergyEnergy
Energy
 
Seminário Marketing Digital 24 Abril 2013
Seminário Marketing Digital 24 Abril 2013Seminário Marketing Digital 24 Abril 2013
Seminário Marketing Digital 24 Abril 2013
 
Informe línea 4 para rendición de cuentas
Informe línea 4 para rendición de cuentasInforme línea 4 para rendición de cuentas
Informe línea 4 para rendición de cuentas
 

Similar to 2007 Ala

Digital Reference Service
Digital Reference ServiceDigital Reference Service
Digital Reference Service
ronda3
 
Reinvigorating a Library Workshop Series: Moving Workshops into the Online En...
Reinvigorating a Library Workshop Series: Moving Workshops into the Online En...Reinvigorating a Library Workshop Series: Moving Workshops into the Online En...
Reinvigorating a Library Workshop Series: Moving Workshops into the Online En...
Mandi Goodsett
 
Managing user queries using cloud services: KAUST library experience
Managing user queries using cloud services: KAUST library experienceManaging user queries using cloud services: KAUST library experience
Managing user queries using cloud services: KAUST library experience
Rindra Ramli
 

Similar to 2007 Ala (20)

Let's Chat: The Art of Delivering Information Literacy Instruction in a Virtu...
Let's Chat: The Art of Delivering Information Literacy Instruction in a Virtu...Let's Chat: The Art of Delivering Information Literacy Instruction in a Virtu...
Let's Chat: The Art of Delivering Information Literacy Instruction in a Virtu...
 
Digital Reference Service
Digital Reference ServiceDigital Reference Service
Digital Reference Service
 
Scholarly Requirements for Large Scale Text Analysis
Scholarly Requirements for Large Scale Text AnalysisScholarly Requirements for Large Scale Text Analysis
Scholarly Requirements for Large Scale Text Analysis
 
LibGuiding the way - Northern Collaboration 2017 Conference
LibGuiding the way - Northern Collaboration 2017 ConferenceLibGuiding the way - Northern Collaboration 2017 Conference
LibGuiding the way - Northern Collaboration 2017 Conference
 
Reinvigorating a Library Workshop Series: Moving Workshops into the Online En...
Reinvigorating a Library Workshop Series: Moving Workshops into the Online En...Reinvigorating a Library Workshop Series: Moving Workshops into the Online En...
Reinvigorating a Library Workshop Series: Moving Workshops into the Online En...
 
Mining Virtual Reference Data for an Iterative Assessment Cycle
Mining Virtual Reference Data for an Iterative Assessment CycleMining Virtual Reference Data for an Iterative Assessment Cycle
Mining Virtual Reference Data for an Iterative Assessment Cycle
 
Mining Virtual Reference Data for an Iterative Assessment Cycle
Mining Virtual Reference Data for an Iterative Assessment CycleMining Virtual Reference Data for an Iterative Assessment Cycle
Mining Virtual Reference Data for an Iterative Assessment Cycle
 
Interview_Search_Process (1).pptx
Interview_Search_Process (1).pptxInterview_Search_Process (1).pptx
Interview_Search_Process (1).pptx
 
Annotated Bibliographies: Step by Step Guide
Annotated Bibliographies: Step by Step GuideAnnotated Bibliographies: Step by Step Guide
Annotated Bibliographies: Step by Step Guide
 
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopUsing Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
 
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopUsing Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
 
Judith Schwartz/QuestionPoint Use Study at Hunter College
Judith Schwartz/QuestionPoint Use Study at Hunter CollegeJudith Schwartz/QuestionPoint Use Study at Hunter College
Judith Schwartz/QuestionPoint Use Study at Hunter College
 
Raw presentation2
Raw presentation2Raw presentation2
Raw presentation2
 
Managing user queries using cloud services: KAUST library experience
Managing user queries using cloud services: KAUST library experienceManaging user queries using cloud services: KAUST library experience
Managing user queries using cloud services: KAUST library experience
 
Universities and their web-based library services : a study of their relati...
Universities and their  web-based library services :  a study of their relati...Universities and their  web-based library services :  a study of their relati...
Universities and their web-based library services : a study of their relati...
 
2 Birds, 1 Stone: A Mixed Methods Approach to Measure Service Process and Ide...
2 Birds, 1 Stone: A Mixed Methods Approach to Measure Service Process and Ide...2 Birds, 1 Stone: A Mixed Methods Approach to Measure Service Process and Ide...
2 Birds, 1 Stone: A Mixed Methods Approach to Measure Service Process and Ide...
 
Speaking on the record: Combining interviews with search log analysis in user...
Speaking on the record: Combining interviews with search log analysis in user...Speaking on the record: Combining interviews with search log analysis in user...
Speaking on the record: Combining interviews with search log analysis in user...
 
Librarian consultations: supporting student researchers in the hybrid world -...
Librarian consultations: supporting student researchers in the hybrid world -...Librarian consultations: supporting student researchers in the hybrid world -...
Librarian consultations: supporting student researchers in the hybrid world -...
 
Speaking on the Record: Combining Interviews with Search Log Analysis in User...
Speaking on the Record: Combining Interviews with Search Log Analysis in User...Speaking on the Record: Combining Interviews with Search Log Analysis in User...
Speaking on the Record: Combining Interviews with Search Log Analysis in User...
 
Gathering & Presenting User Input
Gathering & Presenting User InputGathering & Presenting User Input
Gathering & Presenting User Input
 

More from Sarah Maximiek (9)

International students orientation 2012
International students orientation 2012 International students orientation 2012
International students orientation 2012
 
International students orientation 2012 - Libraries
International students orientation 2012  - LibrariesInternational students orientation 2012  - Libraries
International students orientation 2012 - Libraries
 
GoogleVoice at the Reference Desk
GoogleVoice at the Reference DeskGoogleVoice at the Reference Desk
GoogleVoice at the Reference Desk
 
CV
CVCV
CV
 
Reference: NYLA Library Assistants Training
Reference: NYLA Library Assistants TrainingReference: NYLA Library Assistants Training
Reference: NYLA Library Assistants Training
 
Lib h3lp show
Lib h3lp showLib h3lp show
Lib h3lp show
 
Info Management Social Sciences
Info Management Social SciencesInfo Management Social Sciences
Info Management Social Sciences
 
What happened the Census?
What happened the Census?What happened the Census?
What happened the Census?
 
Im Nyla
Im NylaIm Nyla
Im Nyla
 

Recently uploaded

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 

Recently uploaded (20)

Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
Magic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptxMagic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Third Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptxThird Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptx
 

2007 Ala

  • 1. Evaluating the Quality of Instant Messaging Reference Service through Transcript Analysis 13th Annual Reference Research Forum Sunday, June 24th Sarah Maximiek [email_address] Erin Rushton [email_address] . edu Binghamton University
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 11.
  • 13. Types of Reference Questions *More than one question type could be selected per transcript
  • 14.
  • 15.
  • 16. Resources Used to Answer Question *More than one question type could be selected per transcript
  • 17.
  • 18. Correctness and Completeness Not complete : incomplete reference interview OR no referral/follow-up Not correct : used for incorrect answers Model adapted from “Evaluating the Quality of a Chat Service. Julie Arnold. Neal Kaske. portal: Libraries and the Academy 5.2 (2005) 177-193
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.