SlideShare a Scribd company logo
1 of 16
Tagging MPLP: A Comparison of Novice & Expert
Domain User Generated Tags in a Minimally
Processed Digital Photographic Archive
Edward Benoit, III
School of Information Studies, UW-Milwaukee
Introduction/Background
• Howard Zinn
• The postmodern archives
• Rising backlog problem
• Minimal processing/MPLP
• Minimally processed digital archives
Study Focus
• Supplemental metadata from social tags
• User prior domain knowledge as quality
control
• Research questions:
– What are the similarities/differences between tags
generated by expert and novices?
– In what ways do tags generated by expert/novice
users correspond with full metadata?
– In what ways do tags generated by expert/novice
users correspond with existing users’ query
terms?
Methodology
• Mixed methods, quasi-experimental two-
group design
• 60 participants (novice & experts) generate
tags for 15 photographs & 15 documents
• Pre- and post-questionnaires
• Analysis:
– Open coding
– Descriptive statistics
Sample Collection: Groppi Papers
http://collections.lib.uwm.edu/cdm/landingpage/collection/march
Participants
• Scoring:
– Expert x= 7.57
– Novice x= 2.77
• Ages: 18-63, x= 31.73
• Gender (M/F/O):
23.3%/75%/1.7%
Race Frequency
% of
Participants
White 44 73.3%
Black 9 15.0%
Hispanic/Latino 10 16.7%
American Indian 4 6.7%
Asian/Indian 2 3.3%
Pacific Islander 0 0.0%
Other 1 1.7%
• 48.3% from WI or IL
• 58.3% non-students
Participants’ Prior Use/Knowledge
Coding Scheme
• Replication of metadata
• Format focused
• General identification
• Specific identification
• Description
• Broader context
• Emotional
Wisconsin Historical Society, WHS-26541
• Image removed for
copyright. Accessible at:
http://www.wisconsinhi
story.org/whi/fullRecor
d.asp?id=26541
Results: Number of Tags
Total Unique Min Max x
Expert 1705 396 15 196 56.83
Novice 2142 291 15 577 71.4
Combined 3847 396 15 577 64.12
Results: Types of Tags
Replication Format Gen ID Spec ID Description Broader Emotion
Expert 17.54% 0.00% 20.12% 11.79% 31.91% 17.13% 1.52%
Novice 14.01% 3.08% 29.43% 12.42% 24.01% 15.74% 1.31%
Results: Matching Metadata
% Matching % Non-matching
Expert 34.17% 65.83%
Novice 25.18% 74.82%
Combined 36.69% 63.31%
Results: Matching Queries
Match
Non-
match % Match
% Non-
match
% of Q.T.
matching
Tags
Expert 248 97 71.88% 28.12% 0.58%
Novice 184 69 72.73% 27.27% 0.43%
Combined 312 147 67.97% 32.03% 0.73%
• Query log analysis for one month on existing
collection resulted in 42,755 unique query terms
Results: Tagging Motivation
How I would
find the item
How others
would find the
item
The content of
the item
The item’s
format
The
connection
between items
The accuracy
of the
provided
information
The previous
user’s tags
My previous
tags
Expert 4.27 4.10 4.50 3.33 3.43 3.50 3.63 3.87
Novice 4.60 4.60 4.67 3.23 3.63 3.70 3.90 4.10
Combined 4.43 4.35 4.58 3.28 3.53 3.60 3.77 3.98
Results: Motivating Taggers
Account & login Newsletter/website
recognition
Social media
recognition
Non-monetary
rewards
Anonymously
submission
Monetary rewards
Expert 3.67 3.30 2.97 3.67 3.87 4.40
Novice 3.07 3.23 2.97 3.83 3.90 4.40
Combined 3.37 3.27 2.97 3.75 3.88 4.40
Conclusion/Future Directions
• Replication of presented metadata
• Benefits of domain expert tagging
• Benefits of including both domain expert and
novice tags
• Further study needed on:
– Alternative factors
– How to motive tag generation
Thanks for listening!
Please hold your questions for later

More Related Content

Similar to VRA2014 Collaboration in archives and special collections, Benoit

Speaking on the Record: Combining Interviews with Search Log Analysis in User...
Speaking on the Record: Combining Interviews with Search Log Analysis in User...Speaking on the Record: Combining Interviews with Search Log Analysis in User...
Speaking on the Record: Combining Interviews with Search Log Analysis in User...Lynn Connaway
 
User Research 101: DIY Quick Course - CodeMash 2.0.1.1.
User Research 101: DIY Quick Course - CodeMash 2.0.1.1.User Research 101: DIY Quick Course - CodeMash 2.0.1.1.
User Research 101: DIY Quick Course - CodeMash 2.0.1.1.Carol Smith
 
Bibliometrics in practice 2016 | Breakout session | Designing the academic self
Bibliometrics in practice 2016 | Breakout session | Designing the academic selfBibliometrics in practice 2016 | Breakout session | Designing the academic self
Bibliometrics in practice 2016 | Breakout session | Designing the academic selfTanya Williamson
 
Digital Scholar Webinar: Recruiting Research Participants Online Using Reddit
Digital Scholar Webinar: Recruiting Research Participants Online Using RedditDigital Scholar Webinar: Recruiting Research Participants Online Using Reddit
Digital Scholar Webinar: Recruiting Research Participants Online Using RedditSC CTSI at USC and CHLA
 
Qualitative and quantitative analysis
Qualitative and quantitative analysisQualitative and quantitative analysis
Qualitative and quantitative analysisNellie Deutsch (Ed.D)
 
The User Side of Personalization: How Personalization Affects the Users
The User Side of Personalization: How Personalization Affects the UsersThe User Side of Personalization: How Personalization Affects the Users
The User Side of Personalization: How Personalization Affects the UsersPeter Brusilovsky
 
Marshall hm poster_vra2015
Marshall hm poster_vra2015Marshall hm poster_vra2015
Marshall hm poster_vra2015Hannah Marshall
 
Who's Afraid of Qualitative Analysis?
Who's Afraid of Qualitative Analysis?Who's Afraid of Qualitative Analysis?
Who's Afraid of Qualitative Analysis?BrigitteScott
 
Thesis Presentation
Thesis PresentationThesis Presentation
Thesis Presentationnirvdrum
 
Speaking on the record: Combining interviews with search log analysis in user...
Speaking on the record: Combining interviews with search log analysis in user...Speaking on the record: Combining interviews with search log analysis in user...
Speaking on the record: Combining interviews with search log analysis in user...Lynn Connaway
 
AIRG Presentation
AIRG PresentationAIRG Presentation
AIRG Presentationnirvdrum
 
Personalized Search-Building a prototype to infer the user's interest
Personalized Search-Building a prototype to infer the user's interestPersonalized Search-Building a prototype to infer the user's interest
Personalized Search-Building a prototype to infer the user's interestTom Burgmans
 
Learning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational researchLearning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational researchAndrew Deacon
 
Multi-method Evaluation in Scientific Paper Recommender Systems
Multi-method Evaluation in Scientific Paper Recommender SystemsMulti-method Evaluation in Scientific Paper Recommender Systems
Multi-method Evaluation in Scientific Paper Recommender SystemsAravind Sesagiri Raamkumar
 
Toward an automated student feedback system for text based assignments - Pete...
Toward an automated student feedback system for text based assignments - Pete...Toward an automated student feedback system for text based assignments - Pete...
Toward an automated student feedback system for text based assignments - Pete...Blackboard APAC
 
The analysis of qualitative data 22nd Oct 2015
The analysis of qualitative data 22nd Oct 2015The analysis of qualitative data 22nd Oct 2015
The analysis of qualitative data 22nd Oct 2015Matthew Maycock
 
Understanding Student Learning Using Learning Management Systems and Basic An...
Understanding Student Learning Using Learning Management Systems and Basic An...Understanding Student Learning Using Learning Management Systems and Basic An...
Understanding Student Learning Using Learning Management Systems and Basic An...Michael Wilder
 
Interactions of reading and assessment activities
Interactions of reading and assessment activitiesInteractions of reading and assessment activities
Interactions of reading and assessment activitiesSergey Sosnovsky
 
Journal club, tool of change asted at 32_2_nov2012final
Journal club, tool of change asted at 32_2_nov2012final Journal club, tool of change asted at 32_2_nov2012final
Journal club, tool of change asted at 32_2_nov2012final ICFPLibrarian
 

Similar to VRA2014 Collaboration in archives and special collections, Benoit (20)

Speaking on the Record: Combining Interviews with Search Log Analysis in User...
Speaking on the Record: Combining Interviews with Search Log Analysis in User...Speaking on the Record: Combining Interviews with Search Log Analysis in User...
Speaking on the Record: Combining Interviews with Search Log Analysis in User...
 
User Research 101: DIY Quick Course - CodeMash 2.0.1.1.
User Research 101: DIY Quick Course - CodeMash 2.0.1.1.User Research 101: DIY Quick Course - CodeMash 2.0.1.1.
User Research 101: DIY Quick Course - CodeMash 2.0.1.1.
 
Bibliometrics in practice 2016 | Breakout session | Designing the academic self
Bibliometrics in practice 2016 | Breakout session | Designing the academic selfBibliometrics in practice 2016 | Breakout session | Designing the academic self
Bibliometrics in practice 2016 | Breakout session | Designing the academic self
 
Test.In.Hand.6th.pptx
Test.In.Hand.6th.pptxTest.In.Hand.6th.pptx
Test.In.Hand.6th.pptx
 
Digital Scholar Webinar: Recruiting Research Participants Online Using Reddit
Digital Scholar Webinar: Recruiting Research Participants Online Using RedditDigital Scholar Webinar: Recruiting Research Participants Online Using Reddit
Digital Scholar Webinar: Recruiting Research Participants Online Using Reddit
 
Qualitative and quantitative analysis
Qualitative and quantitative analysisQualitative and quantitative analysis
Qualitative and quantitative analysis
 
The User Side of Personalization: How Personalization Affects the Users
The User Side of Personalization: How Personalization Affects the UsersThe User Side of Personalization: How Personalization Affects the Users
The User Side of Personalization: How Personalization Affects the Users
 
Marshall hm poster_vra2015
Marshall hm poster_vra2015Marshall hm poster_vra2015
Marshall hm poster_vra2015
 
Who's Afraid of Qualitative Analysis?
Who's Afraid of Qualitative Analysis?Who's Afraid of Qualitative Analysis?
Who's Afraid of Qualitative Analysis?
 
Thesis Presentation
Thesis PresentationThesis Presentation
Thesis Presentation
 
Speaking on the record: Combining interviews with search log analysis in user...
Speaking on the record: Combining interviews with search log analysis in user...Speaking on the record: Combining interviews with search log analysis in user...
Speaking on the record: Combining interviews with search log analysis in user...
 
AIRG Presentation
AIRG PresentationAIRG Presentation
AIRG Presentation
 
Personalized Search-Building a prototype to infer the user's interest
Personalized Search-Building a prototype to infer the user's interestPersonalized Search-Building a prototype to infer the user's interest
Personalized Search-Building a prototype to infer the user's interest
 
Learning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational researchLearning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational research
 
Multi-method Evaluation in Scientific Paper Recommender Systems
Multi-method Evaluation in Scientific Paper Recommender SystemsMulti-method Evaluation in Scientific Paper Recommender Systems
Multi-method Evaluation in Scientific Paper Recommender Systems
 
Toward an automated student feedback system for text based assignments - Pete...
Toward an automated student feedback system for text based assignments - Pete...Toward an automated student feedback system for text based assignments - Pete...
Toward an automated student feedback system for text based assignments - Pete...
 
The analysis of qualitative data 22nd Oct 2015
The analysis of qualitative data 22nd Oct 2015The analysis of qualitative data 22nd Oct 2015
The analysis of qualitative data 22nd Oct 2015
 
Understanding Student Learning Using Learning Management Systems and Basic An...
Understanding Student Learning Using Learning Management Systems and Basic An...Understanding Student Learning Using Learning Management Systems and Basic An...
Understanding Student Learning Using Learning Management Systems and Basic An...
 
Interactions of reading and assessment activities
Interactions of reading and assessment activitiesInteractions of reading and assessment activities
Interactions of reading and assessment activities
 
Journal club, tool of change asted at 32_2_nov2012final
Journal club, tool of change asted at 32_2_nov2012final Journal club, tool of change asted at 32_2_nov2012final
Journal club, tool of change asted at 32_2_nov2012final
 

More from Visual Resources Association

Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...
Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...
Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...Visual Resources Association
 
The Medieval Kingdom of Sicily Image Database Project: From Concept to Reality
The Medieval Kingdom of Sicily Image Database Project: From Concept to RealityThe Medieval Kingdom of Sicily Image Database Project: From Concept to Reality
The Medieval Kingdom of Sicily Image Database Project: From Concept to RealityVisual Resources Association
 
Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...
Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...
Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...Visual Resources Association
 
Recreating a 19th-Century Spectacle: The 3D Glass Stereo Project
Recreating a 19th-Century Spectacle: The 3D Glass Stereo ProjectRecreating a 19th-Century Spectacle: The 3D Glass Stereo Project
Recreating a 19th-Century Spectacle: The 3D Glass Stereo ProjectVisual Resources Association
 
Cradle of Texas Gay Liberty: An Alternate History of the Alamo City
Cradle of Texas Gay Liberty: An Alternate History of the Alamo CityCradle of Texas Gay Liberty: An Alternate History of the Alamo City
Cradle of Texas Gay Liberty: An Alternate History of the Alamo CityVisual Resources Association
 
Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...
Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...
Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...Visual Resources Association
 
Disinformation and Deepfakes: The Urgent Need for Visual Literacy
Disinformation and Deepfakes: The Urgent Need for Visual LiteracyDisinformation and Deepfakes: The Urgent Need for Visual Literacy
Disinformation and Deepfakes: The Urgent Need for Visual LiteracyVisual Resources Association
 
Pattern and Representation: Critical Cataloging for a New Perspective on Camp...
Pattern and Representation: Critical Cataloging for a New Perspective on Camp...Pattern and Representation: Critical Cataloging for a New Perspective on Camp...
Pattern and Representation: Critical Cataloging for a New Perspective on Camp...Visual Resources Association
 
Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...
Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...
Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...Visual Resources Association
 
Supporting Art History Students' Digital Projects at American University
Supporting Art History Students' Digital Projects at American UniversitySupporting Art History Students' Digital Projects at American University
Supporting Art History Students' Digital Projects at American UniversityVisual Resources Association
 
Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...
Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...
Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...Visual Resources Association
 
Describing Art on the Street: The Graffiti Art Community Voice
Describing Art on the Street: The Graffiti Art Community VoiceDescribing Art on the Street: The Graffiti Art Community Voice
Describing Art on the Street: The Graffiti Art Community VoiceVisual Resources Association
 
Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...
Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...
Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...Visual Resources Association
 
Accessibility Guidance for Digital Cultural Heritage
Accessibility Guidance for Digital Cultural HeritageAccessibility Guidance for Digital Cultural Heritage
Accessibility Guidance for Digital Cultural HeritageVisual Resources Association
 

More from Visual Resources Association (20)

Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...
Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...
Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...
 
Unsettling Collections: Bias in the Visual Canon
Unsettling Collections: Bias in the Visual CanonUnsettling Collections: Bias in the Visual Canon
Unsettling Collections: Bias in the Visual Canon
 
The Medieval Kingdom of Sicily Image Database Project: From Concept to Reality
The Medieval Kingdom of Sicily Image Database Project: From Concept to RealityThe Medieval Kingdom of Sicily Image Database Project: From Concept to Reality
The Medieval Kingdom of Sicily Image Database Project: From Concept to Reality
 
Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...
Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...
Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...
 
Recreating a 19th-Century Spectacle: The 3D Glass Stereo Project
Recreating a 19th-Century Spectacle: The 3D Glass Stereo ProjectRecreating a 19th-Century Spectacle: The 3D Glass Stereo Project
Recreating a 19th-Century Spectacle: The 3D Glass Stereo Project
 
Cradle of Texas Gay Liberty: An Alternate History of the Alamo City
Cradle of Texas Gay Liberty: An Alternate History of the Alamo CityCradle of Texas Gay Liberty: An Alternate History of the Alamo City
Cradle of Texas Gay Liberty: An Alternate History of the Alamo City
 
Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...
Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...
Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...
 
Personal Archiving for Undergraduate Students
Personal Archiving for Undergraduate StudentsPersonal Archiving for Undergraduate Students
Personal Archiving for Undergraduate Students
 
Disinformation and Deepfakes: The Urgent Need for Visual Literacy
Disinformation and Deepfakes: The Urgent Need for Visual LiteracyDisinformation and Deepfakes: The Urgent Need for Visual Literacy
Disinformation and Deepfakes: The Urgent Need for Visual Literacy
 
Jean Charlot: Artist as Archivist
Jean Charlot: Artist as ArchivistJean Charlot: Artist as Archivist
Jean Charlot: Artist as Archivist
 
Pattern and Representation: Critical Cataloging for a New Perspective on Camp...
Pattern and Representation: Critical Cataloging for a New Perspective on Camp...Pattern and Representation: Critical Cataloging for a New Perspective on Camp...
Pattern and Representation: Critical Cataloging for a New Perspective on Camp...
 
Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...
Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...
Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...
 
Supporting Art History Students' Digital Projects at American University
Supporting Art History Students' Digital Projects at American UniversitySupporting Art History Students' Digital Projects at American University
Supporting Art History Students' Digital Projects at American University
 
Material Objects and Special Collections
Material Objects and Special CollectionsMaterial Objects and Special Collections
Material Objects and Special Collections
 
Digital Art History
Digital Art HistoryDigital Art History
Digital Art History
 
Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...
Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...
Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...
 
Describing Art on the Street: The Graffiti Art Community Voice
Describing Art on the Street: The Graffiti Art Community VoiceDescribing Art on the Street: The Graffiti Art Community Voice
Describing Art on the Street: The Graffiti Art Community Voice
 
Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...
Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...
Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...
 
Crowdsourcing Collection Development
Crowdsourcing Collection DevelopmentCrowdsourcing Collection Development
Crowdsourcing Collection Development
 
Accessibility Guidance for Digital Cultural Heritage
Accessibility Guidance for Digital Cultural HeritageAccessibility Guidance for Digital Cultural Heritage
Accessibility Guidance for Digital Cultural Heritage
 

Recently uploaded

“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application ) Sakshi Ghasle
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docxPoojaSen20
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 

Recently uploaded (20)

“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application )
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docx
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 

VRA2014 Collaboration in archives and special collections, Benoit

  • 1. Tagging MPLP: A Comparison of Novice & Expert Domain User Generated Tags in a Minimally Processed Digital Photographic Archive Edward Benoit, III School of Information Studies, UW-Milwaukee
  • 2. Introduction/Background • Howard Zinn • The postmodern archives • Rising backlog problem • Minimal processing/MPLP • Minimally processed digital archives
  • 3. Study Focus • Supplemental metadata from social tags • User prior domain knowledge as quality control • Research questions: – What are the similarities/differences between tags generated by expert and novices? – In what ways do tags generated by expert/novice users correspond with full metadata? – In what ways do tags generated by expert/novice users correspond with existing users’ query terms?
  • 4. Methodology • Mixed methods, quasi-experimental two- group design • 60 participants (novice & experts) generate tags for 15 photographs & 15 documents • Pre- and post-questionnaires • Analysis: – Open coding – Descriptive statistics
  • 5. Sample Collection: Groppi Papers http://collections.lib.uwm.edu/cdm/landingpage/collection/march
  • 6. Participants • Scoring: – Expert x= 7.57 – Novice x= 2.77 • Ages: 18-63, x= 31.73 • Gender (M/F/O): 23.3%/75%/1.7% Race Frequency % of Participants White 44 73.3% Black 9 15.0% Hispanic/Latino 10 16.7% American Indian 4 6.7% Asian/Indian 2 3.3% Pacific Islander 0 0.0% Other 1 1.7% • 48.3% from WI or IL • 58.3% non-students
  • 8. Coding Scheme • Replication of metadata • Format focused • General identification • Specific identification • Description • Broader context • Emotional Wisconsin Historical Society, WHS-26541 • Image removed for copyright. Accessible at: http://www.wisconsinhi story.org/whi/fullRecor d.asp?id=26541
  • 9. Results: Number of Tags Total Unique Min Max x Expert 1705 396 15 196 56.83 Novice 2142 291 15 577 71.4 Combined 3847 396 15 577 64.12
  • 10. Results: Types of Tags Replication Format Gen ID Spec ID Description Broader Emotion Expert 17.54% 0.00% 20.12% 11.79% 31.91% 17.13% 1.52% Novice 14.01% 3.08% 29.43% 12.42% 24.01% 15.74% 1.31%
  • 11. Results: Matching Metadata % Matching % Non-matching Expert 34.17% 65.83% Novice 25.18% 74.82% Combined 36.69% 63.31%
  • 12. Results: Matching Queries Match Non- match % Match % Non- match % of Q.T. matching Tags Expert 248 97 71.88% 28.12% 0.58% Novice 184 69 72.73% 27.27% 0.43% Combined 312 147 67.97% 32.03% 0.73% • Query log analysis for one month on existing collection resulted in 42,755 unique query terms
  • 13. Results: Tagging Motivation How I would find the item How others would find the item The content of the item The item’s format The connection between items The accuracy of the provided information The previous user’s tags My previous tags Expert 4.27 4.10 4.50 3.33 3.43 3.50 3.63 3.87 Novice 4.60 4.60 4.67 3.23 3.63 3.70 3.90 4.10 Combined 4.43 4.35 4.58 3.28 3.53 3.60 3.77 3.98
  • 14. Results: Motivating Taggers Account & login Newsletter/website recognition Social media recognition Non-monetary rewards Anonymously submission Monetary rewards Expert 3.67 3.30 2.97 3.67 3.87 4.40 Novice 3.07 3.23 2.97 3.83 3.90 4.40 Combined 3.37 3.27 2.97 3.75 3.88 4.40
  • 15. Conclusion/Future Directions • Replication of presented metadata • Benefits of domain expert tagging • Benefits of including both domain expert and novice tags • Further study needed on: – Alternative factors – How to motive tag generation
  • 16. Thanks for listening! Please hold your questions for later

Editor's Notes

  1. Howard Zinn infamously caused quite a stir in the 1970s through his lambasting of archivists’ reinforcing the status quo and social control of the politically elite. Zinn called on archivists to “take the trouble to compile a whole new world of documentary material, about the lives, desires, needs, of ordinary people,” and, “to begin to play some small part in the creation of a real democracy” (Zinn, 1977, http://www.libr.org/progarchs/documents/Zinn_Speech_MwA_1977.html) Zinn’s comments, along with others, initiated the post-modern movement in archives, and a concerted effort to increase the breadth of voices included within the archives. The addition of a wide-range of new materials, combined with hiring stagnation directly led to a massive backlog problem during the past twenty years, to the extent that some archives housed more unprocessed (and therefore inaccessible) collections than processed ones. In response, Greene and Meissner (2005) proposed a drastic shift in archival practice toward the concept of “More Product, Less Process” or MPLP, and minimal processing. Minimal processing expanded throughout archival practice including digital archives from its origins within arrangement and description resulting in an increase of available collections both physically and digitally. The minimal processing technique in digital archives prioritizes the collection as a whole over individual items, specifically regarding metadata. The online collections provide only minimal metadata, typically at the series or folder level. The MPLP approach deviates from contemporary practice which describes digital archival materials at the item or record level. For example, each letter in a traditionally processed folder of digitized correspondence includes individualized descriptive metadata. The MPLP version of the same collection would only describe the folder as an aggregate with individual letters sharing duplicate metadata. While this replicates the experience of researchers in the physical archives, studies demonstrate an increasing demand for more description and access points from online users.
  2. Reaching out to the same users for assistance and requesting them to help supplement minimally processed digital archives’ metadata through creation of tags could address this issue. However, social tagging without some measure of control could generate too many useless terms, thereby hindering access rather than increasing it. Additionally, archival users previously stated a preference for user-generated content control mechanisms. While some suggest digital archivists could simply approve/disapprove each tag, such a system requires too much oversight. I propose categorizing the users rather than the tags. Specifically, permitting users who are subject area experts (hereafter referred to as expert users) to tag the collections. The expert users provide more reliable tags, meeting the needs of institutions and increasing access to the collections. Additionally, the inclusion of user-generated tags embraces the ideals of the post-modern movement through encouraging community participation and increasing the voices heard within the archival description process. Studies have shown users increasingly demand immediate, online access to archival materials with detailed descriptions (access points). The high costs of creating and maintaining digital archives precluded many archives from providing users with digital content or increasing the amount of digitized materials. The adoption of minimal processing theory to digital archives limits the access points at the folder or series level rather than the item-level description users’ desire. User-generated content, such as tags, could supplement the minimally processed metadata, though users are reluctant to trust or use unmediated tags. This project explores the potential for controlling/mediating the supplemental metadata from user-generated tags through inclusion of only expert domain user generated tags.
  3. Ages: Experts: 19-63, x= 35.1;Novice: 18-60, x= 28.366Race: Note, participants could select more than one
  4. Notes: Based on self-assessment on Visual Analog Scale (VAS). Expert users assessed higher on prior use of archives, knowledge of social tagging, and use of social tagging.
  5. Examples of the coding scheme tags from this particular image:Replication of metadata: Groppi, Father Groppi, photographFormat focused: black and white, black and white photographyGeneral identification: big man, police, riot gear, wagonSpecific identification: Wagon 722, 1967, Milwaukee policeDescription: Arrested, detained priest, inside police vehicleBroader context: Catholic social action, civil rights movement, raceEmotional: unjust, acceptance
  6. Note: While Novice users appear to generate more tags on average, the one novice participant who created 577 tags skews the average. Removing this user who result in an average of 53.97 tags per novice user (less than the expert average).
  7. 42,755 total Query terms
  8. Note: Some additional considerations while creating tags listed in open-ended questions include:Visual cues (e.g., American flag)Began with most obvious, but became more specific as time progressed“I also thought of how I personally would like Fr. Groppi to be remembered by posterity”Leaving out what data was already provided (multiple mentions)Not inferring information that is not present
  9. Archive requires you to create a user account and login to submit tagsArchive offers recognition for tagging in newsletter or websiteArchive recognizes top taggers through social media (Facebook, Twitter, etc.)Archive provides non-monetary rewards for tagging (research assistance, archive tour, etc.)Archive allows you to anonymously submit tagsArchive provides monetary rewards to tagging (photographic prints, photocopies, discounted or free membership, etc.)Note: Some other methods for motivating tag generation listed in open-ended questions:Allowing others to validate your tagsAs more people benefit from tags, they will begin tagging moreMaking tagging/commenting options more prevalent on websitesInstitutions marketing directly to usersSpecial events for taggers