SlideShare a Scribd company logo
1 of 30
Download to read offline
Critical Metadata:
Re-examining Data
Transformation
Devon Murphy, TARO Metadata Analyst, University of Texas at Austin
devon.murphy@austin.utexas.edu
March 23rd, 2021
OUTLINE
OpenRefine Introduction
OpenRefine W
orkflow
Introduction to Data
Validation
Fuzzy Matching
Thank You!
Problematizing Data
Transformation
Critcat Best Practices
Limitations
What is
OpenRefine?
OPENREFINE
...a Java-based power tool that allows you
to load data, understand it, clean it up,
reconcile it, and augment it with data
coming from the web.
-https://github.com/OpenRefine/OpenRefine
“
”
OPENREFINE
View of OpenRefine server
OPENREFINE
View of OpenRefine in browser with text transform menu open
OPENREFINE
“Completeness: Checking to see what elements/properties/attributes are
present (and how much of it is missing!)
Accuracy: Information is correct and factual (to the best of our abilities)
Conformance to expectations: Information adheres to our expectations
Consistency: Values are consistent within our domain, elements are
represented in a consistent manner”
-Gretchen Gueguen, Digital Public Library of America
Introduction to
Data Validation
DATA VALIDATION
A two-step definition for Data Validation:
“An activity aimed at verifying whether the value of a data item comes from the
given (finite or infinite) set of acceptable values.”
-UNECE 2013 Glossary of terms on statistical data editing
“Data validation could be operationally defined as a process which ensures the
correspondence of the final (published) data with a number of quality
characteristics.”
-Simon A., (2013a) Definition of validation levels and other related concepts v01307. Working document
DATA VALIDATION
Two paths
to Data
Validation:
Manually check terms against sources
(use when no existing reconciliation service/no
URIs and no. of content is small)
Use reconciliation services to check terms against
sources
(use when services available, especially helpful with
large no. of content!)
DATA VALIDATION
OpenRefine project
Using Recon Service API (GET, POST)
Name Authorities with URIs
Retrieve terms and URIs
View of original Art and Architecture terms
View of validated Art and
Architecture terms
DATA VALIDATION
Source: Texas Archival Resources Online (TARO) project, as part of current work duties
What is
fuzzy matching?
FUZZY MATCHING
University of Texas. Glee Club
University of Texas. Glee Clubs
University of Texas Glee Club
The University of Texas. Glee Club
The University of Texas. glee club
University of Texas--glee clubs
University of Texas. Glee Club
FUZZY MATCHING
View of clustering menu in OpenRefine, demonstrating fuzzy matching
Problematizing
Data Transformation
Screenshot of Library of Congress subject headings for
Nuu-Chah-Nulth people and related topics.
Screenshot of Getty AAT record for Nuu-Chah-Nulth, with sources
used to make the record highlighted
OpenRefine project
Using Recon Service API (GET, POST)
Name Authorities with URIs
Retrieve terms and URIs
PROBLEMATIZING DATA TRANSFORMATION
Where did this information come from?
Are there pieces missing?
Who may not know this is here?
Is this record truly a 1:1 relationship?
Should all of this information be shared?
Critical Cataloging
Best Practices
No one size
fits all.
It’s all about ...
Relationships
Img source: Lea L on Unsplash
...it is insufficient to care only for the object, which is
the material expression of a people’s way of life.
Instead, the knowledge itself, including the means
of its making, must be treated with
respect...including the establishment of
fair and just reciprocal relationships between the
holding institutions and the Indigenous peoples
who created the original expressions.
-Littletree, Belarde-Lewis, and Duarte (2020), p. 416
“
”
Indian Arts Research Center. 2019. Guidelines for Collaboration (website). Facilitated by Landis Smith,
Cynthia Chavez Lamar, and Brian Vallo. Santa Fe, NM: School for Advanced Research
A REVISED WORKFLOW
Metadata project
Name authorities with URIs
Retrieve terms and URIs
Use reconciliation services
Community stakeholders/resources
Consult communities/resources
Employ protocols for info
Img sources: spreadsheet by Yuri Mazursky from the Noun Project; Community by Adrien Coquet from the Noun Project
Share results
Limitations
Not all information can be shared in our collections
systems
Not all knowledge systems/ways of knowing can
be ethically represented in our collections systems
Sometimes collaboration is not possible
(and as such, we should not forge ahead with
related projects without it)
Sometimes, resources do not yet exist
Even so, it is all still worthwhile work :)
Img source: Photo of Tataviam land (Vasquez Rocks) by author, 2020.
Thank you!
THANK YOU
The following list contains resources on the tools I have used, literature on reconciliation services, and critical cataloging.
Open Refine
https://openrefine.org/
https://github.com/OpenRefine/OpenRefine
https://www.getty.edu/research/tools/vocabularies/obtain/getty_vocabularies_openrefine_tutorial.pdf
https://guides.library.illinois.edu/openrefine/gettingstarted
https://librarycarpentry.org/lc-open-refine/aio.html
https://mnylc.org/fellows/2017/03/17/using-openrefine-to-reconcile-name-entities/
https://github.com/OpenRefine/OpenRefine/wiki/Clustering-In-Depth
Reconciliation Services
http://refine.codefork.com/reconcile/viafproxy/LC
https://github.com/cmharlow/lc-reconcile/tree/5739c08f0e20f51a3a9a27637b1ec13869709002
https://www.getty.edu/research/tools/vocabularies/obtain/openrefine.html
https://www.howtogeek.com/343877/what-is-an-api/
https://github.com/cmharlow/c4lMDCpres/blob/master/slides/OpenRefineReconSlides.pdf
Critical Cataloging
Changes to Library of Congress Subject Headings Related to Indigenous Peoples
Archives for Black Lives in Philadelphia Anti-Racist Description Resources
Writing About Slavery? This Might Help. P. Gabrielle Forman, et al.
Homosaurus
Disability Language Style Guide
THANK YOU
The following list contains resources on the tools I have used, literature on reconciliation services, and critical cataloging.
Critical Cataloging cont.
First Nations, Metis, and Inuit Ontology
Change the Subject Documentary
Referencing Indigenous Knowledge in non-Indigenous sources
"The Right to Know": Decolonizing Native American Archives
Decentering Whiteness in Design History Resources
Citing Indigenous Elders and Knowledge Keepers from UBC
Centering Relationality: A Conceptual Model to Advance Indigenous Knowledge Organization Practices
‘Of course, data can never fully represent reality’: Assessing the Relationship between Indigenous Data and IK, TEK, and TK
Local Contexts Traditional Knowledge Labels
Knowledge Organization from an Indigenous Perspective: The Mashantucket Pequot Thesaurus of American Indian Terminology Project
Chicano Studies Collection thesaurus and The Chicano Database: Re-imagining Data Management as (Un)disciplinarity
Continuing Education workshops, hosted by Maskwacis Cultural College
United States Indigenous Data Sovereignty Network
Land Acknowledgement Info
Eastern Band of Cherokee Indians, EBCI Story Maps Project
Absentee Shawnee , Shawnee Tribe, and Eastern Shawnee Tribe of Oklahoma
Miami Tribe of Oklahoma, Myaamia Center
Peoria Tribe of Oklahoma
Yuchi Tribe -- assimilated into many different tribal groups

More Related Content

Similar to Critical Metadata: Re-examining Data Transformation, Devon Murphy

Using the Semantic Web, and Contributing to it
Using the Semantic Web, and Contributing to itUsing the Semantic Web, and Contributing to it
Using the Semantic Web, and Contributing to itMathieu d'Aquin
 
Finding knowledge, data and answers on the Semantic Web
Finding knowledge, data and answers on the Semantic WebFinding knowledge, data and answers on the Semantic Web
Finding knowledge, data and answers on the Semantic Webebiquity
 
2013-07-19 myExperiment research objects, beyond workflows and packs (PPTX)
2013-07-19 myExperiment research objects, beyond workflows and packs (PPTX)2013-07-19 myExperiment research objects, beyond workflows and packs (PPTX)
2013-07-19 myExperiment research objects, beyond workflows and packs (PPTX)Stian Soiland-Reyes
 
Self adaptive based natural language interface for disambiguation of
Self adaptive based natural language interface for disambiguation ofSelf adaptive based natural language interface for disambiguation of
Self adaptive based natural language interface for disambiguation ofNurfadhlina Mohd Sharef
 
Doing Clever Things with the Semantic Web
Doing Clever Things with the Semantic WebDoing Clever Things with the Semantic Web
Doing Clever Things with the Semantic WebMathieu d'Aquin
 
Research on collaborative information sharing systems
Research on collaborative information sharing systemsResearch on collaborative information sharing systems
Research on collaborative information sharing systemsDavide Eynard
 
OpenRefine reconciliation services
OpenRefine reconciliation servicesOpenRefine reconciliation services
OpenRefine reconciliation servicesJen Hammock
 
Public PhD Defense - Ben De Meester
Public PhD Defense - Ben De MeesterPublic PhD Defense - Ben De Meester
Public PhD Defense - Ben De MeesterBen De Meester
 
Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...
Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...
Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...Amit Sheth
 
Investing in a time of desruptive change
Investing in a time of desruptive changeInvesting in a time of desruptive change
Investing in a time of desruptive changeJisc
 
Metaphic or the art of looking another way.
Metaphic or the art of looking another way.Metaphic or the art of looking another way.
Metaphic or the art of looking another way.Suresh Manian
 
Big Data in Learning Analytics - Analytics for Everyday Learning
Big Data in Learning Analytics - Analytics for Everyday LearningBig Data in Learning Analytics - Analytics for Everyday Learning
Big Data in Learning Analytics - Analytics for Everyday LearningStefan Dietze
 
Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...
Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...
Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...Artificial Intelligence Institute at UofSC
 
How the Web can change social science research (including yours)
How the Web can change social science research (including yours)How the Web can change social science research (including yours)
How the Web can change social science research (including yours)Frank van Harmelen
 
Making working thesauri
Making working thesauriMaking working thesauri
Making working thesauriliddy
 
NetIKX Semantic Search Presentation
NetIKX Semantic Search PresentationNetIKX Semantic Search Presentation
NetIKX Semantic Search Presentationurvics
 
From open data to open development
From open data to open developmentFrom open data to open development
From open data to open developmentckliu
 
The Neuroscience Information Framework: A Scalable Platform for Information E...
The Neuroscience Information Framework: A Scalable Platform for Information E...The Neuroscience Information Framework: A Scalable Platform for Information E...
The Neuroscience Information Framework: A Scalable Platform for Information E...Neuroscience Information Framework
 
2013 nas-ehs-data-integration-dc
2013 nas-ehs-data-integration-dc2013 nas-ehs-data-integration-dc
2013 nas-ehs-data-integration-dcc.titus.brown
 

Similar to Critical Metadata: Re-examining Data Transformation, Devon Murphy (20)

Using the Semantic Web, and Contributing to it
Using the Semantic Web, and Contributing to itUsing the Semantic Web, and Contributing to it
Using the Semantic Web, and Contributing to it
 
Finding knowledge, data and answers on the Semantic Web
Finding knowledge, data and answers on the Semantic WebFinding knowledge, data and answers on the Semantic Web
Finding knowledge, data and answers on the Semantic Web
 
2013-07-19 myExperiment research objects, beyond workflows and packs (PPTX)
2013-07-19 myExperiment research objects, beyond workflows and packs (PPTX)2013-07-19 myExperiment research objects, beyond workflows and packs (PPTX)
2013-07-19 myExperiment research objects, beyond workflows and packs (PPTX)
 
Self adaptive based natural language interface for disambiguation of
Self adaptive based natural language interface for disambiguation ofSelf adaptive based natural language interface for disambiguation of
Self adaptive based natural language interface for disambiguation of
 
Doing Clever Things with the Semantic Web
Doing Clever Things with the Semantic WebDoing Clever Things with the Semantic Web
Doing Clever Things with the Semantic Web
 
Research on collaborative information sharing systems
Research on collaborative information sharing systemsResearch on collaborative information sharing systems
Research on collaborative information sharing systems
 
OpenRefine reconciliation services
OpenRefine reconciliation servicesOpenRefine reconciliation services
OpenRefine reconciliation services
 
Public PhD Defense - Ben De Meester
Public PhD Defense - Ben De MeesterPublic PhD Defense - Ben De Meester
Public PhD Defense - Ben De Meester
 
Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...
Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...
Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...
 
Investing in a time of desruptive change
Investing in a time of desruptive changeInvesting in a time of desruptive change
Investing in a time of desruptive change
 
Metaphic or the art of looking another way.
Metaphic or the art of looking another way.Metaphic or the art of looking another way.
Metaphic or the art of looking another way.
 
Big Data in Learning Analytics - Analytics for Everyday Learning
Big Data in Learning Analytics - Analytics for Everyday LearningBig Data in Learning Analytics - Analytics for Everyday Learning
Big Data in Learning Analytics - Analytics for Everyday Learning
 
Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...
Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...
Spatial Semantics for Better Interoperability and Analysis: Challenges and Ex...
 
How the Web can change social science research (including yours)
How the Web can change social science research (including yours)How the Web can change social science research (including yours)
How the Web can change social science research (including yours)
 
Making working thesauri
Making working thesauriMaking working thesauri
Making working thesauri
 
NetIKX Semantic Search Presentation
NetIKX Semantic Search PresentationNetIKX Semantic Search Presentation
NetIKX Semantic Search Presentation
 
DataHub
DataHubDataHub
DataHub
 
From open data to open development
From open data to open developmentFrom open data to open development
From open data to open development
 
The Neuroscience Information Framework: A Scalable Platform for Information E...
The Neuroscience Information Framework: A Scalable Platform for Information E...The Neuroscience Information Framework: A Scalable Platform for Information E...
The Neuroscience Information Framework: A Scalable Platform for Information E...
 
2013 nas-ehs-data-integration-dc
2013 nas-ehs-data-integration-dc2013 nas-ehs-data-integration-dc
2013 nas-ehs-data-integration-dc
 

More from Visual Resources Association

Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...
Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...
Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...Visual Resources Association
 
The Medieval Kingdom of Sicily Image Database Project: From Concept to Reality
The Medieval Kingdom of Sicily Image Database Project: From Concept to RealityThe Medieval Kingdom of Sicily Image Database Project: From Concept to Reality
The Medieval Kingdom of Sicily Image Database Project: From Concept to RealityVisual Resources Association
 
Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...
Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...
Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...Visual Resources Association
 
Recreating a 19th-Century Spectacle: The 3D Glass Stereo Project
Recreating a 19th-Century Spectacle: The 3D Glass Stereo ProjectRecreating a 19th-Century Spectacle: The 3D Glass Stereo Project
Recreating a 19th-Century Spectacle: The 3D Glass Stereo ProjectVisual Resources Association
 
Cradle of Texas Gay Liberty: An Alternate History of the Alamo City
Cradle of Texas Gay Liberty: An Alternate History of the Alamo CityCradle of Texas Gay Liberty: An Alternate History of the Alamo City
Cradle of Texas Gay Liberty: An Alternate History of the Alamo CityVisual Resources Association
 
Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...
Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...
Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...Visual Resources Association
 
Disinformation and Deepfakes: The Urgent Need for Visual Literacy
Disinformation and Deepfakes: The Urgent Need for Visual LiteracyDisinformation and Deepfakes: The Urgent Need for Visual Literacy
Disinformation and Deepfakes: The Urgent Need for Visual LiteracyVisual Resources Association
 
Pattern and Representation: Critical Cataloging for a New Perspective on Camp...
Pattern and Representation: Critical Cataloging for a New Perspective on Camp...Pattern and Representation: Critical Cataloging for a New Perspective on Camp...
Pattern and Representation: Critical Cataloging for a New Perspective on Camp...Visual Resources Association
 
Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...
Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...
Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...Visual Resources Association
 
Supporting Art History Students' Digital Projects at American University
Supporting Art History Students' Digital Projects at American UniversitySupporting Art History Students' Digital Projects at American University
Supporting Art History Students' Digital Projects at American UniversityVisual Resources Association
 
Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...
Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...
Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...Visual Resources Association
 
Describing Art on the Street: The Graffiti Art Community Voice
Describing Art on the Street: The Graffiti Art Community VoiceDescribing Art on the Street: The Graffiti Art Community Voice
Describing Art on the Street: The Graffiti Art Community VoiceVisual Resources Association
 
Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...
Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...
Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...Visual Resources Association
 
Accessibility Guidance for Digital Cultural Heritage
Accessibility Guidance for Digital Cultural HeritageAccessibility Guidance for Digital Cultural Heritage
Accessibility Guidance for Digital Cultural HeritageVisual Resources Association
 

More from Visual Resources Association (20)

Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...
Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...
Comparative Study and Expansion of Metadata Standards for Historic Fashion Co...
 
Unsettling Collections: Bias in the Visual Canon
Unsettling Collections: Bias in the Visual CanonUnsettling Collections: Bias in the Visual Canon
Unsettling Collections: Bias in the Visual Canon
 
The Medieval Kingdom of Sicily Image Database Project: From Concept to Reality
The Medieval Kingdom of Sicily Image Database Project: From Concept to RealityThe Medieval Kingdom of Sicily Image Database Project: From Concept to Reality
The Medieval Kingdom of Sicily Image Database Project: From Concept to Reality
 
Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...
Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...
Interactive Topography with IIIF: Open Access to Photographs from the Ernest ...
 
Recreating a 19th-Century Spectacle: The 3D Glass Stereo Project
Recreating a 19th-Century Spectacle: The 3D Glass Stereo ProjectRecreating a 19th-Century Spectacle: The 3D Glass Stereo Project
Recreating a 19th-Century Spectacle: The 3D Glass Stereo Project
 
Cradle of Texas Gay Liberty: An Alternate History of the Alamo City
Cradle of Texas Gay Liberty: An Alternate History of the Alamo CityCradle of Texas Gay Liberty: An Alternate History of the Alamo City
Cradle of Texas Gay Liberty: An Alternate History of the Alamo City
 
Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...
Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...
Material Order: A Discovery Group, Shared Catalog, and Research Platform for ...
 
Personal Archiving for Undergraduate Students
Personal Archiving for Undergraduate StudentsPersonal Archiving for Undergraduate Students
Personal Archiving for Undergraduate Students
 
Disinformation and Deepfakes: The Urgent Need for Visual Literacy
Disinformation and Deepfakes: The Urgent Need for Visual LiteracyDisinformation and Deepfakes: The Urgent Need for Visual Literacy
Disinformation and Deepfakes: The Urgent Need for Visual Literacy
 
Jean Charlot: Artist as Archivist
Jean Charlot: Artist as ArchivistJean Charlot: Artist as Archivist
Jean Charlot: Artist as Archivist
 
Pattern and Representation: Critical Cataloging for a New Perspective on Camp...
Pattern and Representation: Critical Cataloging for a New Perspective on Camp...Pattern and Representation: Critical Cataloging for a New Perspective on Camp...
Pattern and Representation: Critical Cataloging for a New Perspective on Camp...
 
Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...
Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...
Stories from the Stop (and Re-Start?): Visual Resources Professionals Face Re...
 
Supporting Art History Students' Digital Projects at American University
Supporting Art History Students' Digital Projects at American UniversitySupporting Art History Students' Digital Projects at American University
Supporting Art History Students' Digital Projects at American University
 
Material Objects and Special Collections
Material Objects and Special CollectionsMaterial Objects and Special Collections
Material Objects and Special Collections
 
Digital Art History
Digital Art HistoryDigital Art History
Digital Art History
 
Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...
Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...
Assessing the use of Qualitative Data Analysis Software (QDAS) by Art Histori...
 
Describing Art on the Street: The Graffiti Art Community Voice
Describing Art on the Street: The Graffiti Art Community VoiceDescribing Art on the Street: The Graffiti Art Community Voice
Describing Art on the Street: The Graffiti Art Community Voice
 
Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...
Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...
Photographic Glass Plates and Birthdates: Secrets to Optimizing AI-Generated ...
 
Crowdsourcing Collection Development
Crowdsourcing Collection DevelopmentCrowdsourcing Collection Development
Crowdsourcing Collection Development
 
Accessibility Guidance for Digital Cultural Heritage
Accessibility Guidance for Digital Cultural HeritageAccessibility Guidance for Digital Cultural Heritage
Accessibility Guidance for Digital Cultural Heritage
 

Recently uploaded

Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfAdmir Softic
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxVishalSingh1417
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxnegromaestrong
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxVishalSingh1417
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfSanaAli374401
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docxPoojaSen20
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.MateoGardella
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin ClassesCeline George
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.christianmathematics
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.pptRamjanShidvankar
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxAreebaZafar22
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...KokoStevan
 

Recently uploaded (20)

Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 

Critical Metadata: Re-examining Data Transformation, Devon Murphy

  • 1. Critical Metadata: Re-examining Data Transformation Devon Murphy, TARO Metadata Analyst, University of Texas at Austin devon.murphy@austin.utexas.edu March 23rd, 2021
  • 2. OUTLINE OpenRefine Introduction OpenRefine W orkflow Introduction to Data Validation Fuzzy Matching Thank You! Problematizing Data Transformation Critcat Best Practices Limitations
  • 4. OPENREFINE ...a Java-based power tool that allows you to load data, understand it, clean it up, reconcile it, and augment it with data coming from the web. -https://github.com/OpenRefine/OpenRefine “ ”
  • 6. OPENREFINE View of OpenRefine in browser with text transform menu open
  • 7. OPENREFINE “Completeness: Checking to see what elements/properties/attributes are present (and how much of it is missing!) Accuracy: Information is correct and factual (to the best of our abilities) Conformance to expectations: Information adheres to our expectations Consistency: Values are consistent within our domain, elements are represented in a consistent manner” -Gretchen Gueguen, Digital Public Library of America
  • 9. DATA VALIDATION A two-step definition for Data Validation: “An activity aimed at verifying whether the value of a data item comes from the given (finite or infinite) set of acceptable values.” -UNECE 2013 Glossary of terms on statistical data editing “Data validation could be operationally defined as a process which ensures the correspondence of the final (published) data with a number of quality characteristics.” -Simon A., (2013a) Definition of validation levels and other related concepts v01307. Working document
  • 10. DATA VALIDATION Two paths to Data Validation: Manually check terms against sources (use when no existing reconciliation service/no URIs and no. of content is small) Use reconciliation services to check terms against sources (use when services available, especially helpful with large no. of content!)
  • 11. DATA VALIDATION OpenRefine project Using Recon Service API (GET, POST) Name Authorities with URIs Retrieve terms and URIs
  • 12. View of original Art and Architecture terms View of validated Art and Architecture terms DATA VALIDATION Source: Texas Archival Resources Online (TARO) project, as part of current work duties
  • 14. FUZZY MATCHING University of Texas. Glee Club University of Texas. Glee Clubs University of Texas Glee Club The University of Texas. Glee Club The University of Texas. glee club University of Texas--glee clubs University of Texas. Glee Club
  • 15. FUZZY MATCHING View of clustering menu in OpenRefine, demonstrating fuzzy matching
  • 17. Screenshot of Library of Congress subject headings for Nuu-Chah-Nulth people and related topics.
  • 18. Screenshot of Getty AAT record for Nuu-Chah-Nulth, with sources used to make the record highlighted
  • 19. OpenRefine project Using Recon Service API (GET, POST) Name Authorities with URIs Retrieve terms and URIs PROBLEMATIZING DATA TRANSFORMATION Where did this information come from? Are there pieces missing? Who may not know this is here? Is this record truly a 1:1 relationship? Should all of this information be shared?
  • 22. It’s all about ... Relationships Img source: Lea L on Unsplash
  • 23. ...it is insufficient to care only for the object, which is the material expression of a people’s way of life. Instead, the knowledge itself, including the means of its making, must be treated with respect...including the establishment of fair and just reciprocal relationships between the holding institutions and the Indigenous peoples who created the original expressions. -Littletree, Belarde-Lewis, and Duarte (2020), p. 416 “ ”
  • 24. Indian Arts Research Center. 2019. Guidelines for Collaboration (website). Facilitated by Landis Smith, Cynthia Chavez Lamar, and Brian Vallo. Santa Fe, NM: School for Advanced Research
  • 25. A REVISED WORKFLOW Metadata project Name authorities with URIs Retrieve terms and URIs Use reconciliation services Community stakeholders/resources Consult communities/resources Employ protocols for info Img sources: spreadsheet by Yuri Mazursky from the Noun Project; Community by Adrien Coquet from the Noun Project Share results
  • 27. Not all information can be shared in our collections systems Not all knowledge systems/ways of knowing can be ethically represented in our collections systems Sometimes collaboration is not possible (and as such, we should not forge ahead with related projects without it) Sometimes, resources do not yet exist Even so, it is all still worthwhile work :) Img source: Photo of Tataviam land (Vasquez Rocks) by author, 2020.
  • 29. THANK YOU The following list contains resources on the tools I have used, literature on reconciliation services, and critical cataloging. Open Refine https://openrefine.org/ https://github.com/OpenRefine/OpenRefine https://www.getty.edu/research/tools/vocabularies/obtain/getty_vocabularies_openrefine_tutorial.pdf https://guides.library.illinois.edu/openrefine/gettingstarted https://librarycarpentry.org/lc-open-refine/aio.html https://mnylc.org/fellows/2017/03/17/using-openrefine-to-reconcile-name-entities/ https://github.com/OpenRefine/OpenRefine/wiki/Clustering-In-Depth Reconciliation Services http://refine.codefork.com/reconcile/viafproxy/LC https://github.com/cmharlow/lc-reconcile/tree/5739c08f0e20f51a3a9a27637b1ec13869709002 https://www.getty.edu/research/tools/vocabularies/obtain/openrefine.html https://www.howtogeek.com/343877/what-is-an-api/ https://github.com/cmharlow/c4lMDCpres/blob/master/slides/OpenRefineReconSlides.pdf Critical Cataloging Changes to Library of Congress Subject Headings Related to Indigenous Peoples Archives for Black Lives in Philadelphia Anti-Racist Description Resources Writing About Slavery? This Might Help. P. Gabrielle Forman, et al. Homosaurus Disability Language Style Guide
  • 30. THANK YOU The following list contains resources on the tools I have used, literature on reconciliation services, and critical cataloging. Critical Cataloging cont. First Nations, Metis, and Inuit Ontology Change the Subject Documentary Referencing Indigenous Knowledge in non-Indigenous sources "The Right to Know": Decolonizing Native American Archives Decentering Whiteness in Design History Resources Citing Indigenous Elders and Knowledge Keepers from UBC Centering Relationality: A Conceptual Model to Advance Indigenous Knowledge Organization Practices ‘Of course, data can never fully represent reality’: Assessing the Relationship between Indigenous Data and IK, TEK, and TK Local Contexts Traditional Knowledge Labels Knowledge Organization from an Indigenous Perspective: The Mashantucket Pequot Thesaurus of American Indian Terminology Project Chicano Studies Collection thesaurus and The Chicano Database: Re-imagining Data Management as (Un)disciplinarity Continuing Education workshops, hosted by Maskwacis Cultural College United States Indigenous Data Sovereignty Network Land Acknowledgement Info Eastern Band of Cherokee Indians, EBCI Story Maps Project Absentee Shawnee , Shawnee Tribe, and Eastern Shawnee Tribe of Oklahoma Miami Tribe of Oklahoma, Myaamia Center Peoria Tribe of Oklahoma Yuchi Tribe -- assimilated into many different tribal groups