Your spoken paper cannot be the same as your written paper<br />Read more: Museums and the Web 2011 (MW2011): Presentation...
Computational Linguistics in Museums: Applications for Cultural Datasets<br />Klavans<br />Judith<br />Susan<br />Robert<b...
ComputationalLinguistics<br />Language  - Words, Words, Words<br />Use<br />Meaning<br />Syntax<br />Shape of words<br />S...
Applications<br />Speech synthesis – 1980’s Talking Machines for the Blind<br />Intelligent search – pre-google<br />Findi...
Domains for Computational Linguistics<br />Healthcare – interpreting patient records<br />Government – helping people find...
Computational <br />Linguistics for<br />Metadata<br />Building<br />+<br />
Computational Linguistics in Museums: Applications for Cultural Datasets<br />Klavans<br />Judith<br />Susan<br />Robert<b...
InterdisciplinaryResearch<br />Computational Linguistics<br />in Museums<br />
Text, Tags, Trust<br />Funded in 2008 by IMLS<br />With the University of Maryland, and collaborative of museum partners<b...
MW 2011 Contributions		<br />Which Computational Linguistic tools can or should be applied to tags?<br />How do these tool...
Hard  Challenges<br /><ul><li>  What do these words really mean?
  How can tags be related to other tags? </li></ul>		across languages<br />		across users<br /><ul><li>   How are tags ove...
   How can they be used?  </li></li></ul><li>Finding a Needle in the Haystack<br />
Gallery Label<br />This canvas was the first one Gauguin painted during the two months he spent in Provence.... Gauguin ha...
Tools for Tags<br />Morphological Analysis – Conflate when possible<br />Cats, cat<br />Haystacks, haystack<br />Painting,...
Raw Tags or Tokens<br />
Results		<br />25% <br />93% <br />68% <br />
1. NN=25205<br />2. JJ=6319<br />3. NNS=4041<br />4. NN_NN=2257<br />5. JJ_NN=1792<br />6. VBG=1043<br />7. VBN=727<br />8...
Top 10 POS Patterns:<br />1. NN=6706<br />2. NN_NN=1713<br />3. JJ_NN=1194<br />4. JJ=921<br />5. NNS=757<br />6. JJ_NNS=3...
Hard  Challenges<br /><ul><li>  What do these words really mean?
  How can tags be related to other tags? </li></ul>		across languages<br />		across users<br /><ul><li>   How are tags ove...
   How can they be used?  </li></li></ul><li>Why Part of Speech? <br /><ul><li>Integral to most language processing pipelines
Irecursor to parsing.
   However, for social tags, parsing is not a meaningful step.  </li></ul>Research:<br /><ul><li>  Understand the nature o...
  Link part of speech information with other lexical resources for disambiguation</li></li></ul><li>You shall know a word ...
What About “New England”<br />Idioms / lexicalized phrases are more difficult<br />Heuristic comparison to Wikipedia Title...
Upcoming SlideShare
Loading in …5
×

MW2011: Klavans, J. +, Computational Linguistics in Museums: Applications for Cultural Datasets

1,563 views

Published on

As museums continue to develop more sophisticated techniques for managing and analyzing cultural data, many are beginning to encounter challenges when trying to deal with the nuances of language and automated processing tools. How might user-generated comments be harvested and processed to determine the nature of the comment? Is it possible to use existing collection documentation to derive relations between similar objects? How can we train systems to automatically recognize (disambiguate) different meanings of the same word? Can automated language processing lead to more compelling browsing interfaces for online collections?

Luckily, a good deal of expertise and tools exist within the field of computational linguistics that can be applied to these problems to achieve meaningful results. Informed by previous work in computational linguistics and relevant project experience, the authors will address a number of these questions providing insight about how answers to impact museum practice might be found. Authors will share tools and resources that museum software developers can use to prototype and experiment with these techniques - without being experts in language processing themselves. In addition, the authors will describe the work of the T3: Text, Tags, Trust research project and how they have applied these tools to a large shared dataset of object metadata and social tags collected by the Steve.museum project.

Specific challenges regarding batch-processing tools and large datasets will be addressed. Best practices and algorithms will be shared for dealing with a number of sticky issues. Directions for future research and promising application areas will be also be discussed.

A presentation from Museums and the Web 2011 (MW2011)

Published in: Technology, Education
1 Comment
0 Likes
Statistics
Notes
  • Be the first to like this

No Downloads
Views
Total views
1,563
On SlideShare
0
From Embeds
0
Number of Embeds
162
Actions
Shares
0
Downloads
5
Comments
1
Likes
0
Embeds 0
No embeds

No notes for slide
  • Take this seriously.
  • IN presenting this paper, start with something not in the paper.
  • Still need to finish
  • Words,words, words.
  • MW2011: Klavans, J. +, Computational Linguistics in Museums: Applications for Cultural Datasets

    1. 1. Your spoken paper cannot be the same as your written paper<br />Read more: Museums and the Web 2011 (MW2011): Presentation Guidelines | conference.archimuse.com<br />
    2. 2. Computational Linguistics in Museums: Applications for Cultural Datasets<br />Klavans<br />Judith<br />Susan<br />Robert<br />Chun<br />Stein<br />Guerra<br />Raul<br />
    3. 3. ComputationalLinguistics<br />Language - Words, Words, Words<br />Use<br />Meaning<br />Syntax<br />Shape of words<br />Sounds<br />
    4. 4. Applications<br />Speech synthesis – 1980’s Talking Machines for the Blind<br />Intelligent search – pre-google<br />Finding names – who, what, where<br />Translation<br />Speech recognition<br />Answering Questions – What is Watson? <br />
    5. 5. Domains for Computational Linguistics<br />Healthcare – interpreting patient records<br />Government – helping people find information<br />International Affairs – cross-language translation<br />Law – analyzing Enron scandal email<br />Marketing – Opinions on products<br />Museums – analyzing text and tags associated with objects for better access <br />
    6. 6. Computational <br />Linguistics for<br />Metadata<br />Building<br />+<br />
    7. 7. Computational Linguistics in Museums: Applications for Cultural Datasets<br />Klavans<br />Judith<br />Susan<br />Robert<br />Chun<br />Stein<br />Guerra<br />Raul<br />
    8. 8. InterdisciplinaryResearch<br />Computational Linguistics<br />in Museums<br />
    9. 9. Text, Tags, Trust<br />Funded in 2008 by IMLS<br />With the University of Maryland, and collaborative of museum partners<br />Studying the relationships between social tags, scholarly text and resources, and the application of trust networks to improve access to museum collections.<br />
    10. 10. MW 2011 Contributions <br />Which Computational Linguistic tools can or should be applied to tags?<br />How do these tools impact tag analysis?<br />What results differ from the initial steve.museum results from Trant 2007?<br />So what – for CL?<br />So what – for Museums?<br />
    11. 11. Hard Challenges<br /><ul><li> What do these words really mean?
    12. 12. How can tags be related to other tags? </li></ul> across languages<br /> across users<br /><ul><li> How are tags over museum objects related to tags over anything else?
    13. 13. How can they be used? </li></li></ul><li>Finding a Needle in the Haystack<br />
    14. 14. Gallery Label<br />This canvas was the first one Gauguin painted during the two months he spent in Provence.... Gauguin had rebelled against Impressionism's reliance on the visible world, and he altered nature's shapes and colors to suggest his own more subjective reaction to the landscape.<br />While the rural subject and acidic colors show the influence of van Gogh, this image is more indebted to Paul Cézanne. In his careful integration of the haystack and farm buildings, Gauguin has echoed Cézanne's emphasis on geometric form.<br />
    15. 15. Tools for Tags<br />Morphological Analysis – Conflate when possible<br />Cats, cat<br />Haystacks, haystack<br />Painting, paint ?<br />What words are verbs, nouns, adjectives?<br />How should multi-word tags be handled?<br />
    16. 16. Raw Tags or Tokens<br />
    17. 17. Results <br />25% <br />93% <br />68% <br />
    18. 18. 1. NN=25205<br />2. JJ=6319<br />3. NNS=4041<br />4. NN_NN=2257<br />5. JJ_NN=1792<br />6. VBG=1043<br />7. VBN=727<br />8. NP=708<br />9. OD_NN=454<br />10. JJ_NNS=413<br />
    19. 19. Top 10 POS Patterns:<br />1. NN=6706<br />2. NN_NN=1713<br />3. JJ_NN=1194<br />4. JJ=921<br />5. NNS=757<br />6. JJ_NNS=303<br />7. NN_NNS=300<br />8. VBG=238<br />9. NP=209<br />10. VBN_NN=202<br />
    20. 20. Hard Challenges<br /><ul><li> What do these words really mean?
    21. 21. How can tags be related to other tags? </li></ul> across languages<br /> across users<br /><ul><li> How are tags over museum objects related to tags over anything else?
    22. 22. How can they be used? </li></li></ul><li>Why Part of Speech? <br /><ul><li>Integral to most language processing pipelines
    23. 23. Irecursor to parsing.
    24. 24. However, for social tags, parsing is not a meaningful step. </li></ul>Research:<br /><ul><li> Understand the nature of this kind of descriptive tagging.
    25. 25. Link part of speech information with other lexical resources for disambiguation</li></li></ul><li>You shall know a word <br />by the company it keeps. <br />J.R. Firth<br />Gold <br />Orange <br />Necklace<br />Ripe<br />
    26. 26. What About “New England”<br />Idioms / lexicalized phrases are more difficult<br />Heuristic comparison to Wikipedia Titles matched 46% (30% distinct) of multiword tags<br />E.g. “Grapes of Wrath”, “Irish Wolfhound”, “Franco-Prussian War”<br />*Klavans and Golbeck, 2010<br />
    27. 27. Wish List - Better ways to tame the proliferation of rich but “noisy” content<br />Clustering over tags for similarity<br />Clustering over tags and terms from text<br />Matching over existing terms to identify meaningful units<br />Apply machine learning techniques to guess meaning<br />Bigrams, Trigram, Thesauri, Corpus Analysis<br />
    28. 28. Acknowledgements<br />Steve.museum project members<br />T3 and steve.museum museum partners<br />University of Maryland, T3 group<br />IMA Museum <br />……and other participants<br />
    29. 29. Thank You!<br />Questions?<br />

    ×