The Semantic Quilt

The Semantic Quilt: Contexts, Co-occurrences, Kernels, and Ontologies Ted Pedersen University of Minnesota, Duluth http:// www.d.umn.edu/~tpederse

Sew together different materials

Ontologies Co-Occurrences Kernels Contexts

Semantics in NLP ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What do we mean by semantics ? …it depends on our resources… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What level of granularity? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The Terrible Tension : Ambiguity versus Granularity ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The Current State of Affairs ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Similarity as Organizing Principle ,[object Object],[object Object],[object Object],[object Object],[object Object]

Things we can do now… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Things we want to do… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Semantic Patches to Sew Together ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Ngram Statistics Package http:// ngram.sourceforge.net Co-Occurrences

Co-occurrences and semantics? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why pairs of words? ,[object Object],[object Object],[object Object],[object Object],[object Object]

Bigrams ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

“ occur together more often than expected by chance…” ,[object Object],[object Object],[object Object],[object Object]

Measures and Tests of Association http:// ngram.sourceforge.net ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What do we get at the end? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

SenseClusters http:// senseclusters.sourceforge.net Contexts

Identify Similar Contexts ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

SenseClusters Methodology ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Second Order Features ,[object Object],[object Object],[object Object]

Similar Contexts may have the same meaning… ,[object Object],[object Object],[object Object],[object Object],[object Object]

Second Order Context Representation ,[object Object],[object Object],[object Object],[object Object],[object Object]

2 nd Order Context Vectors ,[object Object],0 6272.85 2.9133 62.6084 20.032 1176.84 51.021 O2 context 0 18818.55 0 0 0 205.5469 134.5102 guy 0 0 0 136.0441 29.576 0 0 Oscar 0 0 8.7399 51.7812 30.520 3324.98 18.5533 won needle family war movie actor football baseball

After context representation… ,[object Object],[object Object],[object Object],[object Object],[object Object]

What do we get at the end? ,[object Object],[object Object],[object Object]

Ontologies WordNet-Similarity Co-Occurrences Ngram Statistics Package Kernels WSD-Shell Contexts SenseClusters

Oh…we also get plenty of these… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The WSD-Shell http:// www.d.umn.edu/~tpederse/supervised.html Kernels

Machine Learning Approach ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Kernel Methods ,[object Object],[object Object],[object Object]

Kernels are similarity matrices ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What do we get at the end? ,[object Object],[object Object]

WordNet-Similarity http://wn-similarity.sourceforge.net Ontologies

Similarity and Relatedness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

WordNet-Similarity http://wn-similarity.sourceforge.net ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Path Finding ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

watercraft instrumentality object artifact conveyance vehicle motor-vehicle car boat ark article ware table-ware cutlery fork from Jiang and Conrath [1997]

Information Content ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Observed “car”... motor vehicle (327 +1) *root* (32783 + 1) minicab (6) cab (23) car (73 +1) bus (17) stock car (12)

Observed “stock car”... motor vehicle (328+1) *root* (32784+1) minicab (6) cab (23) car (74+1) bus (17) stock car (12+1)

After Counting Concepts... motor vehicle (329) IC = 1.9 *root* (32785) minicab (6) cab (23) car (75) bus (17) IC = 3.5 stock car (13) IC = 3.1

Similarity and Information Content ,[object Object],[object Object],[object Object]

Wait a minute … ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Using Dictionary Glosses to Measure Relatedness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Gloss Vectors ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why measure conceptual similarity? ,[object Object],[object Object],[object Object],[object Object]

Word Sense Disambiguation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

WordNet-SenseRelate http:// senserelate.sourceforge.net SenseRelate

SenseRelate Algorithm ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Coverage… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Ontologies WordNet-Similarity Co-Occurrences Ngram Statistics Package Kernels WSD-Shell Contexts SenseClusters SenseRelate

Kernels are similarity matrices ,[object Object],[object Object],[object Object],[object Object],[object Object]

SenseClusters Input … matrices ,[object Object],[object Object],[object Object],[object Object]

Identifying Collocations ,[object Object],[object Object]

Conclusion ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Many Thanks… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

URLs ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The Semantic Quilt

Recommended

Recommended

More Related Content

Similar to The Semantic Quilt

Similar to The Semantic Quilt (20)

More from University of Minnesota, Duluth

More from University of Minnesota, Duluth (20)

Recently uploaded

Recently uploaded (20)

The Semantic Quilt