Your SlideShare is downloading. ×
Programming for linguistics: Evaluating Parser Output
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Saving this for later?

Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime - even offline.

Text the download link to your phone

Standard text messaging rates apply

Programming for linguistics: Evaluating Parser Output

432
views

Published on

Published in: Self Improvement

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
432
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Programming for Linguistics December 16, 2013 Evaluating parser output
  • 2. Outline of topics 1. Preprocessing (10 slides) 2. Processing (6 slides) 3. Evaluation (1 slide) 4. Results (1 slide) 5. Improvements (1 slide)
  • 3. Programming for Linguistics 1 Preprocessing Penn Treebank trees as NLTK Tree objects
  • 4. Programming for Linguistics 1 Preprocessing
  • 5. Programming for Linguistics 1 Preprocessing
  • 6. Programming for Linguistics 1 Preprocessing
  • 7. Programming for Linguistics 1 Preprocessing
  • 8. Programming for Linguistics 1 Preprocessing
  • 9. Programming for Linguistics 1 Preprocessing
  • 10. Programming for Linguistics 1 Preprocessing
  • 11. Programming for Linguistics 2 Processing D. Klein and C. Manning 2002. A generative constituent-context model for improved grammar induction. In Proceedings of the ACL.
  • 12. Programming for Linguistics 2 Processing Does this work for original trees and processed trees?
  • 13. Programming for Linguistics 2 Processing Spans represented as label-span tuples: (‘label’, start, end)
  • 14. Programming for Linguistics 2 Processing
  • 15. Programming for Linguistics 2 Processing
  • 16. Programming for Linguistics 2 Processing
  • 17. Programming for Linguistics 2 Processing Now what can we do with this information?
  • 18. Programming for Linguistics 4 Evaluation
  • 19. Programming for Linguistics 4 Evaluation
  • 20. Programming for Linguistics 5 Results Evaluation after removing all complex labels and empty categories. GL = gold labels AL = auto labels M = matches
  • 21. Programming for Linguistics 5 Improvements ● Cross brackets ● Remove only labels/categories ● Consider context ● Constituent types ● Depends on task… Thanks!