14. Tasks evaluated in MUC 3-7 [Chinchor, 98] YES YES YES YES YES MUC-7 YES YES YES YES MUC-6 YES MUC-5 YES MUC-4 YES MUC-3 ST TR RE CO NE EVALASK
15. Maximum Results Reported in MUC-7 65 86 87 69 95 PRECISION 42 67 86 56 92 RECALL ST TR TE CO NE MEASSUREASK
16.
17.
18.
19.
20.
21.
22.
23.
24.
25. Language and World Model Linguistic Mention Linguistic Entity Denotes Denotes [Appelt, 2003]
26. NLP Tasks in an Extraction System [Appelt, 2003] Cross-Document Coreference Linguistic Mention Recognition Type Classification Linguistic Entity Coreference Events and Relations Event Recognition
27.
28.
29.
30.
31.
32. Entity and Mention Example [COLOGNE, [Germany]] ( AP ) _ [A [Chilean] exile] has filed a complaint against [former [Chilean] dictator Gen. Augusto Pinochet] accusing [him] of responsibility for [her] arrest and torture in [Chile] in 1973, [prosecutors] said Tuesday. [The woman , [[a Chilean] who has since gained [German] citizenship]] , accused [Pinochet] of depriving [her] of personal liberty and causing bodily harm during [her] arrest and torture. Person Organization Geopolitical Entity
44. “ Information Extraction” From Free Text October 14, 2002, 4:00 a.m. PT For years, Microsoft Corporation CEO Bill Gates railed against the economic philosophy of open-source software with Orwellian fervor, denouncing its communal licensing as a "cancer" that stifled technological innovation. Today, Microsoft claims to "love" the open-source concept, by which software code is made public to encourage improvement and development by outside programmers. Gates himself says Microsoft will gladly disclose its crown jewels--the coveted code behind the Windows operating system--to select customers. "We can be open source. We love the concept of shared source," said Bill Veghte , a Microsoft VP . "That's a super-important shift for us in terms of code access.“ Richard Stallman , founder of the Free Software Foundation , countered saying… Microsoft Corporation CEO Bill Gates Microsoft Gates Microsoft Bill Veghte Microsoft VP Richard Stallman founder Free Software Foundation NAME TITLE ORGANIZATION Bill Gates CEO Microsoft Bill Veghte VP Microsoft Richard Stallman founder Free Soft.. * * * *
70. Statistical Filtering Relevance Rate: rel - freq i Pr(relevant text text contains case frame i ) = total - freq i rel-freq i : number of instances of case - frame i in the relevant documents total-freq i : total number of instances of case - frame i Ranking Function: score i = relevance rate i * log 2 (frequency i ) Pr < 0,5 negatively correlated with the domain
CiteSeer, which we all know and love, is made possible by the automatic extraction of title and author information from research paper headers and references in order to build the reference graph that we use to find related work.
WB’s first application area is extracting job openings from the web. Start at company home page, automatically follow links to find the job openings section, segment job openings from each other, and extract job title, location, description, and all of these fields. (Notice that capitalization, position on page, bold face are just as much indicators of this being a job title as the words themselves. Notice also that part of the IE task is figuring out which links to follow. And often data for a relation came from multiple different pages.)
RL, by definition, require data in some relational format.
