SlideShare a Scribd company logo
1 of 32
UAIC Participation at RTE4 Adrian Iftene [email_address] „ Al. I. Cuza“ University, Iasi, Romania Faculty of Computer Science
Overview ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
RTE Competition ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
System presentation Initial   data Minipar module Final result NE Rule Negation  Rules Acronyms Background knowledge eXtended  Wordnet GATE VerbOcean Numbers  & Dates Contradiction Rules In RTE-3 competition Two-way 69.13 % Three-way 54.7 % After RTE-3 competition Test Data 2007: Two-way 74.1 % Three-way 71.8 % Test Data 2008 : Two-way 72.1 % Three-way 68.5 % Fitness Rule Main module TreeTagger Resources DIRT Dependency trees for  (T, H) pairs LingPipe module Named entities for  (T, H) pairs Wikipedia
Example NE (N) subj loc adv (A) subj mod … … NE (N) loc … … DIRT, VerbOcean WordNet Acronyms, BK DIRT: solve=resolve 0.31453 DIRT: convict=arrest 0.28895 DIRT:  convict=acquit  0.302455,OPPOSITE VerbOcean:  increase<>decrease,  VerbOcean:   leave<>stay WordNet: trouble=problem WordNet: talk=discussion   Acronym: EU=European Union BK: Buenos Aires [in] Argentine BK: 16 [is] sixteen   Hypothesis Text verb H  (V) noun (N) verb T  (V) noun (N) … … … …
Rules ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Entailment cases ,[object Object],[object Object],[object Object],[object Object],[object Object],70 80
Entailment cases (cont…) ,[object Object],[object Object],[object Object],[object Object],[object Object]
No entailment cases ,[object Object],[object Object],[object Object]
Contradiction cases ,[object Object],[object Object],[object Object],[object Object]
Contradiction cases (cont…) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Contradiction cases (cont…) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Contradiction cases (cont…) ,[object Object],[object Object],[object Object],[object Object],[object Object]
Unknown cases ,[object Object],[object Object],[object Object]
Unknown cases (cont…) ,[object Object],[object Object],[object Object],[object Object]
Unknown cases (cont…) ,[object Object],[object Object],[object Object],[object Object]
Unknown cases (cont…) ,[object Object],[object Object],[object Object],[object Object],[object Object]
Results in RTE4 68.50% 1000 685 1000 Total 54.25% 42.86% 73.89% 203 150 350 Unknown 58.72% 46.00% 81.18% 85 69 150 Contradiction 76.90% 93.20% 65.45% 712 466 500 Entailment F-measure Recall Precision Total offered by our system Correct offered by our system In Gold Answer Type 72.10% 1000 721 1000 Total 64.72% 51.00% 88.54% 288 255 500 No 76.90% 93.20% 65.45% 712 466 500 Yes F-measure Recall Precision Total offered by our system Correct offered by our system In Gold Answer Type
Comparison with RTE-3 To be able to see each component’s relevance, the systems were run in turn with each component removed 5.55 % 68.10 % - - Without Contradiction rule 7.21 % 66.90 % 16.71 % 57.58 % Without NE rule 4.72 % 68.70 % 2.17 % 67.63 % Without Negation rule 2.36 % 70.40 % 2.00 % 67.75 % Without BK 0.42 % 71.80 % 1.08 % 68.38 %  Without Acronyms 4.16 % 69.10 % 1.63 % 68.00 % Without WordNet 0.97 % 71.40 % 0.54 % 68.76 % Without DIRT Relevance Precision  Relevance Precision  RTE-4 RTE-3 System Description
Limits of the system ,[object Object],[object Object],[object Object],[object Object],[object Object]
Limits of the system (cont…) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Limits of the system (cont…) ,[object Object],[object Object],[object Object],[object Object],[object Object]
Applications ,[object Object],[object Object]
Question Answering ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
QA: System architecture ,[object Object],[object Object],[object Object],[object Object]
Results in QA Competitions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
AVE competition ,[object Object],[object Object],[object Object],[object Object]
The AVE system ,[object Object],[object Object],[object Object],65 % Alicante University, Spain 70 % ” Al. I. Cuza” University, Romania 70 % DFKI, Germany QA accuracy Group 62.96 % Alicante University, Spain 70.37 % ” Al. I. Cuza” University, Romania 70.37 % DFKI, Germany QA accuracy Group
Conclusions ,[object Object],[object Object],[object Object],[object Object]
Acknowledgments ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object]
References ,[object Object]

More Related Content

Viewers also liked

Menus scolarest-avril-2012
Menus scolarest-avril-2012Menus scolarest-avril-2012
Menus scolarest-avril-2012fimbles
 
A Distributed Architecture System for Recognizing Textual Entailment
A Distributed Architecture System for Recognizing Textual EntailmentA Distributed Architecture System for Recognizing Textual Entailment
A Distributed Architecture System for Recognizing Textual EntailmentFaculty of Computer Science
 
Email, apps and SoMe for psychiatrists
Email, apps and SoMe for psychiatristsEmail, apps and SoMe for psychiatrists
Email, apps and SoMe for psychiatristsChristopher Pell
 
Using opinion mining techniques for early crisis detection
Using opinion mining techniques for early crisis detectionUsing opinion mining techniques for early crisis detection
Using opinion mining techniques for early crisis detectionFaculty of Computer Science
 
Question Answering for Machine Reading Evaluation on Romanian and English
Question Answering for Machine Reading Evaluation on Romanian and EnglishQuestion Answering for Machine Reading Evaluation on Romanian and English
Question Answering for Machine Reading Evaluation on Romanian and EnglishFaculty of Computer Science
 
Digital Professionalism 2013
Digital Professionalism 2013Digital Professionalism 2013
Digital Professionalism 2013Christopher Pell
 
Anatomically Correct Big
Anatomically Correct BigAnatomically Correct Big
Anatomically Correct BigLaura F. Sfiat
 
Presentation Neuville
Presentation NeuvillePresentation Neuville
Presentation Neuvillepdelabriffe
 
[ French Humour Blague Drole Fun Joke] Au Boulot
[ French Humour Blague Drole Fun Joke]  Au Boulot[ French Humour Blague Drole Fun Joke]  Au Boulot
[ French Humour Blague Drole Fun Joke] Au Boulotguest5128d5
 
Code De La Route
Code De La RouteCode De La Route
Code De La Routeguest5128d5
 

Viewers also liked (14)

Menus scolarest-avril-2012
Menus scolarest-avril-2012Menus scolarest-avril-2012
Menus scolarest-avril-2012
 
A Distributed Architecture System for Recognizing Textual Entailment
A Distributed Architecture System for Recognizing Textual EntailmentA Distributed Architecture System for Recognizing Textual Entailment
A Distributed Architecture System for Recognizing Textual Entailment
 
Email, apps and SoMe for psychiatrists
Email, apps and SoMe for psychiatristsEmail, apps and SoMe for psychiatrists
Email, apps and SoMe for psychiatrists
 
Using opinion mining techniques for early crisis detection
Using opinion mining techniques for early crisis detectionUsing opinion mining techniques for early crisis detection
Using opinion mining techniques for early crisis detection
 
Question Answering for Machine Reading Evaluation on Romanian and English
Question Answering for Machine Reading Evaluation on Romanian and EnglishQuestion Answering for Machine Reading Evaluation on Romanian and English
Question Answering for Machine Reading Evaluation on Romanian and English
 
Digital Professionalism 2013
Digital Professionalism 2013Digital Professionalism 2013
Digital Professionalism 2013
 
Vocabulari de les flors
Vocabulari de les florsVocabulari de les flors
Vocabulari de les flors
 
Anatomically Correct Big
Anatomically Correct BigAnatomically Correct Big
Anatomically Correct Big
 
Digital professionalism
Digital professionalismDigital professionalism
Digital professionalism
 
Illustration
IllustrationIllustration
Illustration
 
Presentation Neuville
Presentation NeuvillePresentation Neuville
Presentation Neuville
 
Cluedo Géant
Cluedo GéantCluedo Géant
Cluedo Géant
 
[ French Humour Blague Drole Fun Joke] Au Boulot
[ French Humour Blague Drole Fun Joke]  Au Boulot[ French Humour Blague Drole Fun Joke]  Au Boulot
[ French Humour Blague Drole Fun Joke] Au Boulot
 
Code De La Route
Code De La RouteCode De La Route
Code De La Route
 

Similar to UAIC Participation at RTE4

Tac2009 rte5
Tac2009 rte5Tac2009 rte5
Tac2009 rte5bringiton
 
Cs221 lecture3-fall11
Cs221 lecture3-fall11Cs221 lecture3-fall11
Cs221 lecture3-fall11darwinrlo
 
Quantitative Methods for Lawyers - Class #14 - Power Laws, Hypothesis Testing...
Quantitative Methods for Lawyers - Class #14 - Power Laws, Hypothesis Testing...Quantitative Methods for Lawyers - Class #14 - Power Laws, Hypothesis Testing...
Quantitative Methods for Lawyers - Class #14 - Power Laws, Hypothesis Testing...Daniel Katz
 
Critical Thinking 03 consistency
Critical Thinking 03 consistencyCritical Thinking 03 consistency
Critical Thinking 03 consistencythisisnotatextbook
 
QUESTION 11. In argument analysis, the remarks and comments that.docx
QUESTION 11. In argument analysis, the remarks and comments that.docxQUESTION 11. In argument analysis, the remarks and comments that.docx
QUESTION 11. In argument analysis, the remarks and comments that.docxmakdul
 
Bill howe 6_machinelearning_1
Bill howe 6_machinelearning_1Bill howe 6_machinelearning_1
Bill howe 6_machinelearning_1Mahammad Valiyev
 
Math Project Presentation New
Math Project Presentation NewMath Project Presentation New
Math Project Presentation Newguestf89f47
 
IN ORDER TO IMPLEMENT A SET OF RULES / TUTORIALOUTLET DOT COM
IN ORDER TO IMPLEMENT A SET OF RULES / TUTORIALOUTLET DOT COMIN ORDER TO IMPLEMENT A SET OF RULES / TUTORIALOUTLET DOT COM
IN ORDER TO IMPLEMENT A SET OF RULES / TUTORIALOUTLET DOT COMjorge0050
 
Synoptic paper 2011
Synoptic paper 2011Synoptic paper 2011
Synoptic paper 2011Miss Hart
 

Similar to UAIC Participation at RTE4 (10)

Tac2009 rte5
Tac2009 rte5Tac2009 rte5
Tac2009 rte5
 
Cs221 lecture3-fall11
Cs221 lecture3-fall11Cs221 lecture3-fall11
Cs221 lecture3-fall11
 
Quantitative Methods for Lawyers - Class #14 - Power Laws, Hypothesis Testing...
Quantitative Methods for Lawyers - Class #14 - Power Laws, Hypothesis Testing...Quantitative Methods for Lawyers - Class #14 - Power Laws, Hypothesis Testing...
Quantitative Methods for Lawyers - Class #14 - Power Laws, Hypothesis Testing...
 
Critical Thinking 03 consistency
Critical Thinking 03 consistencyCritical Thinking 03 consistency
Critical Thinking 03 consistency
 
QUESTION 11. In argument analysis, the remarks and comments that.docx
QUESTION 11. In argument analysis, the remarks and comments that.docxQUESTION 11. In argument analysis, the remarks and comments that.docx
QUESTION 11. In argument analysis, the remarks and comments that.docx
 
TEST of hypothesis
TEST of hypothesisTEST of hypothesis
TEST of hypothesis
 
Bill howe 6_machinelearning_1
Bill howe 6_machinelearning_1Bill howe 6_machinelearning_1
Bill howe 6_machinelearning_1
 
Math Project Presentation New
Math Project Presentation NewMath Project Presentation New
Math Project Presentation New
 
IN ORDER TO IMPLEMENT A SET OF RULES / TUTORIALOUTLET DOT COM
IN ORDER TO IMPLEMENT A SET OF RULES / TUTORIALOUTLET DOT COMIN ORDER TO IMPLEMENT A SET OF RULES / TUTORIALOUTLET DOT COM
IN ORDER TO IMPLEMENT A SET OF RULES / TUTORIALOUTLET DOT COM
 
Synoptic paper 2011
Synoptic paper 2011Synoptic paper 2011
Synoptic paper 2011
 

More from Faculty of Computer Science

More from Faculty of Computer Science (11)

Using Artificial Intelligence in Software Engineering
Using Artificial Intelligence in Software EngineeringUsing Artificial Intelligence in Software Engineering
Using Artificial Intelligence in Software Engineering
 
Eye and Voice Control for an Augmented Reality Cooking Experience
Eye and Voice Control for an Augmented Reality Cooking ExperienceEye and Voice Control for an Augmented Reality Cooking Experience
Eye and Voice Control for an Augmented Reality Cooking Experience
 
Learn Chemistry with Augmented Reality
Learn Chemistry with Augmented RealityLearn Chemistry with Augmented Reality
Learn Chemistry with Augmented Reality
 
Exploiting Social Networks. Technological Trends
Exploiting Social Networks. Technological TrendsExploiting Social Networks. Technological Trends
Exploiting Social Networks. Technological Trends
 
Augmented Reality in Education
Augmented Reality in EducationAugmented Reality in Education
Augmented Reality in Education
 
Diversification in an Image Retrieval System
Diversification in an Image Retrieval SystemDiversification in an Image Retrieval System
Diversification in an Image Retrieval System
 
Augmented reality
Augmented realityAugmented reality
Augmented reality
 
I See You, You Can't See Me: On People's Perception About Surveillance In Po...
I See You, You Can't See Me: On People's Perception About Surveillance In Po...I See You, You Can't See Me: On People's Perception About Surveillance In Po...
I See You, You Can't See Me: On People's Perception About Surveillance In Po...
 
Identify Experts from a Domain of Interest
Identify Experts from a Domain of Interest Identify Experts from a Domain of Interest
Identify Experts from a Domain of Interest
 
Question Answering on Romanian, English and French Languages
Question Answering on Romanian, English and French LanguagesQuestion Answering on Romanian, English and French Languages
Question Answering on Romanian, English and French Languages
 
Graph Coloring using Peer-to-Peer Networks
Graph Coloring using Peer-to-Peer NetworksGraph Coloring using Peer-to-Peer Networks
Graph Coloring using Peer-to-Peer Networks
 

Recently uploaded

7.pdf This presentation captures many uses and the significance of the number...
7.pdf This presentation captures many uses and the significance of the number...7.pdf This presentation captures many uses and the significance of the number...
7.pdf This presentation captures many uses and the significance of the number...Paul Menig
 
Call Girls in Gomti Nagar - 7388211116 - With room Service
Call Girls in Gomti Nagar - 7388211116  - With room ServiceCall Girls in Gomti Nagar - 7388211116  - With room Service
Call Girls in Gomti Nagar - 7388211116 - With room Servicediscovermytutordmt
 
Monte Carlo simulation : Simulation using MCSM
Monte Carlo simulation : Simulation using MCSMMonte Carlo simulation : Simulation using MCSM
Monte Carlo simulation : Simulation using MCSMRavindra Nath Shukla
 
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...lizamodels9
 
Intro to BCG's Carbon Emissions Benchmark_vF.pdf
Intro to BCG's Carbon Emissions Benchmark_vF.pdfIntro to BCG's Carbon Emissions Benchmark_vF.pdf
Intro to BCG's Carbon Emissions Benchmark_vF.pdfpollardmorgan
 
Call Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine ServiceCall Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine Serviceritikaroy0888
 
A DAY IN THE LIFE OF A SALESMAN / WOMAN
A DAY IN THE LIFE OF A  SALESMAN / WOMANA DAY IN THE LIFE OF A  SALESMAN / WOMAN
A DAY IN THE LIFE OF A SALESMAN / WOMANIlamathiKannappan
 
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...Dipal Arora
 
VIP Call Girl Jamshedpur Aashi 8250192130 Independent Escort Service Jamshedpur
VIP Call Girl Jamshedpur Aashi 8250192130 Independent Escort Service JamshedpurVIP Call Girl Jamshedpur Aashi 8250192130 Independent Escort Service Jamshedpur
VIP Call Girl Jamshedpur Aashi 8250192130 Independent Escort Service JamshedpurSuhani Kapoor
 
M.C Lodges -- Guest House in Jhang.
M.C Lodges --  Guest House in Jhang.M.C Lodges --  Guest House in Jhang.
M.C Lodges -- Guest House in Jhang.Aaiza Hassan
 
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdfRenandantas16
 
Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023Neil Kimberley
 
Insurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usageInsurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usageMatteo Carbone
 
VIP Call Girls Pune Kirti 8617697112 Independent Escort Service Pune
VIP Call Girls Pune Kirti 8617697112 Independent Escort Service PuneVIP Call Girls Pune Kirti 8617697112 Independent Escort Service Pune
VIP Call Girls Pune Kirti 8617697112 Independent Escort Service PuneCall girls in Ahmedabad High profile
 
Sales & Marketing Alignment: How to Synergize for Success
Sales & Marketing Alignment: How to Synergize for SuccessSales & Marketing Alignment: How to Synergize for Success
Sales & Marketing Alignment: How to Synergize for SuccessAggregage
 
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...lizamodels9
 
GD Birla and his contribution in management
GD Birla and his contribution in managementGD Birla and his contribution in management
GD Birla and his contribution in managementchhavia330
 
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call GirlsCash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call GirlsApsara Of India
 

Recently uploaded (20)

7.pdf This presentation captures many uses and the significance of the number...
7.pdf This presentation captures many uses and the significance of the number...7.pdf This presentation captures many uses and the significance of the number...
7.pdf This presentation captures many uses and the significance of the number...
 
Call Girls in Gomti Nagar - 7388211116 - With room Service
Call Girls in Gomti Nagar - 7388211116  - With room ServiceCall Girls in Gomti Nagar - 7388211116  - With room Service
Call Girls in Gomti Nagar - 7388211116 - With room Service
 
Monte Carlo simulation : Simulation using MCSM
Monte Carlo simulation : Simulation using MCSMMonte Carlo simulation : Simulation using MCSM
Monte Carlo simulation : Simulation using MCSM
 
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
 
Intro to BCG's Carbon Emissions Benchmark_vF.pdf
Intro to BCG's Carbon Emissions Benchmark_vF.pdfIntro to BCG's Carbon Emissions Benchmark_vF.pdf
Intro to BCG's Carbon Emissions Benchmark_vF.pdf
 
Call Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine ServiceCall Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine Service
 
A DAY IN THE LIFE OF A SALESMAN / WOMAN
A DAY IN THE LIFE OF A  SALESMAN / WOMANA DAY IN THE LIFE OF A  SALESMAN / WOMAN
A DAY IN THE LIFE OF A SALESMAN / WOMAN
 
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
 
VIP Call Girl Jamshedpur Aashi 8250192130 Independent Escort Service Jamshedpur
VIP Call Girl Jamshedpur Aashi 8250192130 Independent Escort Service JamshedpurVIP Call Girl Jamshedpur Aashi 8250192130 Independent Escort Service Jamshedpur
VIP Call Girl Jamshedpur Aashi 8250192130 Independent Escort Service Jamshedpur
 
M.C Lodges -- Guest House in Jhang.
M.C Lodges --  Guest House in Jhang.M.C Lodges --  Guest House in Jhang.
M.C Lodges -- Guest House in Jhang.
 
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
 
Best Practices for Implementing an External Recruiting Partnership
Best Practices for Implementing an External Recruiting PartnershipBest Practices for Implementing an External Recruiting Partnership
Best Practices for Implementing an External Recruiting Partnership
 
Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝
 
Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023
 
Insurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usageInsurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usage
 
VIP Call Girls Pune Kirti 8617697112 Independent Escort Service Pune
VIP Call Girls Pune Kirti 8617697112 Independent Escort Service PuneVIP Call Girls Pune Kirti 8617697112 Independent Escort Service Pune
VIP Call Girls Pune Kirti 8617697112 Independent Escort Service Pune
 
Sales & Marketing Alignment: How to Synergize for Success
Sales & Marketing Alignment: How to Synergize for SuccessSales & Marketing Alignment: How to Synergize for Success
Sales & Marketing Alignment: How to Synergize for Success
 
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
 
GD Birla and his contribution in management
GD Birla and his contribution in managementGD Birla and his contribution in management
GD Birla and his contribution in management
 
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call GirlsCash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
 

UAIC Participation at RTE4

  • 1. UAIC Participation at RTE4 Adrian Iftene [email_address] „ Al. I. Cuza“ University, Iasi, Romania Faculty of Computer Science
  • 2.
  • 3.
  • 4. System presentation Initial data Minipar module Final result NE Rule Negation Rules Acronyms Background knowledge eXtended Wordnet GATE VerbOcean Numbers & Dates Contradiction Rules In RTE-3 competition Two-way 69.13 % Three-way 54.7 % After RTE-3 competition Test Data 2007: Two-way 74.1 % Three-way 71.8 % Test Data 2008 : Two-way 72.1 % Three-way 68.5 % Fitness Rule Main module TreeTagger Resources DIRT Dependency trees for (T, H) pairs LingPipe module Named entities for (T, H) pairs Wikipedia
  • 5. Example NE (N) subj loc adv (A) subj mod … … NE (N) loc … … DIRT, VerbOcean WordNet Acronyms, BK DIRT: solve=resolve 0.31453 DIRT: convict=arrest 0.28895 DIRT: convict=acquit 0.302455,OPPOSITE VerbOcean: increase<>decrease, VerbOcean: leave<>stay WordNet: trouble=problem WordNet: talk=discussion Acronym: EU=European Union BK: Buenos Aires [in] Argentine BK: 16 [is] sixteen Hypothesis Text verb H (V) noun (N) verb T (V) noun (N) … … … …
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18. Results in RTE4 68.50% 1000 685 1000 Total 54.25% 42.86% 73.89% 203 150 350 Unknown 58.72% 46.00% 81.18% 85 69 150 Contradiction 76.90% 93.20% 65.45% 712 466 500 Entailment F-measure Recall Precision Total offered by our system Correct offered by our system In Gold Answer Type 72.10% 1000 721 1000 Total 64.72% 51.00% 88.54% 288 255 500 No 76.90% 93.20% 65.45% 712 466 500 Yes F-measure Recall Precision Total offered by our system Correct offered by our system In Gold Answer Type
  • 19. Comparison with RTE-3 To be able to see each component’s relevance, the systems were run in turn with each component removed 5.55 % 68.10 % - - Without Contradiction rule 7.21 % 66.90 % 16.71 % 57.58 % Without NE rule 4.72 % 68.70 % 2.17 % 67.63 % Without Negation rule 2.36 % 70.40 % 2.00 % 67.75 % Without BK 0.42 % 71.80 % 1.08 % 68.38 % Without Acronyms 4.16 % 69.10 % 1.63 % 68.00 % Without WordNet 0.97 % 71.40 % 0.54 % 68.76 % Without DIRT Relevance Precision Relevance Precision RTE-4 RTE-3 System Description
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.