Your SlideShare is downloading. ×
0
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Incremental Evolving Grammar Fragments
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Incremental Evolving Grammar Fragments

458

Published on

IFSA/EUFSLAT 2009

IFSA/EUFSLAT 2009

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
458
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009 Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009
  • Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009 Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009
  • Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009 Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009
  • Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009 Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009
  • Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009 Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009
  • Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009 Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009
  • Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009 Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009
  • Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009 Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009
  • Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009 Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009
  • Transcript

    • 1. Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning Nurfadhlina Mohd Sharef, Trevor Martin, Yun Shen Artificial Intelligence Group, University of Bristol, BS8 1TR UK [email_address] , [email_address] , [email_address]
    • 2. <ul><li>Outline </li></ul><ul><li>Background of problem </li></ul><ul><li>Literature review </li></ul><ul><li>Fuzzy text pattern learning </li></ul><ul><li>Grammar Combination </li></ul><ul><li>Independent Order Grammar Learning </li></ul><ul><li>Conclusion </li></ul>Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09
    • 3. <ul><li>Text Fragments Structure </li></ul><ul><li>Text Fragment Patterns </li></ul><ul><ul><li>Similar but not identical </li></ul></ul><ul><ul><li>Less Structured </li></ul></ul><ul><ul><li>Text segments and simple sentences </li></ul></ul><ul><li>Application: Instance matching, Dialogue system, Question Answering, etc </li></ul>Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09
    • 4. <ul><li>Existing Approaches </li></ul><ul><li>full language model </li></ul><ul><li>tagging-based information extraction </li></ul><ul><li>document distributions and statistical model </li></ul><ul><li>evolutionary genetic algorithms </li></ul><ul><li>Schema/structure matching </li></ul>Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09
    • 5. <ul><li>Grammars for Postal Address </li></ul><ul><ul><li>number, street name , town, postCode </li></ul></ul><ul><ul><li>‘ 21 London Rd Ipswich Suffolk IP1 2EZ’ </li></ul></ul><ul><li>And others: </li></ul><ul><ul><li>‘ 29 Meredith Rd Ipswich’ </li></ul></ul><ul><ul><li>number, street name,town </li></ul></ul><ul><ul><li>‘ Belfairs Hotel 33 Graham Rd Ipswich’ </li></ul></ul><ul><ul><li>word, business, number, street name, town </li></ul></ul><ul><ul><li>mamma&apos;s pizza 46 st.matthews st ipswich </li></ul></ul><ul><ul><li>beautiful designs 8 norwich rd ipswich </li></ul></ul>Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09
    • 6. <ul><li>Learning Fuzzy Grammar Fragments </li></ul><ul><li>“ To investigate </li></ul><ul><li>an incremental evolving fuzzy grammar fragment learning </li></ul><ul><li>with independent-order feature” </li></ul>Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09
    • 7. <ul><li>ISSUES </li></ul><ul><li>Grammar Variety- incremental evolving </li></ul><ul><li>Grammar Derivation- fuzzy grammar, fuzzy membership </li></ul><ul><li>Grammar Similarity- fuzzy grammar similarity </li></ul><ul><li>Grammar combination- maximal, minimal, flexible, compact </li></ul><ul><li>Flexible- independent order </li></ul>Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09
    • 8. <ul><li>Fuzzy Approach for Text Pattern Learning </li></ul><ul><li>Fuzzy Membership </li></ul><ul><ul><li>relation between </li></ul></ul><ul><ul><li>text and the grammar </li></ul></ul><ul><ul><li>fragment </li></ul></ul><ul><li>Fuzzy Grammar </li></ul><ul><li>Similarity </li></ul><ul><ul><li>Distance </li></ul></ul><ul><ul><li>between grammars </li></ul></ul><ul><ul><li>&lt;I D S Rs Rt&gt; </li></ul></ul>Figure 5: Partial Order Table for UK Address Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09
    • 9. <ul><li>Grammar Similarity </li></ul>Table 1: Example of string edit distance operation (*I:Insert, D:Delete, S:Substitute) Table 2: Example of Grammar Edit Distance Operation (*I:Insert, D:Delete, S:Substitute) Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09 Source string W E D N E S D A Y Target string T U E S D A Y Edit distance* S=1 S=1 D=1 D=1 = = = = = Source grammar Number Word Word Streetending Placename Target grammar Number Placename Streetending Placename Countyname Edit distance* = S=1 D=1 = = I=1
    • 10. <ul><li>Grammar Learning </li></ul>Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09 Start s=new string maxMem=membership(s,TG) maxMem&lt;1? costST=costTS=1 Y gx=Combine(sg,tg) costST=1 &amp;&amp; costTS=0 gx=sg N Y N costST=0 &amp;&amp; costTS=1 gx=tg Y Update TG: GTj={GTj-1-gti} union {gx} gx=sg N sg=deriveGrammar(s) tg=target grammar with maxMem costST=grammarSimilarity(sg,tg) costTS=grammarSimilarity (tg,sg) End Y N
    • 11. <ul><li>Minimal Combination Algorithm </li></ul>Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09 Source Grammar Target Grammar Cost (Source, Target) Cost (Target, Source) Combination Operation Combined grammar a-b-c a-b 0 1 0 - - 1 0 0 - - Insert a-b-[c] a-b a-b-c 1 0 0 - - 0 1 0 - - Insert a-b-[c] a-b-c a-B-c 0 0 0 - - 0 0 1 - - Merge a-B-c, B&gt;b a-B-c a-b-c 0 0 1 - - 0 0 0 - - Merge a-B-c, B&gt;b a-F-c a-G-c 0 0 1 - - 0 0 1 - - Create a-X-c , X:=F||G,
    • 12. <ul><li>Experiment-Parsing Coverage </li></ul><ul><li>Data </li></ul><ul><ul><li>Restaurant.xml </li></ul></ul><ul><ul><li>and yellowpages.xml </li></ul></ul><ul><li>Setting </li></ul><ul><ul><li>25% train, 75% test </li></ul></ul><ul><li>Parameters </li></ul><ul><ul><li># max parsing of </li></ul></ul><ul><ul><li>each string </li></ul></ul><ul><ul><li># max parsing by </li></ul></ul><ul><ul><li>each grammar </li></ul></ul>FG: Fuzzy Grammar IEG: Incremental Evolving Fuzzy Grammar Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09 Setting Dataset Average Maximum Parsing (%) FG Restaurant 89.5 IEG Restaurant 100 FG Yellowpages 97 IEG Yellowpages 100
    • 13. <ul><li>Experiment-Independent Order Grammar Learning </li></ul><ul><li>To compare parsing coverage </li></ul><ul><li>of grammars generated from different orders </li></ul>G1: a a b c G2: b a c G3: a c G4: a a c G5: a a a Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09 Order 1: G 1-G2-G3-G4-G5 Order 2: G 4-G5-G2-G1-G3 Order 3: G 2-G4-G1-G3-G5 a a [b] c (1+4) a a a (4+5) (b||a) a c (2+4) [b] a c (2+3) [b] a c (2+3) a a b c (1) a a a (5) a a b c (1) a c (3) a a a (5)
    • 14. <ul><li>Conclusion and Future Work </li></ul><ul><li>Incremental evolving fuzzy grammar fragment learning with independent-order effect </li></ul><ul><li>Latest Achievements </li></ul><ul><ul><li>Formal proving of independent order in minimal combination </li></ul></ul><ul><ul><li>Flexible Combination and formal proving </li></ul></ul><ul><ul><li>Preliminary Theme Classification </li></ul></ul><ul><li>More Future Works </li></ul><ul><ul><li>Focus on softer structures for grammar learning and theme classification </li></ul></ul>Minimal Combination for Incremental Evolving Fuzzy Grammar Fragment Learning, IFSA 09

    ×