GATE
General Architecture
for Text Engineering

           Presented by Ahmed Magdy Ezzeldin
What is Text Engineering?




●   Text or Language Engineering means applying
    scientific principles to the design, construction and
    maintenance of tools to help deal with information
    that has been expressed in natural languages
    (the languages that people use for communicating
    with one another).
Applications
●   Automatic summarization
●   Co-reference resolution
●   Discourse analysis (elaboration, explanation, contrast, question, statement, assertion)
●   Machine translation
●   Morphological segmentation
●   Named entity recognition
●   Natural language generation
●   Natural language understanding
●   Optical character recognition (OCR)
●   Part-of-speech tagging
●   Parsing
●   Question answering
●   Relationship extraction
●   Sentiment analysis (Polarity)
●   Speech recognition (Speech segmentation)
●   Sentence breaking, Word segmentation, Topic segmentation
●   Word sense disambiguation
What is GATE?

●   General Architecture for Text Engineering
●   Java suite of NLP tools
●   University of Sheffield
●   Initial Release 1995 (17 years ago)
●   Last Stable Release 6.1 May 6, 2011
●   Languages : English, Spanish, Chinese, Arabic, Bulgarian, French,
    German, Hindi, Italian, Cebuano, Romanian, Russian.
●   Accepted Input Formats TXT, HTML, XML, Doc, PDF and Java
    Serial, PostgreSQL, Lucene, Oracle Databases
●   GATE Developer which is a GATE graphical user interface, like
    Eclipse for Java programmers, provides a graphical environment for
    research and development of language processing software.
Gate Components and APIs
ANNIE GATE Application

●   A Nearly-New Information Extraction System
●   Example Application for English Language Engineering
●   A set of modules:
    ●   Tokenizer
    ●   Gazetteer
    ●   Sentence splitter
    ●   Part-of-speech tagger
    ●   Named entities transducer
    ●   Co-reference tagger.
ANNIE Architecture
Demos

●   ANNIE Gazetteer: A list lookup component. The list files are
    located in $GATE_HOME/plugins/ANNIE/resources/gazetteer
●   JAPE Transducer: JAPE is a Java Annotation Patterns Engine.
    JAPE provides finite state transduction over annotations based
    on regular expressions. Example files are located in
    $GATE_HOME/plugins/ANNIE/resources/NE
●   ANNIE NE Transducer: (ANNIE named entity grammar) a
    semantic tagger based on the JAPE language.
Mimir

●   Provides indexing and searching the linguistic
    and semantic information generated by GATE


                     Demo
Installing Mimir
●   Open GATE and Load ANNIE Systems with
    Defaults
●   Then click the
    Manage CREOLE
    Plug-ins
Add Mimir Client Path
●   Add Mimir as a Plugin and set mimir-client directory
●   Make sure Mimir Plugin is loaded now and every
    time you open GATE
●   Add Mimir Indexing PR to
    Processing Resources
●   Create a New Corpus from Language Resource
●   Right Click the Corpus and populate it with Documents
Edit the Default Index Template

●   Open http://localhost:8080/mimir-demo in your
    browser and go to the configuration page
●   Then go to the Index Templates section and
    manage them
●   Then Click on the default Index Template to edit it.
Add some annotations to the Default Index Template
Add a new Index
Edit the Index you created and set the Scorer Algorithm
        (1)



                                  (2)


                                                     (3)
Copy the Index URL
Paste Index URL in Mimir and Run ANNIE on the Corpus
Double click any document and check Annotations yourself
Close and Search the Index

                             (1)




           (2)
Example Query
Thank you
References




               GATE Website (it is huge)
                 http://gate.ac.uk



              Mother of all Knowledge
             http://www.wikipedia.com

GATE : General Architecture for Text Engineering

  • 1.
    GATE General Architecture for TextEngineering Presented by Ahmed Magdy Ezzeldin
  • 2.
    What is TextEngineering? ● Text or Language Engineering means applying scientific principles to the design, construction and maintenance of tools to help deal with information that has been expressed in natural languages (the languages that people use for communicating with one another).
  • 3.
    Applications ● Automatic summarization ● Co-reference resolution ● Discourse analysis (elaboration, explanation, contrast, question, statement, assertion) ● Machine translation ● Morphological segmentation ● Named entity recognition ● Natural language generation ● Natural language understanding ● Optical character recognition (OCR) ● Part-of-speech tagging ● Parsing ● Question answering ● Relationship extraction ● Sentiment analysis (Polarity) ● Speech recognition (Speech segmentation) ● Sentence breaking, Word segmentation, Topic segmentation ● Word sense disambiguation
  • 4.
    What is GATE? ● General Architecture for Text Engineering ● Java suite of NLP tools ● University of Sheffield ● Initial Release 1995 (17 years ago) ● Last Stable Release 6.1 May 6, 2011 ● Languages : English, Spanish, Chinese, Arabic, Bulgarian, French, German, Hindi, Italian, Cebuano, Romanian, Russian. ● Accepted Input Formats TXT, HTML, XML, Doc, PDF and Java Serial, PostgreSQL, Lucene, Oracle Databases ● GATE Developer which is a GATE graphical user interface, like Eclipse for Java programmers, provides a graphical environment for research and development of language processing software.
  • 5.
  • 6.
    ANNIE GATE Application ● A Nearly-New Information Extraction System ● Example Application for English Language Engineering ● A set of modules: ● Tokenizer ● Gazetteer ● Sentence splitter ● Part-of-speech tagger ● Named entities transducer ● Co-reference tagger.
  • 7.
  • 8.
    Demos ● ANNIE Gazetteer: A list lookup component. The list files are located in $GATE_HOME/plugins/ANNIE/resources/gazetteer ● JAPE Transducer: JAPE is a Java Annotation Patterns Engine. JAPE provides finite state transduction over annotations based on regular expressions. Example files are located in $GATE_HOME/plugins/ANNIE/resources/NE ● ANNIE NE Transducer: (ANNIE named entity grammar) a semantic tagger based on the JAPE language.
  • 9.
    Mimir ● Provides indexing and searching the linguistic and semantic information generated by GATE Demo
  • 10.
  • 11.
    Open GATE and Load ANNIE Systems with Defaults ● Then click the Manage CREOLE Plug-ins
  • 12.
    Add Mimir ClientPath ● Add Mimir as a Plugin and set mimir-client directory
  • 13.
    Make sure Mimir Plugin is loaded now and every time you open GATE
  • 14.
    Add Mimir Indexing PR to Processing Resources
  • 15.
    Create a New Corpus from Language Resource
  • 16.
    Right Click the Corpus and populate it with Documents
  • 17.
    Edit the DefaultIndex Template ● Open http://localhost:8080/mimir-demo in your browser and go to the configuration page ● Then go to the Index Templates section and manage them ● Then Click on the default Index Template to edit it.
  • 18.
    Add some annotationsto the Default Index Template
  • 19.
    Add a newIndex
  • 20.
    Edit the Indexyou created and set the Scorer Algorithm (1) (2) (3)
  • 21.
  • 22.
    Paste Index URLin Mimir and Run ANNIE on the Corpus
  • 23.
    Double click anydocument and check Annotations yourself
  • 24.
    Close and Searchthe Index (1) (2)
  • 25.
  • 26.
  • 27.
    References GATE Website (it is huge) http://gate.ac.uk Mother of all Knowledge http://www.wikipedia.com