SlideShare a Scribd company logo

Massive Multilingual Named Entity Recognition Using Polyglot-NER

•
•
Bryan Perozzi
Bryan Perozzi

The increasing diversity of languages used on the web introduces a new level of complexity to Information Retrieval (IR) systems. We can no longer assume that textual content is written in one language or even the same language family. In this paper, we demonstrate how to build massive multilingual annotators with minimal human expertise and intervention. We describe a system that builds Named Entity Recognition (NER) annotators for 40 major languages using Wikipedia and Freebase. Our approach does not require NER human annotated datasets or language specific resources like treebanks, parallel corpora, and orthographic rules. The novelty of approach lies therein - using only language agnostic techniques, while achieving competitive performance. Our method learns distributed word representations (word embeddings) which encode semantic and syntactic features of words in each language. Then, we automatically generate datasets from Wikipedia link structure and Freebase attributes. Finally, we apply two preprocessing stages (oversampling and exact surface form matching) which do not require any linguistic expertise. Our evaluation is two fold: First, we demonstrate the system performance on human annotated datasets. Second, for languages where no gold-standard benchmarks are available, we propose a new method, distant evaluation, based on statistical machine translation.

Science
1 of 26
Download to read offline
Polyglot-NER: Massive Multilingual Named Entity Recognition SDM May 2, 2015 Rami Al-Rfou, Vivek Kulkarni, Bryan Perozzi, Steve Skiena Stony Brook University
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Named Entity Recognition (NER) Problem ■Input: Plain text, T ■Output: The spans of T that constitute proper names, and the classification of the entity’s type.
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition NER Examples Input: Vancouver is a coastal seaport city on the mainland of British Columbia. The city's mayor is Gregor Robertson. Output: Vancouver is a coastal seaport city on the mainland of British Columbia. The city's mayor is Gregor Robertson. Location Location Person
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Multilingual NER ❑NLTK ■ English ❑Stanford ■ English, Spanish, Chinese, Arabic ❑OpenNLP ■ English, German, Dutch, Spanish ❑Polyglot-NER ■ 40 Major Languages! (English, Spanish, French, German, Russian, Polish, Portuguese, Italian, Dutch, Arabic, Hebrew, Hindi, Korean, Japanese, Vietnamese, …) While many pipelines exist, most languages are unsupported
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Does Multilingual Matter? Yes! Only 55% of the top 10 million websites are in English! [1] There are 51 languages on Wikipedia with 100,000+ articles. [2] [1] http://w3techs.com/technologies/history_overview/content_language/ms/y [2] http://meta.wikimedia.org/wiki/List_of_Wikipedias
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Multilingual is Hard Feature Scarcity NLP tasks typically rely on language-specific feature engineering ❑ Orthographic features ❑ Part of Speech Tags ❑ Parallel Corpora ❑ WordNet Annotation Scarcity Need NER examples - labeled data is expensive. Our solution: neural word embeddings. Our solution: Wikipedia/Freebase for training examples
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Sub-problem: Word Representation Input: Unstructured text Output: Low dimensional word embeddings
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Distributed Word Representations Big Idea: Give similar words similar representations pine oak rose daisy reading writing read write |V| |V|: size of vocabulary pine oak rose daisy reading writing read write d d << |V| Similar words share similar representations. Latent Dimensions Explicit Dimensions
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Polyglot Embeddings ● Wikipedia article text ● 137 Languages ● Available: ○ http://bit.ly/embeddings [Al-Rfou, Perozzi, Skiena, 13] C Imagination C is C greater C than C detail Score Hidden Layer H Projection Layer
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Sub-Problem: Annotation Mining Input: Wikipedia, Freebase Output: Labeled NER training examples
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Related Work
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Annotations from Wikipedia Inter-wiki links are a great potential source of mentions. WikipediaFreebase Freebase tells us which articles are entity articles.
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Example Wiki Text: Vancouver is a coastal seaport city on the mainland of British Columbia. The city's mayor is Gregor Robertson. “Vancouver” “British Columbia” “Gregor Robertson” Strings /m/080h2 /m/015jr /m/0grlms Freebase MID City Region Person Freebase Category Location Location Person NER Label
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition The Bad News Many false negatives in our dataset! ■ Wikipedia editors annotate only the first mention of an entity but not later ones. ■ Most of the named entity mentions are not linked! Example: Vancouver is a coastal seaport city on the mainland of British Columbia. Vancouver’s mayor is Gregor Robertson.
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition The Good News Positive labels are very high quality! Need to emphasize this in our training. ? ? ? ? ? ? ? ‘Learning Classifiers from only positive and unlabeled examples’ [Elkin & Noto, 08]
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition The trick: Oversampling p We can change the label distribution by oversampling from the positive labels. p is the percentage of positive labels in the training dataset. Initially no oversampling p = 0.5, much better
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Cross-Domain Performance Oversampling Oversampling + Exact Matching Cross-Domain Testing on CoNLL
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition NER Demo @ http://bit.ly/polyglot-ner Legend: Location Organization Person
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition But How to Evaluate? ■We have labeled data for a few languages ■Would like to evaluate everything
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Distant Evaluation John proviene de la ciudad de Nueva York. John is coming from New York City. Machine Translation Calculate the error of omitting entities and the error of adding entities. Person: 1 Location: 1 Organization: 0 Person: 0 Location: 1 Organization: 1 1 1
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Experimental Design Distant Evaluation for Polyglot-NER: 1. Annotate English Wikipedia sentences using Stanford NER. 2. Randomly pick 1500 sentences that have at least one entity detected. 3. Translate these sentences using Google translate to 40 languages. 4. Run Polyglot-NER on the translated datasets. 5. Compare the number of entity chunks our annotators found to the ones detected by Stanford per sentence. 6. Calculate the error of omitting (ℰ 𝓜) and adding entities (ℰ 𝒜)
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Effect of Data Size ■ Size of training data matters! ■ Tokenization is quite important when the word embeddings coverage is limited. # Words (Log Scale) ErrorMissing More Data Will Help Anomalies Good
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Performance by Category ℰ 𝒜: Adding Error ℰ 𝓜: Missing Error Person Location
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Limitations ■Named entities don’t always translate well: ❑Ex: “Γείτονας Shanna Rudd δήλωσε στο CNN …” ■Need a working translation system for the language
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Take-aways ■NER in 40 languages! ■Word embeddings & oversampling offers equal or better performance to feature engineering for NER annotation mining. ■Translation based evaluation?
Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Thanks! NER Demo: http://bit.ly/polyglot-ner NER Code: http://polyglot-nlp.com bperozzi@cs.stonybrook.edu www.perozzi.net Bryan Perozzi

Recommended

Nlp toolkits and_preprocessing_techniques
Nlp toolkits and_preprocessing_techniquesNlp toolkits and_preprocessing_techniques
Nlp toolkits and_preprocessing_techniquesankit_ppt
 
Lecture: Question Answering
Lecture: Question AnsweringLecture: Question Answering
Lecture: Question AnsweringMarina Santini
 
Word Embeddings, why the hype ?
Word Embeddings, why the hype ? Word Embeddings, why the hype ?
Word Embeddings, why the hype ? Hady Elsahar
 
Transformers in 2021
Transformers in 2021Transformers in 2021
Transformers in 2021Grigory Sapunov
 
Introduction to Named Entity Recognition
Introduction to Named Entity RecognitionIntroduction to Named Entity Recognition
Introduction to Named Entity RecognitionTomer Lieber
 
Introduction to Visual transformers
Introduction to Visual transformers Introduction to Visual transformers
Introduction to Visual transformers leopauly
 
Word embedding
Word embedding Word embedding
Word embedding ShivaniChoudhary74
 
AI-09 Logic in AI
AI-09 Logic in AIAI-09 Logic in AI
AI-09 Logic in AIPankaj Debbarma
 

Recommended

Nlp toolkits and_preprocessing_techniques
Nlp toolkits and_preprocessing_techniquesNlp toolkits and_preprocessing_techniques
Nlp toolkits and_preprocessing_techniquesankit_ppt
 
Lecture: Question Answering
Lecture: Question AnsweringLecture: Question Answering
Lecture: Question AnsweringMarina Santini
 
Word Embeddings, why the hype ?
Word Embeddings, why the hype ? Word Embeddings, why the hype ?
Word Embeddings, why the hype ? Hady Elsahar
 
Transformers in 2021
Transformers in 2021Transformers in 2021
Transformers in 2021Grigory Sapunov
 
Introduction to Named Entity Recognition
Introduction to Named Entity RecognitionIntroduction to Named Entity Recognition
Introduction to Named Entity RecognitionTomer Lieber
 
Introduction to Visual transformers
Introduction to Visual transformers Introduction to Visual transformers
Introduction to Visual transformers leopauly
 
Word embedding
Word embedding Word embedding
Word embedding ShivaniChoudhary74
 
AI-09 Logic in AI
AI-09 Logic in AIAI-09 Logic in AI
AI-09 Logic in AIPankaj Debbarma
 
Deep Natural Language Processing for Search Systems (sigir 2019 tutorial)
Deep Natural Language Processing for Search Systems (sigir 2019 tutorial)Deep Natural Language Processing for Search Systems (sigir 2019 tutorial)
Deep Natural Language Processing for Search Systems (sigir 2019 tutorial)Weiwei Guo
 
Searching on Intent: Knowledge Graphs, Personalization, and Contextual Disamb...
Searching on Intent: Knowledge Graphs, Personalization, and Contextual Disamb...Searching on Intent: Knowledge Graphs, Personalization, and Contextual Disamb...
Searching on Intent: Knowledge Graphs, Personalization, and Contextual Disamb...Trey Grainger
 
2013-1 Machine Learning Lecture 03 - Andrew Moore - probabilistic and baye…
2013-1 Machine Learning Lecture 03 - Andrew Moore - probabilistic and baye…2013-1 Machine Learning Lecture 03 - Andrew Moore - probabilistic and baye…
2013-1 Machine Learning Lecture 03 - Andrew Moore - probabilistic and baye…Dongseo University
 
Bert
BertBert
BertAbdallah Bashir
 
ورشة تضمين الكلمات في التعلم العميق Word embeddings workshop
ورشة تضمين الكلمات في التعلم العميق Word embeddings workshopورشة تضمين الكلمات في التعلم العميق Word embeddings workshop
ورشة تضمين الكلمات في التعلم العميق Word embeddings workshopiwan_rg
 
Sentiment analysis and opinion mining Ch.7
Sentiment analysis and opinion mining Ch.7Sentiment analysis and opinion mining Ch.7
Sentiment analysis and opinion mining Ch.7PC LO
 
눈으로 듣는 음악 추천 시스템
눈으로 듣는 음악 추천 시스템눈으로 듣는 음악 추천 시스템
눈으로 듣는 음악 추천 시스템if kakao
 
Text analysis using python
Text analysis using pythonText analysis using python
Text analysis using pythonVijay Ramachandran
 
임태현, Text-CNN을 이용한 Sentiment 분설모델 구현
임태현, Text-CNN을 이용한 Sentiment 분설모델 구현임태현, Text-CNN을 이용한 Sentiment 분설모델 구현
임태현, Text-CNN을 이용한 Sentiment 분설모델 구현태현 임
 
파이썬을 활용한 챗봇 서비스 개발 3일차
파이썬을 활용한 챗봇 서비스 개발 3일차파이썬을 활용한 챗봇 서비스 개발 3일차
파이썬을 활용한 챗봇 서비스 개발 3일차Taekyung Han
 
NLP_KASHK:Minimum Edit Distance
NLP_KASHK:Minimum Edit DistanceNLP_KASHK:Minimum Edit Distance
NLP_KASHK:Minimum Edit DistanceHemantha Kulathilake
 
LSTM Basics
LSTM BasicsLSTM Basics
LSTM BasicsAkshay Sehgal
 
Neural Architectures for Named Entity Recognition
Neural Architectures for Named Entity RecognitionNeural Architectures for Named Entity Recognition
Neural Architectures for Named Entity RecognitionRrubaa Panchendrarajan
 
텐서플로우로 배우는 딥러닝
텐서플로우로 배우는 딥러닝텐서플로우로 배우는 딥러닝
텐서플로우로 배우는 딥러닝찬웅 주
 
Deep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDeep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDevashish Shanker
 
Processamento de Linguagem Natural
Processamento de Linguagem NaturalProcessamento de Linguagem Natural
Processamento de Linguagem NaturalGustavo Gattass Ayub
 
Transformers in Vision: From Zero to Hero
Transformers in Vision: From Zero to HeroTransformers in Vision: From Zero to Hero
Transformers in Vision: From Zero to HeroBill Liu
 
Dialogue systems and personal assistants
Dialogue systems and personal assistantsDialogue systems and personal assistants
Dialogue systems and personal assistantsNatalia Konstantinova
 
randomwalk.ppt
randomwalk.pptrandomwalk.ppt
randomwalk.pptssusere8264d1
 
Rnn and lstm
Rnn and lstmRnn and lstm
Rnn and lstmShreshth Saxena
 
Currículo Nacional de la Educación Básica
Currículo Nacional de la Educación BásicaCurrículo Nacional de la Educación Básica
Currículo Nacional de la Educación BásicaDiego Ponce de Leon
 
Portafolio de Evidencias de mi Práctica Docente
Portafolio de Evidencias de mi Práctica DocentePortafolio de Evidencias de mi Práctica Docente
Portafolio de Evidencias de mi Práctica DocenteNorma Vega
 

More Related Content

What's hot

Deep Natural Language Processing for Search Systems (sigir 2019 tutorial)
Deep Natural Language Processing for Search Systems (sigir 2019 tutorial)Deep Natural Language Processing for Search Systems (sigir 2019 tutorial)
Deep Natural Language Processing for Search Systems (sigir 2019 tutorial)Weiwei Guo
 
Searching on Intent: Knowledge Graphs, Personalization, and Contextual Disamb...
Searching on Intent: Knowledge Graphs, Personalization, and Contextual Disamb...Searching on Intent: Knowledge Graphs, Personalization, and Contextual Disamb...
Searching on Intent: Knowledge Graphs, Personalization, and Contextual Disamb...Trey Grainger
 
2013-1 Machine Learning Lecture 03 - Andrew Moore - probabilistic and baye…
2013-1 Machine Learning Lecture 03 - Andrew Moore - probabilistic and baye…2013-1 Machine Learning Lecture 03 - Andrew Moore - probabilistic and baye…
2013-1 Machine Learning Lecture 03 - Andrew Moore - probabilistic and baye…Dongseo University
 
ورشة تضمين الكلمات في التعلم العميق Word embeddings workshop
ورشة تضمين الكلمات في التعلم العميق Word embeddings workshopورشة تضمين الكلمات في التعلم العميق Word embeddings workshop
ورشة تضمين الكلمات في التعلم العميق Word embeddings workshopiwan_rg
 
Sentiment analysis and opinion mining Ch.7
Sentiment analysis and opinion mining Ch.7Sentiment analysis and opinion mining Ch.7
Sentiment analysis and opinion mining Ch.7PC LO
 
눈으로 듣는 음악 추천 시스템
눈으로 듣는 음악 추천 시스템눈으로 듣는 음악 추천 시스템
눈으로 듣는 음악 추천 시스템if kakao
 
임태현, Text-CNN을 이용한 Sentiment 분설모델 구현
임태현, Text-CNN을 이용한 Sentiment 분설모델 구현임태현, Text-CNN을 이용한 Sentiment 분설모델 구현
임태현, Text-CNN을 이용한 Sentiment 분설모델 구현태현 임
 
파이썬을 활용한 챗봇 서비스 개발 3일차
파이썬을 활용한 챗봇 서비스 개발 3일차파이썬을 활용한 챗봇 서비스 개발 3일차
파이썬을 활용한 챗봇 서비스 개발 3일차Taekyung Han
 
Neural Architectures for Named Entity Recognition
Neural Architectures for Named Entity RecognitionNeural Architectures for Named Entity Recognition
Neural Architectures for Named Entity RecognitionRrubaa Panchendrarajan
 
텐서플로우로 배우는 딥러닝
텐서플로우로 배우는 딥러닝텐서플로우로 배우는 딥러닝
텐서플로우로 배우는 딥러닝찬웅 주
 
Deep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDeep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDevashish Shanker
 
Processamento de Linguagem Natural
Processamento de Linguagem NaturalProcessamento de Linguagem Natural
Processamento de Linguagem NaturalGustavo Gattass Ayub
 
Transformers in Vision: From Zero to Hero
Transformers in Vision: From Zero to HeroTransformers in Vision: From Zero to Hero
Transformers in Vision: From Zero to HeroBill Liu
 
Dialogue systems and personal assistants
Dialogue systems and personal assistantsDialogue systems and personal assistants
Dialogue systems and personal assistantsNatalia Konstantinova
 

What's hot (20)

Deep Natural Language Processing for Search Systems (sigir 2019 tutorial)
Deep Natural Language Processing for Search Systems (sigir 2019 tutorial)Deep Natural Language Processing for Search Systems (sigir 2019 tutorial)
Deep Natural Language Processing for Search Systems (sigir 2019 tutorial)
 
Searching on Intent: Knowledge Graphs, Personalization, and Contextual Disamb...
Searching on Intent: Knowledge Graphs, Personalization, and Contextual Disamb...Searching on Intent: Knowledge Graphs, Personalization, and Contextual Disamb...
Searching on Intent: Knowledge Graphs, Personalization, and Contextual Disamb...
 
2013-1 Machine Learning Lecture 03 - Andrew Moore - probabilistic and baye…
2013-1 Machine Learning Lecture 03 - Andrew Moore - probabilistic and baye…2013-1 Machine Learning Lecture 03 - Andrew Moore - probabilistic and baye…
2013-1 Machine Learning Lecture 03 - Andrew Moore - probabilistic and baye…
 
Bert
BertBert
Bert
 
ورشة تضمين الكلمات في التعلم العميق Word embeddings workshop
ورشة تضمين الكلمات في التعلم العميق Word embeddings workshopورشة تضمين الكلمات في التعلم العميق Word embeddings workshop
ورشة تضمين الكلمات في التعلم العميق Word embeddings workshop
 
Sentiment analysis and opinion mining Ch.7
Sentiment analysis and opinion mining Ch.7Sentiment analysis and opinion mining Ch.7
Sentiment analysis and opinion mining Ch.7
 
눈으로 듣는 음악 추천 시스템
눈으로 듣는 음악 추천 시스템눈으로 듣는 음악 추천 시스템
눈으로 듣는 음악 추천 시스템
 
Text analysis using python
Text analysis using pythonText analysis using python
Text analysis using python
 
임태현, Text-CNN을 이용한 Sentiment 분설모델 구현
임태현, Text-CNN을 이용한 Sentiment 분설모델 구현임태현, Text-CNN을 이용한 Sentiment 분설모델 구현
임태현, Text-CNN을 이용한 Sentiment 분설모델 구현
 
파이썬을 활용한 챗봇 서비스 개발 3일차
파이썬을 활용한 챗봇 서비스 개발 3일차파이썬을 활용한 챗봇 서비스 개발 3일차
파이썬을 활용한 챗봇 서비스 개발 3일차
 
NLP_KASHK:Minimum Edit Distance
NLP_KASHK:Minimum Edit DistanceNLP_KASHK:Minimum Edit Distance
NLP_KASHK:Minimum Edit Distance
 
LSTM Basics
LSTM BasicsLSTM Basics
LSTM Basics
 
Neural Architectures for Named Entity Recognition
Neural Architectures for Named Entity RecognitionNeural Architectures for Named Entity Recognition
Neural Architectures for Named Entity Recognition
 
텐서플로우로 배우는 딥러닝
텐서플로우로 배우는 딥러닝텐서플로우로 배우는 딥러닝
텐서플로우로 배우는 딥러닝
 
Deep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDeep Learning for Natural Language Processing
Deep Learning for Natural Language Processing
 
Processamento de Linguagem Natural
Processamento de Linguagem NaturalProcessamento de Linguagem Natural
Processamento de Linguagem Natural
 
Transformers in Vision: From Zero to Hero
Transformers in Vision: From Zero to HeroTransformers in Vision: From Zero to Hero
Transformers in Vision: From Zero to Hero
 
Dialogue systems and personal assistants
Dialogue systems and personal assistantsDialogue systems and personal assistants
Dialogue systems and personal assistants
 
randomwalk.ppt
randomwalk.pptrandomwalk.ppt
randomwalk.ppt
 
Rnn and lstm
Rnn and lstmRnn and lstm
Rnn and lstm
 

Viewers also liked

Currículo Nacional de la Educación Básica
Currículo Nacional de la Educación BásicaCurrículo Nacional de la Educación Básica
Currículo Nacional de la Educación BásicaDiego Ponce de Leon
 
Portafolio de Evidencias de mi Práctica Docente
Portafolio de Evidencias de mi Práctica DocentePortafolio de Evidencias de mi Práctica Docente
Portafolio de Evidencias de mi Práctica DocenteNorma Vega
 
JULIOPARI - Elaborando un Plan de Negocios
JULIOPARI - Elaborando un Plan de NegociosJULIOPARI - Elaborando un Plan de Negocios
JULIOPARI - Elaborando un Plan de NegociosJulio Pari
 
El emprendedor y el empresario profesional cert
El emprendedor y el empresario profesional certEl emprendedor y el empresario profesional cert
El emprendedor y el empresario profesional certMaestros Online
 
1ºBACH Economía Tema 5 Oferta y demanda
1ºBACH Economía Tema 5 Oferta y demanda1ºBACH Economía Tema 5 Oferta y demanda
1ºBACH Economía Tema 5 Oferta y demandaGeohistoria23
 
Onderzoeksrapport acrs v3.0_definitief
Onderzoeksrapport acrs v3.0_definitiefOnderzoeksrapport acrs v3.0_definitief
Onderzoeksrapport acrs v3.0_definitiefrloggen
 
Como hacer un plan de negocios
Como hacer un plan de negociosComo hacer un plan de negocios
Como hacer un plan de negociosXPINNERPablo
 
Schrijven voor het web
Schrijven voor het webSchrijven voor het web
Schrijven voor het webSimone Levie
 
Evidence: Describing my kitchen. ENGLISH DOT WORKS 2. SENA.
Evidence: Describing my kitchen. ENGLISH DOT WORKS 2. SENA.Evidence: Describing my kitchen. ENGLISH DOT WORKS 2. SENA.
Evidence: Describing my kitchen. ENGLISH DOT WORKS 2. SENA... ..
 
Estrategias competitivas básicas
Estrategias competitivas básicasEstrategias competitivas básicas
Estrategias competitivas básicasLarryJimenez
 
2. describing cities and places. ENGLISH DOT WORKS 2. SENA. semana 4 acitivda...
2. describing cities and places. ENGLISH DOT WORKS 2. SENA. semana 4 acitivda...2. describing cities and places. ENGLISH DOT WORKS 2. SENA. semana 4 acitivda...
2. describing cities and places. ENGLISH DOT WORKS 2. SENA. semana 4 acitivda..... ..
 
3.Evidence: Getting to Bogota.ENGLISH DOT WORKS 2. SENA.semana 4 actividad 3.
3.Evidence: Getting to Bogota.ENGLISH DOT WORKS 2. SENA.semana 4 actividad 3.3.Evidence: Getting to Bogota.ENGLISH DOT WORKS 2. SENA.semana 4 actividad 3.
3.Evidence: Getting to Bogota.ENGLISH DOT WORKS 2. SENA.semana 4 actividad 3... ..
 
Evidence: Going to the restaurant . ENGLISH DOT WORKS 2. SENA.
Evidence: Going to the restaurant . ENGLISH DOT WORKS 2. SENA.Evidence: Going to the restaurant . ENGLISH DOT WORKS 2. SENA.
Evidence: Going to the restaurant . ENGLISH DOT WORKS 2. SENA... ..
 
Evidence: I can’t believe it.ENGLISH DOT WORKS 2. semana 3 actividad 1.SENA.
Evidence: I can’t believe it.ENGLISH DOT WORKS 2. semana 3 actividad 1.SENA.Evidence: I can’t believe it.ENGLISH DOT WORKS 2. semana 3 actividad 1.SENA.
Evidence: I can’t believe it.ENGLISH DOT WORKS 2. semana 3 actividad 1.SENA... ..
 
Evidence: Memorable moments.ENGLISH DOT WORKS 2. SENA. semana 2 actividad 2.
Evidence: Memorable moments.ENGLISH DOT WORKS 2. SENA. semana 2 actividad 2.Evidence: Memorable moments.ENGLISH DOT WORKS 2. SENA. semana 2 actividad 2.
Evidence: Memorable moments.ENGLISH DOT WORKS 2. SENA. semana 2 actividad 2... ..
 
Evidence: Planning my trip. ENGLISH DOT WORKS 2. SENA. semana 4 actividad 1.
Evidence: Planning my trip. ENGLISH DOT WORKS 2. SENA. semana 4 actividad 1.Evidence: Planning my trip. ENGLISH DOT WORKS 2. SENA. semana 4 actividad 1.
Evidence: Planning my trip. ENGLISH DOT WORKS 2. SENA. semana 4 actividad 1... ..
 

Viewers also liked (20)

Currículo Nacional de la Educación Básica
Currículo Nacional de la Educación BásicaCurrículo Nacional de la Educación Básica
Currículo Nacional de la Educación Básica
 
Portafolio de Evidencias de mi Práctica Docente
Portafolio de Evidencias de mi Práctica DocentePortafolio de Evidencias de mi Práctica Docente
Portafolio de Evidencias de mi Práctica Docente
 
JULIOPARI - Elaborando un Plan de Negocios
JULIOPARI - Elaborando un Plan de NegociosJULIOPARI - Elaborando un Plan de Negocios
JULIOPARI - Elaborando un Plan de Negocios
 
El emprendedor y el empresario profesional cert
El emprendedor y el empresario profesional certEl emprendedor y el empresario profesional cert
El emprendedor y el empresario profesional cert
 
PMP Sonora Saludable 2010 2015
PMP Sonora Saludable 2010 2015 PMP Sonora Saludable 2010 2015
PMP Sonora Saludable 2010 2015
 
Tears In The Rain
Tears In The RainTears In The Rain
Tears In The Rain
 
1ºBACH Economía Tema 5 Oferta y demanda
1ºBACH Economía Tema 5 Oferta y demanda1ºBACH Economía Tema 5 Oferta y demanda
1ºBACH Economía Tema 5 Oferta y demanda
 
Onderzoeksrapport acrs v3.0_definitief
Onderzoeksrapport acrs v3.0_definitiefOnderzoeksrapport acrs v3.0_definitief
Onderzoeksrapport acrs v3.0_definitief
 
Como hacer un plan de negocios
Como hacer un plan de negociosComo hacer un plan de negocios
Como hacer un plan de negocios
 
Schrijven voor het web
Schrijven voor het webSchrijven voor het web
Schrijven voor het web
 
Evidence: Describing my kitchen. ENGLISH DOT WORKS 2. SENA.
Evidence: Describing my kitchen. ENGLISH DOT WORKS 2. SENA.Evidence: Describing my kitchen. ENGLISH DOT WORKS 2. SENA.
Evidence: Describing my kitchen. ENGLISH DOT WORKS 2. SENA.
 
Estrategias competitivas básicas
Estrategias competitivas básicasEstrategias competitivas básicas
Estrategias competitivas básicas
 
Cápsula 1. estudios de mercado
Cápsula 1. estudios de mercadoCápsula 1. estudios de mercado
Cápsula 1. estudios de mercado
 
Rodriguez alvarez
Rodriguez alvarezRodriguez alvarez
Rodriguez alvarez
 
2. describing cities and places. ENGLISH DOT WORKS 2. SENA. semana 4 acitivda...
2. describing cities and places. ENGLISH DOT WORKS 2. SENA. semana 4 acitivda...2. describing cities and places. ENGLISH DOT WORKS 2. SENA. semana 4 acitivda...
2. describing cities and places. ENGLISH DOT WORKS 2. SENA. semana 4 acitivda...
 
3.Evidence: Getting to Bogota.ENGLISH DOT WORKS 2. SENA.semana 4 actividad 3.
3.Evidence: Getting to Bogota.ENGLISH DOT WORKS 2. SENA.semana 4 actividad 3.3.Evidence: Getting to Bogota.ENGLISH DOT WORKS 2. SENA.semana 4 actividad 3.
3.Evidence: Getting to Bogota.ENGLISH DOT WORKS 2. SENA.semana 4 actividad 3.
 
Evidence: Going to the restaurant . ENGLISH DOT WORKS 2. SENA.
Evidence: Going to the restaurant . ENGLISH DOT WORKS 2. SENA.Evidence: Going to the restaurant . ENGLISH DOT WORKS 2. SENA.
Evidence: Going to the restaurant . ENGLISH DOT WORKS 2. SENA.
 
Evidence: I can’t believe it.ENGLISH DOT WORKS 2. semana 3 actividad 1.SENA.
Evidence: I can’t believe it.ENGLISH DOT WORKS 2. semana 3 actividad 1.SENA.Evidence: I can’t believe it.ENGLISH DOT WORKS 2. semana 3 actividad 1.SENA.
Evidence: I can’t believe it.ENGLISH DOT WORKS 2. semana 3 actividad 1.SENA.
 
Evidence: Memorable moments.ENGLISH DOT WORKS 2. SENA. semana 2 actividad 2.
Evidence: Memorable moments.ENGLISH DOT WORKS 2. SENA. semana 2 actividad 2.Evidence: Memorable moments.ENGLISH DOT WORKS 2. SENA. semana 2 actividad 2.
Evidence: Memorable moments.ENGLISH DOT WORKS 2. SENA. semana 2 actividad 2.
 
Evidence: Planning my trip. ENGLISH DOT WORKS 2. SENA. semana 4 actividad 1.
Evidence: Planning my trip. ENGLISH DOT WORKS 2. SENA. semana 4 actividad 1.Evidence: Planning my trip. ENGLISH DOT WORKS 2. SENA. semana 4 actividad 1.
Evidence: Planning my trip. ENGLISH DOT WORKS 2. SENA. semana 4 actividad 1.
 

Recently uploaded

Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bSérgio Sacani
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)Areesha Ahmad
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsSérgio Sacani
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksSérgio Sacani
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )aarthirajkumar25
 
Zoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdfZoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdfSumit Kumar yadav
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPirithiRaju
 
DIFFERENCE IN BACK CROSS AND TEST CROSS
DIFFERENCE IN BACK CROSS AND TEST CROSSDIFFERENCE IN BACK CROSS AND TEST CROSS
DIFFERENCE IN BACK CROSS AND TEST CROSSLeenakshiTyagi
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PPRINCE C P
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...Sérgio Sacani
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...RohitNehra6
 
Natural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsNatural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsAArockiyaNisha
 
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCESTERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCEPRINCE C P
 
Botany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfBotany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfSumit Kumar yadav
 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)Areesha Ahmad
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfSumit Kumar yadav
 
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...ssifa0344
 
GFP in rDNA Technology (Biotechnology).pptx
GFP in rDNA Technology (Biotechnology).pptxGFP in rDNA Technology (Biotechnology).pptx
GFP in rDNA Technology (Biotechnology).pptxAleenaTreesaSaji
 

Recently uploaded (20)

Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
 
The Philosophy of Science
The Philosophy of ScienceThe Philosophy of Science
The Philosophy of Science
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disks
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )
 
Zoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdfZoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdf
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
 
DIFFERENCE IN BACK CROSS AND TEST CROSS
DIFFERENCE IN BACK CROSS AND TEST CROSSDIFFERENCE IN BACK CROSS AND TEST CROSS
DIFFERENCE IN BACK CROSS AND TEST CROSS
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C P
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
 
Engler and Prantl system of classification in plant taxonomy
Engler and Prantl system of classification in plant taxonomyEngler and Prantl system of classification in plant taxonomy
Engler and Prantl system of classification in plant taxonomy
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
 
Natural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsNatural Polymer Based Nanomaterials
Natural Polymer Based Nanomaterials
 
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCESTERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
 
Botany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfBotany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdf
 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdf
 
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
 
GFP in rDNA Technology (Biotechnology).pptx
GFP in rDNA Technology (Biotechnology).pptxGFP in rDNA Technology (Biotechnology).pptx
GFP in rDNA Technology (Biotechnology).pptx
 

Massive Multilingual Named Entity Recognition Using Polyglot-NER

  • 1. Polyglot-NER: Massive Multilingual Named Entity Recognition SDM May 2, 2015 Rami Al-Rfou, Vivek Kulkarni, Bryan Perozzi, Steve Skiena Stony Brook University
  • 2. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Named Entity Recognition (NER) Problem ■Input: Plain text, T ■Output: The spans of T that constitute proper names, and the classification of the entity’s type.
  • 3. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition NER Examples Input: Vancouver is a coastal seaport city on the mainland of British Columbia. The city's mayor is Gregor Robertson. Output: Vancouver is a coastal seaport city on the mainland of British Columbia. The city's mayor is Gregor Robertson. Location Location Person
  • 4. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Multilingual NER ❑NLTK ■ English ❑Stanford ■ English, Spanish, Chinese, Arabic ❑OpenNLP ■ English, German, Dutch, Spanish ❑Polyglot-NER ■ 40 Major Languages! (English, Spanish, French, German, Russian, Polish, Portuguese, Italian, Dutch, Arabic, Hebrew, Hindi, Korean, Japanese, Vietnamese, …) While many pipelines exist, most languages are unsupported
  • 5. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Does Multilingual Matter? Yes! Only 55% of the top 10 million websites are in English! [1] There are 51 languages on Wikipedia with 100,000+ articles. [2] [1] http://w3techs.com/technologies/history_overview/content_language/ms/y [2] http://meta.wikimedia.org/wiki/List_of_Wikipedias
  • 6. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Multilingual is Hard Feature Scarcity NLP tasks typically rely on language-specific feature engineering ❑ Orthographic features ❑ Part of Speech Tags ❑ Parallel Corpora ❑ WordNet Annotation Scarcity Need NER examples - labeled data is expensive. Our solution: neural word embeddings. Our solution: Wikipedia/Freebase for training examples
  • 7. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Sub-problem: Word Representation Input: Unstructured text Output: Low dimensional word embeddings
  • 8. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Distributed Word Representations Big Idea: Give similar words similar representations pine oak rose daisy reading writing read write |V| |V|: size of vocabulary pine oak rose daisy reading writing read write d d << |V| Similar words share similar representations. Latent Dimensions Explicit Dimensions
  • 9. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Polyglot Embeddings ● Wikipedia article text ● 137 Languages ● Available: ○ http://bit.ly/embeddings [Al-Rfou, Perozzi, Skiena, 13] C Imagination C is C greater C than C detail Score Hidden Layer H Projection Layer
  • 10. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Sub-Problem: Annotation Mining Input: Wikipedia, Freebase Output: Labeled NER training examples
  • 11. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Related Work
  • 12. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Annotations from Wikipedia Inter-wiki links are a great potential source of mentions. WikipediaFreebase Freebase tells us which articles are entity articles.
  • 13. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Example Wiki Text: Vancouver is a coastal seaport city on the mainland of British Columbia. The city's mayor is Gregor Robertson. “Vancouver” “British Columbia” “Gregor Robertson” Strings /m/080h2 /m/015jr /m/0grlms Freebase MID City Region Person Freebase Category Location Location Person NER Label
  • 14. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition The Bad News Many false negatives in our dataset! ■ Wikipedia editors annotate only the first mention of an entity but not later ones. ■ Most of the named entity mentions are not linked! Example: Vancouver is a coastal seaport city on the mainland of British Columbia. Vancouver’s mayor is Gregor Robertson.
  • 15. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition The Good News Positive labels are very high quality! Need to emphasize this in our training. ? ? ? ? ? ? ? ‘Learning Classifiers from only positive and unlabeled examples’ [Elkin & Noto, 08]
  • 16. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition The trick: Oversampling p We can change the label distribution by oversampling from the positive labels. p is the percentage of positive labels in the training dataset. Initially no oversampling p = 0.5, much better
  • 17. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Cross-Domain Performance Oversampling Oversampling + Exact Matching Cross-Domain Testing on CoNLL
  • 18. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition NER Demo @ http://bit.ly/polyglot-ner Legend: Location Organization Person
  • 19. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition But How to Evaluate? ■We have labeled data for a few languages ■Would like to evaluate everything
  • 20. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Distant Evaluation John proviene de la ciudad de Nueva York. John is coming from New York City. Machine Translation Calculate the error of omitting entities and the error of adding entities. Person: 1 Location: 1 Organization: 0 Person: 0 Location: 1 Organization: 1 1 1
  • 21. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Experimental Design Distant Evaluation for Polyglot-NER: 1. Annotate English Wikipedia sentences using Stanford NER. 2. Randomly pick 1500 sentences that have at least one entity detected. 3. Translate these sentences using Google translate to 40 languages. 4. Run Polyglot-NER on the translated datasets. 5. Compare the number of entity chunks our annotators found to the ones detected by Stanford per sentence. 6. Calculate the error of omitting (ℰ 𝓜) and adding entities (ℰ 𝒜)
  • 22. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Effect of Data Size ■ Size of training data matters! ■ Tokenization is quite important when the word embeddings coverage is limited. # Words (Log Scale) ErrorMissing More Data Will Help Anomalies Good
  • 23. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Performance by Category ℰ 𝒜: Adding Error ℰ 𝓜: Missing Error Person Location
  • 24. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Limitations ■Named entities don’t always translate well: ❑Ex: “Γείτονας Shanna Rudd δήλωσε στο CNN …” ■Need a working translation system for the language
  • 25. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Take-aways ■NER in 40 languages! ■Word embeddings & oversampling offers equal or better performance to feature engineering for NER annotation mining. ■Translation based evaluation?
  • 26. Bryan Perozzi Polyglot-NER: Massive Multilingual Named Entity Recognition Thanks! NER Demo: http://bit.ly/polyglot-ner NER Code: http://polyglot-nlp.com bperozzi@cs.stonybrook.edu www.perozzi.net Bryan Perozzi