SlideShare a Scribd company logo
1 of 12
Download to read offline
Visualizing who
is relevant
to a topic in
International Relations
by David Berger
5,000+ articles
• article text
• date
• headline
2010-2015
5,000+ articles
2010-2015
• article text
• date
• headline
• extracted named
entities with NLK
PoS Tagger
Whoosh
Python Search Library and Document Indexer
Whoosh
Python Search Library and Document Indexer
scraped articles
Whoosh
Python Search Library and Document Indexer
build or update index
scraped articles
Whoosh
Python Search Library and Document Indexer
build or update index
submit search query
scraped articles
Whoosh
Python Search Library and Document Indexer
build or update index
submit search query
scraped articles
okapi search function
Whoosh
Python Search Library and Document Indexer
build or update index
relevant articles
submit search query
scraped articles
okapi search function
Whoosh
Python Search Library and Document Indexer
build or update index
relevant articles
submit search query
scraped articles
okapi search function
count named entities
Whoosh
Python Search Library and Document Indexer
build or update index
relevant articles
submit search query
scraped articles
okapi search function
count named entities
Outside
Flask
Inside
Flask
Live web-app at:
bit.ly/international-affairs-entities-finder

More Related Content

What's hot

Introduction to Azure Search
Introduction to Azure SearchIntroduction to Azure Search
Introduction to Azure SearchRadoslav Gatev
 
Cited-by Linking
Cited-by Linking Cited-by Linking
Cited-by Linking Crossref
 
Using server logs to your advantage
Using server logs to your advantageUsing server logs to your advantage
Using server logs to your advantageAlexandra Johnson
 
Managing plagiarism: Similarity Check
Managing plagiarism: Similarity CheckManaging plagiarism: Similarity Check
Managing plagiarism: Similarity CheckCrossref
 
Elasticsearch at Automattic
Elasticsearch at AutomatticElasticsearch at Automattic
Elasticsearch at AutomatticGreg Brown
 
Crossref Metadata and Metadata Services
Crossref Metadata and Metadata ServicesCrossref Metadata and Metadata Services
Crossref Metadata and Metadata ServicesCrossref
 
Log File Analysis: The most powerful tool in your SEO toolkit
Log File Analysis: The most powerful tool in your SEO toolkitLog File Analysis: The most powerful tool in your SEO toolkit
Log File Analysis: The most powerful tool in your SEO toolkitTom Bennet
 
Designing RESTful APIs
Designing RESTful APIsDesigning RESTful APIs
Designing RESTful APIsanandology
 
So we all have ORCID integrations, now what?
So we all have ORCID integrations, now what?So we all have ORCID integrations, now what?
So we all have ORCID integrations, now what?Bram Luyten
 
Talis Platform: A Linked Data Engine
Talis Platform: A Linked Data EngineTalis Platform: A Linked Data Engine
Talis Platform: A Linked Data EngineLeigh Dodds
 
Gab2015 azure search as a service
Gab2015 azure search as a serviceGab2015 azure search as a service
Gab2015 azure search as a serviceAlexandre Marreiros
 
Cenitpede: Analyzing Webcrawl
Cenitpede: Analyzing WebcrawlCenitpede: Analyzing Webcrawl
Cenitpede: Analyzing WebcrawlPrimal Pappachan
 
Hack angular wildly
Hack angular wildlyHack angular wildly
Hack angular wildlyTodd Warren
 

What's hot (18)

Introduction to Azure Search
Introduction to Azure SearchIntroduction to Azure Search
Introduction to Azure Search
 
CARA MENGELOLA PERUBAHAN PADA NASKAH
CARA MENGELOLA PERUBAHAN PADA NASKAHCARA MENGELOLA PERUBAHAN PADA NASKAH
CARA MENGELOLA PERUBAHAN PADA NASKAH
 
Cited-by Linking
Cited-by Linking Cited-by Linking
Cited-by Linking
 
Using server logs to your advantage
Using server logs to your advantageUsing server logs to your advantage
Using server logs to your advantage
 
Managing plagiarism: Similarity Check
Managing plagiarism: Similarity CheckManaging plagiarism: Similarity Check
Managing plagiarism: Similarity Check
 
Elasticsearch at Automattic
Elasticsearch at AutomatticElasticsearch at Automattic
Elasticsearch at Automattic
 
Crossref Metadata and Metadata Services
Crossref Metadata and Metadata ServicesCrossref Metadata and Metadata Services
Crossref Metadata and Metadata Services
 
Jinchao demo
Jinchao demoJinchao demo
Jinchao demo
 
APA ITU DOI?
APA ITU DOI?APA ITU DOI?
APA ITU DOI?
 
Log File Analysis: The most powerful tool in your SEO toolkit
Log File Analysis: The most powerful tool in your SEO toolkitLog File Analysis: The most powerful tool in your SEO toolkit
Log File Analysis: The most powerful tool in your SEO toolkit
 
Designing RESTful APIs
Designing RESTful APIsDesigning RESTful APIs
Designing RESTful APIs
 
INTEGRASI ORCID DENGAN CROSSREF
INTEGRASI ORCID DENGAN CROSSREFINTEGRASI ORCID DENGAN CROSSREF
INTEGRASI ORCID DENGAN CROSSREF
 
Live Blog Analysis
Live Blog AnalysisLive Blog Analysis
Live Blog Analysis
 
So we all have ORCID integrations, now what?
So we all have ORCID integrations, now what?So we all have ORCID integrations, now what?
So we all have ORCID integrations, now what?
 
Talis Platform: A Linked Data Engine
Talis Platform: A Linked Data EngineTalis Platform: A Linked Data Engine
Talis Platform: A Linked Data Engine
 
Gab2015 azure search as a service
Gab2015 azure search as a serviceGab2015 azure search as a service
Gab2015 azure search as a service
 
Cenitpede: Analyzing Webcrawl
Cenitpede: Analyzing WebcrawlCenitpede: Analyzing Webcrawl
Cenitpede: Analyzing Webcrawl
 
Hack angular wildly
Hack angular wildlyHack angular wildly
Hack angular wildly
 

Similar to IA Named Entity Finder

Getting started with looking up metadata
Getting started with looking up metadataGetting started with looking up metadata
Getting started with looking up metadataCrossref
 
PyCon India 2012: Rapid development of website search in python
PyCon India 2012: Rapid development of website search in pythonPyCon India 2012: Rapid development of website search in python
PyCon India 2012: Rapid development of website search in pythonChetan Giridhar
 
Research Support Service through Reference Management Tools zotero and mandel...
Research Support Service through Reference Management Tools zotero and mandel...Research Support Service through Reference Management Tools zotero and mandel...
Research Support Service through Reference Management Tools zotero and mandel...Dr Shalini Lihitkar
 
Schema.org - An Extending Influence
Schema.org - An Extending InfluenceSchema.org - An Extending Influence
Schema.org - An Extending InfluenceRichard Wallis
 
Introduction to Research Objects - Collaboartions Workshop 2015, Oxford
Introduction to Research Objects - Collaboartions Workshop 2015, OxfordIntroduction to Research Objects - Collaboartions Workshop 2015, Oxford
Introduction to Research Objects - Collaboartions Workshop 2015, Oxfordmatthewgamble
 
Context Driven Search Ranking and Faceting - Torsten Köster, shopping24 inter...
Context Driven Search Ranking and Faceting - Torsten Köster, shopping24 inter...Context Driven Search Ranking and Faceting - Torsten Köster, shopping24 inter...
Context Driven Search Ranking and Faceting - Torsten Köster, shopping24 inter...Lucidworks
 
Fire kit ios (r-baldwin)
Fire kit ios (r-baldwin)Fire kit ios (r-baldwin)
Fire kit ios (r-baldwin)DevDays
 
Academic Search Engines.pptx
Academic Search Engines.pptxAcademic Search Engines.pptx
Academic Search Engines.pptxRitikchaudhary46
 
Docs as Part of the Product - Open Source Summit North America 2018
Docs as Part of the Product - Open Source Summit North America 2018Docs as Part of the Product - Open Source Summit North America 2018
Docs as Part of the Product - Open Source Summit North America 2018Den Delimarsky
 
BISAC Identification Committee -- ISTC
BISAC Identification Committee -- ISTCBISAC Identification Committee -- ISTC
BISAC Identification Committee -- ISTCbisg
 
Schema.org - Extending Benefits
Schema.org - Extending BenefitsSchema.org - Extending Benefits
Schema.org - Extending BenefitsRichard Wallis
 
Tracking Changes through EARMARK: a Theoretical Perspective and an Implementa...
Tracking Changes through EARMARK: a Theoretical Perspective and an Implementa...Tracking Changes through EARMARK: a Theoretical Perspective and an Implementa...
Tracking Changes through EARMARK: a Theoretical Perspective and an Implementa...University of Bologna
 
Reference material: Topics or databases?
Reference material: Topics or databases?Reference material: Topics or databases?
Reference material: Topics or databases?Ben Colborn
 
Information Architecture for SharePoint
Information Architecture for SharePointInformation Architecture for SharePoint
Information Architecture for SharePointnForm User Experience
 
Checking for Originality thorough Crossref Similarity Check
Checking for Originality thorough Crossref Similarity CheckChecking for Originality thorough Crossref Similarity Check
Checking for Originality thorough Crossref Similarity CheckCrossref
 

Similar to IA Named Entity Finder (20)

Getting started with looking up metadata
Getting started with looking up metadataGetting started with looking up metadata
Getting started with looking up metadata
 
PyCon India 2012: Rapid development of website search in python
PyCon India 2012: Rapid development of website search in pythonPyCon India 2012: Rapid development of website search in python
PyCon India 2012: Rapid development of website search in python
 
Research Support Service through Reference Management Tools zotero and mandel...
Research Support Service through Reference Management Tools zotero and mandel...Research Support Service through Reference Management Tools zotero and mandel...
Research Support Service through Reference Management Tools zotero and mandel...
 
Schema.org - An Extending Influence
Schema.org - An Extending InfluenceSchema.org - An Extending Influence
Schema.org - An Extending Influence
 
Acedemic search engines.pptx
Acedemic search engines.pptxAcedemic search engines.pptx
Acedemic search engines.pptx
 
Introduction to Research Objects - Collaboartions Workshop 2015, Oxford
Introduction to Research Objects - Collaboartions Workshop 2015, OxfordIntroduction to Research Objects - Collaboartions Workshop 2015, Oxford
Introduction to Research Objects - Collaboartions Workshop 2015, Oxford
 
Context Driven Search Ranking and Faceting - Torsten Köster, shopping24 inter...
Context Driven Search Ranking and Faceting - Torsten Köster, shopping24 inter...Context Driven Search Ranking and Faceting - Torsten Köster, shopping24 inter...
Context Driven Search Ranking and Faceting - Torsten Köster, shopping24 inter...
 
Fire kit ios (r-baldwin)
Fire kit ios (r-baldwin)Fire kit ios (r-baldwin)
Fire kit ios (r-baldwin)
 
Everything You Wish You Knew About Search
Everything You Wish You Knew About SearchEverything You Wish You Knew About Search
Everything You Wish You Knew About Search
 
Academic Search Engines.pptx
Academic Search Engines.pptxAcademic Search Engines.pptx
Academic Search Engines.pptx
 
Academic Search Engines.pptx
Academic Search Engines.pptxAcademic Search Engines.pptx
Academic Search Engines.pptx
 
Academic Search Engines.pptx
Academic Search Engines.pptxAcademic Search Engines.pptx
Academic Search Engines.pptx
 
Docs as Part of the Product - Open Source Summit North America 2018
Docs as Part of the Product - Open Source Summit North America 2018Docs as Part of the Product - Open Source Summit North America 2018
Docs as Part of the Product - Open Source Summit North America 2018
 
BISAC Identification Committee -- ISTC
BISAC Identification Committee -- ISTCBISAC Identification Committee -- ISTC
BISAC Identification Committee -- ISTC
 
Schema.org - Extending Benefits
Schema.org - Extending BenefitsSchema.org - Extending Benefits
Schema.org - Extending Benefits
 
Tracking Changes through EARMARK: a Theoretical Perspective and an Implementa...
Tracking Changes through EARMARK: a Theoretical Perspective and an Implementa...Tracking Changes through EARMARK: a Theoretical Perspective and an Implementa...
Tracking Changes through EARMARK: a Theoretical Perspective and an Implementa...
 
Reference material: Topics or databases?
Reference material: Topics or databases?Reference material: Topics or databases?
Reference material: Topics or databases?
 
Reference management tools
Reference management toolsReference management tools
Reference management tools
 
Information Architecture for SharePoint
Information Architecture for SharePointInformation Architecture for SharePoint
Information Architecture for SharePoint
 
Checking for Originality thorough Crossref Similarity Check
Checking for Originality thorough Crossref Similarity CheckChecking for Originality thorough Crossref Similarity Check
Checking for Originality thorough Crossref Similarity Check
 

IA Named Entity Finder