Jaganadh Gopinadhan, profile picture
Uploaded byJaganadh Gopinadhan
PDF, PPTX3,263 views

Practical Natural Language Processing From Theory to Industrial Applications

The document provides an overview of a presentation on practical natural language processing (NLP). It discusses Jaganadh G, an expert in NLP, machine learning, and data mining who is giving the presentation. The presentation covers introducing NLP and its goals, discussing practical NLP problems and solutions, explaining NLP tasks like text classification and information extraction, and exploring topics such as morphology, part-of-speech tagging, and syntactic parsing. The goal is to discuss both theory and real-world applications of NLP.

Embed presentation

Download as PDF, PPTX
1 / 110
2 / 110
3 / 110
4 / 110
5 / 110
6 / 110
7 / 110
8 / 110
9 / 110
10 / 110
11 / 110
12 / 110
13 / 110
14 / 110
15 / 110
16 / 110
17 / 110
18 / 110
19 / 110
20 / 110
21 / 110
22 / 110
23 / 110
24 / 110
25 / 110
26 / 110
27 / 110
28 / 110
29 / 110
30 / 110
31 / 110
32 / 110
33 / 110
34 / 110
35 / 110
36 / 110
37 / 110
38 / 110
39 / 110
40 / 110
41 / 110
42 / 110
43 / 110
44 / 110
45 / 110
46 / 110
47 / 110
48 / 110
49 / 110
50 / 110
51 / 110
52 / 110
53 / 110
54 / 110
55 / 110
56 / 110
57 / 110
58 / 110
59 / 110
60 / 110
61 / 110
62 / 110
63 / 110
64 / 110
65 / 110
66 / 110
67 / 110
68 / 110
69 / 110
70 / 110
71 / 110
72 / 110
73 / 110
74 / 110
75 / 110
76 / 110
77 / 110
78 / 110
79 / 110
80 / 110
81 / 110
82 / 110
83 / 110
84 / 110
85 / 110
86 / 110
87 / 110
88 / 110
89 / 110
90 / 110
91 / 110
92 / 110
93 / 110
94 / 110
95 / 110
96 / 110
97 / 110
98 / 110
99 / 110
100 / 110
101 / 110
102 / 110
103 / 110
104 / 110
105 / 110
106 / 110
107 / 110
108 / 110
109 / 110
110 / 110
Practical Natural Language Processing From Theory to Industrial Applications Jaganadh G http://jaganadhg.in jaganadhg@gmail.com Karpagam University Coimbatore 19th March 2012 Jaganadh G Practical Natural Language Processing
About me !! Working in Natural Language Processing, Machine Learning, Data Mining etc... Passionate about Free and Open source :-) When gets free time teaches Python, Speaks about FOSS and blogs at http://jaganadhg.in I am a computational linguist / Linguist and Indologist, Book reviewer Software Engineer by Profession Jaganadh G Practical Natural Language Processing
Question ?? Have you ever used any Natural Language Processing based tools/services? Jaganadh G Practical Natural Language Processing
Question ?? Have you ever used any Natural Language Processing based tools/services? Jaganadh G Practical Natural Language Processing
Question ?? Have you ever used any Natural Language Processing based tools/services? Jaganadh G Practical Natural Language Processing
What is Natural Language Processing (NLP) ? Aim : To build intelligent systems that can interact with human beings as like human beings Jaganadh G Practical Natural Language Processing
What is Natural Language Processing (NLP) ? Aim : To build intelligent systems that can interact with human beings as like human beings Jaganadh G Practical Natural Language Processing
What is Natural Language Processing (NLP) ? Aim : To build intelligent systems that can interact with human beings as like human beings A sub-field of Artificial Intelligence (AI) Jaganadh G Practical Natural Language Processing
What is Natural Language Processing (NLP) ? Aim : To build intelligent systems that can interact with human beings as like human beings A sub-field of Artificial Intelligence (AI) Inter-disciplinary subject (Language + Linguistics + Statistics + Computer Science + .. ) Natural Language Refers to the language spoken by people, e.g. English,Japanese, Tamil, Malayalam as opposed to artificial languages, like C++, Java, etc. Jaganadh G Practical Natural Language Processing
Definition Natural Language Processing Natural Language Processing is a theoretically motivated range of computational techniques for analyzing and representing naturally occurring texts/speech at one or more levels of linguistic analysis for the purpose of achieving human-like language processing for a range of tasks or applications. NLP was considered as an academic discipline before some 10 to 20 years. Now concepts from NLP is applied in variety of Computing Platforms and Services Jaganadh G Practical Natural Language Processing
Practical NLP ? Problem Picture Courtesy: http://twitpic.com/1y21qm/full Jaganadh G Practical Natural Language Processing
Practical NLP ? Problem Before going to some theory can we have some funny practical problems to solve ? Picture Courtesy: http://twitpic.com/1y21qm/full Jaganadh G Practical Natural Language Processing
Practical NLP ? Problem Before going to some theory can we have some funny practical problems to solve ? Picture Courtesy: http://twitpic.com/1y21qm/full Jaganadh G Practical Natural Language Processing
Practical NLP Problem Jaganadh G Practical Natural Language Processing
Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Jaganadh G Practical Natural Language Processing
Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Jaganadh G Practical Natural Language Processing
Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Jaganadh G Practical Natural Language Processing
Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers Jaganadh G Practical Natural Language Processing
Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Jaganadh G Practical Natural Language Processing
Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Identify tweet category Jaganadh G Practical Natural Language Processing
Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Identify tweet category Process home-delivery request Jaganadh G Practical Natural Language Processing
Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Identify tweet category Process home-delivery request Evaluate quality related tweets Jaganadh G Practical Natural Language Processing
Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Identify tweet category Process home-delivery request Evaluate quality related tweets How? How to find a solution for Tweet-a-Toddy Jaganadh G Practical Natural Language Processing
Solution ?? Any Solutions Jaganadh G Practical Natural Language Processing
Solution ?? Any Solutions Some thoughts Jaganadh G Practical Natural Language Processing
Solution ?? Any Solutions Some thoughts Text Classification Jaganadh G Practical Natural Language Processing
Solution ?? Any Solutions Some thoughts Text Classification Entity Identification Jaganadh G Practical Natural Language Processing
Solution ?? Any Solutions Some thoughts Text Classification Entity Identification Information Extraction Jaganadh G Practical Natural Language Processing
Solution ?? Any Solutions Some thoughts Text Classification Entity Identification Information Extraction Sentiment Analysis Jaganadh G Practical Natural Language Processing
Solution ?? Any Solutions Some thoughts Text Classification Entity Identification Information Extraction Sentiment Analysis Parsing, gammer ... Jaganadh G Practical Natural Language Processing
Solution ?? Any Solutions Some thoughts Text Classification Entity Identification Information Extraction Sentiment Analysis Parsing, gammer ... Regex (Regular Expressions) Jaganadh G Practical Natural Language Processing
Another Practical Question Everybody might have used spell checker available in word processing systems like OpenOffice.org or Microsoft Word Any guess on how to develop a spell checker system ? Solutions Jaganadh G Practical Natural Language Processing
Another Practical Question Everybody might have used spell checker available in word processing systems like OpenOffice.org or Microsoft Word Any guess on how to develop a spell checker system ? Solutions Word List Jaganadh G Practical Natural Language Processing
Another Practical Question Everybody might have used spell checker available in word processing systems like OpenOffice.org or Microsoft Word Any guess on how to develop a spell checker system ? Solutions Word List Structure of words Jaganadh G Practical Natural Language Processing
Another Practical Question Everybody might have used spell checker available in word processing systems like OpenOffice.org or Microsoft Word Any guess on how to develop a spell checker system ? Solutions Word List Structure of words Dynamic Programming (Edit Distance) Jaganadh G Practical Natural Language Processing
Another Practical Question ... Context Sensitive Spell-checking Identifying and suggesting spelling of words based on context How ?? Jaganadh G Practical Natural Language Processing
Another Practical Question ... Context Sensitive Spell-checking Identifying and suggesting spelling of words based on context How ?? Solutions Jaganadh G Practical Natural Language Processing
Another Practical Question ... Context Sensitive Spell-checking Identifying and suggesting spelling of words based on context How ?? Solutions Statistical Models Jaganadh G Practical Natural Language Processing
Another Practical Question ... Context Sensitive Spell-checking Identifying and suggesting spelling of words based on context How ?? Solutions Statistical Models Word category based suggestions Jaganadh G Practical Natural Language Processing
Can Machines Translate ?? Answer !!! Jaganadh G Practical Natural Language Processing
Why NLP ? Because ”Information is Power !!!” Jaganadh G Practical Natural Language Processing
Why NLP ? Because ”Information is Power !!!” Picture Courtesy: http://soundsgood.in/wikipediafat print book/ Jaganadh G Practical Natural Language Processing
Why NLP ? Because ”Information is Power !!!” Every day wast amount of text and speech data is being produced Picture Courtesy: http://soundsgood.in/wikipediafat print book/ Jaganadh G Practical Natural Language Processing
Why NLP ? Because ”Information is Power !!!” Every day wast amount of text and speech data is being produced Internet == at least 40 Million pages Picture Courtesy: http://soundsgood.in/wikipediafat print book/ Jaganadh G Practical Natural Language Processing
Why NLP ? Because ”Information is Power !!!” Every day wast amount of text and speech data is being produced Internet == at least 40 Million pages Picture Courtesy: http://soundsgood.in/wikipediafat print book/ Jaganadh G Practical Natural Language Processing
History Jaganadh G Practical Natural Language Processing
History Second World War !!! Jaganadh G Practical Natural Language Processing
History Second World War !!! Machine Translation Jaganadh G Practical Natural Language Processing
History Second World War !!! Machine Translation Now : Jaganadh G Practical Natural Language Processing
History Second World War !!! Machine Translation Now : Most promising imperfect technology Jaganadh G Practical Natural Language Processing
History Second World War !!! Machine Translation Now : Most promising imperfect technology Moves from Lab to Industry to Layman Jaganadh G Practical Natural Language Processing
NLP Really Hard to Achieve? NLP delas with human languages Human Language is dynamic and mysterious !!! Jaganadh G Practical Natural Language Processing
NLP Really Hard to Achieve? NLP delas with human languages Human Language is dynamic and mysterious !!! Communication in Human Language Jaganadh G Practical Natural Language Processing
NLP Really Hard to Achieve? Levels of Knowledge encoding in Language Data Jaganadh G Practical Natural Language Processing
Tasks in NLP Broad Areas Jaganadh G Practical Natural Language Processing
Tasks in NLP Broad Areas Text Processing Jaganadh G Practical Natural Language Processing
Tasks in NLP Broad Areas Text Processing Speech Processing Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing Word Level Analysis Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing Word Level Analysis Morphological Synthesis Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Stemming Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Stemming Lemmatization Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Stemming Lemmatization Sentence Level Analysis - Syntactical Parsing Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Stemming Lemmatization Sentence Level Analysis - Syntactical Parsing Discourse Analysis - Semantic Processing Jaganadh G Practical Natural Language Processing
Morphology The branch of linguistics that studies word structures. Jaganadh G Practical Natural Language Processing
Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Jaganadh G Practical Natural Language Processing
Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Jaganadh G Practical Natural Language Processing
Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Jaganadh G Practical Natural Language Processing
Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Jaganadh G Practical Natural Language Processing
Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Morphological Generation Jaganadh G Practical Natural Language Processing
Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Morphological Generation Stemming Jaganadh G Practical Natural Language Processing
Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Morphological Generation Stemming Lemmatization Jaganadh G Practical Natural Language Processing
Practical Question from Morphology Approximate number of word forms that can be derived from the word ”maram” Jaganadh G Practical Natural Language Processing
Parts of Speech Tagging POS tagging is the process of marking up the words in a text (corpus) as corresponding to a particular part of speech, based on both its definition, as well as its context. Ram goes to school. Ram/NNP goes/VBZ to/TO school/NN ./. Jaganadh G Practical Natural Language Processing
Parts of Speech Tagging POS tagging is the process of marking up the words in a text (corpus) as corresponding to a particular part of speech, based on both its definition, as well as its context. Ram goes to school. Ram/NNP goes/VBZ to/TO school/NN ./. Words are ambiguous !!!! e.g. book, cricket, bank Jaganadh G Practical Natural Language Processing
Syntactical Parsing Parsing In computer science and linguistics, parsing, or, more formally, syntactic analysis, is the process of analyzing a text, made of a sequence of tokens (for example, words), to determine its grammatical structure with respect to a given (more or less) formal grammar. Jaganadh G Practical Natural Language Processing
Syntactical Parsing Parsing In computer science and linguistics, parsing, or, more formally, syntactic analysis, is the process of analyzing a text, made of a sequence of tokens (for example, words), to determine its grammatical structure with respect to a given (more or less) formal grammar. Sentences are ambiguous !!!! Jaganadh G Practical Natural Language Processing
Semantics Study of meaning ans its structure Jaganadh G Practical Natural Language Processing
Semantics Study of meaning ans its structure Word meaning is ambiguous !!!! E.g. marriage Jaganadh G Practical Natural Language Processing
Where can I apply this techniques? Machine Translation Systems Jaganadh G Practical Natural Language Processing
Where can I apply this techniques? Machine Translation Systems Search Engine Jaganadh G Practical Natural Language Processing
Where can I apply this techniques? Machine Translation Systems Search Engine Spell-checker Jaganadh G Practical Natural Language Processing
Where can I apply this techniques? Machine Translation Systems Search Engine Spell-checker Grammar Checker Jaganadh G Practical Natural Language Processing
Where can I apply this techniques? Machine Translation Systems Search Engine Spell-checker Grammar Checker .......... Jaganadh G Practical Natural Language Processing
Other Interesting Tasks Named Entity Identification Jaganadh G Practical Natural Language Processing
Other Interesting Tasks Named Entity Identification Information Extraction Jaganadh G Practical Natural Language Processing
Other Interesting Tasks Named Entity Identification Information Extraction Information Retrieval Jaganadh G Practical Natural Language Processing
Other Interesting Tasks Named Entity Identification Information Extraction Information Retrieval Text Classification and Clustering Jaganadh G Practical Natural Language Processing
Speech Processing Two Major Areas Text to Speech Speech Recognition Jaganadh G Practical Natural Language Processing
Speech Processing Two Major Areas Text to Speech Speech Recognition Practical Applications IVR Technology for Visually Challenged People Mobile Phones Speech Enabled Web Vehicle Mounted GPS Navigator Jaganadh G Practical Natural Language Processing
Commerical NLP Applications What Industry Looks Jaganadh G Practical Natural Language Processing
Commerical NLP Applications What Industry Looks Components of Word Processors Jaganadh G Practical Natural Language Processing
Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Jaganadh G Practical Natural Language Processing
Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Jaganadh G Practical Natural Language Processing
Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Jaganadh G Practical Natural Language Processing
Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Entity Identification Jaganadh G Practical Natural Language Processing
Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Entity Identification Text Summarization Jaganadh G Practical Natural Language Processing
Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Entity Identification Text Summarization Speech Systems Jaganadh G Practical Natural Language Processing
Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Entity Identification Text Summarization Speech Systems Question Answering Systems Jaganadh G Practical Natural Language Processing
Future of NLP Future!!! Semantics oriented technologies Jaganadh G Practical Natural Language Processing
NLP in other domains Bio-Medical Legal Forensic Science Advertisement Education Politics E-governance Business Development Marketing and where ever we use language !!! Jaganadh G Practical Natural Language Processing
Natural Language Processing in India Academic Institutions IIT Kanpur, Kharagpur, Bombay IIIT hydrabad IISc Bangalore AU-KBC Chennai Amritha University Ettimadai, Coimbatore IIITMK, Trivandrum Central University, Hydrabad JNU, Delhi Tamil University, Thanjore Jaganadh G Practical Natural Language Processing
Natural Language Processing in India Industry Microsoft Yahoo! AOL 365Media Pvt. Ltd. Inside View Thaazza AIAIO Labs Jaganadh G Practical Natural Language Processing
Questions ?? Jaganadh G Practical Natural Language Processing
References Daniel Jurafsky,James H. Martin, SPEECH and LANGUAGE PROCESSING, 2nd Edition. U.S. Tiwary, Tanveer Siddiqui , Natural Language Processing and Information Retrieval Jaganadh G Practical Natural Language Processing
Finally Jaganadh G Practical Natural Language Processing
Questions ?? Jaganadh G Practical Natural Language Processing
References Daniel Jurafsky,James H. Martin, SPEECH and LANGUAGE PROCESSING, 2nd Edition. U.S. Tiwary, Tanveer Siddiqui , Natural Language Processing and Information Retrieval Jaganadh G Practical Natural Language Processing
Finally Jaganadh G Practical Natural Language Processing

More Related Content

PPTX
Natural language processing
byHansi Thenuwara
 
DOCX
Natural language processing
byKarenVacca
 
PPTX
Natural Language Processing
byVarunjeet Singh Rekhi
 
PDF
Natural language processing (nlp)
byKuppusamy P
 
PDF
Natural language processing
byNational Institute of Technology Durgapur
 
PPTX
NLP
byGirish Khanzode
 
PPTX
Natural Language Processing (NLP).pptx
bySHIBDASDUTTA
 
PPTX
natural language processing help at myassignmenthelp.net
bywww.myassignmenthelp.net
 
Natural language processing
byHansi Thenuwara
 
Natural language processing
byKarenVacca
 
Natural Language Processing
byVarunjeet Singh Rekhi
 
Natural language processing (nlp)
byKuppusamy P
 
Natural language processing
byNational Institute of Technology Durgapur
 
NLP
byGirish Khanzode
 
Natural Language Processing (NLP).pptx
bySHIBDASDUTTA
 
natural language processing help at myassignmenthelp.net
bywww.myassignmenthelp.net
 

What's hot

PPTX
Natural Language processing Parts of speech tagging, its classes, and how to ...
byRajnish Raj
 
PPTX
Natural Language Processing
bySaurabh Kaushik
 
PPTX
Natural Language Processing
byRishikese MR
 
PPTX
A Panorama of Natural Language Processing
byTed Xiao
 
PPTX
Nlp
byNishanthini Mary
 
PDF
Natural language processing
byAanchal Chaurasia
 
PPT
Natural Language Processing
byYasir Khan
 
PDF
Natural Language Processing seminar review
byJayneel Vora
 
PPTX
Treebank annotation
byMohit Jasapara
 
PPTX
Natural Language Processing
byAdarsh Saxena
 
PPTX
Introduction to natural language processing (NLP)
byAlia Hamwi
 
PDF
Natural Language Processing
byJaganadh Gopinadhan
 
PPT
First order logic
byRushdi Shams
 
PPTX
Natural language processing
byYogendra Tamang
 
PPTX
Natural Language Processing
byVeenaSKumar2
 
PPT
context free language
bykhush_boo31
 
PPTX
Natural language processing (NLP)
byASWINKP11
 
PPT
Natural language processing
byBasha Chand
 
PPTX
Word embedding
byShivaniChoudhary74
 
PDF
Nlp ambiguity presentation
byGurram Poorna Prudhvi
 
Natural Language processing Parts of speech tagging, its classes, and how to ...
byRajnish Raj
 
Natural Language Processing
bySaurabh Kaushik
 
Natural Language Processing
byRishikese MR
 
A Panorama of Natural Language Processing
byTed Xiao
 
Nlp
byNishanthini Mary
 
Natural language processing
byAanchal Chaurasia
 
Natural Language Processing
byYasir Khan
 
Natural Language Processing seminar review
byJayneel Vora
 
Treebank annotation
byMohit Jasapara
 
Natural Language Processing
byAdarsh Saxena
 
Introduction to natural language processing (NLP)
byAlia Hamwi
 
Natural Language Processing
byJaganadh Gopinadhan
 
First order logic
byRushdi Shams
 
Natural language processing
byYogendra Tamang
 
Natural Language Processing
byVeenaSKumar2
 
context free language
bykhush_boo31
 
Natural language processing (NLP)
byASWINKP11
 
Natural language processing
byBasha Chand
 
Word embedding
byShivaniChoudhary74
 
Nlp ambiguity presentation
byGurram Poorna Prudhvi
 

Viewers also liked

PDF
Natural Language Processing for the Semantic Web
byIsabelle Augenstein
 
PDF
Natural Language Processing and Machine Learning
byKarthik Sankar
 
PPT
NLTK: Natural Language Processing made easy
byoutsider2
 
PPTX
NLTK - Natural Language Processing in Python
byshanbady
 
PDF
Practical Natural Language Processing
byJaganadh Gopinadhan
 
PPT
Introduction to Natural Language Processing
byPranav Gupta
 
Natural Language Processing for the Semantic Web
byIsabelle Augenstein
 
Natural Language Processing and Machine Learning
byKarthik Sankar
 
NLTK: Natural Language Processing made easy
byoutsider2
 
NLTK - Natural Language Processing in Python
byshanbady
 
Practical Natural Language Processing
byJaganadh Gopinadhan
 
Introduction to Natural Language Processing
byPranav Gupta
 

Similar to Practical Natural Language Processing From Theory to Industrial Applications

PDF
Practical Natural Language Processing
byJaganadh Gopinadhan
 
PDF
An Overview Of Natural Language Processing
byScott Faria
 
PDF
The Evolution and Impact of Natural Language Processing.pdf
byFuture Education Magazine
 
PPTX
module 1 on exploratory data analysis.pptx
byFathimaFareeda3
 
PPTX
Powerful landscape of natural language processing
byPolestarsolutions
 
PPTX
Natural Language Processing.pptx
byPriyadharshiniG41
 
PPTX
Unit 1_Natural Language Processing complete guide.pptx
bymynamemy
 
PDF
Natural Language Processing
byCloudxLab
 
PPTX
U1_NLP complete.pptxerererererererererrr
byabcdefgh690537
 
PDF
Bird05 nltk-intro
byStefano Lariccia
 
PPTX
Unit-1vvvvvvvvvvvvvvvvvvvvvvbbbbbbbbbbbbbbvvv.pptx
bydivyajchhajeddc16102
 
PPTX
Natural language processing and search
byNathan McMinn
 
PDF
Natural Language Processing (NLP), Search and Wearable Technology
bypixelbuilders
 
PDF
call for papers, research paper publishing, where to publish research paper, ...
byInternational Journal of Engineering Inventions www.ijeijournal.com
 
PPTX
NATURAL LANGUAGE PROCESSING.pptx
bysaivinay93
 
PDF
Demystifying Natural Language Processing: A Beginner’s Guide
byCyberPro Magazine
 
PDF
Role of Natural Language Processing in AI - Overview
byGrapesTech Solutions
 
PPTX
LONGSEM2024-25_CSE3015_ETH_AP2024256000125_Reference-Material-I.pptx
byvemuripraveena2622
 
PDF
NLP in Customer Service - How Its Used Whats Next.pdf
byniahiggins21
 
PDF
NLP in Customer Service – Complete Guide
bySoluLab1231
 
Practical Natural Language Processing
byJaganadh Gopinadhan
 
An Overview Of Natural Language Processing
byScott Faria
 
The Evolution and Impact of Natural Language Processing.pdf
byFuture Education Magazine
 
module 1 on exploratory data analysis.pptx
byFathimaFareeda3
 
Powerful landscape of natural language processing
byPolestarsolutions
 
Natural Language Processing.pptx
byPriyadharshiniG41
 
Unit 1_Natural Language Processing complete guide.pptx
bymynamemy
 
Natural Language Processing
byCloudxLab
 
U1_NLP complete.pptxerererererererererrr
byabcdefgh690537
 
Bird05 nltk-intro
byStefano Lariccia
 
Unit-1vvvvvvvvvvvvvvvvvvvvvvbbbbbbbbbbbbbbvvv.pptx
bydivyajchhajeddc16102
 
Natural language processing and search
byNathan McMinn
 
Natural Language Processing (NLP), Search and Wearable Technology
bypixelbuilders
 
call for papers, research paper publishing, where to publish research paper, ...
byInternational Journal of Engineering Inventions www.ijeijournal.com
 
NATURAL LANGUAGE PROCESSING.pptx
bysaivinay93
 
Demystifying Natural Language Processing: A Beginner’s Guide
byCyberPro Magazine
 
Role of Natural Language Processing in AI - Overview
byGrapesTech Solutions
 
LONGSEM2024-25_CSE3015_ETH_AP2024256000125_Reference-Material-I.pptx
byvemuripraveena2622
 
NLP in Customer Service - How Its Used Whats Next.pdf
byniahiggins21
 
NLP in Customer Service – Complete Guide
bySoluLab1231
 

More from Jaganadh Gopinadhan

PDF
Introduction to Sentiment Analysis
byJaganadh Gopinadhan
 
PDF
Elements of Text Mining Part - I
byJaganadh Gopinadhan
 
PDF
Natural Language Processing with Per
byJaganadh Gopinadhan
 
PPT
Indian Language Spellchecker Development for OpenOffice.org
byJaganadh Gopinadhan
 
PPT
Sanskrit and Computational Linguistic
byJaganadh Gopinadhan
 
PDF
Script to Sentiment : on future of Language TechnologyMysore latest
byJaganadh Gopinadhan
 
ODT
A tutorial on Machine Translation
byJaganadh Gopinadhan
 
PDF
Linguistic localization framework for Ooo
byJaganadh Gopinadhan
 
PDF
Ilucbe python v1.2
byJaganadh Gopinadhan
 
PDF
Social Media Analytics
byJaganadh Gopinadhan
 
PDF
Success Factor
byJaganadh Gopinadhan
 
PDF
ntroduction to GNU/Linux Linux Installation and Basic Commands
byJaganadh Gopinadhan
 
PDF
Let’s Learn Python An introduction to Python
byJaganadh Gopinadhan
 
PDF
Introduction to Free and Open Source Software
byJaganadh Gopinadhan
 
PDF
Opinion Mining and Sentiment Analysis Issues and Challenges
byJaganadh Gopinadhan
 
PDF
What they think about my brand/product ?!?!? An Introduction to Sentiment Ana...
byJaganadh Gopinadhan
 
PDF
Tools andTechnologies for Large Scale Data Mining
byJaganadh Gopinadhan
 
PDF
Hdfs
byJaganadh Gopinadhan
 
PDF
Mahout Tutorial FOSSMEET NITC
byJaganadh Gopinadhan
 
PDF
Practical Machine Learning
byJaganadh Gopinadhan
 
Introduction to Sentiment Analysis
byJaganadh Gopinadhan
 
Elements of Text Mining Part - I
byJaganadh Gopinadhan
 
Natural Language Processing with Per
byJaganadh Gopinadhan
 
Indian Language Spellchecker Development for OpenOffice.org
byJaganadh Gopinadhan
 
Sanskrit and Computational Linguistic
byJaganadh Gopinadhan
 
Script to Sentiment : on future of Language TechnologyMysore latest
byJaganadh Gopinadhan
 
A tutorial on Machine Translation
byJaganadh Gopinadhan
 
Linguistic localization framework for Ooo
byJaganadh Gopinadhan
 
Ilucbe python v1.2
byJaganadh Gopinadhan
 
Social Media Analytics
byJaganadh Gopinadhan
 
Success Factor
byJaganadh Gopinadhan
 
ntroduction to GNU/Linux Linux Installation and Basic Commands
byJaganadh Gopinadhan
 
Let’s Learn Python An introduction to Python
byJaganadh Gopinadhan
 
Introduction to Free and Open Source Software
byJaganadh Gopinadhan
 
Opinion Mining and Sentiment Analysis Issues and Challenges
byJaganadh Gopinadhan
 
What they think about my brand/product ?!?!? An Introduction to Sentiment Ana...
byJaganadh Gopinadhan
 
Tools andTechnologies for Large Scale Data Mining
byJaganadh Gopinadhan
 
Hdfs
byJaganadh Gopinadhan
 
Mahout Tutorial FOSSMEET NITC
byJaganadh Gopinadhan
 
Practical Machine Learning
byJaganadh Gopinadhan
 

Recently uploaded

PDF
Explaining the flow of purpose-specific BOM
byakipii ogaoga
 
PDF
The Emergence of Empathic XR: AWE Asia 2026 keynote
byMark Billinghurst
 
PPTX
Automation Without Apprentices: How AI Challenges the Open Source Way
byIcinga
 
PDF
The Manifesto for AI-enabled Governance !
byYannis Charalabidis
 
PDF
TravelTech Paris 2025 | The EU Digital Identity Wallet and it’s impact on Tra...
byapidays
 
PPTX
TravelTech Paris 2025 | Beyond the pipes: Why Channel Management isn’t really...
byapidays
 
PPTX
Do You Control the AI, or Does the AI Control You?
bymedhateltoukhy
 
PDF
NTG -Company Profile_Software_Vendor_Company_in_MENA
byMustafa Kuğu
 
PDF
How to Install XRDP on CentOS 10 .pdf
byGreen Webpage
 
PDF
Explaining specific examples of purpose-specific BOM
byakipii ogaoga
 
PPTX
Computer architecture, Computer architecture ,Computer architecture
bywaheedqazi123
 
PDF
Traditional-Security-Models-No-Longer-Work.pptx (1).pdf
byOhhproJunction
 
PDF
Antminer S23Hyd-580_Manual-V1.1-oneminers.pdf
byFranzhLawrenceBataan1
 
PDF
Oracle Cloud Infrastructure 2025 Architect Professional (1Z0-1127-25) Master ...
byExamCert App
 
PDF
Rustici Software: eLearning standards in the age of AI
byRustici Software
 
PDF
Escape from the Forbidden Zone: Smuggling green and inclusive tech past the g...
byBookNet Canada
 
PDF
final.pdf
byomarbishtawi04
 
PDF
GenerationAI Paris 2025 | How Agentic AI is Reinventing Organizations
byapidays
 
PDF
Why Many Smart Device Platforms Fail to Scale?
byPromeraki Developments
 
PDF
Odoo Implementation Checklist: A Strategic ERP Blueprint for Business-Ready D...
byBANIBRO IT SOLUTION
 
Explaining the flow of purpose-specific BOM
byakipii ogaoga
 
The Emergence of Empathic XR: AWE Asia 2026 keynote
byMark Billinghurst
 
Automation Without Apprentices: How AI Challenges the Open Source Way
byIcinga
 
The Manifesto for AI-enabled Governance !
byYannis Charalabidis
 
TravelTech Paris 2025 | The EU Digital Identity Wallet and it’s impact on Tra...
byapidays
 
TravelTech Paris 2025 | Beyond the pipes: Why Channel Management isn’t really...
byapidays
 
Do You Control the AI, or Does the AI Control You?
bymedhateltoukhy
 
NTG -Company Profile_Software_Vendor_Company_in_MENA
byMustafa Kuğu
 
How to Install XRDP on CentOS 10 .pdf
byGreen Webpage
 
Explaining specific examples of purpose-specific BOM
byakipii ogaoga
 
Computer architecture, Computer architecture ,Computer architecture
bywaheedqazi123
 
Traditional-Security-Models-No-Longer-Work.pptx (1).pdf
byOhhproJunction
 
Antminer S23Hyd-580_Manual-V1.1-oneminers.pdf
byFranzhLawrenceBataan1
 
Oracle Cloud Infrastructure 2025 Architect Professional (1Z0-1127-25) Master ...
byExamCert App
 
Rustici Software: eLearning standards in the age of AI
byRustici Software
 
Escape from the Forbidden Zone: Smuggling green and inclusive tech past the g...
byBookNet Canada
 
final.pdf
byomarbishtawi04
 
GenerationAI Paris 2025 | How Agentic AI is Reinventing Organizations
byapidays
 
Why Many Smart Device Platforms Fail to Scale?
byPromeraki Developments
 
Odoo Implementation Checklist: A Strategic ERP Blueprint for Business-Ready D...
byBANIBRO IT SOLUTION
 

Practical Natural Language Processing From Theory to Industrial Applications

  • 1.
    Practical Natural LanguageProcessing From Theory to Industrial Applications Jaganadh G http://jaganadhg.in jaganadhg@gmail.com Karpagam University Coimbatore 19th March 2012 Jaganadh G Practical Natural Language Processing
  • 2.
    About me !! Working in Natural Language Processing, Machine Learning, Data Mining etc... Passionate about Free and Open source :-) When gets free time teaches Python, Speaks about FOSS and blogs at http://jaganadhg.in I am a computational linguist / Linguist and Indologist, Book reviewer Software Engineer by Profession Jaganadh G Practical Natural Language Processing
  • 3.
    Question ?? Haveyou ever used any Natural Language Processing based tools/services? Jaganadh G Practical Natural Language Processing
  • 4.
    Question ?? Haveyou ever used any Natural Language Processing based tools/services? Jaganadh G Practical Natural Language Processing
  • 5.
    Question ?? Haveyou ever used any Natural Language Processing based tools/services? Jaganadh G Practical Natural Language Processing
  • 6.
    What is NaturalLanguage Processing (NLP) ? Aim : To build intelligent systems that can interact with human beings as like human beings Jaganadh G Practical Natural Language Processing
  • 7.
    What is NaturalLanguage Processing (NLP) ? Aim : To build intelligent systems that can interact with human beings as like human beings Jaganadh G Practical Natural Language Processing
  • 8.
    What is NaturalLanguage Processing (NLP) ? Aim : To build intelligent systems that can interact with human beings as like human beings A sub-field of Artificial Intelligence (AI) Jaganadh G Practical Natural Language Processing
  • 9.
    What is NaturalLanguage Processing (NLP) ? Aim : To build intelligent systems that can interact with human beings as like human beings A sub-field of Artificial Intelligence (AI) Inter-disciplinary subject (Language + Linguistics + Statistics + Computer Science + .. ) Natural Language Refers to the language spoken by people, e.g. English,Japanese, Tamil, Malayalam as opposed to artificial languages, like C++, Java, etc. Jaganadh G Practical Natural Language Processing
  • 10.
    Definition Natural LanguageProcessing Natural Language Processing is a theoretically motivated range of computational techniques for analyzing and representing naturally occurring texts/speech at one or more levels of linguistic analysis for the purpose of achieving human-like language processing for a range of tasks or applications. NLP was considered as an academic discipline before some 10 to 20 years. Now concepts from NLP is applied in variety of Computing Platforms and Services Jaganadh G Practical Natural Language Processing
  • 11.
    Practical NLP ? Problem Picture Courtesy: http://twitpic.com/1y21qm/full Jaganadh G Practical Natural Language Processing
  • 12.
    Practical NLP ? Problem Before going to some theory can we have some funny practical problems to solve ? Picture Courtesy: http://twitpic.com/1y21qm/full Jaganadh G Practical Natural Language Processing
  • 13.
    Practical NLP ? Problem Before going to some theory can we have some funny practical problems to solve ? Picture Courtesy: http://twitpic.com/1y21qm/full Jaganadh G Practical Natural Language Processing
  • 14.
    Practical NLP Problem Jaganadh G Practical Natural Language Processing
  • 15.
    Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Jaganadh G Practical Natural Language Processing
  • 16.
    Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Jaganadh G Practical Natural Language Processing
  • 17.
    Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Jaganadh G Practical Natural Language Processing
  • 18.
    Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers Jaganadh G Practical Natural Language Processing
  • 19.
    Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Jaganadh G Practical Natural Language Processing
  • 20.
    Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Identify tweet category Jaganadh G Practical Natural Language Processing
  • 21.
    Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Identify tweet category Process home-delivery request Jaganadh G Practical Natural Language Processing
  • 22.
    Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Identify tweet category Process home-delivery request Evaluate quality related tweets Jaganadh G Practical Natural Language Processing
  • 23.
    Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Identify tweet category Process home-delivery request Evaluate quality related tweets How? How to find a solution for Tweet-a-Toddy Jaganadh G Practical Natural Language Processing
  • 24.
    Solution ?? AnySolutions Jaganadh G Practical Natural Language Processing
  • 25.
    Solution ?? AnySolutions Some thoughts Jaganadh G Practical Natural Language Processing
  • 26.
    Solution ?? AnySolutions Some thoughts Text Classification Jaganadh G Practical Natural Language Processing
  • 27.
    Solution ?? AnySolutions Some thoughts Text Classification Entity Identification Jaganadh G Practical Natural Language Processing
  • 28.
    Solution ?? AnySolutions Some thoughts Text Classification Entity Identification Information Extraction Jaganadh G Practical Natural Language Processing
  • 29.
    Solution ?? AnySolutions Some thoughts Text Classification Entity Identification Information Extraction Sentiment Analysis Jaganadh G Practical Natural Language Processing
  • 30.
    Solution ?? AnySolutions Some thoughts Text Classification Entity Identification Information Extraction Sentiment Analysis Parsing, gammer ... Jaganadh G Practical Natural Language Processing
  • 31.
    Solution ?? AnySolutions Some thoughts Text Classification Entity Identification Information Extraction Sentiment Analysis Parsing, gammer ... Regex (Regular Expressions) Jaganadh G Practical Natural Language Processing
  • 32.
    Another Practical Question Everybody might have used spell checker available in word processing systems like OpenOffice.org or Microsoft Word Any guess on how to develop a spell checker system ? Solutions Jaganadh G Practical Natural Language Processing
  • 33.
    Another Practical Question Everybody might have used spell checker available in word processing systems like OpenOffice.org or Microsoft Word Any guess on how to develop a spell checker system ? Solutions Word List Jaganadh G Practical Natural Language Processing
  • 34.
    Another Practical Question Everybody might have used spell checker available in word processing systems like OpenOffice.org or Microsoft Word Any guess on how to develop a spell checker system ? Solutions Word List Structure of words Jaganadh G Practical Natural Language Processing
  • 35.
    Another Practical Question Everybody might have used spell checker available in word processing systems like OpenOffice.org or Microsoft Word Any guess on how to develop a spell checker system ? Solutions Word List Structure of words Dynamic Programming (Edit Distance) Jaganadh G Practical Natural Language Processing
  • 36.
    Another Practical Question... Context Sensitive Spell-checking Identifying and suggesting spelling of words based on context How ?? Jaganadh G Practical Natural Language Processing
  • 37.
    Another Practical Question... Context Sensitive Spell-checking Identifying and suggesting spelling of words based on context How ?? Solutions Jaganadh G Practical Natural Language Processing
  • 38.
    Another Practical Question... Context Sensitive Spell-checking Identifying and suggesting spelling of words based on context How ?? Solutions Statistical Models Jaganadh G Practical Natural Language Processing
  • 39.
    Another Practical Question... Context Sensitive Spell-checking Identifying and suggesting spelling of words based on context How ?? Solutions Statistical Models Word category based suggestions Jaganadh G Practical Natural Language Processing
  • 40.
    Can Machines Translate?? Answer !!! Jaganadh G Practical Natural Language Processing
  • 41.
    Why NLP ? Because ”Information is Power !!!” Jaganadh G Practical Natural Language Processing
  • 42.
    Why NLP ? Because ”Information is Power !!!” Picture Courtesy: http://soundsgood.in/wikipediafat print book/ Jaganadh G Practical Natural Language Processing
  • 43.
    Why NLP ? Because ”Information is Power !!!” Every day wast amount of text and speech data is being produced Picture Courtesy: http://soundsgood.in/wikipediafat print book/ Jaganadh G Practical Natural Language Processing
  • 44.
    Why NLP ? Because ”Information is Power !!!” Every day wast amount of text and speech data is being produced Internet == at least 40 Million pages Picture Courtesy: http://soundsgood.in/wikipediafat print book/ Jaganadh G Practical Natural Language Processing
  • 45.
    Why NLP ? Because ”Information is Power !!!” Every day wast amount of text and speech data is being produced Internet == at least 40 Million pages Picture Courtesy: http://soundsgood.in/wikipediafat print book/ Jaganadh G Practical Natural Language Processing
  • 46.
    History Jaganadh G Practical Natural Language Processing
  • 47.
    History Second World War !!! Jaganadh G Practical Natural Language Processing
  • 48.
    History Second World War !!! Machine Translation Jaganadh G Practical Natural Language Processing
  • 49.
    History Second World War !!! Machine Translation Now : Jaganadh G Practical Natural Language Processing
  • 50.
    History Second World War !!! Machine Translation Now : Most promising imperfect technology Jaganadh G Practical Natural Language Processing
  • 51.
    History Second World War !!! Machine Translation Now : Most promising imperfect technology Moves from Lab to Industry to Layman Jaganadh G Practical Natural Language Processing
  • 52.
    NLP Really Hardto Achieve? NLP delas with human languages Human Language is dynamic and mysterious !!! Jaganadh G Practical Natural Language Processing
  • 53.
    NLP Really Hardto Achieve? NLP delas with human languages Human Language is dynamic and mysterious !!! Communication in Human Language Jaganadh G Practical Natural Language Processing
  • 54.
    NLP Really Hardto Achieve? Levels of Knowledge encoding in Language Data Jaganadh G Practical Natural Language Processing
  • 55.
    Tasks in NLP Broad Areas Jaganadh G Practical Natural Language Processing
  • 56.
    Tasks in NLP Broad Areas Text Processing Jaganadh G Practical Natural Language Processing
  • 57.
    Tasks in NLP Broad Areas Text Processing Speech Processing Jaganadh G Practical Natural Language Processing
  • 58.
    Major tasks inText Processing Jaganadh G Practical Natural Language Processing
  • 59.
    Major tasks inText Processing Word Level Analysis Jaganadh G Practical Natural Language Processing
  • 60.
    Major tasks inText Processing Word Level Analysis Morphological Synthesis Jaganadh G Practical Natural Language Processing
  • 61.
    Major tasks inText Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Jaganadh G Practical Natural Language Processing
  • 62.
    Major tasks inText Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Stemming Jaganadh G Practical Natural Language Processing
  • 63.
    Major tasks inText Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Stemming Lemmatization Jaganadh G Practical Natural Language Processing
  • 64.
    Major tasks inText Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Stemming Lemmatization Sentence Level Analysis - Syntactical Parsing Jaganadh G Practical Natural Language Processing
  • 65.
    Major tasks inText Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Stemming Lemmatization Sentence Level Analysis - Syntactical Parsing Discourse Analysis - Semantic Processing Jaganadh G Practical Natural Language Processing
  • 66.
    Morphology The branchof linguistics that studies word structures. Jaganadh G Practical Natural Language Processing
  • 67.
    Morphology The branchof linguistics that studies word structures. To a computer program a word is : ??? Jaganadh G Practical Natural Language Processing
  • 68.
    Morphology The branchof linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Jaganadh G Practical Natural Language Processing
  • 69.
    Morphology The branchof linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Jaganadh G Practical Natural Language Processing
  • 70.
    Morphology The branchof linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Jaganadh G Practical Natural Language Processing
  • 71.
    Morphology The branchof linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Morphological Generation Jaganadh G Practical Natural Language Processing
  • 72.
    Morphology The branchof linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Morphological Generation Stemming Jaganadh G Practical Natural Language Processing
  • 73.
    Morphology The branchof linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Morphological Generation Stemming Lemmatization Jaganadh G Practical Natural Language Processing
  • 74.
    Practical Question fromMorphology Approximate number of word forms that can be derived from the word ”maram” Jaganadh G Practical Natural Language Processing
  • 75.
    Parts of SpeechTagging POS tagging is the process of marking up the words in a text (corpus) as corresponding to a particular part of speech, based on both its definition, as well as its context. Ram goes to school. Ram/NNP goes/VBZ to/TO school/NN ./. Jaganadh G Practical Natural Language Processing
  • 76.
    Parts of SpeechTagging POS tagging is the process of marking up the words in a text (corpus) as corresponding to a particular part of speech, based on both its definition, as well as its context. Ram goes to school. Ram/NNP goes/VBZ to/TO school/NN ./. Words are ambiguous !!!! e.g. book, cricket, bank Jaganadh G Practical Natural Language Processing
  • 77.
    Syntactical Parsing Parsing In computer science and linguistics, parsing, or, more formally, syntactic analysis, is the process of analyzing a text, made of a sequence of tokens (for example, words), to determine its grammatical structure with respect to a given (more or less) formal grammar. Jaganadh G Practical Natural Language Processing
  • 78.
    Syntactical Parsing Parsing In computer science and linguistics, parsing, or, more formally, syntactic analysis, is the process of analyzing a text, made of a sequence of tokens (for example, words), to determine its grammatical structure with respect to a given (more or less) formal grammar. Sentences are ambiguous !!!! Jaganadh G Practical Natural Language Processing
  • 79.
    Semantics Study ofmeaning ans its structure Jaganadh G Practical Natural Language Processing
  • 80.
    Semantics Study ofmeaning ans its structure Word meaning is ambiguous !!!! E.g. marriage Jaganadh G Practical Natural Language Processing
  • 81.
    Where can Iapply this techniques? Machine Translation Systems Jaganadh G Practical Natural Language Processing
  • 82.
    Where can Iapply this techniques? Machine Translation Systems Search Engine Jaganadh G Practical Natural Language Processing
  • 83.
    Where can Iapply this techniques? Machine Translation Systems Search Engine Spell-checker Jaganadh G Practical Natural Language Processing
  • 84.
    Where can Iapply this techniques? Machine Translation Systems Search Engine Spell-checker Grammar Checker Jaganadh G Practical Natural Language Processing
  • 85.
    Where can Iapply this techniques? Machine Translation Systems Search Engine Spell-checker Grammar Checker .......... Jaganadh G Practical Natural Language Processing
  • 86.
    Other Interesting Tasks Named Entity Identification Jaganadh G Practical Natural Language Processing
  • 87.
    Other Interesting Tasks Named Entity Identification Information Extraction Jaganadh G Practical Natural Language Processing
  • 88.
    Other Interesting Tasks Named Entity Identification Information Extraction Information Retrieval Jaganadh G Practical Natural Language Processing
  • 89.
    Other Interesting Tasks Named Entity Identification Information Extraction Information Retrieval Text Classification and Clustering Jaganadh G Practical Natural Language Processing
  • 90.
    Speech Processing TwoMajor Areas Text to Speech Speech Recognition Jaganadh G Practical Natural Language Processing
  • 91.
    Speech Processing TwoMajor Areas Text to Speech Speech Recognition Practical Applications IVR Technology for Visually Challenged People Mobile Phones Speech Enabled Web Vehicle Mounted GPS Navigator Jaganadh G Practical Natural Language Processing
  • 92.
    Commerical NLP Applications What Industry Looks Jaganadh G Practical Natural Language Processing
  • 93.
    Commerical NLP Applications What Industry Looks Components of Word Processors Jaganadh G Practical Natural Language Processing
  • 94.
    Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Jaganadh G Practical Natural Language Processing
  • 95.
    Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Jaganadh G Practical Natural Language Processing
  • 96.
    Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Jaganadh G Practical Natural Language Processing
  • 97.
    Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Entity Identification Jaganadh G Practical Natural Language Processing
  • 98.
    Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Entity Identification Text Summarization Jaganadh G Practical Natural Language Processing
  • 99.
    Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Entity Identification Text Summarization Speech Systems Jaganadh G Practical Natural Language Processing
  • 100.
    Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Entity Identification Text Summarization Speech Systems Question Answering Systems Jaganadh G Practical Natural Language Processing
  • 101.
    Future of NLP Future!!! Semantics oriented technologies Jaganadh G Practical Natural Language Processing
  • 102.
    NLP in otherdomains Bio-Medical Legal Forensic Science Advertisement Education Politics E-governance Business Development Marketing and where ever we use language !!! Jaganadh G Practical Natural Language Processing
  • 103.
    Natural Language Processingin India Academic Institutions IIT Kanpur, Kharagpur, Bombay IIIT hydrabad IISc Bangalore AU-KBC Chennai Amritha University Ettimadai, Coimbatore IIITMK, Trivandrum Central University, Hydrabad JNU, Delhi Tamil University, Thanjore Jaganadh G Practical Natural Language Processing
  • 104.
    Natural Language Processingin India Industry Microsoft Yahoo! AOL 365Media Pvt. Ltd. Inside View Thaazza AIAIO Labs Jaganadh G Practical Natural Language Processing
  • 105.
    Questions ?? Jaganadh G Practical Natural Language Processing
  • 106.
    References Daniel Jurafsky,James H. Martin, SPEECH and LANGUAGE PROCESSING, 2nd Edition. U.S. Tiwary, Tanveer Siddiqui , Natural Language Processing and Information Retrieval Jaganadh G Practical Natural Language Processing
  • 107.
    Finally Jaganadh G Practical Natural Language Processing
  • 108.
    Questions ?? Jaganadh G Practical Natural Language Processing
  • 109.
    References Daniel Jurafsky,James H. Martin, SPEECH and LANGUAGE PROCESSING, 2nd Edition. U.S. Tiwary, Tanveer Siddiqui , Natural Language Processing and Information Retrieval Jaganadh G Practical Natural Language Processing
  • 110.
    Finally Jaganadh G Practical Natural Language Processing