SlideShare a Scribd company logo
Natural Language Processing with Python Certification Course www.edureka.co
Natural Language Processing with Python Certification Course www.edureka.co
Text Mining
&
NLP
Natural Language Processing with Python Certification Course www.edureka.co
Today’s Training Topics
❖ Evolution of Human Language
❖ What is Text Mining?
❖ Text Mining and Natural Language Processing?
❖ Applications of NLP
❖ NLP Components and Demo
Natural Language Processing with Python Certification Course www.edureka.co
The Human Language
LANGUAGE
ALPHABETS
字母 वर्णमाला
ALFABETOS
‫األبجدية‬ எழுத்துக்கள்
Natural Language Processing with Python Certification Course www.edureka.co
The Human Language
LANGUAGE
ALPHABETS
字母 वर्णमाला ALFABETOS
‫األبجدية‬ எழுத்துக்கள்
Words form Sentences
Natural Language Processing with Python Certification Course www.edureka.co
The Human Language
LANGUAGE
ALPHABETS
字母 वर्णमाला ALFABETOS
‫األبجدية‬ எழுத்துக்கள்
Words form Sentences
Natural Language Processing with Python Certification Course www.edureka.co
The 21st Century
21 %
STRUCTURED
DATA
Natural Language Processing with Python Certification Course www.edureka.co
The 21st Century
STRUCTURED
DATA21 %
Unstructured
Natural Language Processing with Python Certification Course www.edureka.co
What is Text Mining ?
Text Mining / Text Analytics is the process of deriving
meaningful information from natural language text
Natural Language Processing with Python Certification Course www.edureka.co
Text Mining and NLP
As, Text Mining refers to
the process of deriving high quality
information from the text .
The overall goal is, essentially to turn
text into data for analysis, via
application of Natural Language
Processing (NLP)
Natural Language Processing with Python Certification Course www.edureka.co
What is NLP?
NLP: Natural Language Processing is a part of computer science
and artificial intelligence which deals with human languages.
Natural Language Processing with Python Certification Course www.edureka.co
Basic Structure of a NLP Application
Natural Language Processing with Python Certification Course www.edureka.co
Applications of NLP
Sentimental
Analysis
Speech
Recognition
Chatbot
Machine
Translation
Natural Language Processing with Python Certification Course www.edureka.co
Applications of NLP and Text Mining
Spell
Checking
Keyword
Search
Information
Extraction
Advertisement
Matching
Natural Language Processing with Python Certification Course www.edureka.co
Natural Language Processing with Python Certification Course www.edureka.co
NLP : Components
Natural Language Processing with Python Certification Course www.edureka.co
NLP : Components
Natural Language
Understanding
Natural Language
Generation
Natural Language Processing with Python Certification Course www.edureka.co
NLP : Components
Natural Language
Understanding
Natural Language
Generation
• Mapping input to useful representations
• Analyzing different aspects of the
language
• Text Planning
• Sentence Planning
• Text Realization
Natural Language Processing with Python Certification Course www.edureka.co
NLP : Ambiguity
Natural Language
Understanding
Lexical Ambiguity
Syntactic Ambiguity
Referential Ambiguity
Natural Language Processing with Python Certification Course www.edureka.co
NLU : Ambiguity
Lexical Ambiguity
Syntactic Ambiguity
Referential Ambiguity
She is looking for a match.
The fisherman went to the bank.
Natural Language Processing with Python Certification Course www.edureka.co
NLU : Ambiguity
Lexical Ambiguity
Syntactic Ambiguity
Referential Ambiguity
She is looking for a match.
The fisherman went to the bank.
The chicken is ready to eat.
Visiting relatives can be boring.
I saw the man with the binoculars.
Natural Language Processing with Python Certification Course www.edureka.co
NLU : Ambiguity
Lexical Ambiguity
Syntactic Ambiguity
Referential Ambiguity
She is looking for a match.
The fisherman went to the bank.
The chicken is ready to eat.
Visiting relatives can be boring.
I saw the man with the binoculars.
The boy told his father the theft. He was very upset
Natural Language Processing with Python Certification Course www.edureka.co
NLTK
Natural Language Processing with Python Certification Course www.edureka.co
NLTK
NLTK
Natural Language Processing with Python Certification Course www.edureka.co
NLTK
NLTK
Natural Language Processing with Python Certification Course www.edureka.co
Tokenization
01 Break a complex sentence into words
02 Understand the importance of each of the words with respect to the
sentence
03 Produce a structural description on an input sentence
Tokenization is the first step in NLP
Natural Language Processing with Python Certification Course www.edureka.co
Tokenization
01 Break a complex sentence into words
02 Understand the importance of each of the words with respect to the
sentence
03 Produce a structural description on an input sentence
Tokenization is the first step in NLP
Natural Language Processing with Python Certification Course www.edureka.co
Tokenization
Natural Language Processing with Python Certification Course www.edureka.co
Stemming
Affectation Affected Affection AffectingAffectionsAffects
Normalize words into its base form or root form
Natural Language Processing with Python Certification Course www.edureka.co
Stemming
Affect
Normalize words into its base form or root form
Natural Language Processing with Python Certification Course www.edureka.co
• Groups together different inflected forms of a
word, called Lemma
• Somehow similar to Stemming, as it maps
several words into one common root
• Output of Lemmatisation is a proper word
• For example, a Lemmatiser should
map gone, going and went into go
Lemmatization
Natural Language Processing with Python Certification Course www.edureka.co
Stop Words
Are they Helpful or Not
Natural Language Processing with Python Certification Course www.edureka.co
POS : Parts of Speech
Natural Language Processing with Python Certification Course www.edureka.co
POS : Tags and Descriptions
Natural Language Processing with Python Certification Course www.edureka.co
POS : Examples
The Dog killed the bat
DT NN VBD DT NN
SENTENCE
Natural Language Processing with Python Certification Course www.edureka.co
What are Named Entity Recognition ?
MOVIE
LOCATION
MONETARY VALUE
QUANTITIES
ORGANIZATION
PERSON
Natural Language Processing with Python Certification Course www.edureka.co
NER : Named Entity Recognition
Google’s CEO Sundar Pichai introduced the new Pixel at Minnesota Roi Centre Event
Organization Person Location Organization
Natural Language Processing with Python Certification Course www.edureka.co
Syntax
Natural Language Processing with Python Certification Course www.edureka.co
Phase Structure Rules
Natural Language Processing with Python Certification Course www.edureka.co
Syntax Tree
Syntax Tree is a tree representation of syntactic
structure of sentences or strings
Natural Language Processing with Python Certification Course www.edureka.co
Chunking
Picking up Individual pieces of Information and Grouping them into bigger Pieces
CHUNK
Natural Language Processing with Python Certification Course www.edureka.co
Chunking
CHUNKs
PRP VBD DT JJ NN
NP NP
We Caught the Black Panther
Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Training | Edureka

More Related Content

What's hot

Practical Natural Language Processing
Practical Natural Language ProcessingPractical Natural Language Processing
Practical Natural Language Processing
Jaganadh Gopinadhan
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
Yasir Khan
 

What's hot (20)

Natural Language Processing (NLP)
Natural Language Processing (NLP)Natural Language Processing (NLP)
Natural Language Processing (NLP)
 
NLP
NLPNLP
NLP
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
 
Natural Language processing
Natural Language processingNatural Language processing
Natural Language processing
 
Introduction to Natural Language Processing
Introduction to Natural Language ProcessingIntroduction to Natural Language Processing
Introduction to Natural Language Processing
 
Natural Language Processing in AI
Natural Language Processing in AINatural Language Processing in AI
Natural Language Processing in AI
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
Introduction to natural language processing, history and origin
Introduction to natural language processing, history and originIntroduction to natural language processing, history and origin
Introduction to natural language processing, history and origin
 
The Role of Natural Language Processing in Information Retrieval
The Role of Natural Language Processing in Information RetrievalThe Role of Natural Language Processing in Information Retrieval
The Role of Natural Language Processing in Information Retrieval
 
Introduction to Natural Language Processing
Introduction to Natural Language ProcessingIntroduction to Natural Language Processing
Introduction to Natural Language Processing
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
Natural language processing PPT presentation
Natural language processing PPT presentationNatural language processing PPT presentation
Natural language processing PPT presentation
 
NLP using transformers
NLP using transformers NLP using transformers
NLP using transformers
 
What is word2vec?
What is word2vec?What is word2vec?
What is word2vec?
 
Practical Natural Language Processing
Practical Natural Language ProcessingPractical Natural Language Processing
Practical Natural Language Processing
 
Word Embeddings - Introduction
Word Embeddings - IntroductionWord Embeddings - Introduction
Word Embeddings - Introduction
 
Stemming And Lemmatization Tutorial | Natural Language Processing (NLP) With ...
Stemming And Lemmatization Tutorial | Natural Language Processing (NLP) With ...Stemming And Lemmatization Tutorial | Natural Language Processing (NLP) With ...
Stemming And Lemmatization Tutorial | Natural Language Processing (NLP) With ...
 
Natural Language Processing with Python
Natural Language Processing with PythonNatural Language Processing with Python
Natural Language Processing with Python
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 

Similar to Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Training | Edureka

Natural Language Processing (NLP)
Natural Language Processing (NLP)Natural Language Processing (NLP)
Natural Language Processing (NLP)
Abdullah al Mamun
 
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)
Amazon Web Services
 
Natural Language Processing made easy
Natural Language Processing made easyNatural Language Processing made easy
Natural Language Processing made easy
Gopi Krishnan Nambiar
 

Similar to Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Training | Edureka (20)

Unit Plan
Unit PlanUnit Plan
Unit Plan
 
NLP 1.pptx
NLP 1.pptxNLP 1.pptx
NLP 1.pptx
 
Natural Language Processing (NLP)
Natural Language Processing (NLP)Natural Language Processing (NLP)
Natural Language Processing (NLP)
 
Language Learning & Technology with Young Learners
Language Learning & Technology with Young LearnersLanguage Learning & Technology with Young Learners
Language Learning & Technology with Young Learners
 
How to make multilingual plugins and themes
How to make multilingual plugins and themesHow to make multilingual plugins and themes
How to make multilingual plugins and themes
 
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)
 
Python overview
Python overviewPython overview
Python overview
 
Verb conjugation class 601
Verb conjugation class 601Verb conjugation class 601
Verb conjugation class 601
 
Wordpower for ks3
Wordpower for ks3Wordpower for ks3
Wordpower for ks3
 
Pycon India 2018 Natural Language Processing Workshop
Pycon India 2018   Natural Language Processing WorkshopPycon India 2018   Natural Language Processing Workshop
Pycon India 2018 Natural Language Processing Workshop
 
From Programming to Modeling And Back Again
From Programming to Modeling And Back AgainFrom Programming to Modeling And Back Again
From Programming to Modeling And Back Again
 
NLTK: Natural Language Processing made easy
NLTK: Natural Language Processing made easyNLTK: Natural Language Processing made easy
NLTK: Natural Language Processing made easy
 
Natural Language Processing made easy
Natural Language Processing made easyNatural Language Processing made easy
Natural Language Processing made easy
 
Google BERT - SMX London 2020 Virtual Conference
Google BERT - SMX London 2020 Virtual ConferenceGoogle BERT - SMX London 2020 Virtual Conference
Google BERT - SMX London 2020 Virtual Conference
 
Using OpenNLP with Solr to improve search relevance and to extract named enti...
Using OpenNLP with Solr to improve search relevance and to extract named enti...Using OpenNLP with Solr to improve search relevance and to extract named enti...
Using OpenNLP with Solr to improve search relevance and to extract named enti...
 
Isabelle jones-lost in translation
Isabelle jones-lost in translationIsabelle jones-lost in translation
Isabelle jones-lost in translation
 
Apps: Moving Beyond Drill & Practice
Apps: Moving Beyond Drill & PracticeApps: Moving Beyond Drill & Practice
Apps: Moving Beyond Drill & Practice
 
Google BERT - What SEOs and Marketers Need to Know
Google BERT - What SEOs and Marketers Need to KnowGoogle BERT - What SEOs and Marketers Need to Know
Google BERT - What SEOs and Marketers Need to Know
 
Apps: Moving Beyond Drill & Practice
Apps: Moving Beyond Drill & PracticeApps: Moving Beyond Drill & Practice
Apps: Moving Beyond Drill & Practice
 
PPP to TBL Different approaches to language presentation
PPP to TBL Different approaches to language presentationPPP to TBL Different approaches to language presentation
PPP to TBL Different approaches to language presentation
 

More from Edureka!

More from Edureka! (20)

What to learn during the 21 days Lockdown | Edureka
What to learn during the 21 days Lockdown | EdurekaWhat to learn during the 21 days Lockdown | Edureka
What to learn during the 21 days Lockdown | Edureka
 
Top 10 Dying Programming Languages in 2020 | Edureka
Top 10 Dying Programming Languages in 2020 | EdurekaTop 10 Dying Programming Languages in 2020 | Edureka
Top 10 Dying Programming Languages in 2020 | Edureka
 
Top 5 Trending Business Intelligence Tools | Edureka
Top 5 Trending Business Intelligence Tools | EdurekaTop 5 Trending Business Intelligence Tools | Edureka
Top 5 Trending Business Intelligence Tools | Edureka
 
Tableau Tutorial for Data Science | Edureka
Tableau Tutorial for Data Science | EdurekaTableau Tutorial for Data Science | Edureka
Tableau Tutorial for Data Science | Edureka
 
Python Programming Tutorial | Edureka
Python Programming Tutorial | EdurekaPython Programming Tutorial | Edureka
Python Programming Tutorial | Edureka
 
Top 5 PMP Certifications | Edureka
Top 5 PMP Certifications | EdurekaTop 5 PMP Certifications | Edureka
Top 5 PMP Certifications | Edureka
 
Top Maven Interview Questions in 2020 | Edureka
Top Maven Interview Questions in 2020 | EdurekaTop Maven Interview Questions in 2020 | Edureka
Top Maven Interview Questions in 2020 | Edureka
 
Linux Mint Tutorial | Edureka
Linux Mint Tutorial | EdurekaLinux Mint Tutorial | Edureka
Linux Mint Tutorial | Edureka
 
How to Deploy Java Web App in AWS| Edureka
How to Deploy Java Web App in AWS| EdurekaHow to Deploy Java Web App in AWS| Edureka
How to Deploy Java Web App in AWS| Edureka
 
Importance of Digital Marketing | Edureka
Importance of Digital Marketing | EdurekaImportance of Digital Marketing | Edureka
Importance of Digital Marketing | Edureka
 
RPA in 2020 | Edureka
RPA in 2020 | EdurekaRPA in 2020 | Edureka
RPA in 2020 | Edureka
 
Email Notifications in Jenkins | Edureka
Email Notifications in Jenkins | EdurekaEmail Notifications in Jenkins | Edureka
Email Notifications in Jenkins | Edureka
 
EA Algorithm in Machine Learning | Edureka
EA Algorithm in Machine Learning | EdurekaEA Algorithm in Machine Learning | Edureka
EA Algorithm in Machine Learning | Edureka
 
Cognitive AI Tutorial | Edureka
Cognitive AI Tutorial | EdurekaCognitive AI Tutorial | Edureka
Cognitive AI Tutorial | Edureka
 
AWS Cloud Practitioner Tutorial | Edureka
AWS Cloud Practitioner Tutorial | EdurekaAWS Cloud Practitioner Tutorial | Edureka
AWS Cloud Practitioner Tutorial | Edureka
 
Blue Prism Top Interview Questions | Edureka
Blue Prism Top Interview Questions | EdurekaBlue Prism Top Interview Questions | Edureka
Blue Prism Top Interview Questions | Edureka
 
Big Data on AWS Tutorial | Edureka
Big Data on AWS Tutorial | Edureka Big Data on AWS Tutorial | Edureka
Big Data on AWS Tutorial | Edureka
 
A star algorithm | A* Algorithm in Artificial Intelligence | Edureka
A star algorithm | A* Algorithm in Artificial Intelligence | EdurekaA star algorithm | A* Algorithm in Artificial Intelligence | Edureka
A star algorithm | A* Algorithm in Artificial Intelligence | Edureka
 
Kubernetes Installation on Ubuntu | Edureka
Kubernetes Installation on Ubuntu | EdurekaKubernetes Installation on Ubuntu | Edureka
Kubernetes Installation on Ubuntu | Edureka
 
Introduction to DevOps | Edureka
Introduction to DevOps | EdurekaIntroduction to DevOps | Edureka
Introduction to DevOps | Edureka
 

Recently uploaded

Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 

Recently uploaded (20)

UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
Introduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationIntroduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG Evaluation
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 

Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Training | Edureka

  • 1. Natural Language Processing with Python Certification Course www.edureka.co
  • 2. Natural Language Processing with Python Certification Course www.edureka.co Text Mining & NLP
  • 3. Natural Language Processing with Python Certification Course www.edureka.co Today’s Training Topics ❖ Evolution of Human Language ❖ What is Text Mining? ❖ Text Mining and Natural Language Processing? ❖ Applications of NLP ❖ NLP Components and Demo
  • 4. Natural Language Processing with Python Certification Course www.edureka.co The Human Language LANGUAGE ALPHABETS 字母 वर्णमाला ALFABETOS ‫األبجدية‬ எழுத்துக்கள்
  • 5. Natural Language Processing with Python Certification Course www.edureka.co The Human Language LANGUAGE ALPHABETS 字母 वर्णमाला ALFABETOS ‫األبجدية‬ எழுத்துக்கள் Words form Sentences
  • 6. Natural Language Processing with Python Certification Course www.edureka.co The Human Language LANGUAGE ALPHABETS 字母 वर्णमाला ALFABETOS ‫األبجدية‬ எழுத்துக்கள் Words form Sentences
  • 7. Natural Language Processing with Python Certification Course www.edureka.co The 21st Century 21 % STRUCTURED DATA
  • 8. Natural Language Processing with Python Certification Course www.edureka.co The 21st Century STRUCTURED DATA21 % Unstructured
  • 9. Natural Language Processing with Python Certification Course www.edureka.co What is Text Mining ? Text Mining / Text Analytics is the process of deriving meaningful information from natural language text
  • 10. Natural Language Processing with Python Certification Course www.edureka.co Text Mining and NLP As, Text Mining refers to the process of deriving high quality information from the text . The overall goal is, essentially to turn text into data for analysis, via application of Natural Language Processing (NLP)
  • 11. Natural Language Processing with Python Certification Course www.edureka.co What is NLP? NLP: Natural Language Processing is a part of computer science and artificial intelligence which deals with human languages.
  • 12. Natural Language Processing with Python Certification Course www.edureka.co Basic Structure of a NLP Application
  • 13. Natural Language Processing with Python Certification Course www.edureka.co Applications of NLP Sentimental Analysis Speech Recognition Chatbot Machine Translation
  • 14. Natural Language Processing with Python Certification Course www.edureka.co Applications of NLP and Text Mining Spell Checking Keyword Search Information Extraction Advertisement Matching
  • 15. Natural Language Processing with Python Certification Course www.edureka.co
  • 16. Natural Language Processing with Python Certification Course www.edureka.co NLP : Components
  • 17. Natural Language Processing with Python Certification Course www.edureka.co NLP : Components Natural Language Understanding Natural Language Generation
  • 18. Natural Language Processing with Python Certification Course www.edureka.co NLP : Components Natural Language Understanding Natural Language Generation • Mapping input to useful representations • Analyzing different aspects of the language • Text Planning • Sentence Planning • Text Realization
  • 19. Natural Language Processing with Python Certification Course www.edureka.co NLP : Ambiguity Natural Language Understanding Lexical Ambiguity Syntactic Ambiguity Referential Ambiguity
  • 20. Natural Language Processing with Python Certification Course www.edureka.co NLU : Ambiguity Lexical Ambiguity Syntactic Ambiguity Referential Ambiguity She is looking for a match. The fisherman went to the bank.
  • 21. Natural Language Processing with Python Certification Course www.edureka.co NLU : Ambiguity Lexical Ambiguity Syntactic Ambiguity Referential Ambiguity She is looking for a match. The fisherman went to the bank. The chicken is ready to eat. Visiting relatives can be boring. I saw the man with the binoculars.
  • 22. Natural Language Processing with Python Certification Course www.edureka.co NLU : Ambiguity Lexical Ambiguity Syntactic Ambiguity Referential Ambiguity She is looking for a match. The fisherman went to the bank. The chicken is ready to eat. Visiting relatives can be boring. I saw the man with the binoculars. The boy told his father the theft. He was very upset
  • 23. Natural Language Processing with Python Certification Course www.edureka.co NLTK
  • 24. Natural Language Processing with Python Certification Course www.edureka.co NLTK NLTK
  • 25. Natural Language Processing with Python Certification Course www.edureka.co NLTK NLTK
  • 26. Natural Language Processing with Python Certification Course www.edureka.co Tokenization 01 Break a complex sentence into words 02 Understand the importance of each of the words with respect to the sentence 03 Produce a structural description on an input sentence Tokenization is the first step in NLP
  • 27. Natural Language Processing with Python Certification Course www.edureka.co Tokenization 01 Break a complex sentence into words 02 Understand the importance of each of the words with respect to the sentence 03 Produce a structural description on an input sentence Tokenization is the first step in NLP
  • 28. Natural Language Processing with Python Certification Course www.edureka.co Tokenization
  • 29. Natural Language Processing with Python Certification Course www.edureka.co Stemming Affectation Affected Affection AffectingAffectionsAffects Normalize words into its base form or root form
  • 30. Natural Language Processing with Python Certification Course www.edureka.co Stemming Affect Normalize words into its base form or root form
  • 31. Natural Language Processing with Python Certification Course www.edureka.co • Groups together different inflected forms of a word, called Lemma • Somehow similar to Stemming, as it maps several words into one common root • Output of Lemmatisation is a proper word • For example, a Lemmatiser should map gone, going and went into go Lemmatization
  • 32. Natural Language Processing with Python Certification Course www.edureka.co Stop Words Are they Helpful or Not
  • 33. Natural Language Processing with Python Certification Course www.edureka.co POS : Parts of Speech
  • 34. Natural Language Processing with Python Certification Course www.edureka.co POS : Tags and Descriptions
  • 35. Natural Language Processing with Python Certification Course www.edureka.co POS : Examples The Dog killed the bat DT NN VBD DT NN SENTENCE
  • 36. Natural Language Processing with Python Certification Course www.edureka.co What are Named Entity Recognition ? MOVIE LOCATION MONETARY VALUE QUANTITIES ORGANIZATION PERSON
  • 37. Natural Language Processing with Python Certification Course www.edureka.co NER : Named Entity Recognition Google’s CEO Sundar Pichai introduced the new Pixel at Minnesota Roi Centre Event Organization Person Location Organization
  • 38. Natural Language Processing with Python Certification Course www.edureka.co Syntax
  • 39. Natural Language Processing with Python Certification Course www.edureka.co Phase Structure Rules
  • 40. Natural Language Processing with Python Certification Course www.edureka.co Syntax Tree Syntax Tree is a tree representation of syntactic structure of sentences or strings
  • 41. Natural Language Processing with Python Certification Course www.edureka.co Chunking Picking up Individual pieces of Information and Grouping them into bigger Pieces CHUNK
  • 42. Natural Language Processing with Python Certification Course www.edureka.co Chunking CHUNKs PRP VBD DT JJ NN NP NP We Caught the Black Panther