Introduction to NLP.pptx

MR. JAYANAND KAMBLE
WELCOME TO JAK’S TUTORIAL
Prof. Jayanand Kamble
1

CONTENTS:
• Definition
• Issues and strategies
• Application domain
• Tools for NLP
• Linguistic organization of NLP
• NLP vs PLP
2

OVERVIEW
• Human Evolution
• How did Stone Age communicate?
• Early humans could express thoughts and feelings by means of speech or
by signs or gestures. They could signal with fire and smoke, drums, or
whistles.
• Why language?
• Language helps us express our feelings and thoughts — this is unique to
our species because it is a way to express unique ideas and customs
within different cultures and societies.
3

• What are the world's spoken languages?
• Around 7000 languages are spoken in the world today.
4

INDIAN CONTEXT
• India is a multi-lingual country with great linguistic and cultural
diversities
• 22 official languages mentioned in the Indian constitution
• However, Census of India in 2001 reported-
• 122 major languages
• 1,599 other regional languages
5

• 2,371 scripts
• 30 languages are spoken by more than one million native
speakers
• 122 are spoken by more than 10,000 people
• 20% understand English
• 80% cannot understand
6

• Some languages are ranked within 20 in in the world in
terms of the populations speaking them.
• Hindi : 4th (~350 million)
• Bangla: 5th (~230 million)
• Marathi 10th (~84 million)
7

DEFINITION: NLP
• Humans communicate through some form of language either by text or speech.
• To make interactions between computers and humans, computers need to understand
natural languages used by humans.
• Natural language processing is all about making computers learn, understand,
analyze, manipulate and interpret natural(human) languages.
• NLP stands for Natural Language Processing, which is a part of Computer Science,
Human language, and Artificial Intelligence.
• Natural Language Processing (NLP) is the capacity of a computer to "understand"
natural language text at a level that allows meaningful interaction between the
computer and a person working in a particular application domain.
9

• Processing of Natural Language is required when you want an
intelligent system like robot to perform as per your instructions, when
you want to hear decision from a dialogue based clinical expert system,
etc.
• The ability of machines to interpret human language is now at the core
of many applications that we use every day - chatbots, Email
classification and spam filters, search engines, grammar checkers, voice
assistants, and social language translators.
• The input and output of an NLP system can be Speech or Written Text
10

COMPONENTS OF NLP
• There are two components of NLP, Natural Language
Understanding (NLU) and Natural Language Generation (NLG).
• Natural Language Understanding (NLU) which involves
transforming human language into a machine-readable format.
• It helps the machine to understand and analyze human language
by extracting the text from large data such as keywords,
emotions, relations, and semantics.
11

• Natural Language Generation (NLG) acts as a translator that
converts the computerized data into natural language
representation.
• It mainly involves Text planning, Sentence planning, and Text
realization.
• The NLU is harder than NLG.
12

APPLICATION DOMAIN
• text processing - word processing, e-mail, spelling and grammar
checkers
• interfaces to data bases - query languages, information retrieval,
data mining, text summarization
• expert systems - explanations, disease diagnosis
• linguistics - machine translation, content analysis, writers'
assistants, language generation
13

APPLICATION DOMAIN EXAMPLES
• Search Autocorrect and Autocomplete:
• Language Translator:
• Social Media Monitoring: More and more people these days have started using
social media for posting their thoughts about a particular product, policy, or matter.
• Chatbots: Customer service and experience is the most important thing for any
company.
• Survey Analysis: Surveys are an important way of evaluating a company’s
performance. Companies conduct many surveys to get customer’s feedback on
various products.
• Targeted Advertising:
14

• Hiring and Recruitment: The Human Resource department is an integral part
of every company. They have the most important job of selecting the right
employees for a company.
• Voice Assistants: I am sure you’ve already met them, Google Assistant, Apple
Siri, Amazon Alexa, ring a bell? Yes, all of these are voice assistants.
• Grammar Checkers: This is one of the most widely used applications of
natural language processing.
• Email Filtering: Have you ever used Gmail?
15

• Sentiment Analysis: Natural language understanding is particularly difficult for
machines when it comes to opinions, given that humans often use sarcasm and
irony.
• Text Classification: Text classification, a text analysis task that also includes
sentiment analysis, involves automatically understanding, processing, and
categorizing unstructured text.
• Text Extraction: Text extraction, or information extraction, automatically detects
specific information in a text, such as names, companies, places, and more. This is
also known as named entity recognition.
• Machine Translation: Machine translation (MT) is one of the first applications of
natural language processing.
16

• Text Summarization: There are two ways of using natural language processing to
summarize data: extraction-based summarization ‒ which extracts key phrases
and creates a summary, without adding any extra information ‒ and abstraction-
based summarization, which creates new phrases paraphrasing the original
source.
• Market Intelligence: Marketers can benefit from natural language processing to
learn more about their customers and use those insights to create more effective
strategies.
• Intent Classification: Intent classification consists of identifying the goal or
purpose that underlies a text.
17

TOOLS FOR NLP
• Programming languages and software - Prolog , ALE , Lisp/Scheme,
C/C++, python, java
• Statistical Methods - Markov models, probabilistic grammars, text-
based analysis
• Abstract Models - Context-free grammars (BNF), Attribute grammars,
Predicate calculus and other semantic models, Knowledge-based and
ontological methods
18

TOOLS FOR NLP EXAMPLE
• Natural Language Processing tools are helping companies get
insights from unstructured text data like emails, online reviews,
social media posts, and more.
• There are many online tools that make NLP accessible to your
business, like
• open-source and
• SaaS.
19

• Open-source:
• Open-source libraries are free, flexible, and allow developers to fully
customize them.
• However, they’re not cost-effective and you’ll need to spend time
building and training open-source tools before you can reap the
benefits.
• SaaS tools
• SaaS tools are a great alternative if you don’t want to invest a lot of
time building complex infrastructures or spend money on extra
resources.
20

• MonkeyLearn:
• Is a user-friendly, NLP-powered platform that helps to gain valuable insights
from text data.
• To get started, the pre-trained models can be used to perform text analysis
tasks such as sentiment analysis, topic classification, or keyword extraction.
• Aylien:
• Is a SaaS API that uses deep learning and NLP to analyze large volumes of text-
based data, such as academic publications, real-time content from news outlets
and social media data.
• It can be used for NLP tasks like text summarization, article extraction, entity
extraction, and sentiment analysis, among others.
21

• IBM Watson
• IBM Watson is a suite of AI services stored in the IBM Cloud.
• One of its key features is Natural Language Understanding, which allows
to identify and extract keywords, categories, emotions, entities, and more.
• Amazon Comprehend:
• Amazon Comprehend is an NLP service, integrated with the Amazon
Web Services infrastructure.
• This API can be used for NLP tasks such as sentiment analysis, topic
modeling, entity recognition, and more.
22

• Google Cloud
• The Google Cloud Natural Language API provides several pre-
trained models for sentiment analysis, content classification, and
entity extraction, among others.
• It offers AutoML Natural Language, which allow to build
customized machine learning models.
• As part of the Google Cloud infrastructure, it uses Google
question-answering and language understanding technology.
23

• NLTK
• The Natural Language Toolkit (NLTK) with Python is one of
the leading tools in NLP model building.
• Focused on research and education in the NLP field, NLTK is
bolstered by an active community, as well as a range of
tutorials for language processing, sample datasets, and
resources that include a comprehensive Language
Processing and Python handbook.
24

• Stanford Core NLP
• Stanford Core NLP is a popular library built and maintained by the NLP
community at Stanford University.
• It’s written in Java ‒ need to install JDK on computer ‒ but it has APIs in
most programming languages.
• The Core NLP toolkit allows to perform a variety of NLP tasks, such as part-
of-speech tagging, tokenization, or named entity recognition.
• Some of its main advantages include scalability and optimization for
speed, making it a good choice for complex tasks.
25

• TextBlob
• TextBlob is a Python library that works as an extension of
NLTK, allowing to perform the same NLP tasks in a much
more intuitive and user-friendly interface.
• Its learning curve is more simple than with other open-
source libraries, so it’s an excellent choice for beginners, who
want to tackle NLP tasks like sentiment analysis, text
classification, part-of-speech tagging, and more.
26

• SpaCy
• One of the newest open-source Natural Language Processing with
Python libraries is SpaCy.
• It’s lightning-fast, easy to use, well-documented, and designed to
support large volumes of data, not to mention, boasts a series of
pretrained NLP models that make job even easier.
• Unlike NLTK or CoreNLP, which display a number of algorithms for
each task, SpaCy keeps its menu short and serves up the best available
option for each task at hand.
27

• GenSim
• Gensim is a highly specialized Python library that largely deals
with topic modeling tasks using algorithms like Latent Dirichlet
Allocation (LDA).
• It’s also excellent at recognizing text similarities, indexing texts,
and navigating different documents.
• This library is fast, scalable, and good at handling large volumes of
data.
28

NATURAL LANGUAGES VS. COMPUTER LANGUAGES
• Ambiguity is the primary difference between natural and computer
languages.
• Formal programming languages are designed to be unambiguous, i.e.
they can be defined by a grammar that produces a unique parse for
each sentence in the language.
• Programming languages are also designed for efficient parsing, i.e.
they are deterministic context free languages
• A sentence in a DCFL can be parsed in O( n ) time where n is the length of the
string.
29

LINGUISTIC ORGANIZATION OF NLP
• Phonetics and phonology
• Morphology
• Lexical Analysis
• Syntactic Analysis
• Semantic Analysis
• Pragmatics
• Discourse
30
NLP architecture and stages of
processing ambiguity at every
stage
ध्वनीशास्त्र and उच्चारशास्त्र
मॉर्फोलॉजी
शाब्दिक विश्लेषण
िाक्यरचना विश्लेषण
विमेंविक विश्लेषण
व्यािहाररकता
प्रिचन

PHONETICS
• Processing of speech
• Challenges
• Homophones: bank (finance) vs. bank (river bank)
• Near Homophones: maatraa vs. maatra (Hin)
• Word Boundary: aajaayenge (aa jaayenge (will come) or aaj aayenge (will
come today)
• Phrase boundary
• PhD students are especially exhorted to attend as such seminars are integral to one's
post graduate education
• Disfluency: ah, um, ahem etc.
• The best part of my job is … well … the best part of my job is the responsibility.
31 ध्वनीशास्त्र

WORD SEGMENTATION
• Breaking a string of characters (graphemes) into a sequence of words.
• In some written languages (e. g. Chinese) words are not separated by
spaces.
• Even in English, characters other than white space can be used to
separate words [e. g. , ; . - :()]
• Examples from English URLs:
• Jumptheshark.com  jump the shark com
• myspace.com/pluckerswingbar 
• myspace com pluckers wing bar
• myspace com plucker swing bar
32

MORPHOLOGICAL ANALYSIS
• Morphology is the field of linguistics that studies the internal structure of
words.
• A morpheme is the smallest linguistic unit that has semantic meaning.
• e. g. in, come, -ing, forming incoming )
• Morphological analysis is the task of segmenting a word into its
morphemes
• Carried  carry + ed (past tense)
• Independently  in+(depend+ent)+ly
• Googlers  (Google+er)+s (plural)
• Unlockable  un+(lock+able)?
33 unit that cannot be further divided

MORPHOLOGY
• Collection of “Word formation rules from root words”
• Nouns: Plural(boy-boys); Gender marking (Ravi-Ravina)
• Verbs: Tense (stretch-stretched); Aspect (e.g. perfective sit 
had sat); Modality (e.g. request khaanaa  khaaiie)
• Crucial first step in NLP
34
पद्धत

• Languages rich in morphology e. g. Dravidian, Hungarian, Turkish, Indian
languages.
• Languages poor in morphology Chinese, English.
• Languages with rich morphology have the advantage of easier
processing at higher stages of processing.
• A task of interest to computer science: creating Finite State
Word Morphology.
35

LEXICAL ANALYSIS
• Essentially refers to dictionary access and obtaining
the properties of the word.
• Challenge:
• Lexical or word sense
disambiguation
36
e. g. dog
noun (lexical property)
take 's' in plural (morph
property)
animate (semantic property)
4-legged ( do )
carnivore ( do )
शाब्दिक विश्लेषण

LEXICAL DISAMBIGUATION
• First step: Part of Speech Disambiguation
• Dog as a noun (Animal)
• Dog as a verb (to pursue or to go after or to follow somebody
closely.)
• Ex. A shadowy figure was dogging their every move.
• Sense Disambiguation:
• Dog ( as animal)
• Dog ( as a very detestable person)
37

• Needs word relationships in a context:
• The chair emphasized the need for adult education.
• Very common in day to day communications:
“Satellite Channel Ad: Watch what you want, when you
want”
(two senses of watch)
• Watch: wristwatch / watching something
38

TECHNOLOGICAL DEVELOPMENTS BRING IN NEW TERMS,
ADDITIONAL MEANINGS/NUANCES FOR EXISTING TERMS
• Justify as in justify the right margin (word processing context)
• Xeroxed : a new verb
• Digital Trace : a new expression
• Communifaking : pretending to talk on mobile when you are actually
not
• Discomgooglation : anxiety/discomfort at not being able to access
internet
• Helicopter Parenting : over parenting
39

AMBIGUITY OF MULTI-WORDS
• The grandfather kicked the bucket after suffering from
cancer.
• This job is a piece of cake.
• He is the dark horse of the match.
40
to die
खूप िोपी अिलेली गोष्ट; हातचा मळ
someone who has a surprising ability or
skill

AMBIGUITY OF MULTI-WORDS: GOOGLE
TRANSLATION
41
आजोबाांनी क
ॅ न्सरने ग्रािल्यानांतर बादलीला लाथ मारली.
हे काम क
े कचा तुकडा आहे.
तो िामन्याचा डाक
क हॉिक आहे.

SYNTACTIC ANALYSIS
42
िाक्यरचना विश्लेषण

1. PART OF SPEECH (POS) TAGGING
• Annotate each word in a sentence with a PoS
• Useful for subsequent syntactic parsing and word
sense disambiguation
43
I ate the spaghetti with meatballs.
Pro V Det N Prep N

2. PHRASE CHUNKING
• Phrase chunking is a phase of natural language
processing that separates and segments a
sentence into its sub-constituents, such as
noun, verb, and prepositional phrases,
abbreviated as NP, VP, and PP, respectively.
44

• Find all non recursive noun phrases (NPs) and verb
phrases (VPs) in a sentence
45
[NP I] [VP ate] [NP the spaghetti] [PP with] [NP
meatballs].
[NP He ] [VP reckons] [NP the current account deficit
] [VP will narrow] [PP to ] [NP only # 1.8 billion ] [PP
in ] [NP September ]

NLP VS PLP
NLP PLP
domain of discourse broad: what can be expressed
narrow: what can be
computed
lexicon large/complex small/simple
grammatical
constructs
many and varied
- declarative
- interrogative
- fragments
etc.
few
- declarative
- imperative
meanings of an
expression
many one
tools and techniques
morphological analysis
syntactic analysis
semantic analysis
integration of world knowledge
lexical analysis
context-free parsing
code generation/compiling
interpreting
47

Introduction to NLP.pptx

Recommended

Recommended

More Related Content

Similar to Introduction to NLP.pptx

Similar to Introduction to NLP.pptx (20)

Recently uploaded

Recently uploaded (20)

Introduction to NLP.pptx

Editor's Notes