SlideShare a Scribd company logo
1 of 28
Opinion Mining
Outline
Definition
Applications
Challenges
Model
Conclusion
References
Definition
Opinion mining (sentiment mining, opinion/sentiment
extraction) is the area of research that attempts to
make automatic systems to determine human opinion
from text written in natural language.
It seeks to identify the view point (s) underlying
a text span; an example application
is classifying a
movie review as thumbs up or thumbs down.
Opinion mining is a new discipline which has
recently attracted increased attension within fields
such as Marketing,Recomandation systems and
often
financial
associated
market prediction.Although
Emotional states from text,Opinion
Mining is an independent area related to Natural
Language Processing And Text mining that deals
with the Identification of opinionsAnd attitudes in
. Natural Language Text
Consider, for instance, the following scenario. A
m ajor computer manufacturer, disappointed with
unexpectedly low sales, finds itself confronted with
this question:
Why aren't consumers buying our laptop?
What other people think has always been an
im portant piece of information for most of us during
the decision-making process.
Opinion mining draws on computational linguistic,
information retrieval, text mining, natural language
processing, machine learning, statistics and predictive
analysis
Two main types of textual information.
1. Facts
2. Opinions
Most current information processing technique
(e.g., search engines) work with facts (assume
they are true)
Facts can be expressed with topic keywords
In real life, facts are important, but opinion also
plays a crucial role. A computer manufacturer,
disappointed with low sales, asks itself: Why aren’t
consumers buying our laptop? The Democratic
National Committee, disappointed with the last
election, wants to know on an on-going basis: What
is the reaction in the press, newsgroups, chat rooms,
and blogs to Bush’s latest policy decision?
The main advantage is the speed
On average, humans process six articles
per hour against the machine’s throughput of 10 per
second
Applications
recommendation systems
Summarization
Applications in Business
marketing intelligence,
product and service benchmarking and
improvement.
To understand the voice of
the customer as
expressed in everyday communications
Applications
Politics
As is well known, opinions matter a great deal in
politics. Some work has focused on understanding
what voters are thinking
Challenges
The difficulty lies in the richness of the language that
human use.
Example:
1. This is a great camera.
2. A great amount of money was spent for
promoting this camera.
3. One might think this is a great camera. Well
think again, because.....
a single keyword can be used to convey three
different opinions, +ve, neutral and -ve respectively.
Challenges
In order to arrive at sensible conclusions, sentiment
an alysis has to understand context. For example,
“fighting” and “disease” is negative in a war
context but positive in a medical one.
Different mining for different domains.
sentiment analysis model
Data Preparation
The data preparation step performs necessary data
pr eprocessing and cleaning on the dataset for the
subsequent analysis. Some commonly used
preprocessing steps include removing non-textual
contents and markup tags (for HTML pages), and
removing information about the reviews that are not
required for sentiment analysis, such as review dates
and reviewers’ names.
Review Analysis
The review analysis step analyzes the linguistic
features of reviews so that interesting information,
including opinions and/or product features, can be
identified.
This step often applies various computational
linguistics tasks to reviews first, and then extracts
opinions and product features from the processed
reviews.
Sentiment Classification
There are two main techniques for sentiment
classification:
The symbolic technique uses manually crafted rules
and lexicons,
The machine learning approach uses unsupervised,
or
supervised learning to construct a model from a large
training corpus.
?What
Find relevant words, phrases, patterns that can be
used to express subjectivity
Determine the polarity of subjective expressions
Words
Adjectives
positive: honest important mature large patient
Ron Paul is the only honest man in Washington.
Kitchell’s writing is unbelievably mature and is only likely to get
better.
To humour me my patient father agrees yet again to my choice of
film
negative: harmful hypocritical inefficient insecure
It was a macabre and hypocritical circus.
Why are they being so inefficient ?
Words
Verbs
positive: praise, love
negative: blame, criticize
Nouns
positive: pleasure, enjoyment
negative: pain, criticism
Phrases
Phrases containing adjectives and adverbs
positive: high intelligence, low cost
negative: little variation, many troubles
Machine Learning
Studies showed that standard machine learning
techniques definitively outperform human-
produced baselines.
To treat sentiment classification simply as a
special case of topic-based categorization
(with the two “topics” being positive sentiment
and negative sentiment)
Supervised Methods
In order to train a classifier for sentiment recognition
in text, classic supervised learning techniques (e.g.
Support Vector Machines, naive Bayes, Maximum
Entropy) can be used. A supervised approach entails
the use of a labelled training corpus to learn a certain
classification function. The method that in the
literature often yields the highest accuracy regards a
Support Vector Machine classifier
Suport Vector Machine
Unsupervised Learning
A clustering algorithm partitions the adjectives into two
subsets
nice
handsome
terrible
painful
expensive
comfortable
fun
scenic
slow
+
Conclusion
An important field of study
New Field
Many applications
Almost no work in this area
References
Pang, Bo and Lee, L. (2008). “Opinion Mining and
Se ntiment Analysis”, Foundations and Trends R
in, Information Retrieval, Vol. 2, Nos. 1–2 (2008)
1–
135, ebook from
http://www.cs.cornell.edu/home/llee/omsa/omsa.pdf
Wiebe, J. Cardie, C. and Riloff, E. ( 2007).
“Manual and Automatic Subjectivity and Sentiment
Analysis” , Center for Extraction and
Summarization of Events and Opinions in Text.
University of Utah

More Related Content

Similar to opinionmining-131221011849-phpapp02-converted.ppt

Sentiment of Sentence in Tweets: A Review
Sentiment of Sentence in Tweets: A ReviewSentiment of Sentence in Tweets: A Review
Sentiment of Sentence in Tweets: A Reviewiosrjce
 
AI for sentiment analysis - An Overview.pdf
AI for sentiment analysis - An Overview.pdfAI for sentiment analysis - An Overview.pdf
AI for sentiment analysis - An Overview.pdfStephenAmell4
 
Sentiment Analysis Using Hybrid Approach: A Survey
Sentiment Analysis Using Hybrid Approach: A SurveySentiment Analysis Using Hybrid Approach: A Survey
Sentiment Analysis Using Hybrid Approach: A SurveyIJERA Editor
 
Sentiment Features based Analysis of Online Reviews
Sentiment Features based Analysis of Online ReviewsSentiment Features based Analysis of Online Reviews
Sentiment Features based Analysis of Online Reviewsiosrjce
 
Sentiment Analysis
Sentiment AnalysisSentiment Analysis
Sentiment AnalysisDinesh V
 
A Novel Voice Based Sentimental Analysis Technique to Mine the User Driven Re...
A Novel Voice Based Sentimental Analysis Technique to Mine the User Driven Re...A Novel Voice Based Sentimental Analysis Technique to Mine the User Driven Re...
A Novel Voice Based Sentimental Analysis Technique to Mine the User Driven Re...IRJET Journal
 
Aspect-Level Sentiment Analysis On Hotel Reviews
Aspect-Level Sentiment Analysis On Hotel ReviewsAspect-Level Sentiment Analysis On Hotel Reviews
Aspect-Level Sentiment Analysis On Hotel ReviewsKimberly Pulley
 
Dictionary Based Approach to Sentiment Analysis - A Review
Dictionary Based Approach to Sentiment Analysis - A ReviewDictionary Based Approach to Sentiment Analysis - A Review
Dictionary Based Approach to Sentiment Analysis - A ReviewINFOGAIN PUBLICATION
 
Marketing L5: Marketing Research & Guest Speaker
Marketing L5: Marketing Research & Guest SpeakerMarketing L5: Marketing Research & Guest Speaker
Marketing L5: Marketing Research & Guest SpeakerAhmed Eid
 
Sentiment Analysis on Twitter Dataset using R Language
Sentiment Analysis on Twitter Dataset using R LanguageSentiment Analysis on Twitter Dataset using R Language
Sentiment Analysis on Twitter Dataset using R Languageijtsrd
 
How Sentiment Analysis works
How Sentiment Analysis worksHow Sentiment Analysis works
How Sentiment Analysis worksCJ Jenkins
 
Size Of Writing Paper. Writing Paper Sizes Chart. 2019-01-16
Size Of Writing Paper. Writing Paper Sizes Chart. 2019-01-16Size Of Writing Paper. Writing Paper Sizes Chart. 2019-01-16
Size Of Writing Paper. Writing Paper Sizes Chart. 2019-01-16Kimberly Gomez
 

Similar to opinionmining-131221011849-phpapp02-converted.ppt (20)

Sentiment of Sentence in Tweets: A Review
Sentiment of Sentence in Tweets: A ReviewSentiment of Sentence in Tweets: A Review
Sentiment of Sentence in Tweets: A Review
 
W01761157162
W01761157162W01761157162
W01761157162
 
AI for sentiment analysis - An Overview.pdf
AI for sentiment analysis - An Overview.pdfAI for sentiment analysis - An Overview.pdf
AI for sentiment analysis - An Overview.pdf
 
Sentiment Analysis Using Hybrid Approach: A Survey
Sentiment Analysis Using Hybrid Approach: A SurveySentiment Analysis Using Hybrid Approach: A Survey
Sentiment Analysis Using Hybrid Approach: A Survey
 
L017358286
L017358286L017358286
L017358286
 
Sentiment Features based Analysis of Online Reviews
Sentiment Features based Analysis of Online ReviewsSentiment Features based Analysis of Online Reviews
Sentiment Features based Analysis of Online Reviews
 
Sentiment Analysis
Sentiment AnalysisSentiment Analysis
Sentiment Analysis
 
A Novel Voice Based Sentimental Analysis Technique to Mine the User Driven Re...
A Novel Voice Based Sentimental Analysis Technique to Mine the User Driven Re...A Novel Voice Based Sentimental Analysis Technique to Mine the User Driven Re...
A Novel Voice Based Sentimental Analysis Technique to Mine the User Driven Re...
 
Aspect-Level Sentiment Analysis On Hotel Reviews
Aspect-Level Sentiment Analysis On Hotel ReviewsAspect-Level Sentiment Analysis On Hotel Reviews
Aspect-Level Sentiment Analysis On Hotel Reviews
 
NLP Ecosystem
NLP EcosystemNLP Ecosystem
NLP Ecosystem
 
Dictionary Based Approach to Sentiment Analysis - A Review
Dictionary Based Approach to Sentiment Analysis - A ReviewDictionary Based Approach to Sentiment Analysis - A Review
Dictionary Based Approach to Sentiment Analysis - A Review
 
Marketing L5: Marketing Research & Guest Speaker
Marketing L5: Marketing Research & Guest SpeakerMarketing L5: Marketing Research & Guest Speaker
Marketing L5: Marketing Research & Guest Speaker
 
Anu paper(IJARCCE)
Anu paper(IJARCCE)Anu paper(IJARCCE)
Anu paper(IJARCCE)
 
Sentiment analysis
Sentiment analysisSentiment analysis
Sentiment analysis
 
Sentiment analysis
Sentiment analysisSentiment analysis
Sentiment analysis
 
Sentiment analysis on unstructured review
Sentiment analysis on unstructured reviewSentiment analysis on unstructured review
Sentiment analysis on unstructured review
 
Ijmet 10 01_094
Ijmet 10 01_094Ijmet 10 01_094
Ijmet 10 01_094
 
Sentiment Analysis on Twitter Dataset using R Language
Sentiment Analysis on Twitter Dataset using R LanguageSentiment Analysis on Twitter Dataset using R Language
Sentiment Analysis on Twitter Dataset using R Language
 
How Sentiment Analysis works
How Sentiment Analysis worksHow Sentiment Analysis works
How Sentiment Analysis works
 
Size Of Writing Paper. Writing Paper Sizes Chart. 2019-01-16
Size Of Writing Paper. Writing Paper Sizes Chart. 2019-01-16Size Of Writing Paper. Writing Paper Sizes Chart. 2019-01-16
Size Of Writing Paper. Writing Paper Sizes Chart. 2019-01-16
 

Recently uploaded

A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfchloefrazer622
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppCeline George
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...RKavithamani
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesFatimaKhan178732
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpinRaunakKeshri1
 

Recently uploaded (20)

A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website App
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and Actinides
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 

opinionmining-131221011849-phpapp02-converted.ppt

  • 3. Definition Opinion mining (sentiment mining, opinion/sentiment extraction) is the area of research that attempts to make automatic systems to determine human opinion from text written in natural language. It seeks to identify the view point (s) underlying a text span; an example application is classifying a movie review as thumbs up or thumbs down.
  • 4. Opinion mining is a new discipline which has recently attracted increased attension within fields such as Marketing,Recomandation systems and often financial associated market prediction.Although Emotional states from text,Opinion Mining is an independent area related to Natural Language Processing And Text mining that deals with the Identification of opinionsAnd attitudes in . Natural Language Text
  • 5. Consider, for instance, the following scenario. A m ajor computer manufacturer, disappointed with unexpectedly low sales, finds itself confronted with this question: Why aren't consumers buying our laptop?
  • 6. What other people think has always been an im portant piece of information for most of us during the decision-making process. Opinion mining draws on computational linguistic, information retrieval, text mining, natural language processing, machine learning, statistics and predictive analysis
  • 7. Two main types of textual information. 1. Facts 2. Opinions Most current information processing technique (e.g., search engines) work with facts (assume they are true) Facts can be expressed with topic keywords
  • 8. In real life, facts are important, but opinion also plays a crucial role. A computer manufacturer, disappointed with low sales, asks itself: Why aren’t consumers buying our laptop? The Democratic National Committee, disappointed with the last election, wants to know on an on-going basis: What is the reaction in the press, newsgroups, chat rooms, and blogs to Bush’s latest policy decision?
  • 9. The main advantage is the speed On average, humans process six articles per hour against the machine’s throughput of 10 per second
  • 10. Applications recommendation systems Summarization Applications in Business marketing intelligence, product and service benchmarking and improvement. To understand the voice of the customer as expressed in everyday communications
  • 11. Applications Politics As is well known, opinions matter a great deal in politics. Some work has focused on understanding what voters are thinking
  • 12. Challenges The difficulty lies in the richness of the language that human use. Example: 1. This is a great camera. 2. A great amount of money was spent for promoting this camera. 3. One might think this is a great camera. Well think again, because..... a single keyword can be used to convey three different opinions, +ve, neutral and -ve respectively.
  • 13. Challenges In order to arrive at sensible conclusions, sentiment an alysis has to understand context. For example, “fighting” and “disease” is negative in a war context but positive in a medical one. Different mining for different domains.
  • 15. Data Preparation The data preparation step performs necessary data pr eprocessing and cleaning on the dataset for the subsequent analysis. Some commonly used preprocessing steps include removing non-textual contents and markup tags (for HTML pages), and removing information about the reviews that are not required for sentiment analysis, such as review dates and reviewers’ names.
  • 16. Review Analysis The review analysis step analyzes the linguistic features of reviews so that interesting information, including opinions and/or product features, can be identified. This step often applies various computational linguistics tasks to reviews first, and then extracts opinions and product features from the processed reviews.
  • 17. Sentiment Classification There are two main techniques for sentiment classification: The symbolic technique uses manually crafted rules and lexicons, The machine learning approach uses unsupervised, or supervised learning to construct a model from a large training corpus.
  • 18. ?What Find relevant words, phrases, patterns that can be used to express subjectivity Determine the polarity of subjective expressions
  • 19. Words Adjectives positive: honest important mature large patient Ron Paul is the only honest man in Washington. Kitchell’s writing is unbelievably mature and is only likely to get better. To humour me my patient father agrees yet again to my choice of film negative: harmful hypocritical inefficient insecure It was a macabre and hypocritical circus. Why are they being so inefficient ?
  • 20. Words Verbs positive: praise, love negative: blame, criticize Nouns positive: pleasure, enjoyment negative: pain, criticism
  • 21. Phrases Phrases containing adjectives and adverbs positive: high intelligence, low cost negative: little variation, many troubles
  • 22. Machine Learning Studies showed that standard machine learning techniques definitively outperform human- produced baselines. To treat sentiment classification simply as a special case of topic-based categorization (with the two “topics” being positive sentiment and negative sentiment)
  • 23. Supervised Methods In order to train a classifier for sentiment recognition in text, classic supervised learning techniques (e.g. Support Vector Machines, naive Bayes, Maximum Entropy) can be used. A supervised approach entails the use of a labelled training corpus to learn a certain classification function. The method that in the literature often yields the highest accuracy regards a Support Vector Machine classifier
  • 25.
  • 26. Unsupervised Learning A clustering algorithm partitions the adjectives into two subsets nice handsome terrible painful expensive comfortable fun scenic slow +
  • 27. Conclusion An important field of study New Field Many applications Almost no work in this area
  • 28. References Pang, Bo and Lee, L. (2008). “Opinion Mining and Se ntiment Analysis”, Foundations and Trends R in, Information Retrieval, Vol. 2, Nos. 1–2 (2008) 1– 135, ebook from http://www.cs.cornell.edu/home/llee/omsa/omsa.pdf Wiebe, J. Cardie, C. and Riloff, E. ( 2007). “Manual and Automatic Subjectivity and Sentiment Analysis” , Center for Extraction and Summarization of Events and Opinions in Text. University of Utah