Sentiment Analysis Using Solr
Upcoming SlideShare
Loading in...5
×
 

Sentiment Analysis Using Solr

on

  • 3,056 views

Solr is an open source, widely used, popular IR machine. It can be used for simple sentiment analysis and sentiment retrieval tool. Its multi-language analyzers together with UIMA (Unstructured ...

Solr is an open source, widely used, popular IR machine. It can be used for simple sentiment analysis and sentiment retrieval tool. Its multi-language analyzers together with UIMA (Unstructured Information Management Architecture) framework can be extended for sentiment extraction. Each sentence passes through a series of pluggable annotators. Entity and its associated polarity are detected for each sentence. Polarity of each sentence is stored into Solr index. Persistent model files can be created from training data and accessed at run time.

Statistics

Views

Total Views
3,056
Views on SlideShare
2,536
Embed Views
520

Actions

Likes
1
Downloads
37
Comments
0

5 Embeds 520

http://www.scoop.it 498
http://www.linkedin.com 13
https://www.linkedin.com 6
https://twitter.com 2
http://webcache.googleusercontent.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Sentiment Analysis Using Solr Sentiment Analysis Using Solr Presentation Transcript

  • By: Pradeep Pujari
  • Working mostly in Search domainSearch = IR + ML + NLPWho am I?Works for
  • Contributing to SolrSherlock- Open Source ProjectWho am I?http://solrsherlock.github.io/SolrSherlock/
  • What is Sentiment Analysis?A linguistic analysis technique that identifiesThe movie is great.The movie stars Mr. XThe movie is horrible.opinion early in a piece of text.
  • ChallengingToo easy Too hardDifficultymisclassificationWhat is Sentiment Analysis?
  • SentimentAnalysisNLPCognitive ScienceWhat is Sentiment Analysis?
  • Human can easily understandemotions.Can a machine be trained to do it?What is Sentiment Analysis?
  • Solr ?Http Request ServletAdminInterfaceUpdate ServletStandardRequestHandlerCustomRequestHandlerResponseWriterSolr CoreLuceneAnalysis UIMAconfig CachingUpdateHandler
  • Linguistics moduleStems, Lemmas and Synonymsmulti language capabilityCJKAnalyzer, UIMA AnalyzersUIMA integrationUpdateProcessorChainWhy Solr ?
  • Why Solr ?Extract domain specific entitiesand conceptsTime and CostSolr Set Up – 5 minsUIMA Annotators - 5 daysEnrich text, write to dedicated field
  • Tagging entities in review textUsecaseI wasnt really in the market for another tablet, but my girlfriend endedup getting one for me so she got me on this one. I would like to say thatthis tablet reminds me of the first Motorola Droid smartphone that cameout several years back. The phone jam packed a ton of bells & whistlesinto its hardware and software to give a lot of bang for your buck. Thisis what it feels like amazon has done with the Kindle Fire 8.9. They haveput a lot of advanced hardware and innovative software, so for theaverage user, specially someone who absorbs a lot of media, you get alot for the price. But just because you get a lot for the price, doesntmean it is without its flaws.
  • UsecaseConsumer feedback about productsWhich product features are more relevantPolarity
  • Digital SLR with Full 1080p HD VideoThere are many preprogrammed scene modesthat make this a very easy camera to use.The picture quality is beyond belief, andeven better for the price.Price:Usecase
  • Why UIMA ?UIMA Framework manages componentsand data flow – No codingDeploy pipeline of analysis enginesAEs wrap NLP algorithmsPersonPlaceorganizationLanguageDetectionAggregate analysis engineSentenceAnnotatorPOSAnnotatorNER
  • IndexLuceneSolr UpdateRequestProcessorSolrQParser DataSolr+UIMAUIMA AE
  • NLP+UIMAUse POS in query understandingboosting termsSynonym expansionExtract concepts/entitiesFaceting using entitiesIdentify places in queryand use spatial queries
  • Ideas: Sentiment Analysis AppIdentify Subjective Sentences from textRemove noisy sentences– Regex, conditional probabilityGraph min cut – LingPipeSubjectivity LexiconsDiscard Facts and Objective Sentences
  • SubjectivitydetectorSubjectiveObjectivePolarityClassifierIdeas: Sentiment Analysis App
  • Sentiments Intensity - SentiWordNetWordNet-Affect: WordNet +annotated conceptsIdeas: Sentiment Analysis AppHybrid model with adding dictionary
  • UpdateHandler withprocessor chainRemove DuplicatesprocessorLoggingprocessorCustom TransformprocessorIndexprocessorUpdate Processor ChainTextAnalyzersLuceneLucene IndexSentence DetectionprocessorSentiment ClassifierCompany NameAnnotatorSentiment ScoreprocessorProduct Reviews
  • http://lucene.apache.org/solr/http://uima.apache.org/http://alias-i.com/lingpipe/demos/tutorial/sentiment/read-me.htmlhttp://openie.cs.washington.edu/
  • Questions ?
  • Thank YouEmail: pradeepp@rocketmail.com