• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Negative Sentiment (or "Sentiment Analysis is Sh*te")
 

Negative Sentiment (or "Sentiment Analysis is Sh*te")

on

  • 5,993 views

I used to believe that sentiment analysis was one of the most important tools in a smart marketer's box. ...

I used to believe that sentiment analysis was one of the most important tools in a smart marketer's box.

The rise of social media offered (I thought) a huge, free, and above all, reliable source of both qualitative and quantitative data about how real people really feel about brands, and how our marketing contributed to those feelings.

Over the years, though, I've become increasingly disappointed in both the reality and the promise; to the point at which I'm actively recommending that our clients avoid using social media sentiment in their models or as a performance metric.

It's time for us all to stop kidding ourselves, 'fess up, and end the conspiracy. In this short talk, I hope to explain why sentiment analysis doesn't function as a useful social media metric, now or EVER.

Statistics

Views

Total Views
5,993
Views on SlideShare
4,478
Embed Views
1,515

Actions

Likes
8
Downloads
68
Comments
2

19 Embeds 1,515

http://blog.magicbeanlab.com 1185
http://magicbeanlab.com 157
http://magicbeanlab.tumblr.com 100
http://paper.li 17
http://feeds.feedburner.com 10
http://www.linkedin.com 9
https://twitter.com 9
http://www.magicbeanlab.com 8
http://mediaczar.tumblr.com 7
http://www.twylah.com 2
https://si0.twimg.com 2
http://feeds2.feedburner.com 2
https://www.linkedin.com 1
http://dabr.eu 1
http://ranksit.com 1
http://www.slideshare.net 1
http://a0.twimg.com 1
http://twitter.com 1
http://mediaczar.wpengine.com 1
More...

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel

12 of 2 previous next

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Negative Sentiment (or "Sentiment Analysis is Sh*te") Negative Sentiment (or "Sentiment Analysis is Sh*te") Presentation Transcript

    • Mat Morrison @mediaczarTuesday, 5 July 2011
    • Tuesday, 5 July 2011
    • Tuesday, 5 July 2011
    • Elephant in the roomTuesday, 5 July 2011
    • or Emperor’s ClothesTuesday, 5 July 2011
    • Tuesday, 5 July 2011
    • VolumeTuesday, 5 July 2011
    • qualified byVolume Relevance AUTHORITY SentimentTuesday, 5 July 2011
    • quick Question: How Accurate is Sentiment analysis?Tuesday, 5 July 2011
    • The stinksTuesday, 5 July 2011
    • supervised Learning Machine Robot HumanTuesday, 5 July 2011
    • Robots first...Tuesday, 5 July 2011
    • I’m unqualified to make judgements about the science...Tuesday, 5 July 2011
    • I’m unqualified to make judgements about the science... ...and So are you.Tuesday, 5 July 2011
    • Because the Science Is hidden in a boxTuesday, 5 July 2011
    • Because the Science Is hidden in a box But scientific Results are Reproducable!!!Tuesday, 5 July 2011
    • What’s the buzz around “Green Lantern”?Tuesday, 5 July 2011
    • Positive Negative Sysomos (Blogs) 40 17 TweetSentiment 29 11 WDTIT? 56.8 42 SocialMention 18 5 SM2 20 16 Sysomos (Tweets) 6.4 7.6 Rotten Tomatoes 27 73 A quick poll of a few sentiment engines’ analysis of the buzz surrounding the film “Green Lantern” demonstrates no correspondence.Tuesday, 5 July 2011
    • Tuesday, 5 July 2011
    • Tuesday, 5 July 2011
    • Turk THis! RT @BangsandaBun: According to some, I wasnt deserving/grateful/ cool enough to be there, but I blogged about my Glastonbury experience http://t.co/eEInrnuTuesday, 5 July 2011
    • Turk THis! RT @BangsandaBun: According to some, I wasnt deserving/grateful/ cool enough to be there, but I blogged about my Glastonbury experience http://t.co/eEInrnu Robot says NegativeTuesday, 5 July 2011
    • Turk THis! I know the bands for Glastonbury were great this year, but I still dont think you could have paid me to be part of that mental crowd! You?Tuesday, 5 July 2011
    • Turk THis! I know the bands for Glastonbury were great this year, but I still dont think you could have paid me to be part of that mental crowd! You? Robot says positiveTuesday, 5 July 2011
    • SENTIMENT scoring using Amazon Mechanical Turk disagreed with 16/40 (40%) robot judgments. Only 13/40 (32.5%) of robotic judgments were passed by all three human Judges. Raw Data available at http://mczar.me/mkue1pTuesday, 5 July 2011
    • But Are Humans Reliable? ??? Emotional State/Mood Priming Cultural bias Cognitive Bias Famously not.Tuesday, 5 July 2011
    • It Gets Worse... The Same Human Scorer, when presented with the same statement on multiple occasions, may score it differently each time. cf. A Guerilla Experiment in Sentiment Analysis http://mczar.me/lrp7YiTuesday, 5 July 2011
    • Tuesday, 5 July 2011
    • The stinksTuesday, 5 July 2011
    • Academic studies generally focus on Movies & the STOCK Market Why is this?Tuesday, 5 July 2011
    • Social Media data are full of irrelevant...Tuesday, 5 July 2011
    • Social Media data are full of irrelevant...Tuesday, 5 July 2011
    • Tuesday, 5 July 2011
    • Volume Relevance Authority SentimentTuesday, 5 July 2011
    • All four are needed to make sense of dataVolume Relevance Authority Sentiment But I’m only talking sentimentTuesday, 5 July 2011
    • The stinksTuesday, 5 July 2011
    • Why might marketers want to perform Sentiment analysis? To guide customer service interactions As a Performance indicator To qualify social media buzz To identify fansTuesday, 5 July 2011
    • Is sentiment actionable? Product Query Is it a... Product Complaint ??? Product endorsement Product review Product COmparison ...I need to know moreTuesday, 5 July 2011
    • THE KPI Problem !"#"$%&# ##$ &"#$ &##$ %"#$ =)*;>$?)@2<$ A2.-4.@)3>$?)@2<$ %##$ B;3C>,;<<$?)@2<$ "#$ #$ ()*+,-+.$ /+0+,-+.$ 12342.5$ 6+-.42.5$ 72.08$ 9:.;<$ 725$ !"#$ Massive (and unrepresentative) spike in Net Positive Sentiment caused by specific campaign activity Should we be allowed to mark our own homework?Tuesday, 5 July 2011
    • Tuesday, 5 July 2011
    • Tuesday, 5 July 2011
    • Tuesday, 5 July 2011