Giles Palmer - Social Media '09 (a mashup* event)


Published on

Giles Palmer
Sentiment Analysis
Social Media '09
a mashup* event

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Giles Palmer - Social Media '09 (a mashup* event)

  1. 1. Sentiment analysis<br />
  2. 2. Who am I?<br />personal tags: <br />giles palmer<br />founder and ceo of – buzz monitoring to the stars<br />taller than your average joe<br />please sponsor my tash at:<br /><br />
  3. 3. |<br />3<br />Sentiment – so why’s that important then?<br />
  4. 4. Politicians are obsessed with it<br />
  5. 5. |<br />5<br />Companies like it because it can help predict….<br />
  6. 6. |<br />6<br />Sales<br />
  7. 7. Some sentiment stats<br /> |<br />7<br />
  8. 8. |<br />8<br />The sentiment of the web<br />Sample size 400,000 web pages about 1,000 different things<br />
  9. 9. People don’t agree with each other all the time<br /> |<br />9<br />(Arsenal 2 : 1 Man Utd)<br />In our tests, people agree on sentiment 85% of the time<br />
  10. 10. |<br />10<br />Top ‘Brands’ in October – English speaking web<br />Volume ‘000s<br />Sentiment * Volume<br />Sentiment<br />
  11. 11. |<br />11<br />
  12. 12. |<br />12<br />
  13. 13. How do you measure the sentiment of millions of webpages?<br /> |<br />13<br />
  14. 14. Crowdsource ?<br /> |<br />14<br />
  15. 15. Downsides to crowdsourcing<br /> |<br />15<br />Slow (compared to machines)<br />Inconsistent<br />Expensive<br />e.g. Article takes 2 minutes so 30 articles per hour<br />You need native speakers, so £6/hr<br />=&gt; Article costs £0.2 to read<br />10,000 articles * £0.2 = £2,000<br />(Twitter is cheaper) <br />
  16. 16. Machines ?<br /> |<br />16<br />Q: Can we RELIABLY get a machine to do sentiment analysis ?<br />A: Kind of<br />Q: How ?<br />A: You teach it to mimic your own behaviour using a branch of Artificial Intelligence called Machine Learning<br />
  17. 17. Teaching machines<br /> |<br />17<br />Decide what text to feed in<br />Train them (lots)<br />Audit and improve (lots)<br />It’s not quick<br />
  18. 18. |<br />18<br />BSkyB has struck a deal with Apple to launch its mobile TV service providing live access to sport including Premier League football matches on the iPhone.<br />From today the service, Sky Mobile TV, will be made available to iPhone and iPod Touch owners via a new application at the Apple App Store.<br />The application allows iPhone owners to stream live TV – via a Wi-Fi connection – from a selection of channels including the Sky Sports portfolio, Sky Sports News, ESPN, At The Races and Sky News. The sports and news package will cost phone owners £6 a month.<br />Sky&apos;s mobile TV service allows iPhone owners to access live televised matches from the Barclays Premier League, Scottish Premier League and Football League, as well as sport such as European Tour golf, Premiership rugby and international and domestic cricket.<br />The application is free to download and is being made available to all iPhone owners regardless of which mobile network they are signed to.<br />Sky Mobile TV is already available, for £5 a month, on the 3G networks of Vodafone, Orange and T-Mobile.<br />In the past year BSkyB has launched a number of applications in the Apple App Store, for football, cricket and news updates, and claims more than 2m downloads so far.<br />&quot;In less than a year we&apos;ve already seen millions of downloads of Sky&apos;s various iPhone apps,&quot; said David Gibbs, the general manager for mobile at Sky. &quot;Now, by launching our new Sky Mobile TV app, we are able to combine the demand for great live TV on the move with the quality of experience offered through the iPhone and iTouch.&quot;<br />As part of the launch of the service mobile network operator O2 is giving its iPhone customer base three months&apos; free subscription to Sky Mobile TV.<br />
  19. 19. |<br />19<br />
  20. 20. How to train machines<br /> |<br />20<br />A trained native speaker reads something and tags it<br />Feed that data into the program<br />Repeat many times<br />The program use this information to build up statistical maps<br />Then you feed an untagged snippet in and the machine gives it the tag that’s statistically closest to its training<br />
  21. 21. Different language<br /> |<br />21<br /><ul><li>Results are only as good as the training (Royal Mail)
  22. 22. Type of language used has big effect eg Insurance news vs online gaming forums
  23. 23. Foreign languages are done in the same way</li></ul>Stats<br /><ul><li>Training to date 650,000 mentions in 60 industries from merchant banking to military
  24. 24. Accuracy ranges from 94% for Swedish videogames to 50% for Portuguese telecom</li></ul>Good target is 75% which is achievable<br />
  25. 25. The best approach<br /> |<br />22<br />For small volumes – crowdsource<br />For large volumes – use machines, but also look at the most important mentions manually <br />
  26. 26. Recap<br /> |<br />23<br /><ul><li>Machine-based sentiment IS possible
  27. 27. It’s not as good as people (who are native speakers)
  28. 28. The text you feed into the program is critical
  29. 29. Machines need a lot of training
  30. 30. A combined approach is probably best for most</li></li></ul><li>Free giveaway!! <br /> |<br />24<br />Brandwatch 4.0 is out at the end of November<br />50 Free Beta testing accounts<br /><br /><br />