Gary Short introduces data mining of the social web. He explains how to access public APIs to collect tweets mentioning brands like Apple, Google, and Microsoft. Short then preprocesses and stores the tweets in CouchDB for analysis and visualization. As an example, he analyzes around 6,000 tweets to look at lexical diversity by brand, popular words, top posters, and geocoded tweets. He is available for any questions.

1. Data
Mining
The
Social
Web
By
Gary
Short
Developer
Evangelist
Developer
Express

2. Introduc>on
• Gary
Short
• Developer
Evangelist
• gary@garyshort.org
• garys@devexpress.com
• www.garyshort.org
• @twiCer

3. What
About
You
Guys?

4. Why
Bother
Data
Mining
The
Social
Web?

5. How
do
we
Data
Mine
The
Social
Web?
Public
API
Data
Store
Analysis
Visualise
Beyond
Visualisa>on

6. My
Set
UP
Public
API
cUrl
to
file
Preprocessing
Store
to
CouchDB
Analysis
&
Visualisa>on

7. Today’s
Sample
• ~6,000
tweets
• Men>on
– Apple
– Google
– MicrosoS
• Doesn’t
include
last
night’s
announcement
J

8. Lexical
Diversity

9. Compe>>ve
Analysis

10. Lexical
Diversity
by
Brand

11. Top
10
Popular
Words

12. Top
10
Posters
by
Volume

13. Propor>on
Of
Geo
Coded
Tweets

15. Ques>ons
• gary@garyshort.org
• garys@devexpress.com
• @twiCer