This document discusses parsing and analyzing real-time tweets. It recommends using the Twitter Streaming API to track keywords and topics in tweets. It provides examples of saving tweets to a MongoDB database, plotting tweet data, playing music from tweets, and notifying users via SMS or phone call based on tweet volumes or content. Code examples are provided in Python to demonstrate basic keyword tracking, data analysis, and notification functions using tweets.

1. Parsing Real-time
Tweets
Ramanujam Parthasarathy
Monetate
@ramanujam
http://github.com/ramanujam
Wednesday, May 30, 12

2. Why?
• Freely available public intelligence
• News reaches twitter super fast and spreads
• 250 million tweets per day (Oct ‘11)
• Track keywords, sentiment analysis, data mining
• Because you can!
Wednesday, May 30, 12

3. Twitter Streaming API
https://stream.twitter.com/1/statuses/filter.json
Wednesday, May 30, 12

4. Twitter Streaming API
curl https://stream.twitter.com/1/
statuses/filter.json?
track=SEARCH_PARAMETER -
uUSERNAME:PASSWORD
Wednesday, May 30, 12

5. Twitter Python Libraries
• Tweepy
• Python Oauth2
• Python Twitter
• Twython
• Twitty Twister
• Tweetstream
Use a library that has support for Oauth
Wednesday, May 30, 12

6. Get your auth keys
Wednesday, May 30, 12

7. Basic keyword/hashtag tracking
Set the keywords to track
Print the status
File: tracker.py
Wednesday, May 30, 12

8. Save to MongoDB
Pymongo (http://api.mongodb.org/python/2.2/
index.html) is a recommended way to work with
MongoDB from Python
Wednesday, May 30, 12

9. Plot some data
Pie chart of the devices used by people who tweet
about Obama and Romney
File: plotapps.py
Wednesday, May 30, 12

10. Play some music
#pugmusic
http://tinysong.com/6OAB
Wednesday, May 30, 12

11. Play some music
File: playmusic.py
Wednesday, May 30, 12

12. Enqueue more songs
• Grooveshark javascript api
• addSongsByID
• window.Grooveshark.addSongsByID(13766524)
Wednesday, May 30, 12

13. Notify
Twilio API to send a text or make a call based on an event
trigger (eg: > 10 statuses in a 10 second window)
setTerms = ['$AAPL', 'down', '530']
setTerms = [‘aws’, ‘down’]
setTerms = [‘phillies’, ‘win’]
File: sendtext.py
Wednesday, May 30, 12

14. Thank You!
http://github.com/ramanujam/pugtalk
Wednesday, May 30, 12