Parsing real-time data using Twitter Streaming API
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Parsing real-time data using Twitter Streaming API

on

  • 6,435 views

 

Statistics

Views

Total Views
6,435
Views on SlideShare
6,435
Embed Views
0

Actions

Likes
4
Downloads
54
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Parsing real-time data using Twitter Streaming API Presentation Transcript

  • 1. Parsing Real-time Tweets Ramanujam Parthasarathy Monetate @ramanujam http://github.com/ramanujamWednesday, May 30, 12
  • 2. Why? • Freely available public intelligence • News reaches twitter super fast and spreads • 250 million tweets per day (Oct ‘11) • Track keywords, sentiment analysis, data mining • Because you can!Wednesday, May 30, 12
  • 3. Twitter Streaming API https://stream.twitter.com/1/statuses/filter.jsonWednesday, May 30, 12
  • 4. Twitter Streaming API curl https://stream.twitter.com/1/ statuses/filter.json? track=SEARCH_PARAMETER - uUSERNAME:PASSWORDWednesday, May 30, 12
  • 5. Twitter Python Libraries • Tweepy • Python Oauth2 • Python Twitter • Twython • Twitty Twister • Tweetstream Use a library that has support for OauthWednesday, May 30, 12
  • 6. Get your auth keysWednesday, May 30, 12
  • 7. Basic keyword/hashtag tracking Set the keywords to track Print the status File: tracker.pyWednesday, May 30, 12
  • 8. Save to MongoDB Pymongo (http://api.mongodb.org/python/2.2/ index.html) is a recommended way to work with MongoDB from PythonWednesday, May 30, 12
  • 9. Plot some data Pie chart of the devices used by people who tweet about Obama and Romney File: plotapps.pyWednesday, May 30, 12
  • 10. Play some music #pugmusic http://tinysong.com/6OABWednesday, May 30, 12
  • 11. Play some music File: playmusic.pyWednesday, May 30, 12
  • 12. Enqueue more songs • Grooveshark javascript api • addSongsByID • window.Grooveshark.addSongsByID(13766524)Wednesday, May 30, 12
  • 13. Notify Twilio API to send a text or make a call based on an event trigger (eg: > 10 statuses in a 10 second window) setTerms = [$AAPL, down, 530] setTerms = [‘aws’, ‘down’] setTerms = [‘phillies’, ‘win’] File: sendtext.pyWednesday, May 30, 12
  • 14. Thank You! http://github.com/ramanujam/pugtalkWednesday, May 30, 12