HackMIT Presentation

1,221 views

Published on

on wednesday 2nd october i presented to a group of students at MIT on Twitter API Data. this is the presentation i gave them.

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,221
On SlideShare
0
From Embeds
0
Number of Embeds
100
Actions
Shares
0
Downloads
6
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

HackMIT Presentation

  1. 1. Visualizing the real-time information network
  2. 2. Visualizing the real-time information network @themattharris@kmonkeyjam
  3. 3. Global Conversation http://www.flickr.com/photos/twitteroffice/7420677428/
  4. 4. Geographical http://www.flickr.com/photos/twitteroffice/8798022019/
  5. 5. Getting Started http://www.flickr.com/photos/chberge/3770601501/
  6. 6. @TwitterEng | HackMIT URL: https://dev.twitter.com Creating an App 7
  7. 7. @TwitterEng | HackMIT URL: https://dev.twitter.com/apps Creating an App 8
  8. 8. @TwitterEng | HackMIT URL: https://dev.twitter.com/apps/new Creating an App 9
  9. 9. @TwitterEng | HackMIT URL: https://dev.twitter.com/apps/12345/show OAuth Tokens 10
  10. 10. @TwitterEng | HackMIT Core Objects 11 User Timeline Social Graph Tweet
  11. 11. @TwitterEng | HackMIT User 12 User Timeline Social Graph Tweet
  12. 12. @TwitterEng | HackMIT User 13
  13. 13. @TwitterEng | HackMIT User 14 } ] }, "description": { "urls": [ ] } }, "protected": false, "followers_count": 8586, "friends_count": 486, "listed_count": 314, "created_at": "Sat Feb 17 20:49:54 +0000 2007", "favourites_count": 338, "utc_offset": -25200, "time_zone": "Pacific Time (US & Canada)", "geo_enabled": true, "verified": false, "statuses_count": 4874, "lang": "en", "status": { "created_at": "Mon Sep 30 22:46:44 +0000 2013", "id": 384811580208082944, "id_str": "384811580208082944", "text": "the professor and i are deriving ... /cc @jmhodges", "source": "web", "truncated": false, "in_reply_to_status_id": null, "in_reply_to_status_id_str": null, "in_reply_to_user_id": null, "in_reply_to_user_id_str": null, "in_reply_to_screen_name": null, "geo": null, "coordinates": null, "place": null, "contributors": null, "retweet_count": 0, "favorite_count": 1, "entities": { "hashtags": [ ], "symbols": [ ], "urls": [ ], "user_mentions": [ { "screen_name": "jmhodges", "name": "Jeff Hodges", "id": 9267272, "id_str": "9267272", "indices": [ 41, 50 ] } ] }, "favorited": false, "retweeted": false, "lang": "en" },
  14. 14. @TwitterEng | HackMIT User 15 } ] }, "description": { "urls": [ ] } }, "protected": false, "followers_count": 8586, "friends_count": 486, "listed_count": 314, "created_at": "Sat Feb 17 20:49:54 +0000 2007", "favourites_count": 338, "utc_offset": -25200, "time_zone": "Pacific Time (US & Canada)", "geo_enabled": true, "verified": false, "statuses_count": 4874, "lang": "en", "status": { "created_at": "Mon Sep 30 22:46:44 +0000 2013", "id": 384811580208082944, "id_str": "384811580208082944", "text": "the professor and i are deriving ... /cc @jmhodges", "source": "web", "truncated": false, "in_reply_to_status_id": null, "in_reply_to_status_id_str": null, "in_reply_to_user_id": null, "in_reply_to_user_id_str": null, "in_reply_to_screen_name": null, "geo": null, "coordinates": null, "place": null, "contributors": null, "retweet_count": 0, "favorite_count": 1, "entities": { "hashtags": [ ], "symbols": [ ], "urls": [ ], "user_mentions": [ { "screen_name": "jmhodges", "name": "Jeff Hodges", "id": 9267272, "id_str": "9267272", "indices": [ 41, 50 ] } ] }, "favorited": false, "retweeted": false, "lang": "en" }, { "id": 777925, "id_str": "777925", "name": "Matt Harris", "screen_name": "themattharris", "location": "SFO/LHR/YVR/JAX/IAD", "description": "PECoS @twitter. Married to @cindyli. Kryptonite hurts me.", "protected": false, "created_at": "Sat Feb 17 20:49:54 +0000 2007", "utc_offset": -25200, "time_zone": "Pacific Time (US & Canada)", "geo_enabled": true, "verified": false, "lang": "en",
  15. 15. @TwitterEng | HackMIT User 16 } ] }, "description": { "urls": [ ] } }, "protected": false, "followers_count": 8586, "friends_count": 486, "listed_count": 314, "created_at": "Sat Feb 17 20:49:54 +0000 2007", "favourites_count": 338, "utc_offset": -25200, "time_zone": "Pacific Time (US & Canada)", "geo_enabled": true, "verified": false, "statuses_count": 4874, "lang": "en", "status": { "created_at": "Mon Sep 30 22:46:44 +0000 2013", "id": 384811580208082944, "id_str": "384811580208082944", "text": "the professor and i are deriving ... /cc @jmhodges", "source": "web", "truncated": false, "in_reply_to_status_id": null, "in_reply_to_status_id_str": null, "in_reply_to_user_id": null, "in_reply_to_user_id_str": null, "in_reply_to_screen_name": null, "geo": null, "coordinates": null, "place": null, "contributors": null, "retweet_count": 0, "favorite_count": 1, "entities": { "hashtags": [ ], "symbols": [ ], "urls": [ ], "user_mentions": [ { "screen_name": "jmhodges", "name": "Jeff Hodges", "id": 9267272, "id_str": "9267272", "indices": [ 41, 50 ] } ] }, "favorited": false, "retweeted": false, "lang": "en" }, "followers_count": 8586, "friends_count": 486, "listed_count": 314, "favourites_count": 338, "statuses_count": 4874,
  16. 16. @TwitterEng | HackMIT Tweet 17 User Timeline Social Graph Tweet
  17. 17. @TwitterEng | HackMIT Tweet 18
  18. 18. @TwitterEng | HackMIT Tweet 19 140 Characters
  19. 19. @TwitterEng | HackMIT Tweet 20 ~200 bytes
  20. 20. @TwitterEng | HackMIT Tweet 21 "in_reply_to_status_id": null, "in_reply_to_status_id_str": null, "in_reply_to_user_id": null, "in_reply_to_user_id_str": null, "in_reply_to_screen_name": null, "user": { "id": 777925, "id_str": "777925", "name": "Matt Harris", "screen_name": "themattharris", "location": "SFO/LHR/YVR/JAX/IAD", "description": "PECoS @twitter. Married to @cindyli. Kryptonite hurts me.", "url": "http://t.co/ZDjyFfevMF", "entities": { "url": { "urls": [ { "url": "http://t.co/ZDjyFfevMF", "expanded_url": "http://about.me/themattharris", "display_url": "about.me/themattharris", "indices": [0, 22] } ] }, "description": { "urls": [ ] } }, "protected": false, "followers_count": 8586, "friends_count": 486, "listed_count": 314, "created_at": "Sat Feb 17 20:49:54 +0000 2007", "favourites_count": 338, "utc_offset": -25200, "time_zone": "Pacific Time (US & Canada)", "geo_enabled": true, "verified": false, "statuses_count": 4874, "lang": "en", "contributors_enabled": false, "is_translator": false, "profile_background_color": "C0DEED", "profile_background_image_url": "http://abs.twimg.com/images/themes/theme1/bg.png", "profile_background_image_url_https": "https://abs.twimg.com/images/themes/theme1/bg.png", "profile_background_tile": false, "profile_image_url": "http://a0.twimg.com/profile_images/554181350/matt_normal.jpg", "profile_image_url_https": "https://si0.twimg.com/profile_images/554181350/matt_normal.jpg", "profile_banner_url": "https://pbs.twimg.com/profile_banners/777925/1351367661", "profile_link_color": "0084B4", "profile_sidebar_border_color": "C0DEED", "profile_sidebar_fill_color": "DDEEF6", "profile_text_color": "333333", "profile_use_background_image": true, "default_profile": true, "default_profile_image": false, "following": true, "follow_request_sent": false, "notifications": null }, "geo": null, "coordinates": null, "place": { "id": "5a110d312052166f", "url": "https://api.twitter.com/1.1/geo/id/5a110d312052166f.json", "place_type": "city", "name": "San Francisco", "full_name": "San Francisco, CA", "country_code": "US", "country": "United States", "bounding_box": { "type": "Polygon", "coordinates": [ [ [-122.51368188, 37.70813196], [-122.35845384, 37.70813196], [-122.35845384, 37.83245301], [-122.51368188, 37.83245301] ] ] }, "attributes": { } }, "contributors": null, "retweet_count": 1, "favorite_count": 4, "entities": { "hashtags": [ ], "symbols": [ ],
  21. 21. @TwitterEng | HackMIT Tweet 22 "in_reply_to_status_id": null, "in_reply_to_status_id_str": null, "in_reply_to_user_id": null, "in_reply_to_user_id_str": null, "in_reply_to_screen_name": null, "user": { "id": 777925, "id_str": "777925", "name": "Matt Harris", "screen_name": "themattharris", "location": "SFO/LHR/YVR/JAX/IAD", "description": "PECoS @twitter. Married to @cindyli. Kryptonite hurts me.", "url": "http://t.co/ZDjyFfevMF", "entities": { "url": { "urls": [ { "url": "http://t.co/ZDjyFfevMF", "expanded_url": "http://about.me/themattharris", "display_url": "about.me/themattharris", "indices": [0, 22] } ] }, "description": { "urls": [ ] } }, "protected": false, "followers_count": 8586, "friends_count": 486, "listed_count": 314, "created_at": "Sat Feb 17 20:49:54 +0000 2007", "favourites_count": 338, "utc_offset": -25200, "time_zone": "Pacific Time (US & Canada)", "geo_enabled": true, "verified": false, "statuses_count": 4874, "lang": "en", "contributors_enabled": false, "is_translator": false, "profile_background_color": "C0DEED", "profile_background_image_url": "http://abs.twimg.com/images/themes/theme1/bg.png", "profile_background_image_url_https": "https://abs.twimg.com/images/themes/theme1/bg.png", "profile_background_tile": false, "profile_image_url": "http://a0.twimg.com/profile_images/554181350/matt_normal.jpg", "profile_image_url_https": "https://si0.twimg.com/profile_images/554181350/matt_normal.jpg", "profile_banner_url": "https://pbs.twimg.com/profile_banners/777925/1351367661", "profile_link_color": "0084B4", "profile_sidebar_border_color": "C0DEED", "profile_sidebar_fill_color": "DDEEF6", "profile_text_color": "333333", "profile_use_background_image": true, "default_profile": true, "default_profile_image": false, "following": true, "follow_request_sent": false, "notifications": null }, "geo": null, "coordinates": null, "place": { "id": "5a110d312052166f", "url": "https://api.twitter.com/1.1/geo/id/5a110d312052166f.json", "place_type": "city", "name": "San Francisco", "full_name": "San Francisco, CA", "country_code": "US", "country": "United States", "bounding_box": { "type": "Polygon", "coordinates": [ [ [-122.51368188, 37.70813196], [-122.35845384, 37.70813196], [-122.35845384, 37.83245301], [-122.51368188, 37.83245301] ] ] }, "attributes": { } }, "contributors": null, "retweet_count": 1, "favorite_count": 4, "entities": { "hashtags": [ ], "symbols": [ ], { "created_at": "Thu Sep 19 17:43:52 +0000 2013", "id": 380749093766561793, "id_str": "380749093766561793", "text": "iOS7: battery life not included", "source": "web", "truncated": false, "in_reply_to_status_id": null, "in_reply_to_status_id_str": null, "in_reply_to_user_id": null, "in_reply_to_user_id_str": null, "in_reply_to_screen_name": null,
  22. 22. @TwitterEng | HackMIT Tweet 23 "in_reply_to_status_id": null, "in_reply_to_status_id_str": null, "in_reply_to_user_id": null, "in_reply_to_user_id_str": null, "in_reply_to_screen_name": null, "user": { "id": 777925, "id_str": "777925", "name": "Matt Harris", "screen_name": "themattharris", "location": "SFO/LHR/YVR/JAX/IAD", "description": "PECoS @twitter. Married to @cindyli. Kryptonite hurts me.", "url": "http://t.co/ZDjyFfevMF", "entities": { "url": { "urls": [ { "url": "http://t.co/ZDjyFfevMF", "expanded_url": "http://about.me/themattharris", "display_url": "about.me/themattharris", "indices": [0, 22] } ] }, "description": { "urls": [ ] } }, "protected": false, "followers_count": 8586, "friends_count": 486, "listed_count": 314, "created_at": "Sat Feb 17 20:49:54 +0000 2007", "favourites_count": 338, "utc_offset": -25200, "time_zone": "Pacific Time (US & Canada)", "geo_enabled": true, "verified": false, "statuses_count": 4874, "lang": "en", "contributors_enabled": false, "is_translator": false, "profile_background_color": "C0DEED", "profile_background_image_url": "http://abs.twimg.com/images/themes/theme1/bg.png", "profile_background_image_url_https": "https://abs.twimg.com/images/themes/theme1/bg.png", "profile_background_tile": false, "profile_image_url": "http://a0.twimg.com/profile_images/554181350/matt_normal.jpg", "profile_image_url_https": "https://si0.twimg.com/profile_images/554181350/matt_normal.jpg", "profile_banner_url": "https://pbs.twimg.com/profile_banners/777925/1351367661", "profile_link_color": "0084B4", "profile_sidebar_border_color": "C0DEED", "profile_sidebar_fill_color": "DDEEF6", "profile_text_color": "333333", "profile_use_background_image": true, "default_profile": true, "default_profile_image": false, "following": true, "follow_request_sent": false, "notifications": null }, "geo": null, "coordinates": null, "place": { "id": "5a110d312052166f", "url": "https://api.twitter.com/1.1/geo/id/5a110d312052166f.json", "place_type": "city", "name": "San Francisco", "full_name": "San Francisco, CA", "country_code": "US", "country": "United States", "bounding_box": { "type": "Polygon", "coordinates": [ [ [-122.51368188, 37.70813196], [-122.35845384, 37.70813196], [-122.35845384, 37.83245301], [-122.51368188, 37.83245301] ] ] }, "attributes": { } }, "contributors": null, "retweet_count": 1, "favorite_count": 4, "entities": { "hashtags": [ ], "symbols": [ ], "user": { "id": 777925, "id_str": "777925", "name": "Matt Harris", "screen_name": "themattharris", "location": "SFO/LHR/YVR/JAX/IAD", "description": "PECoS @twitter. Married to @cindyli. Kryptonite hurts me.", "url": "http://t.co/ZDjyFfevMF", "entities": { "url": { "urls": [ { "url": "http://t.co/ZDjyFfevMF", "expanded_url": "http://about.me/themattharris", "display_url": "about.me/themattharris", "indices": [0, 22]
  23. 23. @TwitterEng | HackMIT Tweet 24 "in_reply_to_status_id": null, "in_reply_to_status_id_str": null, "in_reply_to_user_id": null, "in_reply_to_user_id_str": null, "in_reply_to_screen_name": null, "user": { "id": 777925, "id_str": "777925", "name": "Matt Harris", "screen_name": "themattharris", "location": "SFO/LHR/YVR/JAX/IAD", "description": "PECoS @twitter. Married to @cindyli. Kryptonite hurts me.", "url": "http://t.co/ZDjyFfevMF", "entities": { "url": { "urls": [ { "url": "http://t.co/ZDjyFfevMF", "expanded_url": "http://about.me/themattharris", "display_url": "about.me/themattharris", "indices": [0, 22] } ] }, "description": { "urls": [ ] } }, "protected": false, "followers_count": 8586, "friends_count": 486, "listed_count": 314, "created_at": "Sat Feb 17 20:49:54 +0000 2007", "favourites_count": 338, "utc_offset": -25200, "time_zone": "Pacific Time (US & Canada)", "geo_enabled": true, "verified": false, "statuses_count": 4874, "lang": "en", "contributors_enabled": false, "is_translator": false, "profile_background_color": "C0DEED", "profile_background_image_url": "http://abs.twimg.com/images/themes/theme1/bg.png", "profile_background_image_url_https": "https://abs.twimg.com/images/themes/theme1/bg.png", "profile_background_tile": false, "profile_image_url": "http://a0.twimg.com/profile_images/554181350/matt_normal.jpg", "profile_image_url_https": "https://si0.twimg.com/profile_images/554181350/matt_normal.jpg", "profile_banner_url": "https://pbs.twimg.com/profile_banners/777925/1351367661", "profile_link_color": "0084B4", "profile_sidebar_border_color": "C0DEED", "profile_sidebar_fill_color": "DDEEF6", "profile_text_color": "333333", "profile_use_background_image": true, "default_profile": true, "default_profile_image": false, "following": true, "follow_request_sent": false, "notifications": null }, "geo": null, "coordinates": null, "place": { "id": "5a110d312052166f", "url": "https://api.twitter.com/1.1/geo/id/5a110d312052166f.json", "place_type": "city", "name": "San Francisco", "full_name": "San Francisco, CA", "country_code": "US", "country": "United States", "bounding_box": { "type": "Polygon", "coordinates": [ [ [-122.51368188, 37.70813196], [-122.35845384, 37.70813196], [-122.35845384, 37.83245301], [-122.51368188, 37.83245301] ] ] }, "attributes": { } }, "contributors": null, "retweet_count": 1, "favorite_count": 4, "entities": { "hashtags": [ ], "symbols": [ ], "place": { "id": "5a110d312052166f", "url": "https://api.twitter.com/1.1/geo/id/5a110d312052166f.json", "place_type": "city", "name": "San Francisco", "full_name": "San Francisco, CA", "country_code": "US", "country": "United States", "bounding_box": { "type": "Polygon", "coordinates": [ [ [-122.51368188, 37.70813196], [-122.35845384, 37.70813196], [-122.35845384, 37.83245301], [-122.51368188, 37.83245301] ] ] },
  24. 24. @TwitterEng | HackMIT Tweet 25 "in_reply_to_status_id": null, "in_reply_to_status_id_str": null, "in_reply_to_user_id": null, "in_reply_to_user_id_str": null, "in_reply_to_screen_name": null, "user": { "id": 777925, "id_str": "777925", "name": "Matt Harris", "screen_name": "themattharris", "location": "SFO/LHR/YVR/JAX/IAD", "description": "PECoS @twitter. Married to @cindyli. Kryptonite hurts me.", "url": "http://t.co/ZDjyFfevMF", "entities": { "url": { "urls": [ { "url": "http://t.co/ZDjyFfevMF", "expanded_url": "http://about.me/themattharris", "display_url": "about.me/themattharris", "indices": [0, 22] } ] }, "description": { "urls": [ ] } }, "protected": false, "followers_count": 8586, "friends_count": 486, "listed_count": 314, "created_at": "Sat Feb 17 20:49:54 +0000 2007", "favourites_count": 338, "utc_offset": -25200, "time_zone": "Pacific Time (US & Canada)", "geo_enabled": true, "verified": false, "statuses_count": 4874, "lang": "en", "contributors_enabled": false, "is_translator": false, "profile_background_color": "C0DEED", "profile_background_image_url": "http://abs.twimg.com/images/themes/theme1/bg.png", "profile_background_image_url_https": "https://abs.twimg.com/images/themes/theme1/bg.png", "profile_background_tile": false, "profile_image_url": "http://a0.twimg.com/profile_images/554181350/matt_normal.jpg", "profile_image_url_https": "https://si0.twimg.com/profile_images/554181350/matt_normal.jpg", "profile_banner_url": "https://pbs.twimg.com/profile_banners/777925/1351367661", "profile_link_color": "0084B4", "profile_sidebar_border_color": "C0DEED", "profile_sidebar_fill_color": "DDEEF6", "profile_text_color": "333333", "profile_use_background_image": true, "default_profile": true, "default_profile_image": false, "following": true, "follow_request_sent": false, "notifications": null }, "geo": null, "coordinates": null, "place": { "id": "5a110d312052166f", "url": "https://api.twitter.com/1.1/geo/id/5a110d312052166f.json", "place_type": "city", "name": "San Francisco", "full_name": "San Francisco, CA", "country_code": "US", "country": "United States", "bounding_box": { "type": "Polygon", "coordinates": [ [ [-122.51368188, 37.70813196], [-122.35845384, 37.70813196], [-122.35845384, 37.83245301], [-122.51368188, 37.83245301] ] ] }, "attributes": { } }, "contributors": null, "retweet_count": 1, "favorite_count": 4, "entities": { "hashtags": [ ], "symbols": [ ], "contributors": null, "retweet_count": 1, "favorite_count": 4, "entities": { "hashtags": [ ], "symbols": [ ], "urls": [ ], "user_mentions": [ ] }, "favorited": false, "retweeted": false, "lang": "en"
  25. 25. @TwitterEng | HackMIT Timeline 26 User Timeline Social Graph Tweet
  26. 26. @TwitterEng | HackMIT Timeline (User) 27
  27. 27. @TwitterEng | HackMIT Timeline (Home) 28
  28. 28. @TwitterEng | HackMIT Timeline 29 User Timeline Social Graph Tweet
  29. 29. @TwitterEng | HackMIT Social Graph 30 Follows Followed By
  30. 30. @TwitterEng | HackMIT Social Graph 31 Follows Followed By
  31. 31. @TwitterEng | HackMIT Social Graph 32 Follows
  32. 32. @TwitterEng | HackMIT Social Graph 33 FollowsFollows Follows Followed By
  33. 33. @TwitterEng | HackMIT Social Graph 34 FollowsFollows Followed By Follows
  34. 34. Got Data?Got Data? http://www.flickr.com/photos/nickwheeleroz/2669814012/
  35. 35. @TwitterEng | HackMIT Sources 36 Search Streaming Snapshot Timelines
  36. 36. @TwitterEng | HackMIT Sources 37 Search Streaming Snapshot Timelines On Demand Relevance Based Rate Limited Historical
  37. 37. @TwitterEng | HackMIT Sources 38 Search Streaming Snapshot Timelines On Demand User Based Rate Limited Historical
  38. 38. @TwitterEng | HackMIT Sources 39 Search Streaming Snapshot Timelines Long Poll Targetted Sampled Real Time
  39. 39. @TwitterEng | HackMIT Sources 40 Search Streaming Snapshot Timelines Event Focused Sampled Historical
  40. 40. @TwitterEng | HackMIT Snapshots 41 Breaking Bad Final Season “Felina” 9/29 Boston Redsox Game 7/29 #breakingbad, #felina #redsox, @redsox, @Raysbaseball Breaking Bad Final Season “Bloodmoney” 8/11 #breakingbad, #bloodmoney
  41. 41. @TwitterEng | HackMIT Things to know 42 use _str { "created_at": "Thu Sep 19 17:43:52 +0000 2013", "id": 380749093766561793, "id_str": "380749093766561793", "text": "iOS7: battery life not included", "source": "web", "truncated": false, "in_reply_to_status_id": null, "in_reply_to_status_id_str": null, "in_reply_to_user_id": null, "in_reply_to_user_id_str": null, "in_reply_to_screen_name": null,
  42. 42. @TwitterEng | HackMIT Things to know 43 use _str { "created_at": "Thu Sep 19 17:43:52 +0000 2013", "id": 380749093766561793, "id_str": "380749093766561793", "text": "iOS7: battery life not included", "source": "web", "truncated": false, "in_reply_to_status_id": null, "in_reply_to_status_id_str": null, "in_reply_to_user_id": null, "in_reply_to_user_id_str": null, "in_reply_to_screen_name": null,
  43. 43. @TwitterEng | HackMIT Things to know 44 use _str (380749093766561793).toString() "380749093766561800"
  44. 44. @TwitterEng | HackMIT Things to know 45 use _str (380749093766561793).toString() "380749093766561800"
  45. 45. @TwitterEng | HackMIT Things to know 46 use _str console rate limits
  46. 46. @TwitterEng | HackMIT Things to know 47 use _str console support rate limits
  47. 47. @TwitterEng | HackMIT Docs https://dev.twitter.com https://dev.twitter.com/console Code https://github.com/mbilotti/hashtag_aggregator https://github.com/kmonkeyjam/trends_cloud https://github.com/twitter/hbc Visuals http://www.flickr.com/photos/twitteroffice/sets/72157633647745984/ 48
  48. 48. @TwitterEng | HackMIT Come and see us 49
  49. 49. @TwitterEng | HackMIT Demo 50

×