Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Realtime Social Data
workshop @ startupfest
Sylvain Carle
Senior Developer Advocate
@froginthevalley
2
Twitter is the
pulse of the planet
@Sylvain: from Startup to Twitter
3
• Startup CTO (a few times around)
• REST + Streaming API building Needium
• Didn’t wo...
Twitter Data APIs
4
Twitter APIs deal both with 

the moment and the past
The pulse of the planet
5
• More than 241 million monthly active users
• 500 million Tweets are sent per day, or 1 billion...
Get started
6
!
Create you app: easy

t.co/apps



Do not re-invent the wheel: libs
t.co/libs
!
Create your App
7
Twitter Data APIs
8
The Past: REST API

t.co/rest
Optimize your calls, don’t get 429-ied
!
The Moment: Streaming API
t.co/...
Getting started
9
Twurl
10
!
t.co/twurl
Twurl
11
!
t.co/console
Hosebird (HBC)
12
!
t.co/hbc
Getting started
13
Think with Data
14
• Focus on 2nd order effects
• Derive value from the content/network
• Catch emerging patterns: trends
•...
Think with Data
15
• Find one top level object to get started
• Users, Tweets, Timelines
• Map this concept to your domain...
Building you taxonomy
16
• Human Insights (domain knowledge)
• Data Insights
• Discovery mode (keyword inventory / baselin...
Taxonomy: Needium Locksmiths
17
• Human Insights (existing taxo + research)
• http://en.wikipedia.org/wiki/Lock
• Data Ins...
Other Examples
18
• Dataminr - finding emerging news
• Lithium - managing social at scale
• Sprinklr - social experience ma...
REST API 1.1 Resources
19
!
t.co/1.1
Streaming API Resources
20
!
t.co/1.1
Ramp up
21
• Start small, grow organically
• Get your core data in and out (+ management)
• Build your MVP Twitter integra...
Twitter Data APIs
22
!
Ask us @TwitterDev



Ask in the forums
t.co/discuss
!
Twitter Data APIs
Streaming API t.co/streaming
REST API t.co/rest
Create App t.co/apps

Twurl t.co/twurl
Open Source Libs ...
Upcoming SlideShare
Loading in …5
×

Twitter Realtime Social Data @StartupFest

930 views

Published on

Learn how to work with public, conversational, real-time data. This workshop will provide some perspective on data collection strategies using Twitter’s public APIs as the starting point (REST and Streaming).

Published in: Technology, Education
  • Be the first to comment

Twitter Realtime Social Data @StartupFest

  1. 1. Realtime Social Data workshop @ startupfest Sylvain Carle Senior Developer Advocate @froginthevalley
  2. 2. 2 Twitter is the pulse of the planet
  3. 3. @Sylvain: from Startup to Twitter 3 • Startup CTO (a few times around) • REST + Streaming API building Needium • Didn’t work so well (that’s another story) • The tech stack was pretty awesome! • Modern version of our 2011 idea today • Colin @ElasticSearch, Sylvain @Twitter • In the end, not so bad!
  4. 4. Twitter Data APIs 4 Twitter APIs deal both with 
 the moment and the past
  5. 5. The pulse of the planet 5 • More than 241 million monthly active users • 500 million Tweets are sent per day, or 1 billion every ~2 days • 300+ billion Tweets have been sent since founding in 2006 • 76% of our active users are mobile users • 40% of our active users simply consume content on Twitter • Over 400 million monthly unique visitors to twitter.com • Twitter supports 35 different languages • 77% of Twitter accounts are outside the U.S.
  6. 6. Get started 6 ! Create you app: easy
 t.co/apps
 
 Do not re-invent the wheel: libs t.co/libs !
  7. 7. Create your App 7
  8. 8. Twitter Data APIs 8 The Past: REST API
 t.co/rest Optimize your calls, don’t get 429-ied ! The Moment: Streaming API t.co/streaming 1% Sample or Track Keywords !
  9. 9. Getting started 9
  10. 10. Twurl 10 ! t.co/twurl
  11. 11. Twurl 11 ! t.co/console
  12. 12. Hosebird (HBC) 12 ! t.co/hbc
  13. 13. Getting started 13
  14. 14. Think with Data 14 • Focus on 2nd order effects • Derive value from the content/network • Catch emerging patterns: trends • Listen to the chatter: conversations • Flip it inside out: content from users • Broader perspective: analytics • Understand users: personalization
  15. 15. Think with Data 15 • Find one top level object to get started • Users, Tweets, Timelines • Map this concept to your domain knowledge • Start with a measurable experience • Moebius virtuous circle: fed and feed data • Add your own layer of data for max value • Analyze collections + context, not single tweets
  16. 16. Building you taxonomy 16 • Human Insights (domain knowledge) • Data Insights • Discovery mode (keyword inventory / baseline) • Machine Learning (co-occurrences, clustering) • Historical Indices • Noise cancellation • Detecting emerging trends
  17. 17. Taxonomy: Needium Locksmiths 17 • Human Insights (existing taxo + research) • http://en.wikipedia.org/wiki/Lock • Data Insights • Discovery mode: swearing, types of issues • Machine Learning: “locked up” “locked out” • Historical Indices: evaluate opportunity by geo • Noise cancellation: “lockin” “boat” “clock” • Detecting emerging trends: seasonal, time of day
  18. 18. Other Examples 18 • Dataminr - finding emerging news • Lithium - managing social at scale • Sprinklr - social experience management • Wayin - best brand stories by customers • Inside - most important stories, for you • More at t.co/partners
  19. 19. REST API 1.1 Resources 19 ! t.co/1.1
  20. 20. Streaming API Resources 20 ! t.co/1.1
  21. 21. Ramp up 21 • Start small, grow organically • Get your core data in and out (+ management) • Build your MVP Twitter integration • Measure, experiment, learn • Accelerate: rewrite, optimize, elevate • Pedal to the metal: promoted, hoses
  22. 22. Twitter Data APIs 22 ! Ask us @TwitterDev
 
 Ask in the forums t.co/discuss !
  23. 23. Twitter Data APIs Streaming API t.co/streaming REST API t.co/rest Create App t.co/apps
 Twurl t.co/twurl Open Source Libs t.co/libs Discussion forums t.co/discuss
 Ask us @TwitterDev

×