Guess the Country - Playing with Twitter Streaming API
•
1 like•7,631 views
(1) The document describes a project that collected over 285,000 geo-tagged tweets over 13 days using the Twitter Streaming API and extracted user names and countries to build a database linking names to countries. (2) It then used Spark to process the data and built a web interface that allows users to search for a name and get the most likely country. (3) Analysis of the data found the top countries by user count were the United States, United Kingdom, Indonesia and others, and the most common first and last names.
Recommended
More Related Content
Viewers also liked
Viewers also liked (19)
Similar to Guess the Country - Playing with Twitter Streaming API
Similar to Guess the Country - Playing with Twitter Streaming API (20)
More from Chris Birchall
Recently uploaded
Recently uploaded (20)
Guess the Country - Playing with Twitter Streaming API
- 1. Guess the Country Playing with Twitter Streaming API Chris Birchall #m3dev Tech Talk 2014/7/11
- 2. It started with an idle tweet... https://twitter.com/cbirchall/status/466197512143912961
- 3. Let’s use Twitter for something (slightly) useful! The plan: ● Collect geo-tagged tweets from Twitter Streaming API ● Use them to build a name⇔country DB ● Build a simple search UI as a proof of concept ● (crowbar Spark in there somewhere because it’s cool)
- 5. Collecting tweets ● Ran the collector for 13 days ● Collected 285,340 geo-tagged tweets ● 205,798 distinct users ● Only collected names and countries, threw everything else away ● Used Spark to filter out duplicate users Processing
- 6. Stats Top 10 countries by user count Distinct countries = 204 Distinct first names = 40,689 Distinct last names = 81,674 country | percentage -----------------------------+------------ United States | 39.4 United Kingdom | 10.1 Indonesia | 8.9 Brasil | 8.1 Türkiye | 3.9 España | 2.4 México | 2.2 Republic of the Philippines | 2.0 Canada | 1.8 Malaysia | 1.8 first_name ------------ chris alex david michael sarah second_name ------------- smith jones garcia williams johnson Most popular first names Most popular surnames
- 7. Results It works surprisingly well! (well, it worked for my name, anyway) Note for the pedantic: Since the original data is geo-tagged tweets, strictly speaking we only know where a user is, not where they come from.