1. Data @ foursquare
6/28/2011 Big Data Camp Ben Lee - @benlee

2. Overview
• What is foursquare?
• Data
• Technology Stack
• Analysis (Graphs and stuff.)
6/28/2011 Big Data Camp Ben Lee - @benlee

3. foursquare
• Location based app
• Helps you to explore your
neighborhood, discover new places
• Visit places, check-in, earn
rewards, stay connected with your
friends
6/28/2011 Big Data Camp Ben Lee - @benlee

4. Explore
• Social recommendation
engine
• Realtime suggestions based
on friends, user history
6/28/2011 Big Data Camp Ben Lee - @benlee

5. Stats
• Over 10 million users
• Over 15 million venues
• Over 750 million check-ins total
• Over 3 million check-ins per day
• ~10k developers using API
• ~70 employees in NYC and SF
6/28/2011 Big Data Camp Ben Lee - @benlee

6. Growth
6/28/2011 Big Data Camp Ben Lee - @benlee

7. Growth
6/28/2011 Big Data Camp Ben Lee - @benlee

8. Growth
6/28/2011 Big Data Camp Ben Lee - @benlee

9. Technology Stack
• MongoDB / Scala (service)
• Amazon EC2, S3, Elastic Mapreduce
• Hadoop (Java/Streaming)
• Hive
• Flume
• Web-based job interface
6/28/2011 Big Data Camp Ben Lee - @benlee

10. Analysis
• Collaborative filtering over check-in data
• Usage analysis, experimentation
• Infographic fun
6/28/2011 Big Data Camp Ben Lee - @benlee

11. Job interface
Text
6/28/2011 Big Data Camp Ben Lee - @benlee

12. Unnamed coffee shop.
6/28/2011 Big Data Camp Ben Lee - @benlee

13. Usage analysis
6/28/2011 Big Data Camp Ben Lee - @benlee

14. 6/28/2011 Big Data Camp Ben Lee - @benlee

15. foursquare is hiring!
• http://foursquare.com/jobs
6/28/2011 Big Data Camp Ben Lee - @benlee