Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Scalable Event Tracking

397 views

Published on

Scalable event tracking. How to be able to track user actions without slowing down the core application.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Scalable Event Tracking

  1. 1. SCALABLE EVENT TRACKING by Ø istein Sø rensen - Schibsted Payment
  2. 2. WHAT IS AN EVENT?
  3. 3. EVENTS UDP UDP Logger Logger SPiD Core SPiD Core Events Events file_logger file_logger aws_sqs aws_sqs Amazon SQS
  4. 4. EVENTS Mixpanel Mixpanel EC2 DataPiper Amazon SQS Amazon SQS Auto Scaling Redshift
  5. 5. UDP LOGGER
  6. 6. DATAPIPER
  7. 7. AMAZON EC2 DEPLOYMENT
  8. 8. EC2 DEPLOYMENT Auto Scaling EC2 instances
  9. 9. EC2 DEPLOYMENT EC2 Ubuntu 12.04 LTS m1.medium Auto Scaling $$bash < User Data bash < User Data Auto Scaling Group Auto Scaling Group Launch Config
  10. 10. EC2 DEPLOYMENT Public S3 Bucket • EC2 Ubuntu 12.04 LTS m1.medium Puppet S3cmd S3cmd config $$bash < User Data bash < User Data
  11. 11. EC2 DEPLOYMENT Private S3 Bucket • • • EC2 Ubuntu 12.04 LTS m1.medium Node.js npm modules Puppet config DataPiper Upstart and logrotate configs $$bash < User Data bash < User Data
  12. 12. EC2 DEPLOYMENT EC2 Ubuntu 12.04 LTS m1.medium DataPiper mixpanel mixpanel redshift redshift SQS SQS
  13. 13. SOFTWARE DEPLOYMENT
  14. 14. SOFTWARE DEPLOYMENT Upload Private S3 Bucket
  15. 15. SOFTWARE DEPLOYMENT 2 Auto Scaling
  16. 16. SOFTWARE DEPLOYMENT Auto Scaling EC2 Ubuntu 12.04 LTS m1.medium DataPiper mixpanel mixpanel redshift redshift
  17. 17. SOFTWARE DEPLOYMENT 1 Auto Scaling
  18. 18. SOFTWARE DEPLOYMENT EC2 Ubuntu 12.04 LTS m1.medium DataPiper mixpanel mixpanel redshift redshift
  19. 19. QUESTIONS?

×