Urturn	
  on	
  AWS	
  -­‐	
  scaling	
  infrastructure,	
  	
  
cost	
  and	
  6me	
  to	
  market	
  
confiden6al	
   3	
  
Limited	
  ways	
  to	
  express	
  
confiden6al	
   4	
  
	
  Write	
  something…	
  
	
  Write	
  something…	
  
Expressions	
  ready-­‐made	
  templates	
  
confiden6al	
   5	
  
Music	
  go-­‐to-­‐market	
  
Urturn	
  turns	
  out	
  to	
  be	
  a	
  great	
  response	
  to	
  
audience	
  engagemen...
confiden6al	
   7	
  
#DrawUnionJ	
  
confiden6al	
   8	
  
#ImatchwithUnionJ	
  
confiden6al	
   9	
  
Traffic	
  Peaks	
  
Max
Time to half: 5 min for Twitter, one hour for FB
Share on FB or Twitter
Time to max: 10 sec on Twit...
Urturn Web Back - AWSUrturn Front
Js client
Urturn reactive
Serving web pages
Rails
Storage
AWS S3
Master
Database
MySQL
G...
1 Replica
1 Slave
Urturn Web BackUrturn Front
Js client
Urturn reactive
Serving web pages
Rails + Unicorn
Database
MySQL
G...
MySQL DB
Urturn clients
Jsclient
Zoom	
  on	
  reacEve	
  requests	
  
iPhone
Apps
Load
balancers
MongoDB
Mobilesite
Cloud...
MySQL DB
Urturn clients
Jsclient
Keep	
  a	
  good	
  experience	
  during	
  Overload	
  
iPhone
Apps
Load
balancers
Mong...
MySQL
Urturn clients
Jsclient
A	
  good	
  request	
  is	
  	
  
a	
  non-­‐existant	
  request	
  
iPhone
Apps
Load
balan...
MySQL
Load testing
Load	
  tesEng	
  
Load
balancers
MongoDB
Grinder in the
cloud
Load test scripts
Running on
multiple
in...
Leveraging	
  AWS	
  
Reserve	
  or	
  not?	
  Instance	
  pricing	
  
0
2000
4000
6000
8000
10000
12000
14000
16000
0 3 6 9 12 15 18 21 24 27 3...
Spot	
  instances	
  
•  AWS	
  offers	
  unused	
  capacity	
  @’spot’	
  price	
  
•  Choose	
  a	
  maximum	
  hourly	
 ...
1 Replica
1 Slave
Urturn Web BackUrturn Front
Js client
Urturn reactive
Serving web pages
Rails + Unicorn
Database
MySQL
G...
1 Replica
1 Slave
Urturn Web BackUrturn client
Js client
Urturn reactive
Serving web pages
Rails + Unicorn
Database
MySQL
...
Urturn on AWS: scaling infra, cost and time to maket
Upcoming SlideShare
Loading in...5
×

Urturn on AWS: scaling infra, cost and time to maket

445

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
445
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Urturn on AWS: scaling infra, cost and time to maket

  1. 1. Urturn  on  AWS  -­‐  scaling  infrastructure,     cost  and  6me  to  market  
  2. 2. confiden6al   3  
  3. 3. Limited  ways  to  express   confiden6al   4    Write  something…    Write  something…  
  4. 4. Expressions  ready-­‐made  templates   confiden6al   5  
  5. 5. Music  go-­‐to-­‐market   Urturn  turns  out  to  be  a  great  response  to   audience  engagement,  one  of  the  main  challenge   of  music  industry   -­‐>  Hired  talent  from  that  industry   -­‐>  Got  bands  on  urturn   -­‐>  Brought  their  fan  base,  centered  on  UK  &  US   confiden6al   6  
  6. 6. confiden6al   7   #DrawUnionJ  
  7. 7. confiden6al   8   #ImatchwithUnionJ  
  8. 8. confiden6al   9  
  9. 9. Traffic  Peaks   Max Time to half: 5 min for Twitter, one hour for FB Share on FB or Twitter Time to max: 10 sec on Twitter, 1 min on FB
  10. 10. Urturn Web Back - AWSUrturn Front Js client Urturn reactive Serving web pages Rails Storage AWS S3 Master Database MySQL Global  architecture   iPhone app Expressions Apps Urturn tasks Computing activities, emails Rails Loadbalancers AmazonWebServices Medias   Logs, analytics, datastores MongoDB Mobile site CDN CloudFront Web server Ngnix Web server Ngnix Infrastructure @ Amazon Web Services
  11. 11. 1 Replica 1 Slave Urturn Web BackUrturn Front Js client Urturn reactive Serving web pages Rails + Unicorn Database MySQL Global  architecture   Google Analytics GoSquared Mixpannel New Relic iPhone app Yahoo image, Youtube, SoundCloud, Facebook, Twitter, Instagram, ... Mixpanel Google Analytics Expressions Apps Urturn tasks Computing activities, emails Rails + Unicorn Loadbalancers AmazonWebServices Thumbs Firefox-based Caching Memcached Green= Scales horizontally Internal   External   Front   Back   Medias   Facebook Logs, counts, analytics… MongoDB Twitter Mobile site CDN CloudFront Web server Ngnix Scout Web server Ngnix 1 Slave Indexation Solr Messages Resque Mails PostFix Storage AWS S3
  12. 12. MySQL DB Urturn clients Jsclient Zoom  on  reacEve  requests   iPhone Apps Load balancers MongoDB Mobilesite CloudFront Memcached Ngnix Queue Rails /public Rails Rails Rails Caching Browser Manifest Local Storage Urturn JS cache FAST SLOW -> $$$$ -> MAX USERS LIMITLOCAL
  13. 13. MySQL DB Urturn clients Jsclient Keep  a  good  experience  during  Overload   iPhone Apps Load balancers MongoDB Mobilesite CloudFront Memcached Ngnix Queue Rails /public Rails Rails Rails Caching Browser Manifest Local Storage Urturn JS cache Monitor  overload  here   •  Serve  those  already  on  the  site   •  Overload  page  to  others   FAST SLOW -> $$$$ -> MAX USERS LIMITLOCAL
  14. 14. MySQL Urturn clients Jsclient A  good  request  is     a  non-­‐existant  request   iPhone Apps Load balancers MongoDB Mobilesite CloudFront Memcached Ngnix Queue Rails /public Rails Rails Rails Caching Browser Manifest Local Storage Urturn JS cache FAST SLOW -> $$$$ -> MAX USERS LIMITLOCAL 1   2   3   4  
  15. 15. MySQL Load testing Load  tesEng   Load balancers MongoDB Grinder in the cloud Load test scripts Running on multiple instances Memcached Ngnix Queue Rails /public Rails Rails Rails FAST SLOW -> $$$$ -> MAX USERS LIMITLOCAL Grinder  in  the  cloud   •  Automa6cally  loads  the   system  to  capacity   •  Make  sure  all  pages  are   in  the  scripts  
  16. 16. Leveraging  AWS  
  17. 17. Reserve  or  not?  Instance  pricing   0 2000 4000 6000 8000 10000 12000 14000 16000 0 3 6 9 12 15 18 21 24 27 30 33 36 Cost(USD) Months On demand 1y heavy (bill anyway) 3y heavy (bill anyway) Spot
  18. 18. Spot  instances   •  AWS  offers  unused  capacity  @’spot’  price   •  Choose  a  maximum  hourly  price,  get  it  at  the  market  price   •  Loose  your  instance  without  warning   •  Pinterest  massively  uses  spot  intances   On-­‐demand   price  
  19. 19. 1 Replica 1 Slave Urturn Web BackUrturn Front Js client Urturn reactive Serving web pages Rails + Unicorn Database MySQL Google Analytics GoSquared Mixpannel New Relic iPhone app Yahoo image, Youtube, SoundCloud, Facebook, Twitter, Instagram, ... Mixpanel Google Analytics Expressions Apps Urturn tasks Computing activities, emails Rails + Unicorn Loadbalancers AmazonWebServices Thumbs Firefox-based Caching Memcached Green= Scales horizontally Internal   External   Front   Back   Medias   Facebook Logs, counts, analytics… MongoDB Twitter Mobile site CDN CloudFront Web server Ngnix Scout Web server Ngnix 1 Slave Indexation Solr Messages Resque Mails PostFix Storage AWS S3 If  we  had  to  do  it  again…  
  20. 20. 1 Replica 1 Slave Urturn Web BackUrturn client Js client Urturn reactive Serving web pages Rails + Unicorn Database MySQL Google Analytics GoSquared Mixpannel New Relic iPhone app Yahoo image, Youtube, SoundCloud, Facebook, Twitter, Instagram, ... Mixpanel Google Analytics Expressions Apps Urturn tasks Computing activities, emails Rails + Unicorn Loadbalancers AmazonWebServices Thumbs Firefox-based Caching Memcached Green= Scales horizontally Internal   External   Front   Back   Medias   Facebook Logs, counts, analytics… MongoDB Twitter Mobile site Amazon CloudFront Web server Ngnix Scout Web server Ngnix 1 Slave Indexation Solr Messages Resque Mails PostFix Amazon S3 DynamoDB Amazon RDS Amazon CloudSearch Amazon SQS Amazon SES Amazon ElastiCache …  we’d  consider  this  
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×