Who we are
Andrea Belvedere
VP of Engineering
Derek Szydlowski
Lead Operations
Engineer
Yosuke Tomita
Backend and Ops
Engi...
Communicate freely.
Connect to people-powered
translation at scale.
Gengo engineering
12 engineers, 9+ languages spoken
What is Gengo
Submit your
translation via Website
or API
8000 translators
and counting
Language pairs
and counting
54Web A...
The Order Flow
Order
translation
Translator
gets job
Receive your
translation
1 2 3
Order
translation
Translator
gets job
Receive your
translation
1 2 3
Order
translation
Translator
gets job
Receive your
translation
1 2 3
The API
Fully automated
workflow, no project
management, plug into
8,000 translators
A direct connection
Client libraries,...
Simple?
Complex Job Flow
T
T
T
T
C C C
C C C
C C C
C C C
C
C
C
Receive Translate Deliver
Scaling Concerns
Translators Engineering
Translator
Ops
Finance and
Business
API and
Retail
Customers
Integrations
& Proje...
Scaling for Customers
In the beginning…
Single Instance
Web Instances
Single DB Instance
Elastic Load Balancer
Going Global
Web Instances
Single DB Instance
Elastic Load Balancer
CloudFront
Where are we going to keep it all?
Enter S3.
Web Instances
Single DB Instance
Elastic Load Balancer
CloudFront
S3
Web Instances
Single DB Instance
Elastic Load Balancer
CloudFront
S3 Redis Instances
Asynchronous Jobs Processing
Web Instances
Single DB Instance
Elastic Load Balancer
CloudFront
S3 Redis Instances
Processor Instances
Scaling for Translators
More space!
Growth
-
10,000,000
20,000,000
30,000,000
40,000,000
50,000,000
60,000,000
70,000,000
80,000,000
90,000,000
100,000,000
20...
Complex Workflows
100% CPU 
Web Instances
Single R/W
DB Instance
Elastic Load Balancer
CloudFront
S3 Redis Instances
Processor Instances
Multiple Read...
Read Only Slaves 
Web Instances
Elastic Load Balancer
S3 Redis Instances Processor InstancesDB Instances
API Instances
Elastic Load Balancer...
Caching!
Scaling for Operations
Growing up
Dedicated Ops DB Slave
Translator Operations
Search for Operations
Breaking it out further…
Web Instances
Elastic Load Balancer
S3 Redis Instances Processor InstancesDB Instances
API Instances
Elastic Load Balancer...
Lessons Learned
+
Future
Web Instances
Elastic Load Balancer
S3 ElastiCache Processor InstancesRDS DB Instances
API Instances
Elastic Load Balancer...
Measure Your Application
…not just your servers!
Give Your Applications a Voice
Monitor Everything
Wow
Such thanks.
Gengo Jaws Days Tokyo  2014 Presentation
Gengo Jaws Days Tokyo  2014 Presentation
Gengo Jaws Days Tokyo  2014 Presentation
Gengo Jaws Days Tokyo  2014 Presentation
Upcoming SlideShare
Loading in …5
×

Gengo Jaws Days Tokyo 2014 Presentation

1,541 views

Published on

Scaling at Gengo Presentation at AWS Jaws Days Tokyo.
Presented and outlines Derek Szydlowski.
Assistance from David Gilbert, Yosuke Tomita, Andrea Belvedere and Matt Romaine

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,541
On SlideShare
0
From Embeds
0
Number of Embeds
590
Actions
Shares
0
Downloads
7
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Gengo Jaws Days Tokyo 2014 Presentation

  1. 1. Who we are Andrea Belvedere VP of Engineering Derek Szydlowski Lead Operations Engineer Yosuke Tomita Backend and Ops Engineer
  2. 2. Communicate freely. Connect to people-powered translation at scale. Gengo engineering 12 engineers, 9+ languages spoken
  3. 3. What is Gengo Submit your translation via Website or API 8000 translators and counting Language pairs and counting 54Web API
  4. 4. The Order Flow
  5. 5. Order translation Translator gets job Receive your translation 1 2 3
  6. 6. Order translation Translator gets job Receive your translation 1 2 3
  7. 7. Order translation Translator gets job Receive your translation 1 2 3
  8. 8. The API Fully automated workflow, no project management, plug into 8,000 translators A direct connection Client libraries, developer support and a friendly testing environment Quick to start Documented REST API makes integrating straight forward Clean and easy
  9. 9. Simple?
  10. 10. Complex Job Flow T T T T C C C C C C C C C C C C C C C Receive Translate Deliver
  11. 11. Scaling Concerns Translators Engineering Translator Ops Finance and Business API and Retail Customers Integrations & Projects
  12. 12. Scaling for Customers
  13. 13. In the beginning…
  14. 14. Single Instance
  15. 15. Web Instances Single DB Instance Elastic Load Balancer
  16. 16. Going Global
  17. 17. Web Instances Single DB Instance Elastic Load Balancer CloudFront
  18. 18. Where are we going to keep it all? Enter S3.
  19. 19. Web Instances Single DB Instance Elastic Load Balancer CloudFront S3
  20. 20. Web Instances Single DB Instance Elastic Load Balancer CloudFront S3 Redis Instances
  21. 21. Asynchronous Jobs Processing
  22. 22. Web Instances Single DB Instance Elastic Load Balancer CloudFront S3 Redis Instances Processor Instances
  23. 23. Scaling for Translators
  24. 24. More space!
  25. 25. Growth - 10,000,000 20,000,000 30,000,000 40,000,000 50,000,000 60,000,000 70,000,000 80,000,000 90,000,000 100,000,000 2008 2009 2010 2011 2012 2013 Units Units Translated
  26. 26. Complex Workflows
  27. 27. 100% CPU 
  28. 28. Web Instances Single R/W DB Instance Elastic Load Balancer CloudFront S3 Redis Instances Processor Instances Multiple Read DB Instance
  29. 29. Read Only Slaves 
  30. 30. Web Instances Elastic Load Balancer S3 Redis Instances Processor InstancesDB Instances API Instances Elastic Load Balancer Segregating concerns
  31. 31. Caching!
  32. 32. Scaling for Operations
  33. 33. Growing up
  34. 34. Dedicated Ops DB Slave
  35. 35. Translator Operations
  36. 36. Search for Operations
  37. 37. Breaking it out further…
  38. 38. Web Instances Elastic Load Balancer S3 Redis Instances Processor InstancesDB Instances API Instances Elastic Load Balancer Admin Instances Elastic Load Balancer Retail Instances Elastic Load Balancer
  39. 39. Lessons Learned + Future
  40. 40. Web Instances Elastic Load Balancer S3 ElastiCache Processor InstancesRDS DB Instances API Instances Elastic Load Balancer Admin Instances Elastic Load Balancer Retail Instances Elastic Load Balancer
  41. 41. Measure Your Application …not just your servers!
  42. 42. Give Your Applications a Voice
  43. 43. Monitor Everything
  44. 44. Wow Such thanks.

×