How AfterShip use beanstalkd queue system to track over billions of tracking jobs in last 2 years.

1. teddy@aftership.com
Teddy Chan
CEO & Co-Founder

2. Shipment tracking API
Supporting 290 310+ carriers

3. Free Shipping APIs
Single API for 5 19 carriers

4. Beanstalkd
The queue system processed billions of job

5. Why we love queue?

6. Queue
- Buffer
- Load Balancing
- Scale Horizontal
- Async process

7. Beanstalkd
How AfterShip use queue?
- Ten of millions of job per day
- Billions of job so far
- 4 beanstalkd servers (AWS m3.large)
- 4 down incidents in last 3 years

8. Beanstalkd Protocol
Characteristics
- Guarantee FIFO
- Each job is uniquely assigned to one worker.
- Each connection can only reserve one job at a time
- Support jobs persistent (“-b” option)
- Support priority, delay, ttr (time to run), bury
- No HA

9. Queue systems
References:
http://queues.io/
http://www.sitepoint.com/message-queues-comparing-beanstalkd-ironmq-amazon-sqs/
Beanstalkd Amazon SQS
Server Setup Self Host Full Managed
Response Time single digit ms hundred ms
First In First Out (FIFO) Guarantee & unique Does not guarantee
Priority Yes No
Delay Yes Yes
Pub / Sub TCP pub/sub https polling

10. Beanstalkd Protocol
Action you can do
Status Description
put (with delay) Add a new job in the queue
reserve Take the job from queue
delete Delete the job after reserved.
bury Bury the job after reserved.
kick Kick the job from buried status to ready status.
release (with delay) Release the job back to ready status, after reserved it.
The job id, pri, will be same.

11. Beanstalkd Protocol
Typical life cycle for a job
put
--------> [READY] -------> [RESERVED]-------> *proof*
Ready
Tube
Job 1
put

12. Beanstalkd Protocol
Put
put
--------> [READY] -------> [RESERVED]-------> *proof*
Ready
Tube
Job 1

13. Beanstalkd Protocol
Reserve
put reserve
--------> [READY] -------> [RESERVED]-------> *proof*
Ready
Tube
Job 1
reserve

14. Beanstalkd Protocol
Delete
put reserve delete
--------> [READY] -------> [RESERVED]-------> *proof*
Ready
Tube
Job 1
delete

15. Beanstalkd Protocol
Bury
put reserve bury
--------> [READY] -------> [RESERVED]-------> [BURIED]
Ready
Tube
Job 1
bury
Buried
Tube

16. Beanstalkd Protocol
Kick
put reserve bury
--------> [READY] -------> [RESERVED]-------> [BURIED]
KICK
Ready
Tube
kick
Buried
Tube
Job 1

17. Beanstalkd Protocol
Delay
Job 1
Job 2
Ready Job
Delay Job (with 3s)

18. Beanstalkd Protocol
Delay
Job 1
Job 2
Ready Job
Delay Job (After 3s)

19. Beanstalkd Protocol
Full picture of the life cycle

20. Beanstalkd
Let’s do something fun

21. Beanstalkd
So how much?
- 15 servers @ USD0.05 / hr
- 2 workers @ 0.05 USD per hr
- some traffic… $0.12 / GB

22. Beanstalkd
So how much?
- 15 servers @ USD0.05 / hr
- 2 workers @ 0.05 USD per hr
- some traffic… $0.12 / GB
- $0.97 in total

23. http://www.slideshare.net/aftership
FAQ