Scaling with Meteor

1. Scaling to 100 M

2. Agenda
• About ShareThis
• What is SocialAB
• Scaling Meteor at ShareThis
Problems faced
Redesigned Meteor architecture
Load Test Results
• Q&A

3. Introduction
▪ Growth Engineering @ ShareThis
Vijay

4. WHOShareThis was founded in 2007 – with a lofty goal – to make social sharing a
part of every day consumer behavior. And today it is.
WE
ARE

8. © 2016ShareThis. All rights reserved.
sharethis reachTRUSTED BY 4.7 MILLION WEBSITES/APPS
8
3 Easy Steps to
Install Sharing
Tools

9. ShareThis is building out a
social platform to address
publishers needs.
SOCIAL
OPTIMIZATION
PLATFORM

10. © 2016ShareThis. All rights reserved.
social A/BTHE WORLD’S TOP CONTENT CREATORS USE A/B TESTING
ON SOCIAL
10
Social A/B brings the power of this share graph optimization technology to ShareThis publisher partners by testing your headlines on
Facebook. This allows you to tap into social networks to draw new readers to your site.
ARTICLE
HEADLINE #1
ARTICLE
HEADLINE #2

11. © 2016ShareThis. All rights reserved.
social A/BPROPRIETARY ALGORITHM
11
Our algorithm learns as the experiments run, so you can
see the best results as quickly as possible, detecting the
best performing headline.

12. Why do we need to Scale?

13. Big Publishers want this tool!
100 Million events/ month
Know before our publishers

14. ShareThis Infrastructure

15. Initial Meteor Architecture

16. Slow Img

17. Things We Tried
Better Indexing Mongo
Made Meteor to tail Mongo Oplogs instead of default polling
Paginated the UI
Scale out Meteor to multiple instances

18. Load Test Data

19. Load Test Data

20. Meteor Pub/Sub Failed !

21. Decoupled UI From Meteor

22. SocialAB Architecture

23. Lessons Learnt
Meteor SockJs can’t handle sticky sessions in current
Infrastructure.
Meteor Publisher/Subscriber doesn’t handle heavy load in real
time

24. We are Hiring!
sharethis.com/join
stackshare.io/sharethis
Docker Kubernetes Kafka Google Cloud Meteor JS

25. Light Bulb, an idea
history
hack a thon
productivity
locked in a room
2 teams
2 differnet ideas
pretty difficult
2 days
intense focus
Questions?