SoundCloud's Toolbox for Microservices
•
3 likes•1,551 views
At SoundCloud we managed to break away from the monolith while delivering key business features. Our journey towards a microservices architecture has not been a straightforward one. We experimented a lot to reach the set of tools and technologies that we use today. We changed how we build our applications. We introduced specific apis for our mobile and web clients. We call them BFFs (backend for the frontend). They became the central piece of SoundCloud’s architecture. We rethought how we monitor our services. We created a service registry for knowledge sharing. While making all these changes, we benefited from the learnings of our peer companies. This talk will share our learnings from this journey: what worked for us and what we moved away from.
Recommended
Recommended
More Related Content
What's hot
What's hot (15)
Viewers also liked
Viewers also liked (6)
Similar to SoundCloud's Toolbox for Microservices
Similar to SoundCloud's Toolbox for Microservices (20)
Recently uploaded
Recently uploaded (20)
SoundCloud's Toolbox for Microservices
- 3. SoundCloud is the largest online audio distribution platform
- 4. 12 HOURS OF AUDIO every minute
- 5. Bora Tunca Joined SoundCloud 2.5 years ago soundcloud.com front-end client specific apis core-engineering @grandbora
- 8. FINAGLE
- 11. Service Req Future[Rep] Req => Future[Rep] Service
- 12. Service Req Future[Rep]ReqA Future[RepA] (ReqA, Service) => Future[RepA] Filter Filter
- 13. Service Req Future[Rep]ReqA Future[RepA] (ReqA, Service) => Future[RepA] Filter Filter + Service
- 14. val service = new ExceptionFilter andThen new HeaderFilter andThen new HttpTimeoutFilter(Duration(1, TimeUnit.SECONDS)) andThen new RestService()
- 15. Toolbox Finagle
- 18. Api-v2 Api-mobile Api-embedded Public API
- 19. Api-v2 Api-mobile Api-embedded Public API messages MOTHERSHIP likes search stats images
- 28. Api-v2 Api-mobile Api-embedded Public API messages MOTHERSHIP likes search stats images
- 29. Api-v2 Api-mobile Api-embedded Public API messages MOTHERSHIP likes search stats images
- 30. Api-v2 Api-mobile Api-embedded Public API messages MOTHERSHIP likes search stats images
- 32. MOTHERSHIP Legacy Public API Public API Strangler
- 33. MOTHERSHIP Legacy Public API Public API Strangler messages likes search
- 34. MOTHERSHIP Legacy Public API Public API Strangler messages likes search stats images
- 35. MOTHERSHIP Legacy Public API Public API Strangler messages likes search stats images
- 36. Toolbox Strangler Pattern Client Specific Apis Finagle
- 37. CRITICAL PATH
- 38. BFF
- 39. BFF authentication geo location features 1
- 47. Microservices
- 50. messages MOTHERSHIP BFF likes search stats images authentication geo location features BFF BFFBFF BFFBFF
- 51. messages MOTHERSHIP BFF likes search stats images authentication geo location features BFF BFFBFF BFFBFF Critical Path
- 53. Handle failures gracefully On critical path…
- 54. Handle failures gracefully Be ready for traffic bursts On critical path…
- 55. Toolbox Critical Path Client Specific Apis Strangler Pattern Finagle
- 56. SERVICE LAYERING
- 64. images userstracks Foundation Layer playlistsstream profiles Value Added Layer
- 65. images userstracks Foundation Layer playlistsstream profiles Value Added Layer
- 66. images userstracks Foundation Layer playlistsstream profiles Value Added Layer
- 67. images userstracks Foundation Layer playlistsstream profiles Value Added Layer BFF BFF Edge Layer
- 68. images userstracks Foundation Layer playlistsstream profiles Value Added Layer BFF BFF Edge Layer
- 69. images userstracks Foundation Layer playlistsstream profiles Value Added Layer MOTHERSHIP BFF BFF Edge Layer
- 70. Toolbox Service Layering Client Specific Apis Strangler Pattern Critical Path Finagle
- 71. HUMANE REGISTRY
- 74. Humane Registry
- 75. Oriented around people Humane Registry
- 76. Oriented around people Don't rely on people to stay up to date Humane Registry
- 77. Oriented around people Don't rely on people to stay up to date Expect humans to read and contribute Humane Registry
- 81. Toolbox Humane Registry Client Specific Apis Strangler Pattern Critical Path Service Layering Finagle
- 82. PROMETHEUS
- 83. Prometheus Scalable data collection Operational simplicity Multi-dimensional data Powerful query language https://developers.soundcloud.com/blog/prometheus-monitoring-at-soundcloud http://prometheus.io/
- 87. Prometheus My Service jvm client My Service jvm client My Service jvm client My Service jvm client My Service jvm client My Service jvm client My Service jvm client My Service jvm client My Service jvm client My Service jvm client
- 88. val requestCount = telemetry.counter("outgoing_http_requests_total", "A counter for the HTTP requests", "service", "method", "status", "statusClass") send requestCount .labels( serviceName, request.getMethod, response.getStatus, response.getStatusClass ).inc()
- 89. val requestCount = telemetry.counter("outgoing_http_requests_total", "A counter for the HTTP requests", "service", "method", "status", "statusClass") send requestCount .labels( serviceName, request.getMethod, response.getStatus, response.getStatusClass ).inc() query SUM(rate(outgoing_http_requests_total{statusClass="5xx"}[10m])) by (service, method, status)
- 90. Toolbox Client Specific Apis Strangler Pattern Critical Path Service Layering Humane Registry Prometheus Finagle
- 97. Toolbox Service Level Objectives Prometheus Client Specific Apis Strangler Pattern Critical Path Service Layering Humane Registry Finagle
- 98. RECAP
- 99. Toolbox Service Level Objectives Prometheus Client Specific Apis Strangler Pattern Critical Path Service Layering Humane Registry Finagle
- 100. backstage.soundcloud.com @pcalcado - How we ended up with microservices @starcoffe - Why SoundCloud stopped using its own public API InfoQ - Moving from a Monolith to Microservices at SoundCloud @SoundCloudDev InfoQ - Microservices Evolution at Soundcloud Sam Newman - Backends for Frontends