Supervise your Akka actors - Devoxx
•
1 like•1,475 views
The document discusses supervising Akka actors to increase reliability and performance of a data processing workflow. It describes moving the workflow from a Talend-based ETL process to an Akka actor system with Scala. Key aspects covered include using actors to isolate business logic, implementing supervision strategies to handle failures, adding metrics and health checks for monitoring, and lessons learned around actor system design and testing. The results were successfully moving the workflow to production using the Akka framework.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Supervise your Akka actors - Devoxx
Similar to Supervise your Akka actors - Devoxx (20)
More from Publicis Sapient Engineering
More from Publicis Sapient Engineering (20)
Recently uploaded
Recently uploaded (20)
Supervise your Akka actors - Devoxx
- 1. Supervise your Akka actors Nicolas Jozwiak Xebia #Devoxx #SuperviseAkka @njozwiak
- 2. Who am I Programmer and agiliste @njozwiak #Devoxx #SuperviseAkka @njozwiak
- 3. Agenda • Context • Why Akka and Scala ? • Solution • DevOps • Issues and key learnings • Results #Devoxx #SuperviseAkka @njozwiak
- 4. Context #Devoxx #SuperviseAkka @njozwiak
- 5. FTP 1 Read FTP Talend offers offers 3 Ask Web Service for diff Web Service offers syslog 4 Save Logstash ElasticSearch UI result 2 Translate Xml in Jobs #Devoxx #SuperviseAkka @njozwiak
- 6. • Not happy customers • Business logic everywhere • Talend processing complex • Approximate error handling • Dashboard not efficient • Slow integration lost process difficult to replay talend not known #Devoxx #SuperviseAkka @njozwiak
- 7. • Increase processing reliability • Centralize business logic • Enhance processing performance #Devoxx #SuperviseAkka @njozwiak
- 8. Why Akka and Scala ? #Devoxx #SuperviseAkka @njozwiak
- 9. Why Akka ? • Isolate business code in actors • Events to process • Fault tolerance • Supervision strategy • Performance #Devoxx #SuperviseAkka @njozwiak
- 10. Why Scala ? • Team knew Scala (a little) • Try Scala in the company • Scala with Akka rocks ! #Devoxx #SuperviseAkka @njozwiak
- 11. Solution #Devoxx #SuperviseAkka @njozwiak
- 12. offers offers Ask Web Service for diff Web Service offers FTP 1 Read FTP 2 3 4 TAakleknad Translate Xml in Jobs Save #Devoxx #SuperviseAkka @njozwiak
- 13. Supervision • Every single actor has a default supervisor strategy • Means manage Actors failures • Send a notification to its supervisor • Clean separation of processing and error handling #Devoxx #SuperviseAkka @njozwiak
- 14. Actor system Actor1 Actor2 A D B C A Exception B C #Devoxx #SuperviseAkka @njozwiak
- 16. MasterSupervisor FileSystem Supervisor FileCrawler Xml Supervisor XmlReader DeadLetterListener WorkStatus Posting Supervisor DiffActor Posting Service Syslog #Devoxx #SuperviseAkka @njozwiak
- 17. DevOps #Devoxx #SuperviseAkka @njozwiak
- 18. • No guarantee on message delivery • Have some metrics : ‣ Logs ‣ Metrics with Graphite ‣ Ostrich (Twitter) ‣ Kamon IO #Devoxx #SuperviseAkka @njozwiak
- 23. • Endpoints access with Spray : ‣ Statistics ‣ HealthCheck ‣ Workflow state #Devoxx #SuperviseAkka @njozwiak
- 24. Issues and key learnings #Devoxx #SuperviseAkka @njozwiak
- 25. • Actor system design • An actor with lots of processing • Unit testing • Actors and Futures #Devoxx #SuperviseAkka @njozwiak
- 26. • Mind shift • Business events • Delegate to actors • Isolate business rules • Behaviour testing #Devoxx #SuperviseAkka @njozwiak
- 27. Results #Devoxx #SuperviseAkka @njozwiak
- 28. • In production • Proactive way • Processing time • Web Service to optimize • FTP to remove #Devoxx #SuperviseAkka @njozwiak
- 29. Conclusion #Devoxx #SuperviseAkka @njozwiak
- 30. • Akka is very powerful ‣ Complex underlying notions ‣ Active ecosystem • KISS #Devoxx #SuperviseAkka @njozwiak
- 31. Thank you for watching #Devoxx #SuperviseAkka @njozwiak