Akka Presentation Schule@synyx

1,574 views

Published on

Demonstration of a web crawler implemented using Akka. Link to the sources coming soon.

0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,574
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
12
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Akka Presentation Schule@synyx

  1. 1. Florian Hopfhttp://blog.florian-hopf.de
  2. 2. Download Page Link downloaded already?Parse Links & Content Index Content
  3. 3. Sequential Example
  4. 4. 1. Scale Up
  5. 5. Thread A Page Thread B Store
  6. 6. Synchronize Thread A Page Thread B and Suffer Store
  7. 7. Actor-Framework
  8. 8. Message Passing Concurrency
  9. 9. Thread A Thread B Actor A Actor B
  10. 10. Master Page Fetch Store Index Page Page Page Indexed Page Content IndexingParsing Actor Actor
  11. 11. Simple Example
  12. 12. Actors are accessed by references
  13. 13. Reference Actor Instance
  14. 14. Reference Actor Actor n Instance Instance Actor Instances
  15. 15. Fetching Pages in parallel
  16. 16. 2. Scale Out
  17. 17. References can pointto remote machines
  18. 18. akka {     actor {     deployment {     /serviceA/aggregation {     router = "round­robin"     nr­of­instances = 10     target {     nodes =  ["akka://app@10.0.0.2:2552",  "akka://app@10.0.0.3:2552"]     }     }     }     }    }
  19. 19. 3. Fault Tolerance
  20. 20. Actors are supervised by their parent
  21. 21. Master Page Store Page IndexingParsing Actor Actor
  22. 22. Reference Actor Instance
  23. 23. Master Page Store Page IndexingParsing Actor Actor
  24. 24. Reference Actor Instance
  25. 25. Actions:EscalateResumeRestart Stop
  26. 26. Network fail on download
  27. 27. Master Page Store Page IndexingParsing Actor Actor
  28. 28. ResumePageParsingActor, resend message
  29. 29. Indexing Failure, I/O Error
  30. 30. Master Page Store Page IndexingParsing Actor Actor
  31. 31. Restart Master
  32. 32. Scaling Up Scaling OutFault Tolerance
  33. 33. Software Transactional Memory Durable Mailboxes
  34. 34. http://akka.io

×