Download as PDF, PPTX
![[ another approach ]
taco.cat/oscon12](https://image.slidesharecdn.com/a-look-at-the-network-120719192920-phpapp01/85/A-Look-at-the-Network-Searching-for-Truth-in-Distributed-Applications-11-320.jpg)
Uploaded byOSCON Byrum
A Look at the Network: Searching for Truth in Distributed Applications
The document discusses the complexities of distributed applications and the role of network communication in their operation, emphasizing that applications cannot fulfill their purpose without interaction within a network. It outlines various challenges such as poor load balancing and network partitions, as well as tools and methods for analyzing network flow and performance. Additionally, it humorously includes a recipe for Thai chili salsa as a bonus.
A Look at the Network: Searching for Truth in Distributed Applications
- 1. A Look atthe Network Searching for Truth in Distributed Applications c. scott andreas (cscotta) oscon 2012 - portland oregon taco.cat/oscon12
- 2.
- 3.
- 4.
- 5. THE NETWORK ISRELIABLE taco.cat/oscon12
- 6. THE NETWORK ISSECURE THERE IS ONE ADMINISTRATOR taco.cat/oscon12
- 7. LATENCY IS ZERO BANDWIDTH IS INFINITE taco.cat/oscon12
- 8. THE NETWORK IS HOMOGENOUS TOPOLOGY DOESN’T CHANGE taco.cat/oscon12
- 9. TRANSPORT COST IS ZERO taco.cat/oscon12
- 10. where can ibuy that? taco.cat/oscon12
- 11. [ another approach] taco.cat/oscon12
- 12.
- 13.
- 14.
- 15.
- 16. NETWORK + YOURAPPS ARE A GRAPH taco.cat/oscon12
- 17.
- 18. YEAH BUT... WHATDO WE DO WITH IT? taco.cat/oscon12
- 19. graphs change constantly their edges can be represented as a time series taco.cat/oscon12
- 20. GRAPH TIME SERIES + taco.cat/oscon12
- 21. LEMMA 1: thereexists no possible way for applications to communicate except via the network taco.cat/oscon12
- 22. LEMMA 2: applications are unable to fulfill their purpose without communic- ating and participating in a cluster taco.cat/oscon12
- 23. LEMMA 3: thenetwork can be represented as a time series and a graph taco.cat/oscon12
- 24. LEMMA 4: nearly all modes of failure in distributed systems can be identified and predicated this way taco.cat/oscon12
- 25. WHAT CAN ONEOBSERVE? poor load balancing network partitions bad deploys GC pauses good deploys impaired nodes variance security breaches taco.cat/oscon12
- 26.
- 27.
- 28.
- 29.
- 30.
- 31. TOOLS – NProbe / NTop – R / RStudio – CFlowd / flow-tools – Esper – TCPDump / TCPReplay – Dynamic Time Warping (algo) – CollectD – Python / NumPy / SciPy taco.cat/oscon12
- 32. FURTHER READING – Network Flow Analysis – Gigascope (No-Starch Press) (AT&T Research) – Eamonn Keogh – Dynamic Time Warping (“Atomic Wedgie”) (algo) – K-Snap – Studying Complex (“Efficient Aggr. for Graph Summ.”) – “Medians and Beyond” (Shrivastava) Adaptive Systems (Holland) – Exponential Smoothing: The State Space Approach (Hyndman) – HyperLogLog / Count-Min Sketch taco.cat/oscon12
- 33. BONUS! a spec for thai chili salsa and reference implementation – Half a thing of cilantro – 28oz peeled tomatoes – 6 cloves of garlic – Half a bag of hot thai chilis – 2 tablespoons of salt – Half a cucumber – 2 tablespoons of white vinegar – Handful of radishes – Juice from half a lime – One green bell pepper – Bit of parsley – A small red onion – Some lemongrass taco.cat/oscon12
- 34. BONUS! U P a spec for thai chili salsa and reference implementation L – L Half a thing of cilantro – 28oz peeled tomatoes A – 6 cloves of garlic – Half a bag of hot thai chilis – T 2 tablespoons of salt I – Half a cucumber – 2 tablespoons of white vinegar – X Handful of radishes I – Juice from half a lime – One green bell pepper – M Bit of parsley – A small red onion – Some lemongrass taco.cat/oscon12
- 35. A Look atthe Network Searching for Truth in Distributed Applications oscon 2012 - portland oregon taco.cat/oscon12