Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
distributed  tracing
twitter zipkingoogle dapper    x-trace  tracelytics   ... more!
motivation
what is slow?
what is slow?
causal flow of control
causal flow of control
how to
possible approaches
possible approaches• Unique identifier
possible approaches• Unique identifier • propagate throughout
possible approaches• Unique identifier • propagate throughout • write instrumentation for various  transports
possible approaches• Unique identifier • propagate throughout • write instrumentation for various  transports
possible approaches• Unique identifier • propagate throughout • write instrumentation for various  transports• Observe and...
possible approaches• Unique identifier • propagate throughout • write instrumentation for various  transports• Observe and...
possible approaches• Unique identifier • propagate throughout • write instrumentation for various  transports• Observe and...
1BD57B58AE7E315BBEAB6795F0BDC198296357
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java
t = start             nginxcache        python        db              internet             the java                       ...
piggyback rides• More Doable • HTTP: x-headers • Thrift: secret argument • Internal RPC protocol: you’re the  boss• Less D...
t = start             nginxcache        python        db              internet             the java                       ...
timing and structure• Timing  • distributed = clock skew• Structure -- two approaches  • Encode in ID  • Encode in back-po...
encode in ID?• nginx1• nginx1python1• nginx1python1cache1• nginx1python1cache1python2• nginx1python1cache1python2sql  1• n...
encode in back-pointer?   nginx   python   cache   python
reporting
reporting
other things worth   figuring out• sampling• reporting• aggregate analysis
thanks!tracelytics.com@dankosaurdan@tracelytics.com
resources• X-Trace: http://x-trace.net  • http://x-trace.net/pubs/xtr-nsdi07.pdf• Google Dapper: http://research.google.co...
distributed tracing in 5 minutes
distributed tracing in 5 minutes
distributed tracing in 5 minutes
distributed tracing in 5 minutes
distributed tracing in 5 minutes
distributed tracing in 5 minutes
distributed tracing in 5 minutes
distributed tracing in 5 minutes
distributed tracing in 5 minutes
You’ve finished this document.
Download and read it offline.
Upcoming SlideShare
HTrace: Tracing in HBase and HDFS (HBase Meetup)
Next
Upcoming SlideShare
HTrace: Tracing in HBase and HDFS (HBase Meetup)
Next
Download to read offline and view in fullscreen.

Share

distributed tracing in 5 minutes

Download to read offline

lightning talk from surge 2012

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all

distributed tracing in 5 minutes

  1. 1. distributed tracing
  2. 2. twitter zipkingoogle dapper x-trace tracelytics ... more!
  3. 3. motivation
  4. 4. what is slow?
  5. 5. what is slow?
  6. 6. causal flow of control
  7. 7. causal flow of control
  8. 8. how to
  9. 9. possible approaches
  10. 10. possible approaches• Unique identifier
  11. 11. possible approaches• Unique identifier • propagate throughout
  12. 12. possible approaches• Unique identifier • propagate throughout • write instrumentation for various transports
  13. 13. possible approaches• Unique identifier • propagate throughout • write instrumentation for various transports
  14. 14. possible approaches• Unique identifier • propagate throughout • write instrumentation for various transports• Observe and correlate
  15. 15. possible approaches• Unique identifier • propagate throughout • write instrumentation for various transports• Observe and correlate • always on the outside - black box
  16. 16. possible approaches• Unique identifier • propagate throughout • write instrumentation for various transports• Observe and correlate • always on the outside - black box • difficult to get threaded + evented processes right
  17. 17. 1BD57B58AE7E315BBEAB6795F0BDC198296357
  18. 18. t = start nginxcache python db internet the java
  19. 19. t = start nginxcache python db internet the java
  20. 20. t = start nginxcache python db internet the java
  21. 21. t = start nginxcache python db internet the java
  22. 22. t = start nginxcache python db internet the java
  23. 23. t = start nginxcache python db internet the java
  24. 24. t = start nginxcache python db internet the java
  25. 25. t = start nginxcache python db internet the java
  26. 26. t = start nginxcache python db internet the java
  27. 27. t = start nginxcache python db internet the java
  28. 28. t = start nginxcache python db internet the java
  29. 29. t = start nginxcache python db internet the java
  30. 30. t = start nginxcache python db internet the java
  31. 31. t = start nginxcache python db internet the java
  32. 32. t = start nginxcache python db internet the java t = end
  33. 33. piggyback rides• More Doable • HTTP: x-headers • Thrift: secret argument • Internal RPC protocol: you’re the boss• Less Doable • SQL: one way ticket, also you’re not percona • memcache: not extensible so not backwards compatible
  34. 34. t = start nginxcache python db internet the java t = end
  35. 35. timing and structure• Timing • distributed = clock skew• Structure -- two approaches • Encode in ID • Encode in back-pointers
  36. 36. encode in ID?• nginx1• nginx1python1• nginx1python1cache1• nginx1python1cache1python2• nginx1python1cache1python2sql 1• nginx1python1cache1python2sql 1python3• ...
  37. 37. encode in back-pointer? nginx python cache python
  38. 38. reporting
  39. 39. reporting
  40. 40. other things worth figuring out• sampling• reporting• aggregate analysis
  41. 41. thanks!tracelytics.com@dankosaurdan@tracelytics.com
  42. 42. resources• X-Trace: http://x-trace.net • http://x-trace.net/pubs/xtr-nsdi07.pdf• Google Dapper: http://research.google.com/ pubs/pub36356.html• Twitter Zipkin: https://github.com/twitter/zipkin• CMU PDL: www.pdl.cmu.edu • StarDust: http://www.pdl.cmu.edu/PDL-FTP/ SelfStar/thereska_sigmetrics06.pdf • Trace Diff: http://www.pdl.cmu.edu/PDL-FTP/ SelfStar/NSDI11.pdf
  • mikemmchen

    Jan. 29, 2018
  • coosuu

    Aug. 11, 2017
  • ssuserf4c046

    Nov. 30, 2016
  • slachiewicz

    Nov. 15, 2016
  • ssusera947e0

    Aug. 7, 2016
  • ChenZhi2

    Jun. 29, 2016
  • shiji_hz

    Jun. 13, 2016
  • ChenYY1

    Mar. 17, 2016
  • se77encc

    Jan. 22, 2016
  • soasme

    Jan. 22, 2016
  • markcastellani

    Dec. 29, 2015
  • chanmiho16

    Oct. 13, 2015
  • andrew7459

    Aug. 4, 2015
  • hypermin

    Jul. 9, 2015
  • sahilsk

    Jun. 4, 2015
  • singer_wang

    May. 4, 2015
  • dgomesbr

    Mar. 23, 2015
  • seveniruby

    Aug. 19, 2014
  • HailinZeng

    Aug. 10, 2014
  • sd4399340

    Jan. 14, 2013

lightning talk from surge 2012

Views

Total views

8,750

On Slideshare

0

From embeds

0

Number of embeds

43

Actions

Downloads

176

Shares

0

Comments

0

Likes

20

×