Distributed Tracing with Golang

1. © 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved.
Go with Tracing

2. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !2

3. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !3

4. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !4

5. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !5

6. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !6
Tracing …

7. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !7
https://github.com/up1/go-get-microservice-meetup

8. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !8
Observability ?

9. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !9
Observability ?
Audit logs
Exception logs Application logs
Infrastructure logs
Application Metrics
Exception tracking
Health check
Change logs
Deployment logs
Distributed tracing
Monitoring
Testing
Alert system

10. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !10

11. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !11
Easy to find the root cause

12. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !12
Work around vs Solution !!

13. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !13
Work around vs Solution !!

14. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !14
Work around vs Solution !!

15. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !15
We need more information !!

16. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !16
Observability
Dashboards and Alerts

17. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !17
Observability
Dashboards and Alerts
Metrics

18. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !18
Dashboard and Metrics

19. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !19
Observability
Dashboards and Alerts
Metrics
Tracing

20. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !20
Tracing

21. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !21
Tracing

22. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !22
Tracing

23. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !23
Observability
Dashboards and Alerts
Metrics
Tracing
Logging

24. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !24
Observability
Dashboards and Alerts
Metrics
Tracing
Logging
Debugging

25. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !25
Debugging

26. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !26
Debugging

27. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !27
Observability
Dashboards and Alerts
Metrics
Tracing
Logging
Debugging
Coding

28. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !28
Dashboards and Alerts
Metrics
Tracing
Logging
Debugging
Coding
Problem
Solution

29. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !29
Observability
Dashboards and Alerts
Metrics
Tracing
Logging
Debugging
Coding

30. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !30
Tracing with Go application
Go tracing tools
Distributed tracing

31. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !31
Distributes Tracing ?
What happens to request across all services
The process of tracking and analyzing

32. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !32
Distributes Tracing

33. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !33
Why we need ?
Where are the bottlenecks ?
What services did a request pass through ?
How much time to use ?
What occurred in each services for a request ?

34. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !34
Trace structure
https://www.jaegertracing.io/docs/1.12/architecture/

35. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !35
Tracing ID (correlation id)
https://www.jaegertracing.io/docs/1.12/architecture/

36. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !36
Tracing ID (correlation id)

37. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !37
We need tools to tracing and
analyzing !!

38. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !38

39. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !39
Tools ?
Service A
Service B
Service C
Tracing system
?
?
?

40. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !40
Tracing system
Service A
Service B
Service C
Tracing system
?
?
?

41. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !41
Standard of tracing message
Service A
Service B
Service C
Tracing system
?
?
?

42. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !42
Standard of tracing message
OpenCensus
OpenTracing
Package net/http/httptrace (Go 1.7+)

43. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !43
Demo Time
OpenTracing + Jaeger

44. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !44
Demo
Service 1
Service 2
Service 3
Tracing system
1
2
3

45. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !45
Jaeger architecture

46. Go with Tracing
© 2017 - 2018 Siam Chamnankit Company Limited. All rights reserved. !46
Demo