Zipkin - Runtime open house

Z I P K I NA distributed tracing framework

Why Zipkin?

Google0.5 sec slower20% trafﬁc drop @skr | @thisisfranklin 3

Google0.5 sec slower 1.5 sec faster20% trafﬁc drop CTR up 12% @skr | @thisisfranklin 3

Performance matters

Front end @skr | @thisisfranklin 5

Front end Back end @skr | @thisisfranklin 5

@skr | @thisisfranklin 6

@skr | @thisisfranklin 8Picture from http://www.ﬂickr.com/photos/jpellgen

• Collects traces from production requests• Low overhead• Minimum of extra work for developers @skr | @thisisfranklin 9

Finagle“Finagle is an asynchronous network stack for the JVM that you can use to buildasynchronous Remote Procedure Call (RPC) clients and servers in Java, Scala, orany JVM-hosted language.” github.com/twitter/ﬁnagle

Finagle Http service @skr | @thisisfranklin 11

Finagle Http serviceFinagle Thrift Service @skr | @thisisfranklin 11

Finagle Http serviceFinagle Thrift Service Service @skr | @thisisfranklin 11

Zipkin terminology‣ Annotation: string data associated with a particular timestamp, service, and host Time time: 2012-01-21 22:37:01 value: “something happened” server: 135.34.53.2 service: “timelineservice” @skr | @thisisfranklin 12

‣ Span: represents one specific method call; made up of a set of annotations. Has a name and an id. Time T:0ms Client Send Span @skr | @thisisfranklin 13

‣ Span: represents one specific method call; made up of a set of annotations. Has a name and an id. Time T:0ms Client Send Span T:10ms Server Receive @skr | @thisisfranklin 13

‣ Span: represents one specific method call; made up of a set of annotations. Has a name and an id. Time T:0ms Client Send Span T:10ms Server Receive T:90ms Server Send @skr | @thisisfranklin 13

‣ Span: represents one specific method call; made up of a set of annotations. Has a name and an id. Time T:0ms Client Send T:100ms Client Receive Span T:10ms Server Receive T:90ms Server Send @skr | @thisisfranklin 13

‣ Span: represents one specific method call; made up of a set of annotations. Has a name and an id. Time T:0ms Client Send T:100ms Client Receive Span T:20ms Read 30 kbytes from ﬁle T:10ms Server Receive T:90ms Server Send @skr | @thisisfranklin 13

‣ Span: represents one specific method call; made up of a set of annotations. Has a name and an id. Time T:0ms Client Send T:100ms Client Receive Span T:20ms Read 30 kbytes from ﬁle T:10ms Server Receive T:90ms Server Send‣ Trace: a set of spans all associated with the same request @skr | @thisisfranklin 13

Finagle httpservice @skr | @thisisfranklin 14

• Generate a random i64 trace id Finagle http service @skr | @thisisfranklin 14

• Generate a random i64 trace id• Decide if we should sample thetrace or not Finagle http service @skr | @thisisfranklin 14

• Generate a random i64 trace id• Decide if we should sample thetrace or not Finagle http service Finagle thrift service @skr | @thisisfranklin 14

• Generate a random i64 trace id• Decide if we should sample thetrace or not Finagle http service• Generate new span id Finagle thrift service @skr | @thisisfranklin 14

• Generate a random i64 trace id• Decide if we should sample thetrace or not Finagle http service• Generate new span id• Pass trace header Finagle thrift service @skr | @thisisfranklin 14

• Generate a random i64 trace id• Decide if we should sample thetrace or not Finagle http struct RequestHeader { service i64 trace_id, i64 span_id,• Generate new span id optional i64 parent_span_id,• Pass trace header optional bool sampled } Finagle thrift service @skr | @thisisfranklin 14

• Generate a random i64 trace id• Decide if we should sample thetrace or not Finagle http struct RequestHeader { service i64 trace_id, i64 span_id,• Generate new span id optional i64 parent_span_id,• Pass trace header optional bool sampled } Finagle• Thrift service adopts trace id from thriftheader if it exists service @skr | @thisisfranklin 14

Finagle httpserviceFinagle thriftservice @skr | @thisisfranklin 14

Finagle http serviceFinagle Finagle thrift thriftservice service @skr | @thisisfranklin 14

Finagle http serviceFinagle Finagle thrift thriftservice service Finagle thrift service @skr | @thisisfranklin 14

Finagle http service SFinagle Finagle thrift thriftSservice service S Finagle thrift S service @skr | @thisisfranklin 14

Finagle http service S Zipkin collectorFinagle Finagle thrift thriftSservice service S Cassandra Finagle thrift S service @skr | @thisisfranklin 14

Finagle http service S Zipkin collectorFinagle Finagle thrift thriftSservice service S Zipkin Zipkin Cassandra Query UI Finagle thrift S service @skr | @thisisfranklin 14

Finagle ♥ Zipkin

Finagle Thrift server ServerBuilder() .bindTo(address) .codec(ThriftServerFramedCodec()) .name("servicename") .build(someService) @skr | @thisisfranklin 16

Finagle Http server ServerBuilder() .bindTo(address) .codec(Http()) .name("servicename") .build(someService) @skr | @thisisfranklin 17

ServerBuilder() .bindTo(address) .codec(ThriftServerFramedCodec()) .name("servicename") .tracerFactory(ZipkinTracer()) .build(someService) @skr | @thisisfranklin 18

ClientBuilder() .cluster(hosts) .codec(ThriftServerFramedCodec()) .name("clientname") .tracerFactory(ZipkinTracer()) .build(someService) @skr | @thisisfranklin 19

Trace.record("doing stuff") @skr | @thisisfranklin 20

Trace.record("doing stuff") time: 2012-01-21 22:37:01 value: “doing stuff” server: 135.34.53.2 service: “timelineservice” @skr | @thisisfranklin 20

Trace.recordBinary("key", data) @skr | @thisisfranklin 21

Key ValueTrace.recordBinary("key", data) responsecode 500 cache:somekey Hit sql.query select *... @skr | @thisisfranklin 21

Platform Protocol Client Server Finagle Thrift Yes Yes Finagle HTTP Yes Yes Finagle Memcache Yes No Finagle Redis Yes No Cassie Thrift Yes NoQuerulous JDBC Yes No Ruby Thrift Yes Yes @skr | @thisisfranklin 22

Zipkin UI

What did we find?

github.com/twitter/zipkin @zipkinproject @skr | @thisisfranklin 27

https://si0.twimg.com	29
https://twimg0-a.akamaihd.net	15
http://us-w1.rockmelt.com	8
https://twitter.com	1

Zipkin - Runtime open house

by Johan Oskarsson on Jul 27, 2012

Accessibility

Categories

Upload Details

Usage Rights

4 Embeds 53

Statistics