Varnish, the high performance valhalla?

Varnish, the high performance valhalla? Kings of Code 2011

JEROEN VAN DIJK∂ CTO @ Enrise∂ Email : jeroen@enrise.com∂ Twitter: @neorey∂ Open source addict 2

THE ENRISE RESTAURANT 3

THE ENRISE RESTAURANT∂ We want to prepare the best dishes 3

THE ENRISE RESTAURANT∂ We want to prepare the best dishes∂ With the best ingredients 3

THE ENRISE RESTAURANT∂ We want to prepare the best dishes∂ With the best ingredients∂ To create a magical client experience!∂ Engineers are our top chefs! 3

BEFORE WE START WHO KNOWS RFC 2616? 4

BEFORE WE START WHO KNOWS HTTP? 5

BEFORE WE START WHO THINKS HE/SHE KNOWS HTTP? 6

STANDARD PROXY∂ Wikipedia : Proxy 7

REVERSE PROXY∂ Wikipedia : Reverse proxy 8

REVERSE PROXIES∂ Wikipedia : Reverse proxy 9

WHAT IS VARNISH? (1)∂ NOT a webserver! 10

WHAT IS VARNISH? (1)∂ Caching reverse proxy∂ NOT a webserver! 10

WHAT IS VARNISH? (1)∂ Caching reverse proxy∂ Load balancer∂ NOT a webserver! 10

WHAT IS VARNISH? (1)∂ Caching reverse proxy∂ Load balancer∂ Fail over system∂ NOT a webserver! 10

WHAT IS VARNISH? (1)∂ Caching reverse proxy∂ Load balancer∂ Fail over system∂ HTTP Accelerator∂ NOT a webserver! 10

WHAT IS VARNISH? (2) 11

WHAT IS VARNISH? (2)∂ Originally built for a Norwegian newspaper 11

WHAT IS VARNISH? (2)∂ Originally built for a Norwegian newspaper∂ > 545k new hostnames in December 2010 § NetCraft monthly survey 11

WHAT IS VARNISH? (2)∂ Originally built for a Norwegian newspaper∂ > 545k new hostnames in December 2010 § NetCraft monthly survey∂ Known users § Wikileaks § Facebook § Twitter § SlashDot∂ Massive growth in usage 11

WHAT IS VARNISH? (3)∂ Scaling limitations currently unknown 12

WHAT IS VARNISH? (3)∂ Designed for 64bit architecture∂ Scaling limitations currently unknown 12

WHAT IS VARNISH? (3)∂ Designed for 64bit architecture∂ Highly scalable∂ Scaling limitations currently unknown 12

WHAT IS VARNISH? (3)∂ Designed for 64bit architecture∂ Highly scalable §Varnish in front of Varnish(es)∂ Scaling limitations currently unknown 12

WHAT IS VARNISH? (3)∂ Designed for 64bit architecture∂ Highly scalable §Varnish in front of Varnish(es)∂ Perfect browser cache solution∂ Scaling limitations currently unknown 12

WHAT IS VARNISH? (3)∂ Designed for 64bit architecture∂ Highly scalable §Varnish in front of Varnish(es)∂ Perfect browser cache solution §Prevent those hard refresh calls!∂ Scaling limitations currently unknown 12

INTERNALS (1)∂ Possible request paths 13

INTERNALS (2)∂ Optimal request path 14

INTERNALS (3)∂ Caching request path 15

INTERNALS (4)∂ Prevent caching 16

INTERNALS (5)∂ Bypassing Varnish 17

INTERNALS (6)∂ Errors or issueing restarts 18

VARNISH CONFIGURATION LANGUAGE (1)∂ Compiled to C when run 19

VARNISH CONFIGURATION LANGUAGE (1)∂ 11 subroutines (vcl_recv, vcl_hash, etc ...)∂ Compiled to C when run 19

VARNISH CONFIGURATION LANGUAGE (1)∂ 11 subroutines (vcl_recv, vcl_hash, etc ...)∂ Backend(s)∂ Compiled to C when run 19

VARNISH CONFIGURATION LANGUAGE (1)∂ 11 subroutines (vcl_recv, vcl_hash, etc ...)∂ Backend(s)∂ Directors (random, round robin, hash)∂ Compiled to C when run 19

VARNISH CONFIGURATION LANGUAGE (1)∂ 11 subroutines (vcl_recv, vcl_hash, etc ...)∂ Backend(s)∂ Directors (random, round robin, hash)∂ Access control lists∂ Compiled to C when run 19

VARNISH CONFIGURATION LANGUAGE (1)∂ 11 subroutines (vcl_recv, vcl_hash, etc ...)∂ Backend(s)∂ Directors (random, round robin, hash)∂ Access control lists∂ Saint and grace mode∂ Compiled to C when run 19

VARNISH CONFIGURATION LANGUAGE (1)∂ 11 subroutines (vcl_recv, vcl_hash, etc ...)∂ Backend(s)∂ Directors (random, round robin, hash)∂ Access control lists∂ Saint and grace mode∂ Custom subroutines∂ Compiled to C when run 19

VARNISH CONFIGURATION LANGUAGE (1)∂ 11 subroutines (vcl_recv, vcl_hash, etc ...)∂ Backend(s)∂ Directors (random, round robin, hash)∂ Access control lists∂ Saint and grace mode∂ Custom subroutines∂ Inline C∂ Compiled to C when run 19

VARNISH CONFIGURATION LANGUAGE (1)∂ 11 subroutines (vcl_recv, vcl_hash, etc ...)∂ Backend(s)∂ Directors (random, round robin, hash)∂ Access control lists∂ Saint and grace mode∂ Custom subroutines∂ Inline C∂ Since v3.0 : VMODS∂ Compiled to C when run 19

VARNISH CONFIGURATION LANGUAGE (2) if (req.request == “GET” && req.url ~ “.(gif|jpg|jpeg|bmp|png|ico)$”) { unset req.http.cookie; set req.grace = 1m; return(lookup); }∂ Cache images in vcl_recv 20

VARNISH CONFIGURATION LANGUAGE (3)if (req.http.cookie) { set req.http.Cookie = regsuball(req.http.Cookie, "__utm.=[^;]+(; )?", ""); if (req.http.cookie ~ "^ *$") { remove req.http.cookie; }}∂ Remove Google Analytics in vcl_recv 21

VARNISH CONFIGURATION LANGUAGE (4)backend default { .host="192.168.1.10"; .port="8080"; .probe={ .url=”/test.php”; }}backend second { .host="192.168.1.20"; .port="8080";}∂ Multiple backend conﬁguration 22

VARNISH CONFIGURATION LANGUAGE (5)director balance random { { .backend = default; .weight = 1; } { .backend = second; .weight = 2; }}sub vcl_recv { set.req.backend = balance; return(pass);}∂ Load balanced 33 / 66 % conﬁg 23

VARNISH CONFIGURATION LANGUAGE (6)if (obj.hits > 0) { #if hit add hit count set resp.http.X-Cache = "HIT-" obj.hits;} else { set resp.http.X-Cache = "MISS”;}∂ Adding headers on response 24

VARNISHING WORDPRESS (1) 25

VARNISHING WORDPRESS (1)∂ Siege on standard WordPress homepage 25

VARNISHING WORDPRESS (1)∂ Siege on standard WordPress homepage §No Varnish 25

VARNISHING WORDPRESS (1)∂ Siege on standard WordPress homepage §No Varnish §Default Varnish installation 25

VARNISHING WORDPRESS (1)∂ Siege on standard WordPress homepage §No Varnish §Default Varnish installation §Custom VCL conﬁguration 25

VARNISHING WORDPRESS (2)∂ No Varnish 26

VARNISHING WORDPRESS (3)∂ Default Varnish 27

VARNISHING WORDPRESS (4)# Drop any cookies sent to WordPress.sub vcl_recv { unset req.http.cookie;}# Drop any cookies WordPress tries to send backsub vcl_fetch { unset beresp.http.set-cookie;}∂ Kill those cookies!! 28

VARNISHING WORDPRESS (5)∂ Custom Varnish 29

OTHER PITFALLS 30

OTHER PITFALLS∂ Accept headers §application/vnd.kingsofcode.speakers+xml; §return “Vary: Accept” header 30

OTHER PITFALLS∂ Accept headers §application/vnd.kingsofcode.speakers+xml; §return “Vary: Accept” header∂ Accept-encoding header 30

OTHER PITFALLS∂ Accept headers §application/vnd.kingsofcode.speakers+xml; §return “Vary: Accept” header∂ Accept-encoding header∂ Vary: User-Agent header∂ Not speciﬁcally Varnish issues 30

EDGE SIDE INCLUDES (1)∂ Markup language∂ Co-authored Akamai, IBM, Oracle & more∂ Extensive features∂ Very powerful for content assembly 31

EDGE SIDE INCLUDES (2)∂ if ... else § <esi:choose><esi:when> ... <esi:otherwise>∂ Variables § <esi:assign> and <esi:vars>∂ Varnish implements only one feature! § <esi:include src=”uri” />∂ Examples? http://esi-examples.akamai.com 32

EDGE SIDE INCLUDES (3)if (req.url ~ "^/url/to/esi/snippets") { unset beresp.http.set-cookie;}## enable esi on header from backendif (beresp.http.enable-esi == "1") { set beresp.do_esi = true; //varnish 3.0 unset beresp.http.enable-esi;}∂ VCL conﬁg for ESI 33

EDGE SIDE INCLUDES (4)∂ Where are the ESI’s? 34

EDGE SIDE INCLUDES (5)∂ Different TTL’s for content snippets 35

TOOLS∂Varnishstat∂Varnishsizes∂Varnishtop∂Varnishadm∂Varnishlog∂ You can’t go without 36

VARNISHLOG∂ Log hits § varnishlog -o VCL_Call hit | grep RxURL∂ Log misses § varnishlog -i TxURL 37

VARNISHLOG∂ Request of a gif image by client 38

CAVEATS∂ Unsuitable for 32 bit∂ Beware of cookie monster applications∂ Check your API design∂ Avoid large ﬁles∂ Minimize cookie usage in ESI∂ No SSL support 39

∂ Questions? Thank you!

http://weblogs.vpro.nl	1363
http://redactie-live.test.vpro.nl	31
http://lanyrd.com	22
http://lanyrd.dev:8000	22
http://paper.li	16
http://tweetedtimes.com	1
http://127.0.0.1:8795	1
http://a0.twimg.com	1
http://translate.googleusercontent.com	1
http://twitter.com	1
http://redactie-test.vpro.omroep.nl	1

Varnish, the high performance valhalla?

by Jeroen van Dijk

Accessibility

Categories

Upload Details

Usage Rights

11 Embeds 1,460

Statistics

Varnish, the high performance valhalla? Presentation Transcript