Varnish

Varnish 3 The easy wayto speed up your websites @fabpot fabien@symfony.comhttp://www.flickr.com/photos/laserstars/908946494

Varnish is an HTTP accelerator http://www.flickr.com/photos/stuckincustoms/3232133635

Varnish is a Caching Reverse Proxy http://www.flickr.com/photos/stuckincustoms/3232133635

Kinds of caches http://www.flickr.com/photos/jnarin/2993803017

Browser Browser BrowserBrowser Cache Browser Cache Browser Cache Within a Company On the server side Your PHP application

Browser Browser Browser Browser Browser BrowserBrowser Cache Browser Cache Browser Cache Browser Cache Browser Cache Browser Cache Proxy Cache Proxy Cache Within a Company Within a Company On the server side Your PHP application

Browser Browser Browser Browser BrowserBrowser Cache Browser Cache Browser Cache Browser Cache Browser Cache Proxy Cache Within a Company On the server side Reverse Proxy Cache Your PHP application

HTTP and Caching http://www.flickr.com/photos/hdz/5623651313

RFC 2616 – HTTP/1.1http://www.ietf.org/rfc/rfc2616.txt http://tools.ietf.org/wg/httpbis/

The Client sends a Request to the ServerThe Server sends back a Response to the Client A Client (browser, bot, WS, curl, …) A Server (Apache, nginx, …)The Request and the Response are HTTP messages

GET / HTTP/1.1Host: http.trainings.sensiolabs.com

HTTP/1.1 200 OKDate: Wed, 15 Oct 2005 07:07:07 GMTServer: ApacheContent-Length: 14Content-Type: text/htmlHello World!

Caching in the HTTP Specification

p1: Messaging: Low-level message parsing and connection management p2: Semantics: Methods, status codes and headers p3: Payload: Dealing with content, message-specific headers p4: Conditional Requests: e.g., If-Modified-Since p5: Range Requests: Getting partial content p6: Caching: Browser and intermediary caches p7: Authentication: HTTP authentication framework

ExpirationCache-Control Expires

ValidationLast-Modified / If-Modified-Since ETag / If-None-Match

The goal is to nevergenerate the same response twice http://www.flickr.com/photos/donaldmacleod/3439612846

HTTP Expiration

GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Some CacheBrowser GET /foo HTTP/1.1 200 OK Cache-Control: s- maxage=10 Hello HTTP/1.1 200 OK HTTP/1.1 200 OK Cache-‐Control: s-‐maxage=10 Hello Hello

Before expiration GET /foo HTTP/1.1 Your application is not called Host: foo.org Your PHP application Some CacheBrowser GET /foo HTTP/1.1 200 OK Cache-Control: s- maxage=10 Hello HTTP/1.1 200 OK Hello

After expiration GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Some Cache fresh Your PHP application NotBrowser GET /foo HTTP/1.1 200 OK Cache-Control: s- maxage=10 Hello HTTP/1.1 200 OK HTTP/1.1 200 OK Cache-Control: s-maxage=10 Hello Hello

HTTP Validation

Last-Modified / If-Modified-Since Etag / If-None-Match

GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Some CacheBrowser GET /foo HTTP/1.1 200 OK Last-Modified: Thu, … Hello HTTP/1.1 200 OK HTTP/1.1 200 OK Last-Modified: Thu, … Last-Modified: Thu, … Hello Hello

If the resource has not changed GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org If-Modified-Since: Thu, Your PHP application Some CacheBrowser GET /foo HTTP/1.1 200 OK Last-Modified: Thu, … Hello HTTP/1.1 200 OK HTTP/1.1 304 Not Modified Last-Modified: Thu, … Hello

If the resource has changed GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org If-Modified-Since: Thu, Your PHP application Some CacheBrowser GET /foo /foo GET HTTP/1.1 200 200 OK HTTP/1.1 OK Last-Modified: Sun,… Last-Modified: Thu,… Hello Hello HTTP/1.1 200 OK HTTP/1.1 200 OK Last-Modified: Sun, … Last-Modified: Sun, … Hello Hello

You can combine HTTP headers the way you wantExpiration wins over Validation

GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Some CacheBrowser GET /foo HTTP/1.1 200 OK Etag: abcdef Cache-‐Control: max-‐ age=10 … Hello HTTP/1.1 200 OK HTTP/1.1 200 OK ETag: abcdef ETag: abcdef Cache-‐Control: max-‐age=10 Cache-‐Control: max-‐age=10 Hello Hello

Before expiration GET /foo HTTP/1.1 Host: foo.org Your application is not called Your PHP application Some CacheBrowser GET /foo HTTP/1.1 200 OK Etag: abcdef Cache-‐Control: max-‐ age=10 … Hello HTTP/1.1 200 OK ETag: abcdef Cache-‐Control: max-‐age=10 Hello

After expiration but resource still valid GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org If-None-Match: abcdef Your PHP application Some CacheBrowser GET /foo HTTP/1.1 200 OK Etag: abcdef Cache-‐Control: max-‐ age=10 … Hello HTTP/1.1 200 OK HTTP/1.1 304 Not Modified ETag: abcdef Cache-‐Control: max-‐age=10 Cache-‐Control: max-‐age=10 Hello

HTTP Expiration

GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: max-age=600 C-C: max-age=600 Bob’s Cache … … Hello HelloBob HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: max-age=600 C-C: max-age=600 C-C: max-age=600 Hello Hello Hello

GET /foo HTTP/1.1 Host: foo.org Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: max-age=600 C-C: max-age=600 Bob’s Cache … … Hello HelloBob HTTP/1.1 200 OK C-C: max-age=600 Hello

GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK Browser Cache C-C: max-age=600 C-C: max-age=600 … … Hello HelloAlice HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: max-age=600 C-C: max-age=600 Hello Hello

HTTP Validation

GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: abcde Etag: abcde Bob’s Cache … … Hello HelloBob HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: abcde Etag: abcde Etag: abcde Hello Hello Hello

GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org If-None-Match: ab If-None-Match: ab Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: ab Etag: ab Bob’s Cache … … Hello HelloBob HTTP/1.1 200 OK Etag: ab 304 Not Modified 304 Not Modified Hello

GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org If-None-Match: ab Your PHP application Reverse Proxy Cache GET /foo GET /foo Browser Cache HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: ab Etag: ab … … Hello HelloAlice HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: ab Etag: ab 304 Not Modified Hello Hello

VCLVarnish Configuration Language http://www.flickr.com/photos/akatayama/84707813

backend default { .host = "127.0.0.1"; .port = "8080";}

pipe vcl_pipe error vcl_error restart deliver orkflow lookup deliverRequest vcl_recv vcl_hash W cached? vcl_hit pass vcl_deliver Response deliver fetch vcl_miss vcl_fetch pass vcl_pass pass

Special Subroutines

req. pipe vcl_pipe error vcl_error restart deliver lookup deliverRequest vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass

if (req.restarts == 0) { if (req.http.x-forwarded-for) { set req.http.X-Forwarded-For = req.http.X-Forwarded-For + ", " + client.ip; } else { set req.http.X-Forwarded-For = client.ip; }}if (req.request != "GET" && req.request != "HEAD" && req.request !="PUT" && req.request != "POST" && req.request != "TRACE" &&req.request != "OPTIONS" && req.request != "DELETE") { return (pipe);}if (req.request != "GET" && req.request != "HEAD") { return (pass);}if (req.http.Authorization || req.http.Cookie) { return (pass);}return (lookup);

req. pipe vcl_pipe error vcl_error restart deliver lookup deliverRequest vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass

hash_data(req.url);if (req.http.host) { hash_data(req.http.host);} else { hash_data(server.ip);}return (hash);

pipe vcl_pipe error vcl_error restart deliver lookup deliverRequest vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass

req. obj. pipe vcl_pipe error vcl_error restart deliver lookup deliverRequest vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass

return (deliver);

req. bereq. pipe vcl_pipe error vcl_error restart deliver lookup deliverRequest vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass

return (fetch);

req. bereq. beresp. pipe vcl_pipe error vcl_error restart deliver lookup deliverRequest vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass

if (beresp.ttl <= 0s || beresp.http.Set-Cookie ||beresp.http.Vary == "*") { set beresp.ttl = 120 s; return (hit_for_pass);}return (deliver);

resp. pipe vcl_pipe error vcl_error restart deliver lookup deliverRequest vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass

return (deliver);

set obj.http.Content-Type = "text/html; charset=utf-8";set obj.http.Retry-After = "5";synthetic {"<?xml version="1.0" encoding="utf-8"?><!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN""http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html><head><title>"} + obj.status + " " + obj.response + {"</title></head><body><h1>Error "} + obj.status + " " + obj.response + {"</h1><p>"} + obj.response + {"</p><h3>Guru Meditation:</h3><p>XID: "} + req.xid + {"</p><hr><p>Varnish cache server</p></body></html>"};return (deliver);

Varnish Workflowhttp://www.flickr.com/photos/w4nd3rl0st/6604159789

lookupRequest vcl_recv vcl_hash cached? vcl_deliver Response deliver fetch vcl_miss vcl_fetch

lookup deliverRequest vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response

pipe vcl_pipeRequest vcl_recv Response

lookupRequest vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver vcl_miss vcl_fetch pass vcl_pass pass

VCL Recipes http://www.flickr.com/photos/christijohnstone/5474556299

backend default { .host = "127.0.0.1"; .port = "8080";}sub vcl_recv{ if ((req.request == "GET" || req.request == "HEAD") && req.url ~ ".(png|gif|jpg|swf|css|js)$") { unset req.http.cookie; return(lookup); }}sub vcl_fetch{ if (req.url ~ ".(png|gif|jpg|swf|css|js)$") { remove beresp.http.set-cookie; set beresp.ttl = 2h; }}

sub vcl_hit{ if (...) { if (obj.hits >= 10) { set obj.ttl = obj.ttl * 2; } }}

backend app { .host = "192.168.0.1"; .port = "8080";}backend images { .host = "192.168.0.2"; .port = "8080";}

sub vcl_recv{ set req.backend = app; if (req.url ~ ".(gif|jpg|swf|css|js)$") { set req.backend = images; }}

sub vcl_deliver{ set resp.http.X-Cache = obj.hits+" "+req.backend;}

sub vcl_recv { if (req.http.host ~ "^(?i)example.org" && req.http.X-Forwarded-Proto !~ "(?i)https") { set req.http.x-Redir-Url = "https://example.org" +req.url; error 750 req.http.x-Redir-Url; }}sub vcl_error { if (obj.status == 750) { set obj.http.Location = obj.response; set obj.status = 302; return (deliver); }}

sub vcl_recv { if (req.http.Cookie) { set req.http.Cookie =regsuball(req.http.Cookie,"(^|; ) *__utm.=[^;]+;? *","1"); if (req.http.Cookie == "") { remove req.http.Cookie; } }}

Saving the Request http://www.flickr.com/photos/lwr/5014290292

backend app { .host = "192.168.0.1"; .port = "8080";}backend rescue { .host = "1.1.1.1"; .port = "8080";}

sub vcl_fetch{ if (beresp.status == 500) { return (restart); }}sub vcl_recv{ set req.backend = default; if (req.restarts > 0) { set req.backend = rescue; }}

director balance round-robin{ { .backend = web1; } { .backend = web2; }}director balance random{ { .backend = web1; .weight = 2 } { .backend = web2; .weight = 1 }}

director balance fallback{ { .backend = web1; } { .backend = web2; }}director balance client{ { .backend = web1; .weight = 2 } { .backend = web2; .weight = 1 }}director balance hash{ { .backend = web1; .weight = 2 } { .backend = web2; .weight = 1 }}

stale-while-revalidate - rfc5861

sub vcl_fetch{ set beresp.grace = 30m;}sub vcl_recv{ set req.grace = 15s;}

sub vcl_recv{ set req.grace = 15s; if (!req.backend.healthy) { set req.grace = 5m; }}

probe health { .url = "/test_health"; .expected_response = 200; .interval = 5s; .timeout = 1s; .window = 5; .threshold = 3;}backend default{ .host = "127.0.0.1"; .port = "8080"; .probe = health;}

stale-if-error - rfc5861

sub vcl_fetch{ if (beresp.status == 500) { set beresp.saintmode = 10s; return (restart); } set beresp.grace = 30m;}

Cache Invalidation http://www.flickr.com/photos/r80o/5549288

sub vcl_recv{ if (req.request == "PURGE") { purge_url(req.url); error 200 "Purged"; }}

acl purge_acl { "localhost"; "192.168.55.0/24";}sub vcl_recv{ if (req.request == "PURGE") { if (!client.ip ~ purge_acl) { error 405 "Not allowed"; } purge_url(req.url); error 200 "Purged"; }}

varnishadm -S /etc/varnish/secret -T 127.0.0.1:6082 "ban.url .*"

ban req.http.host == "example.com" && req.http.url ~ ".png$"

Edge Side Includes ESI

cacheable for 10 minutes cacheable for 5 seconds Lorem ipsum dolor sit amet, consectetur Lorem ipsum dolor sit amet, adipiscing elit. In vel nulla arcu, vitae cursus consectetur adipiscing elit. nunc. Integer semper turpis et enim In vel nulla arcu, vitae porCtor iaculis. Nulla facilisi. Lorem ipsum cursus nunc. Integer dolor sit amet, consectetur adipiscing elit. semper turpis et enim Mauris vehicula vesFbulum dictum. Aenean porCtor iaculis. Nulla non velit tortor. Nullam adipiscing facilisi. Lorem ipsum dolor malesuada aliquam. Mauris dignissim, urna sit amet, consectetur quis iaculis tempus, justo libero porCtor est, adipiscing elit. Mauris nec eleifend est elit vitae ante. Curabitur vehicula vesFbulum dictum. interdum luctus metus, in pulvinar lectus Aenean non velit tortor. rutrum sit amet. Duis gravida, metus in Nullam adipiscing dictum eleifend, dolor risus Fncidunt ligula, malesuada aliquam. Mauris non volutpat nulla sapien in elit. Nulla dignissim, urna quis iaculis rutrum erat id neque suscipit eu ultricies tempus, justo libero odio sollicitudin. Aliquam a mi vel eros porCtor est, nec eleifend placerat hendrerit. Phasellus porCtor, est elit vitae ante. Curabitur augue sit amet vulputate venenaFs, dui leo interdum luctus metus. commodo odio, a euismod turpis ligula in elit.

ESI… or Edge Side Includeshttp://www.w3.org/TR/esi-lang

t ESI houWit Lorem ipsum dolor sit amet, consectetur Lorem ipsum dolor sit amet, adipiscing elit. In vel nulla arcu, vitae cursus consectetur adipiscing elit. nunc. Integer semper turpis et enim In vel nulla arcu, vitae porCtor iaculis. Nulla facilisi. Lorem ipsum cursus nunc. Integer dolor sit amet, consectetur adipiscing elit. semper turpis et enim Mauris vehicula vesFbulum dictum. Aenean porCtor iaculis. Nulla non velit tortor. Nullam adipiscing facilisi. Lorem ipsum dolor malesuada aliquam. Mauris dignissim, urna sit amet, consectetur quis iaculis tempus, justo libero porCtor est, adipiscing elit. Mauris nec eleifend est elit vitae ante. Curabitur vehicula vesFbulum dictum. interdum luctus metus, in pulvinar lectus Aenean non velit tortor. rutrum sit amet. Duis gravida, metus in Nullam adipiscing dictum eleifend, dolor risus Fncidunt ligula, malesuada aliquam. Mauris non volutpat nulla sapien in elit. Nulla dignissim, urna quis iaculis rutrum erat id neque suscipit eu ultricies tempus, justo libero odio sollicitudin. Aliquam a mi vel eros porCtor est, nec eleifend placerat hendrerit. Phasellus porCtor, est elit vitae ante. Curabitur augue sit amet vulputate venenaFs, dui leo interdum luctus metus. commodo odio, a euismod turpis ligula in elit.

ESIW ith <esi:include src="..." /> Lorem ipsum dolor sit amet, consectetur adipiscing elit. In vel nulla arcu, vitae cursus nunc. Integer semper turpis et enim porCtor iaculis. Nulla facilisi. Lorem ipsum dolor sit amet, consectetur adipiscing elit. Mauris vehicula vesFbulum dictum. Aenean non velit tortor. Nullam adipiscing malesuada aliquam. Mauris dignissim, urna quis iaculis tempus, justo libero porCtor est, nec eleifend est elit vitae ante. Curabitur interdum luctus metus, in pulvinar lectus rutrum sit amet. Duis gravida, metus in dictum eleifend, dolor risus Fncidunt ligula, non volutpat nulla sapien in elit. Nulla rutrum erat id neque suscipit eu ultricies odio sollicitudin. Aliquam a mi vel eros placerat hendrerit. Phasellus porCtor, augue sit amet vulputate venenaFs, dui leo commodo odio, a euismod turpis ligula in elit.

GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org HTTP/1.1 200 OK C-C: s-maxage=600 Lorem <esi:include ipsum src="hNp.." /> dolor Your PHP application Gateway Cache Browser Cache GET /bar HTTP/1.1Browser Host: foo.org HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: s-maxage=5 Lorem ipsum Lorem Lorem ipsum Lorem Lorem ipsum dolor sit amet, ipsum dolor sit amet, ipsum dolor dolor dolor GET /bar C-C: s-maxage=5 Lorem GET /foo C-C: s-maxage=600 Lor <esi:include />

GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Gateway Cache Browser CacheBrowser HTTP/1.1 200 OK HTTP/1.1 200 OK Lorem ipsum Lorem Lorem ipsum Lorem dolor sit amet, ipsum dolor sit amet, ipsum dolor dolor GET /bar C-C: s-maxage=5 Lorem GET /foo C-C: s-maxage=6002 seconds later… Lor <esi:include />

GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Gateway Cache Browser Cache GET /bar HTTP/1.1Browser Host: foo.org HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: s-maxage=5 Lorem ipsum Lorem Lorem ipsum Lorem Lorem ipsum dolor sit amet, ipsum dolor sit amet, ipsum dolor dolor dolor GET /bar C-C: s-maxage=5 Lorem GET /foo C-C: s-maxage=6007 seconds later… Lor <esi:include />

Surrogate-Capability Surrogate-Controlhttp://www.w3.org/TR/edge-arch

Surrogate-Capability: abc="Surrogate/1.0 ESI/1.0"

Surrogate-Control: content="ESI/1.0"

sub vcl_recv{ set req.http.Surrogate-Capability = "abc=ESI/1.0";}sub vcl_fetch{ if (beresp.http.Surrogate-Control ~ "ESI/1.0") { unset beresp.http.Surrogate-Control; unset beresp.http.Cache-Control; set beresp.do_esi = true; }}

http://www.flickr.com/photos/atoach/2118513722

Caching only works for “safe” HTTP methods (like GET & HEAD)

Never change the state of the server when serving a GET request(we are talking about the application’s state of course, you can log, cache, …)

Cache-Control: private

Pages with cookiesare not cached by default

Terminate SSL

64 bits

Thank You

http://www.symfony.es	636
http://localhost	104
http://coderwall.com	103
http://ammasajan.blogspot.in	23
http://ammasajan.blogspot.com	22
http://ammasajan.blogspot.sg	13
http://ammasajan.blogspot.com.es	4
http://ammasajan.blogspot.co.uk	4
http://www.linkedin.com	3
http://ammasajan.blogspot.fr	3
http://ammasajan.blogspot.jp	3
http://ammasajan.blogspot.com.br	2
http://ammasajan.blogspot.ro	2
http://ammasajan.blogspot.kr	2
http://ammasajan.blogspot.cz	1
http://translate.googleusercontent.com	1
http://symfony.es	1
http://ammasajan.blogspot.pt	1
http://ammasajan.blogspot.com.ar	1
http://ammasajan.blogspot.ca	1
http://ammasajan.blogspot.com.au	1
http://ammasajan.blogspot.nl	1

Varnish

by Fabien Potencier

Accessibility

Categories

Upload Details

Usage Rights

22 Embeds 932

Statistics

Varnish Presentation Transcript