Fabien Potencier, profile picture
Uploaded byFabien Potencier
9,071 views

Varnish

Varnish is an HTTP accelerator and caching reverse proxy that can be used to speed up websites. It works by caching responses from the web server to reduce load and serve subsequent requests from the cache. The HTTP specification defines caching mechanisms like expiration dates, validation of cached responses using headers like Last-Modified and ETag, and conditional requests to prevent generating duplicate responses. Varnish leverages these caching features to improve website performance.

Embed presentation

Downloaded 35 times
1 / 107
2 / 107
3 / 107
4 / 107
5 / 107
6 / 107
7 / 107
8 / 107
9 / 107
10 / 107
11 / 107
12 / 107
13 / 107
14 / 107
15 / 107
16 / 107
17 / 107
18 / 107
19 / 107
20 / 107
21 / 107
22 / 107
23 / 107
24 / 107
25 / 107
26 / 107
27 / 107
28 / 107
29 / 107
30 / 107
31 / 107
32 / 107
33 / 107
34 / 107
35 / 107
36 / 107
37 / 107
38 / 107
39 / 107
40 / 107
41 / 107
42 / 107
43 / 107
44 / 107
45 / 107
46 / 107
47 / 107
48 / 107
49 / 107
50 / 107
51 / 107
52 / 107
53 / 107
54 / 107
55 / 107
56 / 107
57 / 107
58 / 107
59 / 107
60 / 107
61 / 107
62 / 107
63 / 107
64 / 107
65 / 107
66 / 107
67 / 107
68 / 107
69 / 107
70 / 107
71 / 107
72 / 107
73 / 107
74 / 107
75 / 107
76 / 107
77 / 107
78 / 107
79 / 107
80 / 107
81 / 107
82 / 107
83 / 107
84 / 107
85 / 107
86 / 107
87 / 107
88 / 107
89 / 107
90 / 107
91 / 107
92 / 107
93 / 107
94 / 107
95 / 107
96 / 107
97 / 107
98 / 107
99 / 107
100 / 107
101 / 107
102 / 107
103 / 107
104 / 107
105 / 107
106 / 107
107 / 107
Varnish 3 The easy way to speed up your websites @fabpot fabien@symfony.com http://www.flickr.com/photos/laserstars/908946494
Varnish is an HTTP accelerator http://www.flickr.com/photos/stuckincustoms/3232133635
Varnish is a Caching Reverse Proxy http://www.flickr.com/photos/stuckincustoms/3232133635
Kinds of caches http://www.flickr.com/photos/jnarin/2993803017
Browser Browser Browser Browser Cache Browser Cache Browser Cache Within a Company On the server side Your PHP application
Browser Browser Browser Browser Browser Browser Browser Cache Browser Cache Browser Cache Browser Cache Browser Cache Browser Cache Proxy Cache Proxy Cache Within a Company Within a Company On the server side Your PHP application
Browser Browser Browser Browser Browser Browser Cache Browser Cache Browser Cache Browser Cache Browser Cache Proxy Cache Within a Company On the server side Reverse Proxy Cache Your PHP application
HTTP and Caching http://www.flickr.com/photos/hdz/5623651313
RFC 2616 – HTTP/1.1 http://www.ietf.org/rfc/rfc2616.txt http://tools.ietf.org/wg/httpbis/
The Client sends a Request to the Server The Server sends back a Response to the Client A Client (browser, bot, WS, curl, …) A Server (Apache, nginx, …) The Request and the Response are HTTP messages
GET / HTTP/1.1 Host: http.trainings.sensiolabs.com
HTTP/1.1 200 OK Date: Wed, 15 Oct 2005 07:07:07 GMT Server: Apache Content-Length: 14 Content-Type: text/html Hello World!
Caching in the HTTP Specification
 p1: Messaging: Low-level message parsing and connection management  p2: Semantics: Methods, status codes and headers  p3: Payload: Dealing with content, message-specific headers  p4: Conditional Requests: e.g., If-Modified-Since  p5: Range Requests: Getting partial content  p6: Caching: Browser and intermediary caches  p7: Authentication: HTTP authentication framework
Expiration Cache-Control Expires
Validation Last-Modified / If-Modified-Since ETag / If-None-Match
The goal is to never generate the same response twice http://www.flickr.com/photos/donaldmacleod/3439612846
HTTP Expiration
GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Cache-Control: s- maxage=10 Hello HTTP/1.1 200 OK HTTP/1.1 200 OK Cache-­‐Control:  s-­‐maxage=10 Hello Hello
Before expiration GET /foo HTTP/1.1 Your application is not called Host: foo.org Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Cache-Control: s- maxage=10 Hello HTTP/1.1 200 OK Hello
After expiration GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Some Cache fresh Your PHP application Not Browser GET /foo HTTP/1.1 200 OK Cache-Control: s- maxage=10 Hello HTTP/1.1 200 OK HTTP/1.1 200 OK Cache-Control: s-maxage=10 Hello Hello
HTTP Validation
Last-Modified / If-Modified-Since Etag / If-None-Match
GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Last-Modified: Thu,   … Hello HTTP/1.1 200 OK HTTP/1.1 200 OK Last-Modified: Thu,  … Last-Modified: Thu,  … Hello Hello
If the resource has not changed GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org If-Modified-Since: Thu, Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Last-Modified: Thu,   … Hello HTTP/1.1 200 OK HTTP/1.1 304 Not Modified Last-Modified: Thu,  … Hello
If the resource has changed GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org If-Modified-Since: Thu, Your PHP application Some Cache Browser GET /foo /foo GET HTTP/1.1 200 200 OK HTTP/1.1 OK Last-Modified: Sun,… Last-Modified: Thu,… Hello Hello HTTP/1.1 200 OK HTTP/1.1 200 OK Last-Modified: Sun,  … Last-Modified: Sun,  … Hello Hello
You can combine HTTP headers the way you want Expiration wins over Validation
GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Etag: abcdef Cache-­‐Control:  max-­‐ age=10 … Hello HTTP/1.1 200 OK HTTP/1.1 200 OK ETag: abcdef ETag: abcdef Cache-­‐Control:  max-­‐age=10 Cache-­‐Control:  max-­‐age=10 Hello Hello
Before expiration GET /foo HTTP/1.1 Host: foo.org Your application is not called Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Etag: abcdef Cache-­‐Control:  max-­‐ age=10 … Hello HTTP/1.1 200 OK ETag: abcdef Cache-­‐Control:  max-­‐age=10 Hello
After expiration but resource still valid GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org If-None-Match: abcdef Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Etag: abcdef Cache-­‐Control:  max-­‐ age=10 … Hello HTTP/1.1 200 OK HTTP/1.1 304 Not Modified ETag: abcdef Cache-­‐Control:  max-­‐age=10 Cache-­‐Control:  max-­‐age=10 Hello
HTTP Expiration
GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: max-age=600 C-C: max-age=600 Bob’s Cache … … Hello Hello Bob HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: max-age=600 C-C: max-age=600 C-C: max-age=600 Hello Hello Hello
GET /foo HTTP/1.1 Host: foo.org Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: max-age=600 C-C: max-age=600 Bob’s Cache … … Hello Hello Bob HTTP/1.1 200 OK C-C: max-age=600 Hello
GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK Browser Cache C-C: max-age=600 C-C: max-age=600 … … Hello Hello Alice HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: max-age=600 C-C: max-age=600 Hello Hello
HTTP Validation
GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: abcde Etag: abcde Bob’s Cache … … Hello Hello Bob HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: abcde Etag: abcde Etag: abcde Hello Hello Hello
GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org If-None-Match: ab If-None-Match: ab Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: ab Etag: ab Bob’s Cache … … Hello Hello Bob HTTP/1.1 200 OK Etag: ab 304 Not Modified 304 Not Modified Hello
GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org If-None-Match: ab Your PHP application Reverse Proxy Cache GET /foo GET /foo Browser Cache HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: ab Etag: ab … … Hello Hello Alice HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: ab Etag: ab 304 Not Modified Hello Hello
VCL Varnish Configuration Language http://www.flickr.com/photos/akatayama/84707813
backend default { .host = "127.0.0.1"; .port = "8080"; }
pipe vcl_pipe error vcl_error restart deliver orkflow lookup deliver Request vcl_recv vcl_hash W cached? vcl_hit pass vcl_deliver Response deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
Special Subroutines
req. pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
if (req.restarts == 0) { if (req.http.x-forwarded-for) { set req.http.X-Forwarded-For = req.http.X-Forwarded-For + ", " + client.ip; } else { set req.http.X-Forwarded-For = client.ip; } } if (req.request != "GET" && req.request != "HEAD" && req.request != "PUT" && req.request != "POST" && req.request != "TRACE" && req.request != "OPTIONS" && req.request != "DELETE") { return (pipe); } if (req.request != "GET" && req.request != "HEAD") { return (pass); } if (req.http.Authorization || req.http.Cookie) { return (pass); } return (lookup);
req. pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
hash_data(req.url); if (req.http.host) { hash_data(req.http.host); } else { hash_data(server.ip); } return (hash);
pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
req. obj. pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
return (deliver);
req. bereq. pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
return (fetch);
req. bereq. beresp. pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
if (beresp.ttl <= 0s || beresp.http.Set-Cookie || beresp.http.Vary == "*") { set beresp.ttl = 120 s; return (hit_for_pass); } return (deliver);
resp. pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
return (deliver);
pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
set obj.http.Content-Type = "text/html; charset=utf-8"; set obj.http.Retry-After = "5"; synthetic {" <?xml version="1.0" encoding="utf-8"?> <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"> <html> <head> <title>"} + obj.status + " " + obj.response + {"</title> </head> <body> <h1>Error "} + obj.status + " " + obj.response + {"</h1> <p>"} + obj.response + {"</p> <h3>Guru Meditation:</h3> <p>XID: "} + req.xid + {"</p> <hr> <p>Varnish cache server</p> </body> </html> "}; return (deliver);
Varnish Workflow http://www.flickr.com/photos/w4nd3rl0st/6604159789
lookup Request vcl_recv vcl_hash cached? vcl_deliver Response deliver fetch vcl_miss vcl_fetch
lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response
pipe vcl_pipe Request vcl_recv Response
lookup Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver vcl_miss vcl_fetch pass vcl_pass pass
pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
VCL Recipes http://www.flickr.com/photos/christijohnstone/5474556299
backend default { .host = "127.0.0.1"; .port = "8080"; } sub vcl_recv { if ((req.request == "GET" || req.request == "HEAD") && req.url ~ ". (png|gif|jpg|swf|css|js)$") { unset req.http.cookie; return(lookup); } } sub vcl_fetch { if (req.url ~ ".(png|gif|jpg|swf|css|js)$") { remove beresp.http.set-cookie; set beresp.ttl = 2h; } }
sub vcl_hit { if (...) { if (obj.hits >= 10) { set obj.ttl = obj.ttl * 2; } } }
backend app { .host = "192.168.0.1"; .port = "8080"; } backend images { .host = "192.168.0.2"; .port = "8080"; }
sub vcl_recv { set req.backend = app; if (req.url ~ ".(gif|jpg|swf|css|js)$") { set req.backend = images; } }
sub vcl_deliver { set resp.http.X-Cache = obj.hits+" "+req.backend; }
sub vcl_recv { if (req.http.host ~ "^(?i)example.org" && req.http.X- Forwarded-Proto !~ "(?i)https") { set req.http.x-Redir-Url = "https://example.org" + req.url; error 750 req.http.x-Redir-Url; } } sub vcl_error { if (obj.status == 750) { set obj.http.Location = obj.response; set obj.status = 302; return (deliver); } }
sub vcl_recv { if (req.http.Cookie) { set req.http.Cookie = regsuball(req.http.Cookie,"(^|; ) *__utm.=[^;]+;? *", "1"); if (req.http.Cookie == "") { remove req.http.Cookie; } } }
Saving the Request http://www.flickr.com/photos/lwr/5014290292
backend app { .host = "192.168.0.1"; .port = "8080"; } backend rescue { .host = "1.1.1.1"; .port = "8080"; }
sub vcl_fetch { if (beresp.status == 500) { return (restart); } } sub vcl_recv { set req.backend = default; if (req.restarts > 0) { set req.backend = rescue; } }
director balance round-robin { { .backend = web1; } { .backend = web2; } } director balance random { { .backend = web1; .weight = 2 } { .backend = web2; .weight = 1 } }
director balance fallback { { .backend = web1; } { .backend = web2; } } director balance client { { .backend = web1; .weight = 2 } { .backend = web2; .weight = 1 } } director balance hash { { .backend = web1; .weight = 2 } { .backend = web2; .weight = 1 } }
stale-while-revalidate - rfc5861
sub vcl_fetch { set beresp.grace = 30m; } sub vcl_recv { set req.grace = 15s; }
sub vcl_recv { set req.grace = 15s; if (!req.backend.healthy) { set req.grace = 5m; } }
probe health { .url = "/test_health"; .expected_response = 200; .interval = 5s; .timeout = 1s; .window = 5; .threshold = 3; } backend default { .host = "127.0.0.1"; .port = "8080"; .probe = health; }
stale-if-error - rfc5861
sub vcl_fetch { if (beresp.status == 500) { set beresp.saintmode = 10s; return (restart); } set beresp.grace = 30m; }
Cache Invalidation http://www.flickr.com/photos/r80o/5549288
sub vcl_recv { if (req.request == "PURGE") { purge_url(req.url); error 200 "Purged"; } }
acl purge_acl { "localhost"; "192.168.55.0/24"; } sub vcl_recv { if (req.request == "PURGE") { if (!client.ip ~ purge_acl) { error 405 "Not allowed"; } purge_url(req.url); error 200 "Purged"; } }
varnishadm -S /etc/varnish/secret -T 127.0.0.1:6082 "ban.url .*"
ban req.http.host == "example.com" && req.http.url ~ ".png$"
Edge Side Includes ESI
cacheable for 10 minutes cacheable for 5 seconds Lorem  ipsum  dolor  sit  amet,  consectetur   Lorem  ipsum  dolor  sit  amet,   adipiscing  elit.  In  vel  nulla  arcu,  vitae  cursus   consectetur  adipiscing  elit.   nunc.  Integer  semper  turpis  et  enim   In  vel  nulla  arcu,  vitae   porCtor  iaculis.  Nulla  facilisi.  Lorem  ipsum   cursus  nunc.  Integer   dolor  sit  amet,  consectetur  adipiscing  elit.   semper  turpis  et  enim   Mauris  vehicula  vesFbulum  dictum.  Aenean   porCtor  iaculis.  Nulla   non  velit  tortor.  Nullam  adipiscing   facilisi.  Lorem  ipsum  dolor   malesuada  aliquam.  Mauris  dignissim,  urna   sit  amet,  consectetur   quis  iaculis  tempus,  justo  libero  porCtor  est,   adipiscing  elit.  Mauris   nec  eleifend  est  elit  vitae  ante.  Curabitur   vehicula  vesFbulum  dictum.   interdum  luctus  metus,  in  pulvinar  lectus   Aenean  non  velit  tortor.   rutrum  sit  amet.  Duis  gravida,  metus  in   Nullam  adipiscing   dictum  eleifend,  dolor  risus  Fncidunt  ligula,   malesuada  aliquam.  Mauris   non  volutpat  nulla  sapien  in  elit.  Nulla   dignissim,  urna  quis  iaculis   rutrum  erat  id  neque  suscipit  eu  ultricies   tempus,  justo  libero   odio  sollicitudin.  Aliquam  a  mi  vel  eros   porCtor  est,  nec  eleifend   placerat  hendrerit.  Phasellus  porCtor,   est  elit  vitae  ante.  Curabitur   augue  sit  amet  vulputate  venenaFs,  dui  leo   interdum  luctus  metus. commodo  odio,  a  euismod  turpis  ligula  in   elit.  
ESI… or Edge Side Includes http://www.w3.org/TR/esi-lang
t ESI hou Wit Lorem  ipsum  dolor  sit  amet,  consectetur   Lorem  ipsum  dolor  sit  amet,   adipiscing  elit.  In  vel  nulla  arcu,  vitae  cursus   consectetur  adipiscing  elit.   nunc.  Integer  semper  turpis  et  enim   In  vel  nulla  arcu,  vitae   porCtor  iaculis.  Nulla  facilisi.  Lorem  ipsum   cursus  nunc.  Integer   dolor  sit  amet,  consectetur  adipiscing  elit.   semper  turpis  et  enim   Mauris  vehicula  vesFbulum  dictum.  Aenean   porCtor  iaculis.  Nulla   non  velit  tortor.  Nullam  adipiscing   facilisi.  Lorem  ipsum  dolor   malesuada  aliquam.  Mauris  dignissim,  urna   sit  amet,  consectetur   quis  iaculis  tempus,  justo  libero  porCtor  est,   adipiscing  elit.  Mauris   nec  eleifend  est  elit  vitae  ante.  Curabitur   vehicula  vesFbulum  dictum.   interdum  luctus  metus,  in  pulvinar  lectus   Aenean  non  velit  tortor.   rutrum  sit  amet.  Duis  gravida,  metus  in   Nullam  adipiscing   dictum  eleifend,  dolor  risus  Fncidunt  ligula,   malesuada  aliquam.  Mauris   non  volutpat  nulla  sapien  in  elit.  Nulla   dignissim,  urna  quis  iaculis   rutrum  erat  id  neque  suscipit  eu  ultricies   tempus,  justo  libero   odio  sollicitudin.  Aliquam  a  mi  vel  eros   porCtor  est,  nec  eleifend   placerat  hendrerit.  Phasellus  porCtor,   est  elit  vitae  ante.  Curabitur   augue  sit  amet  vulputate  venenaFs,  dui  leo   interdum  luctus  metus. commodo  odio,  a  euismod  turpis  ligula  in   elit.  
ESI W ith <esi:include src="..." /> Lorem  ipsum  dolor  sit  amet,  consectetur   adipiscing  elit.  In  vel  nulla  arcu,  vitae  cursus   nunc.  Integer  semper  turpis  et  enim   porCtor  iaculis.  Nulla  facilisi.  Lorem  ipsum   dolor  sit  amet,  consectetur  adipiscing  elit.   Mauris  vehicula  vesFbulum  dictum.  Aenean   non  velit  tortor.  Nullam  adipiscing   malesuada  aliquam.  Mauris  dignissim,  urna   quis  iaculis  tempus,  justo  libero  porCtor  est,   nec  eleifend  est  elit  vitae  ante.  Curabitur   interdum  luctus  metus,  in  pulvinar  lectus   rutrum  sit  amet.  Duis  gravida,  metus  in   dictum  eleifend,  dolor  risus  Fncidunt  ligula,   non  volutpat  nulla  sapien  in  elit.  Nulla   rutrum  erat  id  neque  suscipit  eu  ultricies   odio  sollicitudin.  Aliquam  a  mi  vel  eros   placerat  hendrerit.  Phasellus  porCtor,   augue  sit  amet  vulputate  venenaFs,  dui  leo   commodo  odio,  a  euismod  turpis  ligula  in   elit.  
GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org HTTP/1.1 200 OK C-C: s-maxage=600 Lorem   <esi:include   ipsum   src="hNp.."  /> dolor   Your PHP application Gateway Cache Browser Cache GET /bar HTTP/1.1 Browser Host: foo.org HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: s-maxage=5 Lorem  ipsum   Lorem   Lorem  ipsum   Lorem   Lorem  ipsum   dolor  sit  amet,   ipsum   dolor  sit  amet,   ipsum   dolor dolor dolor GET /bar C-C: s-maxage=5 Lorem GET /foo C-C: s-maxage=600 Lor <esi:include />
GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Gateway Cache Browser Cache Browser HTTP/1.1 200 OK HTTP/1.1 200 OK Lorem  ipsum   Lorem   Lorem  ipsum   Lorem   dolor  sit  amet,   ipsum   dolor  sit  amet,   ipsum   dolor dolor GET /bar C-C: s-maxage=5 Lorem GET /foo C-C: s-maxage=600 2 seconds later… Lor <esi:include />
GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Gateway Cache Browser Cache GET /bar HTTP/1.1 Browser Host: foo.org HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: s-maxage=5 Lorem  ipsum   Lorem   Lorem  ipsum   Lorem   Lorem  ipsum   dolor  sit  amet,   ipsum   dolor  sit  amet,   ipsum   dolor dolor dolor GET /bar C-C: s-maxage=5 Lorem GET /foo C-C: s-maxage=600 7 seconds later… Lor <esi:include />
Surrogate-Capability Surrogate-Control http://www.w3.org/TR/edge-arch
Surrogate-Capability: abc="Surrogate/1.0 ESI/1.0"
Surrogate-Control: content="ESI/1.0"
sub vcl_recv { set req.http.Surrogate-Capability = "abc=ESI/ 1.0"; } sub vcl_fetch { if (beresp.http.Surrogate-Control ~ "ESI/1.0") { unset beresp.http.Surrogate-Control; unset beresp.http.Cache-Control; set beresp.do_esi = true; } }
http://www.flickr.com/photos/atoach/2118513722
Caching only works for “safe” HTTP methods (like GET & HEAD)
Never change the state of the server when serving a GET request (we are talking about the application’s state of course, you can log, cache, …)
Cache-Control: private
Pages with cookies are not cached by default
Terminate SSL
64 bits
Thank You

More Related Content

PDF
Caching on the Edge
byFabien Potencier
 
PDF
Hidden Gems in HTTP
byBen Ramsey
 
PDF
Caching the Uncacheable
bydanrot
 
PDF
Devoxx Maroc 2015 HTTP 1, HTTP 2 and folks
byNicolas Martignole
 
PPT
Under the Covers with the Web
byTrevor Lohrbeer
 
PPTX
Http caching basics
byMartin Breest
 
PDF
HTTP Caching in Web Application
byMartins Sipenko
 
PPTX
Advanced HTTP Caching
byMartin Breest
 
Caching on the Edge
byFabien Potencier
 
Hidden Gems in HTTP
byBen Ramsey
 
Caching the Uncacheable
bydanrot
 
Devoxx Maroc 2015 HTTP 1, HTTP 2 and folks
byNicolas Martignole
 
Under the Covers with the Web
byTrevor Lohrbeer
 
Http caching basics
byMartin Breest
 
HTTP Caching in Web Application
byMartins Sipenko
 
Advanced HTTP Caching
byMartin Breest
 

What's hot

PDF
Making the Most of HTTP In Your Apps
byBen Ramsey
 
PDF
IBM dwLive, "Internet & HTTP - 잃어버린 패킷을 찾아서..."
byDongwook Lee
 
PDF
DEF CON 27- ALBINOWAX - http desync attacks
byFelipe Prado
 
PDF
HTTP/2, SPDY e Otimizações Web - Front In Maceió 2014 - Sérgio Lopes
byCaelum
 
PPT
US07FFT-mod_ftp.ppt
bywebhostingguy
 
PPT
Web Server Technologies I: HTTP & Getting Started
byPort80 Software
 
PDF
WP HTTP API
byEunus Hosen
 
PDF
[India Merge World Tour] Meru Networks
byPerforce
 
PDF
HipHop VM: overclocking Symfony
byVadim Borodavko
 
PPT
Utosc2007_Apache_Configuration.ppt
bywebhostingguy
 
PDF
HTTP2：新的机遇与挑战
byJerry Qu
 
PDF
Bandwidth limiting howto
byDien Hien Tran
 
PDF
HTTP colon slash slash: the end of the road?
byAlessandro Nadalin
 
ODP
HAProxy scale out using open source
byIngo Walz
 
PDF
Indy Tech Fest 2008 - ASP.NET MVC
byaaronlerch
 
PDF
Integration with hdfs using WebDFS and NFS
byChristophe Marchal
 
PDF
WebHDFS at King - May 2014 Hadoop MeetUp
byhuguk
 
PDF
Async Tasks with Django Channels
byAlbert O'Connor
 
PDF
Real-Time Django
byBolster Labs
 
PPTX
SPDY - or maybe HTTP2.0
byAndreas Bjärlestam
 
Making the Most of HTTP In Your Apps
byBen Ramsey
 
IBM dwLive, "Internet & HTTP - 잃어버린 패킷을 찾아서..."
byDongwook Lee
 
DEF CON 27- ALBINOWAX - http desync attacks
byFelipe Prado
 
HTTP/2, SPDY e Otimizações Web - Front In Maceió 2014 - Sérgio Lopes
byCaelum
 
US07FFT-mod_ftp.ppt
bywebhostingguy
 
Web Server Technologies I: HTTP & Getting Started
byPort80 Software
 
WP HTTP API
byEunus Hosen
 
[India Merge World Tour] Meru Networks
byPerforce
 
HipHop VM: overclocking Symfony
byVadim Borodavko
 
Utosc2007_Apache_Configuration.ppt
bywebhostingguy
 
HTTP2：新的机遇与挑战
byJerry Qu
 
Bandwidth limiting howto
byDien Hien Tran
 
HTTP colon slash slash: the end of the road?
byAlessandro Nadalin
 
HAProxy scale out using open source
byIngo Walz
 
Indy Tech Fest 2008 - ASP.NET MVC
byaaronlerch
 
Integration with hdfs using WebDFS and NFS
byChristophe Marchal
 
WebHDFS at King - May 2014 Hadoop MeetUp
byhuguk
 
Async Tasks with Django Channels
byAlbert O'Connor
 
Real-Time Django
byBolster Labs
 
SPDY - or maybe HTTP2.0
byAndreas Bjärlestam
 

Viewers also liked

PDF
Look beyond PHP
byFabien Potencier
 
PDF
Unit and Functional Testing with Symfony2
byFabien Potencier
 
PPTX
Varnishes
byPooja Vishwanath
 
PDF
Dependency injection - phpday 2010
byFabien Potencier
 
PDF
Dependency injection-zendcon-2010
byFabien Potencier
 
PDF
Dependency injection in PHP 5.3/5.4
byFabien Potencier
 
PDF
PHP 5.3 in practice
byFabien Potencier
 
DOCX
varnish
byMinhas Azeem
 
PDF
Design patterns revisited with PHP 5.3
byFabien Potencier
 
PPTX
Paints and varnishes
byShrikant Jahagirdar
 
PDF
The state of Symfony2 - SymfonyDay 2010
byFabien Potencier
 
PDF
Symfony2 - OSIDays 2010
byFabien Potencier
 
PDF
Symfony2 Components - The Event Dispatcher
bySarah El-Atm
 
PPTX
Making Symofny shine with Varnish - SymfonyCon Madrid 2014
byBarel Barelon
 
PDF
symfony 1.1 goodness (Dutch PHP Conference 2008)
byFabien Potencier
 
PDF
News of the Symfony2 World
byFabien Potencier
 
PDF
Dependency Injection - ConFoo 2010
byFabien Potencier
 
PDF
Caching on the Edge with Symfony2
byFabien Potencier
 
PDF
PhpBB meets Symfony2
byFabien Potencier
 
PDF
Symfony Components
byFabien Potencier
 
Look beyond PHP
byFabien Potencier
 
Unit and Functional Testing with Symfony2
byFabien Potencier
 
Varnishes
byPooja Vishwanath
 
Dependency injection - phpday 2010
byFabien Potencier
 
Dependency injection-zendcon-2010
byFabien Potencier
 
Dependency injection in PHP 5.3/5.4
byFabien Potencier
 
PHP 5.3 in practice
byFabien Potencier
 
varnish
byMinhas Azeem
 
Design patterns revisited with PHP 5.3
byFabien Potencier
 
Paints and varnishes
byShrikant Jahagirdar
 
The state of Symfony2 - SymfonyDay 2010
byFabien Potencier
 
Symfony2 - OSIDays 2010
byFabien Potencier
 
Symfony2 Components - The Event Dispatcher
bySarah El-Atm
 
Making Symofny shine with Varnish - SymfonyCon Madrid 2014
byBarel Barelon
 
symfony 1.1 goodness (Dutch PHP Conference 2008)
byFabien Potencier
 
News of the Symfony2 World
byFabien Potencier
 
Dependency Injection - ConFoo 2010
byFabien Potencier
 
Caching on the Edge with Symfony2
byFabien Potencier
 
PhpBB meets Symfony2
byFabien Potencier
 
Symfony Components
byFabien Potencier
 

Similar to Varnish

PDF
20100918 android cache
byrroijnoigntroie
 
KEY
Fearless HTTP requests abuse
byLuis Cipriani
 
PDF
Clug 2012 March web server optimisation
bygrooverdan
 
KEY
HTTP's Best-Kept Secret: Caching
byrtomayko
 
PDF
Facebook的缓存系统
byyiditushe
 
PPTX
Web technologies: HTTP
byPiero Fraternali
 
PDF
4069180 Caching Performance Lessons From Facebook
byguoqing75
 
KEY
Super performing websites with TYPO3
byJan-Erik Revsbech
 
PDF
Caching in HTTP
byAlexander Shopov
 
PDF
Charles
byKeegan Street
 
PDF
Building Scalable Websites with Perl
byPerrin Harkins
 
PDF
Load-balancing web servers Load-balancing web servers
bywebhostingguy
 
PPTX
cache concepts and varnish-cache
byMarc Cortinas Val
 
PDF
REST in ( a mobile ) peace @ WHYMCA 05-21-2011
byAlessandro Nadalin
 
PDF
HTTP cache @ PUG Rome 03-29-2011
byAlessandro Nadalin
 
PDF
Web Services PHP Tutorial
byLorna Mitchell
 
PDF
Web services tutorial
byLorna Mitchell
 
ODP
Clug 2011 March web server optimisation
bygrooverdan
 
PDF
Optimising Web Application Frontend
bytkramar
 
PDF
Caching Hypermedia APIs
byC4Media
 
20100918 android cache
byrroijnoigntroie
 
Fearless HTTP requests abuse
byLuis Cipriani
 
Clug 2012 March web server optimisation
bygrooverdan
 
HTTP's Best-Kept Secret: Caching
byrtomayko
 
Facebook的缓存系统
byyiditushe
 
Web technologies: HTTP
byPiero Fraternali
 
4069180 Caching Performance Lessons From Facebook
byguoqing75
 
Super performing websites with TYPO3
byJan-Erik Revsbech
 
Caching in HTTP
byAlexander Shopov
 
Charles
byKeegan Street
 
Building Scalable Websites with Perl
byPerrin Harkins
 
Load-balancing web servers Load-balancing web servers
bywebhostingguy
 
cache concepts and varnish-cache
byMarc Cortinas Val
 
REST in ( a mobile ) peace @ WHYMCA 05-21-2011
byAlessandro Nadalin
 
HTTP cache @ PUG Rome 03-29-2011
byAlessandro Nadalin
 
Web Services PHP Tutorial
byLorna Mitchell
 
Web services tutorial
byLorna Mitchell
 
Clug 2011 March web server optimisation
bygrooverdan
 
Optimising Web Application Frontend
bytkramar
 
Caching Hypermedia APIs
byC4Media
 

More from Fabien Potencier

PDF
Symfony2 - WebExpo 2010
byFabien Potencier
 
PDF
Symfony2 - WebExpo 2010
byFabien Potencier
 
PDF
Dependency Injection IPC 201
byFabien Potencier
 
PDF
Dependency Injection
byFabien Potencier
 
PDF
Symfony2 revealed
byFabien Potencier
 
PDF
Dependency Injection with PHP 5.3
byFabien Potencier
 
PDF
Dependency Injection with PHP and PHP 5.3
byFabien Potencier
 
PDF
Symfony Components 2.0 on PHP 5.3
byFabien Potencier
 
PDF
Playing With PHP 5.3
byFabien Potencier
 
PDF
Symfony 2.0 on PHP 5.3
byFabien Potencier
 
PDF
Symfony2 San Francisco Meetup 2009
byFabien Potencier
 
PDF
Symfony And Zend Framework Together 2009
byFabien Potencier
 
PDF
Twig, the flexible, fast, and secure template language for PHP
byFabien Potencier
 
PDF
symfony: Un Framework Open-Source pour les Entreprises (Solutions Linux 2008)
byFabien Potencier
 
PDF
The symfony platform: Create your very own framework (PHP Quebec 2008)
byFabien Potencier
 
Symfony2 - WebExpo 2010
byFabien Potencier
 
Symfony2 - WebExpo 2010
byFabien Potencier
 
Dependency Injection IPC 201
byFabien Potencier
 
Dependency Injection
byFabien Potencier
 
Symfony2 revealed
byFabien Potencier
 
Dependency Injection with PHP 5.3
byFabien Potencier
 
Dependency Injection with PHP and PHP 5.3
byFabien Potencier
 
Symfony Components 2.0 on PHP 5.3
byFabien Potencier
 
Playing With PHP 5.3
byFabien Potencier
 
Symfony 2.0 on PHP 5.3
byFabien Potencier
 
Symfony2 San Francisco Meetup 2009
byFabien Potencier
 
Symfony And Zend Framework Together 2009
byFabien Potencier
 
Twig, the flexible, fast, and secure template language for PHP
byFabien Potencier
 
symfony: Un Framework Open-Source pour les Entreprises (Solutions Linux 2008)
byFabien Potencier
 
The symfony platform: Create your very own framework (PHP Quebec 2008)
byFabien Potencier
 

Recently uploaded

PDF
Purple Team - Active Directory and AzureAD v1
byVICTOR MAESTRE RAMIREZ
 
PDF
Best-Travel-Portal-Development-Solutions-for-Online-Growth
bykashishnagarrajput
 
PPT
Waste water treatment plant operation and maintenance
byDuggineniRamakrishna
 
PDF
JR : Quality Random Data from the Command line
byGiovanni Marigi
 
PPTX
Full course that Prymehat uploads for you version 2
byOhenebaManu1
 
PDF
Best Bank Statement Converter Software - A Documentation-Based Meta-Analysis ...
bylewisconrada
 
PPTX
AI_in_Cybersecurity_Insights_Case_Studies.pptx
bywrksmith9
 
PDF
XonTel Plus IP-PBX Business Phone System
byXonTel Technology
 
PDF
AI Data Analyst: Smarter Insights for Modern Real Estate Decisions
byLeni Analyst
 
PPTX
On-Device AI with Gemma 3n and PaliGemma 2 Session Slides - GDG VESIT
bygdgcodecellcmpn
 
PDF
SAP WalkMe Overview.pdf SAP WalkMe Overview.pdf
byMurniatiSimbolon2
 
PDF
Effective Ai powered mock interview .pdf
byamazingnishusingh766
 
PPTX
KTU-PEMET413 -MODULE 2-POLYMER MATRIX COMPOSITES - LECTURE 1.pptx
byVINAY B
 
PDF
How Automation Powers Data Quality and Governance at Scale
bySafe Software
 
PDF
January Patch Tuesday
byIvanti
 
PDF
SEO in Charleston SC | Local SEO Strategies to Grow Your Business.pdf
bycustomdigitalsolutio1
 
PDF
A "Kill Switch" (Emergency Off Switch) for AI?
byScott M. Graffius
 
PDF
KM World 2025 Enterprises, KM, & Agentic AI
byEnterprise Knowledge
 
PDF
Presentation on Four Stroke Engine of Ic engine
bySonam Sherpa
 
PDF
2025-CB-NCAE-slide-deck.pptx-1-83.pdf Virtual Orientation on the Administrati...
byNelizabethEsplaguera1
 
Purple Team - Active Directory and AzureAD v1
byVICTOR MAESTRE RAMIREZ
 
Best-Travel-Portal-Development-Solutions-for-Online-Growth
bykashishnagarrajput
 
Waste water treatment plant operation and maintenance
byDuggineniRamakrishna
 
JR : Quality Random Data from the Command line
byGiovanni Marigi
 
Full course that Prymehat uploads for you version 2
byOhenebaManu1
 
Best Bank Statement Converter Software - A Documentation-Based Meta-Analysis ...
bylewisconrada
 
AI_in_Cybersecurity_Insights_Case_Studies.pptx
bywrksmith9
 
XonTel Plus IP-PBX Business Phone System
byXonTel Technology
 
AI Data Analyst: Smarter Insights for Modern Real Estate Decisions
byLeni Analyst
 
On-Device AI with Gemma 3n and PaliGemma 2 Session Slides - GDG VESIT
bygdgcodecellcmpn
 
SAP WalkMe Overview.pdf SAP WalkMe Overview.pdf
byMurniatiSimbolon2
 
Effective Ai powered mock interview .pdf
byamazingnishusingh766
 
KTU-PEMET413 -MODULE 2-POLYMER MATRIX COMPOSITES - LECTURE 1.pptx
byVINAY B
 
How Automation Powers Data Quality and Governance at Scale
bySafe Software
 
January Patch Tuesday
byIvanti
 
SEO in Charleston SC | Local SEO Strategies to Grow Your Business.pdf
bycustomdigitalsolutio1
 
A "Kill Switch" (Emergency Off Switch) for AI?
byScott M. Graffius
 
KM World 2025 Enterprises, KM, & Agentic AI
byEnterprise Knowledge
 
Presentation on Four Stroke Engine of Ic engine
bySonam Sherpa
 
2025-CB-NCAE-slide-deck.pptx-1-83.pdf Virtual Orientation on the Administrati...
byNelizabethEsplaguera1
 

Varnish

  • 1.
    Varnish 3 The easy way to speed up your websites @fabpot fabien@symfony.com http://www.flickr.com/photos/laserstars/908946494
  • 2.
    Varnish is anHTTP accelerator http://www.flickr.com/photos/stuckincustoms/3232133635
  • 3.
    Varnish is aCaching Reverse Proxy http://www.flickr.com/photos/stuckincustoms/3232133635
  • 4.
    Kinds of caches http://www.flickr.com/photos/jnarin/2993803017
  • 5.
    Browser Browser Browser Browser Cache Browser Cache Browser Cache Within a Company On the server side Your PHP application
  • 6.
    Browser Browser Browser Browser Browser Browser Browser Cache Browser Cache Browser Cache Browser Cache Browser Cache Browser Cache Proxy Cache Proxy Cache Within a Company Within a Company On the server side Your PHP application
  • 7.
    Browser Browser Browser Browser Browser Browser Cache Browser Cache Browser Cache Browser Cache Browser Cache Proxy Cache Within a Company On the server side Reverse Proxy Cache Your PHP application
  • 8.
    HTTP and Caching http://www.flickr.com/photos/hdz/5623651313
  • 9.
    RFC 2616 –HTTP/1.1 http://www.ietf.org/rfc/rfc2616.txt http://tools.ietf.org/wg/httpbis/
  • 10.
    The Client sendsa Request to the Server The Server sends back a Response to the Client A Client (browser, bot, WS, curl, …) A Server (Apache, nginx, …) The Request and the Response are HTTP messages
  • 11.
    GET / HTTP/1.1 Host:http.trainings.sensiolabs.com
  • 12.
    HTTP/1.1 200 OK Date:Wed, 15 Oct 2005 07:07:07 GMT Server: Apache Content-Length: 14 Content-Type: text/html Hello World!
  • 13.
    Caching in theHTTP Specification
  • 14.
     p1: Messaging: Low-levelmessage parsing and connection management  p2: Semantics: Methods, status codes and headers  p3: Payload: Dealing with content, message-specific headers  p4: Conditional Requests: e.g., If-Modified-Since  p5: Range Requests: Getting partial content  p6: Caching: Browser and intermediary caches  p7: Authentication: HTTP authentication framework
  • 15.
  • 16.
  • 17.
    The goal isto never generate the same response twice http://www.flickr.com/photos/donaldmacleod/3439612846
  • 18.
  • 19.
    GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Cache-Control: s- maxage=10 Hello HTTP/1.1 200 OK HTTP/1.1 200 OK Cache-­‐Control:  s-­‐maxage=10 Hello Hello
  • 20.
    Before expiration GET /foo HTTP/1.1 Your application is not called Host: foo.org Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Cache-Control: s- maxage=10 Hello HTTP/1.1 200 OK Hello
  • 21.
    After expiration GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Some Cache fresh Your PHP application Not Browser GET /foo HTTP/1.1 200 OK Cache-Control: s- maxage=10 Hello HTTP/1.1 200 OK HTTP/1.1 200 OK Cache-Control: s-maxage=10 Hello Hello
  • 22.
  • 23.
  • 24.
    GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Last-Modified: Thu,   … Hello HTTP/1.1 200 OK HTTP/1.1 200 OK Last-Modified: Thu,  … Last-Modified: Thu,  … Hello Hello
  • 25.
    If the resourcehas not changed GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org If-Modified-Since: Thu, Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Last-Modified: Thu,   … Hello HTTP/1.1 200 OK HTTP/1.1 304 Not Modified Last-Modified: Thu,  … Hello
  • 26.
    If the resourcehas changed GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org If-Modified-Since: Thu, Your PHP application Some Cache Browser GET /foo /foo GET HTTP/1.1 200 200 OK HTTP/1.1 OK Last-Modified: Sun,… Last-Modified: Thu,… Hello Hello HTTP/1.1 200 OK HTTP/1.1 200 OK Last-Modified: Sun,  … Last-Modified: Sun,  … Hello Hello
  • 27.
    You can combineHTTP headers the way you want Expiration wins over Validation
  • 28.
    GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Etag: abcdef Cache-­‐Control:  max-­‐ age=10 … Hello HTTP/1.1 200 OK HTTP/1.1 200 OK ETag: abcdef ETag: abcdef Cache-­‐Control:  max-­‐age=10 Cache-­‐Control:  max-­‐age=10 Hello Hello
  • 29.
    Before expiration GET /foo HTTP/1.1 Host: foo.org Your application is not called Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Etag: abcdef Cache-­‐Control:  max-­‐ age=10 … Hello HTTP/1.1 200 OK ETag: abcdef Cache-­‐Control:  max-­‐age=10 Hello
  • 30.
    After expiration but resource still valid GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org If-None-Match: abcdef Your PHP application Some Cache Browser GET /foo HTTP/1.1 200 OK Etag: abcdef Cache-­‐Control:  max-­‐ age=10 … Hello HTTP/1.1 200 OK HTTP/1.1 304 Not Modified ETag: abcdef Cache-­‐Control:  max-­‐age=10 Cache-­‐Control:  max-­‐age=10 Hello
  • 31.
  • 32.
    GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: max-age=600 C-C: max-age=600 Bob’s Cache … … Hello Hello Bob HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: max-age=600 C-C: max-age=600 C-C: max-age=600 Hello Hello Hello
  • 33.
    GET /foo HTTP/1.1 Host: foo.org Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: max-age=600 C-C: max-age=600 Bob’s Cache … … Hello Hello Bob HTTP/1.1 200 OK C-C: max-age=600 Hello
  • 34.
    GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK Browser Cache C-C: max-age=600 C-C: max-age=600 … … Hello Hello Alice HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: max-age=600 C-C: max-age=600 Hello Hello
  • 35.
  • 36.
    GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: abcde Etag: abcde Bob’s Cache … … Hello Hello Bob HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: abcde Etag: abcde Etag: abcde Hello Hello Hello
  • 37.
    GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org If-None-Match: ab If-None-Match: ab Your PHP application Reverse Proxy Cache GET /foo GET /foo HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: ab Etag: ab Bob’s Cache … … Hello Hello Bob HTTP/1.1 200 OK Etag: ab 304 Not Modified 304 Not Modified Hello
  • 38.
    GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org If-None-Match: ab Your PHP application Reverse Proxy Cache GET /foo GET /foo Browser Cache HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: ab Etag: ab … … Hello Hello Alice HTTP/1.1 200 OK HTTP/1.1 200 OK Etag: ab Etag: ab 304 Not Modified Hello Hello
  • 39.
    VCL Varnish Configuration Language http://www.flickr.com/photos/akatayama/84707813
  • 40.
    backend default { .host = "127.0.0.1"; .port = "8080"; }
  • 41.
    pipe vcl_pipe error vcl_error restart deliver orkflow lookup deliver Request vcl_recv vcl_hash W cached? vcl_hit pass vcl_deliver Response deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
  • 42.
  • 43.
    req. pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
  • 44.
    if (req.restarts ==0) { if (req.http.x-forwarded-for) { set req.http.X-Forwarded-For = req.http.X-Forwarded-For + ", " + client.ip; } else { set req.http.X-Forwarded-For = client.ip; } } if (req.request != "GET" && req.request != "HEAD" && req.request != "PUT" && req.request != "POST" && req.request != "TRACE" && req.request != "OPTIONS" && req.request != "DELETE") { return (pipe); } if (req.request != "GET" && req.request != "HEAD") { return (pass); } if (req.http.Authorization || req.http.Cookie) { return (pass); } return (lookup);
  • 45.
    req. pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
  • 46.
    hash_data(req.url); if (req.http.host) { hash_data(req.http.host); } else { hash_data(server.ip); } return (hash);
  • 47.
    pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
  • 48.
    req. obj. pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
  • 49.
  • 50.
    req. bereq. pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
  • 51.
  • 52.
    req. bereq. beresp. pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
  • 53.
    if (beresp.ttl <=0s || beresp.http.Set-Cookie || beresp.http.Vary == "*") { set beresp.ttl = 120 s; return (hit_for_pass); } return (deliver);
  • 54.
    resp. pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
  • 55.
  • 56.
    pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
  • 57.
    set obj.http.Content-Type ="text/html; charset=utf-8"; set obj.http.Retry-After = "5"; synthetic {" <?xml version="1.0" encoding="utf-8"?> <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"> <html> <head> <title>"} + obj.status + " " + obj.response + {"</title> </head> <body> <h1>Error "} + obj.status + " " + obj.response + {"</h1> <p>"} + obj.response + {"</p> <h3>Guru Meditation:</h3> <p>XID: "} + req.xid + {"</p> <hr> <p>Varnish cache server</p> </body> </html> "}; return (deliver);
  • 58.
  • 59.
    lookup Request vcl_recv vcl_hash cached? vcl_deliver Response deliver fetch vcl_miss vcl_fetch
  • 60.
    lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response
  • 61.
    pipe vcl_pipe Request vcl_recv Response
  • 62.
    lookup Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver vcl_miss vcl_fetch pass vcl_pass pass
  • 63.
    pipe vcl_pipe error vcl_error restart deliver lookup deliver Request vcl_recv vcl_hash cached? vcl_hit vcl_deliver Response pass deliver fetch vcl_miss vcl_fetch pass vcl_pass pass
  • 64.
    VCL Recipes http://www.flickr.com/photos/christijohnstone/5474556299
  • 65.
    backend default { .host = "127.0.0.1"; .port = "8080"; } sub vcl_recv { if ((req.request == "GET" || req.request == "HEAD") && req.url ~ ". (png|gif|jpg|swf|css|js)$") { unset req.http.cookie; return(lookup); } } sub vcl_fetch { if (req.url ~ ".(png|gif|jpg|swf|css|js)$") { remove beresp.http.set-cookie; set beresp.ttl = 2h; } }
  • 66.
    sub vcl_hit { if (...) { if (obj.hits >= 10) { set obj.ttl = obj.ttl * 2; } } }
  • 67.
    backend app { .host = "192.168.0.1"; .port = "8080"; } backend images { .host = "192.168.0.2"; .port = "8080"; }
  • 68.
    sub vcl_recv { set req.backend = app; if (req.url ~ ".(gif|jpg|swf|css|js)$") { set req.backend = images; } }
  • 69.
    sub vcl_deliver { set resp.http.X-Cache = obj.hits+" "+req.backend; }
  • 70.
    sub vcl_recv { if (req.http.host ~ "^(?i)example.org" && req.http.X- Forwarded-Proto !~ "(?i)https") { set req.http.x-Redir-Url = "https://example.org" + req.url; error 750 req.http.x-Redir-Url; } } sub vcl_error { if (obj.status == 750) { set obj.http.Location = obj.response; set obj.status = 302; return (deliver); } }
  • 71.
    sub vcl_recv { if (req.http.Cookie) { set req.http.Cookie = regsuball(req.http.Cookie,"(^|; ) *__utm.=[^;]+;? *", "1"); if (req.http.Cookie == "") { remove req.http.Cookie; } } }
  • 72.
    Saving the Request http://www.flickr.com/photos/lwr/5014290292
  • 73.
    backend app { .host = "192.168.0.1"; .port = "8080"; } backend rescue { .host = "1.1.1.1"; .port = "8080"; }
  • 74.
    sub vcl_fetch { if (beresp.status == 500) { return (restart); } } sub vcl_recv { set req.backend = default; if (req.restarts > 0) { set req.backend = rescue; } }
  • 75.
    director balance round-robin { { .backend = web1; } { .backend = web2; } } director balance random { { .backend = web1; .weight = 2 } { .backend = web2; .weight = 1 } }
  • 76.
    director balance fallback { { .backend = web1; } { .backend = web2; } } director balance client { { .backend = web1; .weight = 2 } { .backend = web2; .weight = 1 } } director balance hash { { .backend = web1; .weight = 2 } { .backend = web2; .weight = 1 } }
  • 77.
  • 78.
    sub vcl_fetch { set beresp.grace = 30m; } sub vcl_recv { set req.grace = 15s; }
  • 79.
    sub vcl_recv { set req.grace = 15s; if (!req.backend.healthy) { set req.grace = 5m; } }
  • 80.
    probe health { .url = "/test_health"; .expected_response = 200; .interval = 5s; .timeout = 1s; .window = 5; .threshold = 3; } backend default { .host = "127.0.0.1"; .port = "8080"; .probe = health; }
  • 81.
  • 82.
    sub vcl_fetch { if (beresp.status == 500) { set beresp.saintmode = 10s; return (restart); } set beresp.grace = 30m; }
  • 83.
    Cache Invalidation http://www.flickr.com/photos/r80o/5549288
  • 84.
    sub vcl_recv { if (req.request == "PURGE") { purge_url(req.url); error 200 "Purged"; } }
  • 85.
    acl purge_acl { "localhost"; "192.168.55.0/24"; } sub vcl_recv { if (req.request == "PURGE") { if (!client.ip ~ purge_acl) { error 405 "Not allowed"; } purge_url(req.url); error 200 "Purged"; } }
  • 86.
    varnishadm -S /etc/varnish/secret -T 127.0.0.1:6082 "ban.url .*"
  • 87.
    ban req.http.host =="example.com" && req.http.url ~ ".png$"
  • 88.
  • 89.
    cacheable for 10minutes cacheable for 5 seconds Lorem  ipsum  dolor  sit  amet,  consectetur   Lorem  ipsum  dolor  sit  amet,   adipiscing  elit.  In  vel  nulla  arcu,  vitae  cursus   consectetur  adipiscing  elit.   nunc.  Integer  semper  turpis  et  enim   In  vel  nulla  arcu,  vitae   porCtor  iaculis.  Nulla  facilisi.  Lorem  ipsum   cursus  nunc.  Integer   dolor  sit  amet,  consectetur  adipiscing  elit.   semper  turpis  et  enim   Mauris  vehicula  vesFbulum  dictum.  Aenean   porCtor  iaculis.  Nulla   non  velit  tortor.  Nullam  adipiscing   facilisi.  Lorem  ipsum  dolor   malesuada  aliquam.  Mauris  dignissim,  urna   sit  amet,  consectetur   quis  iaculis  tempus,  justo  libero  porCtor  est,   adipiscing  elit.  Mauris   nec  eleifend  est  elit  vitae  ante.  Curabitur   vehicula  vesFbulum  dictum.   interdum  luctus  metus,  in  pulvinar  lectus   Aenean  non  velit  tortor.   rutrum  sit  amet.  Duis  gravida,  metus  in   Nullam  adipiscing   dictum  eleifend,  dolor  risus  Fncidunt  ligula,   malesuada  aliquam.  Mauris   non  volutpat  nulla  sapien  in  elit.  Nulla   dignissim,  urna  quis  iaculis   rutrum  erat  id  neque  suscipit  eu  ultricies   tempus,  justo  libero   odio  sollicitudin.  Aliquam  a  mi  vel  eros   porCtor  est,  nec  eleifend   placerat  hendrerit.  Phasellus  porCtor,   est  elit  vitae  ante.  Curabitur   augue  sit  amet  vulputate  venenaFs,  dui  leo   interdum  luctus  metus. commodo  odio,  a  euismod  turpis  ligula  in   elit.  
  • 90.
    ESI… or EdgeSide Includes http://www.w3.org/TR/esi-lang
  • 91.
    t ESI hou Wit Lorem  ipsum  dolor  sit  amet,  consectetur   Lorem  ipsum  dolor  sit  amet,   adipiscing  elit.  In  vel  nulla  arcu,  vitae  cursus   consectetur  adipiscing  elit.   nunc.  Integer  semper  turpis  et  enim   In  vel  nulla  arcu,  vitae   porCtor  iaculis.  Nulla  facilisi.  Lorem  ipsum   cursus  nunc.  Integer   dolor  sit  amet,  consectetur  adipiscing  elit.   semper  turpis  et  enim   Mauris  vehicula  vesFbulum  dictum.  Aenean   porCtor  iaculis.  Nulla   non  velit  tortor.  Nullam  adipiscing   facilisi.  Lorem  ipsum  dolor   malesuada  aliquam.  Mauris  dignissim,  urna   sit  amet,  consectetur   quis  iaculis  tempus,  justo  libero  porCtor  est,   adipiscing  elit.  Mauris   nec  eleifend  est  elit  vitae  ante.  Curabitur   vehicula  vesFbulum  dictum.   interdum  luctus  metus,  in  pulvinar  lectus   Aenean  non  velit  tortor.   rutrum  sit  amet.  Duis  gravida,  metus  in   Nullam  adipiscing   dictum  eleifend,  dolor  risus  Fncidunt  ligula,   malesuada  aliquam.  Mauris   non  volutpat  nulla  sapien  in  elit.  Nulla   dignissim,  urna  quis  iaculis   rutrum  erat  id  neque  suscipit  eu  ultricies   tempus,  justo  libero   odio  sollicitudin.  Aliquam  a  mi  vel  eros   porCtor  est,  nec  eleifend   placerat  hendrerit.  Phasellus  porCtor,   est  elit  vitae  ante.  Curabitur   augue  sit  amet  vulputate  venenaFs,  dui  leo   interdum  luctus  metus. commodo  odio,  a  euismod  turpis  ligula  in   elit.  
  • 92.
    ESI W ith <esi:include src="..." /> Lorem  ipsum  dolor  sit  amet,  consectetur   adipiscing  elit.  In  vel  nulla  arcu,  vitae  cursus   nunc.  Integer  semper  turpis  et  enim   porCtor  iaculis.  Nulla  facilisi.  Lorem  ipsum   dolor  sit  amet,  consectetur  adipiscing  elit.   Mauris  vehicula  vesFbulum  dictum.  Aenean   non  velit  tortor.  Nullam  adipiscing   malesuada  aliquam.  Mauris  dignissim,  urna   quis  iaculis  tempus,  justo  libero  porCtor  est,   nec  eleifend  est  elit  vitae  ante.  Curabitur   interdum  luctus  metus,  in  pulvinar  lectus   rutrum  sit  amet.  Duis  gravida,  metus  in   dictum  eleifend,  dolor  risus  Fncidunt  ligula,   non  volutpat  nulla  sapien  in  elit.  Nulla   rutrum  erat  id  neque  suscipit  eu  ultricies   odio  sollicitudin.  Aliquam  a  mi  vel  eros   placerat  hendrerit.  Phasellus  porCtor,   augue  sit  amet  vulputate  venenaFs,  dui  leo   commodo  odio,  a  euismod  turpis  ligula  in   elit.  
  • 93.
    GET /foo HTTP/1.1 GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Host: foo.org HTTP/1.1 200 OK C-C: s-maxage=600 Lorem   <esi:include   ipsum   src="hNp.."  /> dolor   Your PHP application Gateway Cache Browser Cache GET /bar HTTP/1.1 Browser Host: foo.org HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: s-maxage=5 Lorem  ipsum   Lorem   Lorem  ipsum   Lorem   Lorem  ipsum   dolor  sit  amet,   ipsum   dolor  sit  amet,   ipsum   dolor dolor dolor GET /bar C-C: s-maxage=5 Lorem GET /foo C-C: s-maxage=600 Lor <esi:include />
  • 94.
    GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Gateway Cache Browser Cache Browser HTTP/1.1 200 OK HTTP/1.1 200 OK Lorem  ipsum   Lorem   Lorem  ipsum   Lorem   dolor  sit  amet,   ipsum   dolor  sit  amet,   ipsum   dolor dolor GET /bar C-C: s-maxage=5 Lorem GET /foo C-C: s-maxage=600 2 seconds later… Lor <esi:include />
  • 95.
    GET /foo HTTP/1.1 GET /foo HTTP/1.1 Host: foo.org Host: foo.org Your PHP application Gateway Cache Browser Cache GET /bar HTTP/1.1 Browser Host: foo.org HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK C-C: s-maxage=5 Lorem  ipsum   Lorem   Lorem  ipsum   Lorem   Lorem  ipsum   dolor  sit  amet,   ipsum   dolor  sit  amet,   ipsum   dolor dolor dolor GET /bar C-C: s-maxage=5 Lorem GET /foo C-C: s-maxage=600 7 seconds later… Lor <esi:include />
  • 96.
    Surrogate-Capability Surrogate-Control http://www.w3.org/TR/edge-arch
  • 97.
  • 98.
  • 99.
    sub vcl_recv { set req.http.Surrogate-Capability = "abc=ESI/ 1.0"; } sub vcl_fetch { if (beresp.http.Surrogate-Control ~ "ESI/1.0") { unset beresp.http.Surrogate-Control; unset beresp.http.Cache-Control; set beresp.do_esi = true; } }
  • 100.
  • 101.
    Caching only worksfor “safe” HTTP methods (like GET & HEAD)
  • 102.
    Never change thestate of the server when serving a GET request (we are talking about the application’s state of course, you can log, cache, …)
  • 103.
  • 104.
    Pages with cookies arenot cached by default
  • 105.
  • 106.
  • 107.