Varnish more than a cache

1

Varnish
–
More
than
a
cache

Bernd Löffeld
Head of Platform Development
Magic Internet GmbH
Email: Bernd.Loeffeld@magicinternet.de
Magic Internet entwickelt und betreut
www.myvideo.de
Deutschlands großes Videoportal!

Varnish
Features

2

o  Caching

o  Loadbalancing
and
Backend-‐Selec3on

o  Header
analysis
and
manipula3on

o  DSL
for
handling
all
that

o  Edge
Side
Includes

Varnish
Conﬁgura5on
Language
in
example

4

sub vcl_recv {!
if (req.restarts == 0) {!
if (req.http.x-forwarded-for) {!
set req.http.X-Forwarded-For =!
req.http.X-Forwarded-For + ", " + client.ip;!
} else {!
set req.http.X-Forwarded-For = client.ip;!
}!
}!
if (req.request != "GET" &&!
req.request != "HEAD" &&!
req.request != "PUT" &&!
req.request != "POST" &&!
req.request != "TRACE" &&!
req.request != "OPTIONS" &&!
req.request != "DELETE") {!
return (pipe);!
}!
if (req.request != "GET" && req.request != "HEAD") {!
/* We only deal with GET and HEAD by default */!
return (pass);!
}!
if (req.http.Authorization || req.http.Cookie) {!
return (pass);!
}!
return (lookup);!
}!

The
Setup
–
A
vision
by
now

5

Start:
Just
a
simple
Web
Applica5on

6

Start:
Just
a
simple
Web
Applica5on

7

Step
1:
Ac5vate
the
cache

8

Step
1:
Ac5vate
the
cache

9

include "bwb/backends.vcl“;
Varnish à /etc/varnish/main.vcl
backend default {
.host = "nginx-1";
.port = "80";
}
Varnish à /etc/varnish/bwb/backends.vcl
server {
expires 1m;
}
nginx-1 à /etc/nginx/sites-available/bwb

Step
1:
Ac5vate
the
cache

10

Step
2:
Introduce
new
Backend

11

Step
2:
Introduce
new
Backend

12

include "bwb/backends.vcl";
sub vcl_recv {
if (req.url ~ "/fancy/") {
set req.backend = fancy;
}
}
backend default {
.host = "nginx-1";
.port = "80";
}
backend fancy {
.host = "nginx-2";
.port = "80";
}
Varnish à /etc/varnish/bwb/backends.vcl

Step
2:
Introduce
new
Backend

13

<html>
<head>
<title>Legacy Web Application</title>
<link href="/fancy/css/default.css" rel="stylesheet"
type="text/css" media="all" />
</head>
...
nginx-1 à /srv/www/bwb/page1.html

Step
2:
Introduce
new
Backend

14

Step
2:
Introduce
new
Backend

15

Step
3:
Connect
the
Applica5ons
with
ESI

16

Step
3:
Connect
the
Applica5ons
with
ESI

17

<body>

<esi:include src="/fancy/nav/navigation.html" />
<h1>Just a robust and experienced application</h1>
<div>Page 1 is mostly empty.</div>
<esi:include src="/fancy/news/abox.html" />
</body>
nginx-1 à /srv/www/bwb/page1.html
sub vcl_recv {
if (req.url ~ "/fancy/") { set req.backend = fancy; }
}
sub vcl_fetch {
set beresp.do_esi = true;
}

Step
3:
Connect
the
Applica5ons
with
ESI

18

<div class="container newsbox">
<h1>News</h1>
<div>really hot new stuff to read</div>
</div>
nginx-2 à /srv/www/bwb-fancy/fancy/news/abox.html
server {
...
location /fancy/news/ {
expires 10s;
}
}
nginx-2 à /etc/nginx/sites-available/bwb-fancy

Step
3:
Connect
the
Applica5ons
with
ESI

19

Step
3:
Connect
the
Applica5ons
with
ESI

20

Step
4:
Simple
balancing
between
two
backends

21

Step
4:
Simple
balancing
between
two
backends

22

backend default { … }
backend fancy_1 {
.host = "nginx-2";
.port = "80";
}
backend fancy_2 {
.host = "nginx-3";
.port = "80";
}
varnish à /etc/varnish/bwb/backends.vcl
director fancy_round round-robin {
{
.backend = fancy_1;
}
{
.backend = fancy_2;
}
}
Varnish à /etc/varnish/bwb/director.vcl

Step
4:
Simple
balancing
between
two
backends

23

include "bwb/director.vcl";
sub vcl_recv {
if(req.url ~ "/fancy/") {
set req.backend = fancy_round;
}
}
varnish à /etc/varnish/main.vcl

Step
4:
Simple
balancing
between
two
backends

24

192.168.56.5 - -
[28/Sep/2013:19:51:57 +0200]
"GET /fancy/news/abox.html
HTTP/1.1" 200 100 “
192.168.56.5 - -
[28/Sep/2013:19:52:28 +0200]
HTTP/1.1" 200 100 “
192.168.56.5 - -
[28/Sep/2013:19:52:51 +0200]
HTTP/1.1" 200 100 “
192.168.56.5 - -
[28/Sep/2013:19:53:17 +0200]
HTTP/1.1" 200 100
access-log nginx-1
192.168.56.5 - -
[28/Sep/2013:19:52:14 +0200]
HTTP/1.1" 200 100 “
192.168.56.5 - -
[28/Sep/2013:19:52:39 +0200]
HTTP/1.1" 200 100 “
192.168.56.5 - -
[28/Sep/2013:19:53:05 +0200]
HTTP/1.1" 200 100 “
192.168.56.5 - -
[28/Sep/2013:19:53:31 +0200]
HTTP/1.1" 200 100
access-log nginx-2

Want
to
know
more?

25

Bernd.Loeﬀeld@magicinternet.de

hCp://www.myvideo.de/karriere

Work
with
us!

o  Architect

o  Developer

o  Sysadmin

Varnish more than a cache

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Varnish more than a cache

Similar to Varnish more than a cache (20)

Recently uploaded

Recently uploaded (20)

Varnish more than a cache