Making ZOPE faster
●   Without Squid
●   Without CacheFu
●   Without Varnish
The Problem
                (my problem)
●   The website uses LinguaPlone
    (what is that?!?)
    ... It uses Cookies fo...
Apache + Dynamic Rewrite Map
RewriteMap rpx prg:/home/admin/rpx.py
RewriteRule ^(.*)$ ${rpx:%{HTTP_COOKIE}<>$1<>%{QUERY_ST...
The Dynamic Map Script

#!/usr/bin/python -u
import sys, os, time, urllib2, urllib, re

cacheroot = "/var/www/cache"
zoper...
The Real Dynamic Map Script
cookies, uri, qstring = request.split('<>')
lang = re.findall('I18N_LANGUAGE="([A_Za-z]+)"', c...
The Cache Feeder
if line.startswith("MISS "):
     filepath = line[5:].strip()
     uri, extra = filepath.split("/<>")
   ...
The Cache Itself
admin@cache:~/cache$ find -type f | head
./services/locations-and-contacts/.htaccess
./services/locations...
I swear the code is simple !

admin@cache:~$ wc -l rpx.py
74 rpx.py
Results




Watch to the lovely pictures !
In the unlikely event you want to know
      more about this really dirty hack ...
●   Jérôme Petazzoni
    <jerome.petazz...
Plone Conference 2008 Lightning Talk Static Zope Rpx
Plone Conference 2008 Lightning Talk Static Zope Rpx
Plone Conference 2008 Lightning Talk Static Zope Rpx
Plone Conference 2008 Lightning Talk Static Zope Rpx
Upcoming SlideShare
Loading in...5
×

Plone Conference 2008 Lightning Talk Static Zope Rpx

1,180

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,180
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Plone Conference 2008 Lightning Talk Static Zope Rpx

  1. 1. Making ZOPE faster ● Without Squid ● Without CacheFu ● Without Varnish
  2. 2. The Problem (my problem) ● The website uses LinguaPlone (what is that?!?) ... It uses Cookies for language selection ● Aaaaagh !
  3. 3. Apache + Dynamic Rewrite Map RewriteMap rpx prg:/home/admin/rpx.py RewriteRule ^(.*)$ ${rpx:%{HTTP_COOKIE}<>$1<>%{QUERY_STRING}} [P,L] RewriteMap rpx prg:/home/admin/rpx.py RewriteRule ^(.*)$ ${rpx:%{HTTP_COOKIE} <>$1 <>%{QUERY_STRING}} [P,L]
  4. 4. The Dynamic Map Script #!/usr/bin/python -u import sys, os, time, urllib2, urllib, re cacheroot = "/var/www/cache" zoperoot = "http://slowzope:10000/VirtualHostBas e/http/fastrewriter:80/VirtualHostRoot" logpath = "/home/admin/rpx.log"
  5. 5. The Real Dynamic Map Script cookies, uri, qstring = request.split('<>') lang = re.findall('I18N_LANGUAGE="([A_Za-z]+)"', cookies) lang = lang and lang[0] or '' locuri = uri + "/<>" + lang if qstring: log("PASS %sn"%locuri) sys.stdout.write(zoperoot+uri+"n") elif os.path.isfile(cacheroot + locuri): log("HIT %sn"%locuri) sys.stdout.write("http://faststatic/cache/%sn"%locuri) else: log("MISS %sn"%locuri) sys.stdout.write(zoperoot+uri+"n")
  6. 6. The Cache Feeder if line.startswith("MISS "): filepath = line[5:].strip() uri, extra = filepath.split("/<>") req = urllib2.Request(zoperoot+urllib.quote(uri), None, {'Cookie': 'I18N_LANGUAGE="%s"'%extra}) o = urllib2.urlopen(req) data = o.read() datadir = cacheroot + "/" + uri if not os.path.isdir(datadir):os.makedirs(datadir) f = open(datadir + "/.htaccess", "w") f.write("ForceType %sn"%o.info().type) f.close() f = open(cacheroot + "/" + filepath,"w") f.write(data) f.close() log("FETCH %s <> %sn"%(filepath,extra))
  7. 7. The Cache Itself admin@cache:~/cache$ find -type f | head ./services/locations-and-contacts/.htaccess ./services/locations-and-contacts/<> ./services/locations-and-contacts/<>fr ./services/locations-and-contacts/<>de ./capabilities-1/navigation-services-1/.htaccess ./capabilities-1/navigation-services-1/<> ./services/index_html/rss.gif/.htaccess ./services/index_html/rss.gif/<>fr
  8. 8. I swear the code is simple ! admin@cache:~$ wc -l rpx.py 74 rpx.py
  9. 9. Results Watch to the lovely pictures !
  10. 10. In the unlikely event you want to know more about this really dirty hack ... ● Jérôme Petazzoni <jerome.petazzoni@pilotsystems.net>
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×