How to Create a High-Speed Template Engine in Python

PyconMini JP 2011How to Create a High-SpeedTemplate Engine in PythonPythonmakoto kuwatahttp://www.kuwata-lab.com/

Proﬁle @makotokuwata http://www.kwuata-lab.com/ Ruby/PHP/Python programmer Creator of Erubis (*) Python4PHPer (*) default template engine on Rails 3

Python Products Tenjin : very fast temlate engine Kook : task utility like Ant/Rake Benchmarker : a good friend for performance Oktest : new-style testing library

Tenjin Very fast One ﬁle, 2000 lines Full-featured Python 3 support Google App Engine Release 1.0 coming soon! http://www.kuwta-lab.com/tenjin/

Benchmark Tenjin 2660.1 Mako 1426.4 Jinja2 1257.6 Templetor 903.0 Cheetah 562.3 Django 114.2 Genshi 55.7 Kid 34.6 0 600 1200 1800 2400 3000Python 2.5.5, MacOS X 10.6 (x86_64), 2GB pages/secTenjin 1.0.0, Mako 0.2.5, Jinja2 2.2.1, Templetor 0.32,Cheetah 2.2.2, Django 1.1.0, Genshi 0.5.1, Kid 0.9.6

Benchmarks forString Concatenation

append()

Benchmark pages/sec append() 0 200 400 600 800 1000

extend()

Benchmark pages/sec append() extend() 0 200 400 600 800 1000

StringIO

Benchmark pages/sec append() extend() StringIO 0 200 400 600 800 1000

Benchmark pages/sec append() extend() StringIO mmap 0 200 400 600 800 1000

Generator

Benchmark pages/sec append() extend() StringIO mmap generator 0 200 400 600 800 1000

Benchmark pages/sec append() extend() StringIO mmap generator slice[-1:] slice[99999:] 0 200 400 600 800 1000

Bound method

Benchmark pages/sec append() extend() StringIO mmap generator slice[-1:] slice[99999:]extend() (bound) 0 200 400 600 800 1000

SummaryFast bound method >= slice[] > extend()Slow Generator > append() > mmap > StringIO

Try Benchmark Script

Step by Step toTune-up Template Code

HTML Template

Python Code

Benchmark pages/sec append (singleline) 0 2000 4000 6000 8000 10000 12000

Multiple Line String Eliminates method call

Benchmark pages/sec append (singleline) append (multiline) 0 2000 4000 6000 8000 10000 12000

From append() to extend() Eliminates method call

Benchmark pages/sec append (singleline) append (multiline) extend (unbound) 0 2000 4000 6000 8000 10000 12000

Bound Method Eliminates fetch method

Benchmark pages/sec append (singleline) append (multiline) extend (unbound) extend (bound) 0 2000 4000 6000 8000 10000 12000

str() function Necessary in Python!

Benchmark pages/sec append (singleline) append (multiline) extend (unbound) extend (bound) extend + str 0 2000 4000 6000 8000 10000 12000

Local Variable Local var is faster than global/build-in var

Benchmark pages/sec append (singleline) append (multiline) extend (unbound) extend (bound) extend + str extend + _str=str 0 2000 4000 6000 8000 10000 12000

Format (% operator) Delete all str() call by % operator

Benchmark pages/sec append (singleline) append (multiline) extend (unbound) extend (bound) extend + str extend + _str=str append + format 0 2000 4000 6000 8000 10000 12000

None => Empty String Converts None to empty string

Benchmark pages/sec append (singleline) append (multiline) extend (unbound) extend (bound) extend + str extend + _str=str append + format extend + to_strextend + _to_str=to_str 0 2000 4000 6000 8000 10000 12000

Escape HTML

Benchmark pages/sec append (singleline) append (multiline) extend (unbound) extend (bound) extend + str extend + _str=str append + format extend + to_strextend + _to_str=to_str escape_html + str escape_html + to_str 0 2000 4000 6000 8000 10000 12000

C Extension Implemented in C webext: http://pypi.python.org/pypi/Webext/

Benchmark pages/sec append (singleline) append (multiline) extend (unbound) extend (bound) extend + str extend + _str=str append + format extend + to_str extend + _to_str=to_str escape_html + str escape_html + to_strwebext.escape_html, to_str webext.escape_html 0 2000 4000 6000 8000 10000 12000

Extreme join() Not escaped Be escaped if index % 2 == 0 if index % 2 == 1 (no need to call escape_html() !)

Benchmark Not implemeted yet...

SummaryString concatenation is not a bottleneck extend() & join() are enough fastBottleneck is str() and escape_html() join() should call str() internally C Extension (webext) is great

http://aodag.posterous.com	231
https://jujo00obo2o234ungd3t8qjfcjrs3o6k-a-sites-opensocial.googleusercontent.com	93
http://jujo00obo2o234ungd3t8qjfcjrs3o6k-a-sites-opensocial.googleusercontent.com	45
http://paper.li	13
http://www.techgig.com	11
http://thinkery.me	5
http://webcache.googleusercontent.com	3
http://twitter.com	3
http://a0.twimg.com	3
https://twimg0-a.akamaihd.net	3

How to Create a High-Speed Template Engine in Python

by kwatch on Jan 28, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

10 Embeds 410

Statistics

How to Create a High-Speed Template Engine in Python — Presentation Transcript