Downloaded 23 times
Uploaded byWim Godden
When dynamic becomes static : the next step in web caching techniques
The document discusses advancements in web caching techniques, specifically using ESI (Edge Side Includes) with Nginx to efficiently manage dynamic content. It highlights the benefits of reduced web and database server loads through caching and reverse proxy setups while providing examples and code snippets. The presenter, Wim Godden, emphasizes the transition from traditional caching methods to more modern approaches in a PHP environment, ultimately leading to improved performance and significant cost savings.
More Related Content
Similar to When dynamic becomes static : the next step in web caching techniques
When dynamic becomes static : the next step in web caching techniques
- 1. When dynamic becomesstatic – the next step in web caching techniques Wim Godden Cu.be Solutions
- 2. Disclaimer The next step Asin : what you will be doing in the future Not as in : go home and run it ;-) Language of choice : PHP But : think Perl, Python, Ruby, Java, .Net, …
- 3. Who am I? Wim Godden (@wimgtr)
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
- 12. Belgium – thetraffic
- 13. Who am I? Wim Godden (@wimgtr) Founder of Cu.be Solutions (http://cu.be) Open Source developer since 1997 Developer of OpenX, PHPCompatibility, ... Speaker at PHP and Open Source conferences
- 14. Who are you? Developers ? System/network engineers ? Managers ?
- 15. To understand thepresent Understand the past
- 16. The Stone Age Newblog post by : caveman003
- 17. Pre-PHP : drawit and make html
- 18.
- 19. Old-school PHP :'rebuild-every-time'
- 20.
- 21. PHP : let'scache
- 22.
- 23. PHP : dynamiccontent in static content
- 24.
- 25. PHP : multiplewebservers
- 26. PHP : pushupdates to cache
- 27.
- 28. Adding reverse proxycaching
- 29. Website with ESI Articlecontent page Page content Header Latest news Navigation
- 30. Website with ESI Articlecontent page Page content Top header (TTL = 2h) Latest news Navigation (TTL = 1h)
- 31. Website with ESI Articlecontent page Page content (TTL = 30m) Top header (TTL = 2h) Latest news (TTL = 2m) Navigation (TTL = 1h)
- 32. ESI – howit works GET /pageGET /page
- 33. ESI – howit works <html> ... <esi:include src="/top"/> <esi:include src="/nav"/> <div id=”something”> <esi:include src="/latest-news"/> </div> <esi:include src="/article/id/732"/> ... </html> GET /pageGET /page
- 34. ESI – howit works <div id=”top-part”> <a href=”/login”>Login</a> </div> GET /top
- 35. ESI – howit works <html> ... <esi:include src="/top"/> <esi:include src="/nav"/> <div id=”something”> <esi:include src="/latest-news"/> </div> <esi:include src="/article/id/732"/> ... </html> GET /pageGET /page
- 36. ESI – howit works <html> ... <div id=”top-part”> <a href=”/login”>Login</a> </div> <esi:include src="/nav"/> <div id=”something”> <esi:include src="/latest-news"/> </div> <esi:include src="/article/id/732"/> ... </html> GET /pageGET /page
- 37. Going to /page/id/732 <html> <esi:includesrc="/top"/> <esi:include src="/nav"/> <div id="something"> <esi:include src="/latest-news"/> </div> <esi:include src="/article/id/732"/> </html>
- 38. Article content page <esi:includesrc="/article/732"/> Varnish - ESI <esi:include src="/top"/> <esi:include src="/news"/> <esi:include src="/nav"/>
- 39. Varnish - whatcan/can't be cached ? Can : Static pages Images, js, css Static parts of pages that don't change often (ESI) Can't : POST requests Very large files (it's not a file server !) Requests with Set-Cookie User-specific content
- 40. ESI → nocaching on user-specific content ? Logged in as : Wim Godden 5 messages TTL = 5minTTL=1h TTL = 0s ?
- 41. Nginx Web server Reverse proxy Lightweight,fast 13.46% of all Websites
- 42. Nginx No threads, event-driven Usesepoll / kqueue Low memory footprint 10000 active connections = normal
- 43. ESI on Nginx Loggedin as : Wim Godden 5 messages NEWSMenu
- 44. ESI SLIC onNginx <slic:include key="news" src="/news" /> <slic:include key="menu" src="/menu" /> <slic:include key="top" src="/top" session="true" />
- 45. Requesting /page (1st time) Nginx Sharedmemory 1 2 3 4 /page /page
- 46. Requesting /page SLICsubrequests (1st time) Nginx 1 2 3 /menu /news /top (in SLIC session)
- 47. Requesting /page (nexttime) Nginx Shared memory 1 2 /page /menu /news /top (in SLIC session) /page
- 48. New message issent... POST /send DB insert into... set(...) top (in SLIC session)
- 49. Advantages No repeated GEThits to webserver anymore ! At login : POST → warm up the cache ! No repeated hits for user-specific content Not even for non-specific content
- 50. News added addnews() method DB insertinto... set(...) Memcache key /news
- 51. Advantages No repeated GEThits to webserver anymore ! At login : POST → warm up the cache ! No repeated hits for user-specific content Not even for non-specific content No TTLs for non-specific content
- 52. How many Memcachedrequests ? Logged in as : Wim Godden 5 messages <slic:include key="news" src="/news" /> <slic:include key="menu" src="/menu" /> <slic:include key="top" src="/top" session="true" />
- 53. First release :ESI Part of the ESI 1.0 spec Only relevant features implemented Extension for dynamic session support But : unavailable for copyright reasons
- 54. Rebuilt from scratch: SLIC Control structures : if/else, switch/case, foreach Variable handling Strings : concatenation, substring, … Exception handling, header manipulation, … JSON support !
- 55. SLIC code samples Youare logged in as : <slic:session_var("person_name") /> You are logged in as : <@s("person_name") />
- 56. SLIC code samples <slic:switchvar="session_var('isAdmin')"> <slic:case value="1"> <slic:include key="admin-buttons" src="/admin-buttons.php" /> </slic:case> <slic:default> <div id="just-a-user"> <slic:include key="user-buttons" src="/user-buttons.php" /> </div> </slic:default> </slic:switch>
- 57. SLIC code samples <slic:foreachitem="messageId" src="global_var('thread' + query_var('threadId'))"> <slic:include key="'thread-message_' + messageId" src="'/thread/message.php?id=' + messageId" /> </slic:foreach>
- 58. Approaches – fullblock <p id=”LoggedInAs”> You are logged in as : <slic:session_var("person_name") /> </p> <p id=”MessageCount”> You have 5 messages </p> Logged in as : Wim Godden 5 messages <slic:include key="top" src="/top" session="true" />
- 59. Approaches – individualvariables <p id=”LoggedInAs”> You are logged in as : <slic:session_var("person_name") /> </p> <p id=”MessageCount”> You have <slic:session_var(“messages”) /> messages </p> Logged in as : Wim Godden 5 messages <slic:include key="top" src="/top" session="true" />
- 60. Approaches – JSON <pid=”LoggedInAs”> You are logged in as : <slic:session_var("userData").person_name /> </p> <p id=”MessageCount”> You have <slic:session_var(“userData”).message_count /> messages </p> Logged in as : Wim Godden 5 messages <slic:include key="top" src="/top" session="true" />
- 61. Identifying the user InNginx configuration : slic_session_cookie <name> → Defined by language (or configurable) slic_session_identifier <string> → Defined by you Example for PHP : slic_session_cookie PHPSESSID slic_session_identifier UID
- 62. Identifying the user Nginx+ SLIC Cookie : PHPSESSID = jpsidc1po35sq9q3og4f3hi6e2 get UID_jpsidc1po35sq9q3og4f3hi6e2432
- 63. Retrieving user specificcontent Nginx + SLIC Cookie : PHPSESSID = jpsidc1po35sq9q3og4f3hi6e2 get userData_432
- 64. Why Nginx ? NativeMemcached support Excellent and superfast subrequest system Including parallel subrequests Handles thousands of connections per worker With minimal memory footprint Integrates with php-fpm Additional features (chroot, slow request log, offline processing, ...) Graceful rolling upgrades
- 65.
- 66. Figures 2nd customer : No. ofweb servers : 72 → 8 No. of db servers : 15 → 4 Total : 87 → 12 (86% reduction !) Last customer : No. of total servers : +/- 1350 Expected reduction : 1350 → 380 Expected savings : €1.5 Million per year
- 67. Why is itso much faster ?
- 68. A real example: vBulletin
- 69. A real example: vBulletin Post isModerator session variable isAdmin session variable
- 70. A real example: vBulletin DB Server Load Web Server Load Max Requests/sec (1 = 282) 0 5 10 15 20 25 30 35 Standard install With Memcached Nginx + SCL + memcached
- 71. Code changes Required Template conversion Push-to-DB→ Push-to-DB + Push-to-Cache Choice : If user is logged in → push updates to cache If user is not logged in → warm up cache on login
- 72. Availability Good news : Itwill become Open Source It's solid : ESI version stable at 4 customers PHP version (currently for dev, later for docs and learning) Bad news : First customer holds copyrights Total rebuild → Open Source release No current projects, so spare time Anyone feel like sponsoring ? Beta : Aug 14 (?) Stable : Oct 14 (?) - on Github
- 73.
- 74.
- 75.
- 76. Contact Twitter @wimgtr Web http://techblog.wimgodden.be Slideshttp://www.slideshare.net/wimg E-mail wim.godden@cu.be