SlideShare a Scribd company logo
1 of 54
Optimizing big websites Talk Nerdy to Me December 8th, 2010 Andreas Creten
Hi, I’m Andreas
We are madewithlove, so are our products.
 
Big websites
 
 
Efficient? I don’t think so
wireframes back-end design support front-end hosting concept
Concept Realistic?
Wireframes Not to complex? How many information do we need to show?
Design Fast vs. fancy
Front-end Requests and Kb’s
Framework
Sprites
 
 
 
 
Compress,  merge, minify
 
 
336 Bytes 133 Bytes
Avoid external requests
Back-end Execution time
Less is more
Keep it simple
Caching Performing a lot of queries on a database server might overload it, especially when a lot of users are using the application. Server Can you give me an overview of all our clients? Yeah, sure! I’ll load them from the database. Pff, I’ll get me a coffee in meanwhile. Database Dude, calm down, I’m still getting the first one! Database, can you give me client 1? Database, can you give me client 2? Database, can you give me client 3? Database, can you give me client 4? Database, can you give me client 5? Database, can you give me client 6? It’s getting hot in here The database gets overloaded
Caching By storing the results from the database in a temporary in-memory cache we reduce the number of database request and decrease the page load time. Server Can you give me an overview of all our clients? Yeah, sure! I’ll check if I can remember them, otherwise I’ll load them from the database. Wow, I’ll have to call my secretary to bring some coffee. Database Database, can you give me client 4? Database, can you give me client 6? I’m bored Client 1 Client 2 Client 3 Client 5 Client 6 Client 4
Background workers When a user performs a server intensive action it might slow down the whole server. By executing the tasks in the background we off-load the server. Ex: the user request a zip file of all the photos he uploaded.
Background workers When a user performs a server intensive action it might slow down the whole server. By executing the tasks in the background we off-load the server. Server Can you send me all my photo’s in a zip archive? Yeah, sure! But it might take a while. Dude, this takes for hours! And the site is super slow now! I told you. I can’t do everything at once.
Background workers When a user performs a server intensive action it might slow down the whole server. By executing the tasks in the background we off-load the server. Server Can you send me all my photo’s in a zip archive? Yeah, sure! I’ll send it to a worker, come back in 10 mins. Hey, thanks, that was fast! Worker Ok, I’ll do it straight away I’m ready, that was an easy one!
Review your code
Hosting Scalability
Fine-tuning
Clusters When a user logs in, a session file is created on the server. This file us used as a temporary store. Ex: it enables us to keep a user logged in while browsing a site.
Cluster support The first time a user opens a site we store a session cookie containing his session id. When they navigate to the next page they send us the session id and we know which session to load. Server Session 3 Session 2 Session 1 I want to see my account page Cool, who are you? I’m that guy from Session 1 Ok, there you go!
Cluster support On a cluster the users are send to  servers based on the server load. Server Server Load balancer I want to see my account page Ok, you can do it. Hey, I’ve nothing to do!
Cluster support So their next request might  get handled by another server Server Server Load balancer I want to see the homepage page Ok, you can do it. Hey, I’ve nothing to do!
Cluster support Since the sessions are stored on the server, the second server doesn’t know about the user’s session. Server Server Load balancer I want to see my account page What’s your session id? Session 1 My session has id 1 Hmm, I don’t know about that session
Cluster support Since the sessions are stored on the server, the second server doesn’t know about the user’s session. Server Server Load balancer I want to see my account page Session 1 Hmm, I don’t know about that session The second server is not aware of the session on the first one
Cluster support We solve this problem by storing  the sessions into a central database. Database Server Server Load balancer I want to see my account page What’s your session id? My session has id 1 Let me check for that session in the database There you go Session 1
Hosted vs. Managed vs. Cloud vs. In-house
Reverse-proxy caching
3th party services
Team/company Picking the right people
wireframes back-end design support front-end hosting concept
Interns To do the impossible
 
 
 
 
Thanks. Any questions? [email_address]  - @andreascreten
 

More Related Content

Viewers also liked

Viewers also liked (7)

wp-cli and plugin development with future and past compatibility (Word Camp P...
wp-cli and plugin development with future and past compatibility (Word Camp P...wp-cli and plugin development with future and past compatibility (Word Camp P...
wp-cli and plugin development with future and past compatibility (Word Camp P...
 
Remote: How to actually do it!
Remote: How to actually do it!Remote: How to actually do it!
Remote: How to actually do it!
 
Data Portability - Fronteers Meetup
Data Portability - Fronteers MeetupData Portability - Fronteers Meetup
Data Portability - Fronteers Meetup
 
Entering Mentoring Part 1 Communication at CalTech
Entering Mentoring Part 1 Communication at CalTechEntering Mentoring Part 1 Communication at CalTech
Entering Mentoring Part 1 Communication at CalTech
 
Channel Bonding
Channel BondingChannel Bonding
Channel Bonding
 
[Dutch] Hoger Onderwijs 2.0
[Dutch] Hoger Onderwijs 2.0[Dutch] Hoger Onderwijs 2.0
[Dutch] Hoger Onderwijs 2.0
 
How to actually get software build
How to actually get software buildHow to actually get software build
How to actually get software build
 

Similar to Talk Nerdy to Me: Optimizing big websites

Scalable Architecture 101
Scalable Architecture 101Scalable Architecture 101
Scalable Architecture 101
Mike Willbanks
 
Synchronous Reads Asynchronous Writes RubyConf 2009
Synchronous Reads Asynchronous Writes RubyConf 2009Synchronous Reads Asynchronous Writes RubyConf 2009
Synchronous Reads Asynchronous Writes RubyConf 2009
pauldix
 
DNS_Tutorial 2.pptx
DNS_Tutorial 2.pptxDNS_Tutorial 2.pptx
DNS_Tutorial 2.pptx
viditsir
 
L hammonds adventure
L hammonds adventureL hammonds adventure
L hammonds adventure
Muhamad Fauzi
 
Scalable Web Architectures - Common Patterns & Approaches
Scalable Web Architectures - Common Patterns & ApproachesScalable Web Architectures - Common Patterns & Approaches
Scalable Web Architectures - Common Patterns & Approaches
Cal Henderson
 
Presentation3
Presentation3Presentation3
Presentation3
s1190105
 

Similar to Talk Nerdy to Me: Optimizing big websites (20)

lotus domino questions answers 2017
lotus domino questions answers 2017lotus domino questions answers 2017
lotus domino questions answers 2017
 
MNPHP Scalable Architecture 101 - Feb 3 2011
MNPHP Scalable Architecture 101 - Feb 3 2011MNPHP Scalable Architecture 101 - Feb 3 2011
MNPHP Scalable Architecture 101 - Feb 3 2011
 
Background processes and tasks in an async world
Background processes and tasks in an async worldBackground processes and tasks in an async world
Background processes and tasks in an async world
 
Guide 4 - How To Dramatically Speed Up Your Website Using A Caching Plugin.pdf
Guide 4 - How To Dramatically Speed Up Your Website Using A Caching Plugin.pdfGuide 4 - How To Dramatically Speed Up Your Website Using A Caching Plugin.pdf
Guide 4 - How To Dramatically Speed Up Your Website Using A Caching Plugin.pdf
 
Scalable Architecture 101
Scalable Architecture 101Scalable Architecture 101
Scalable Architecture 101
 
Synchronous Reads Asynchronous Writes RubyConf 2009
Synchronous Reads Asynchronous Writes RubyConf 2009Synchronous Reads Asynchronous Writes RubyConf 2009
Synchronous Reads Asynchronous Writes RubyConf 2009
 
DNS_Tutorial 2.pptx
DNS_Tutorial 2.pptxDNS_Tutorial 2.pptx
DNS_Tutorial 2.pptx
 
HTTP cache @ PUG Rome 03-29-2011
HTTP cache @ PUG Rome 03-29-2011HTTP cache @ PUG Rome 03-29-2011
HTTP cache @ PUG Rome 03-29-2011
 
Expecto Performa! The Magic and Reality of Performance Tuning
Expecto Performa! The Magic and Reality of Performance TuningExpecto Performa! The Magic and Reality of Performance Tuning
Expecto Performa! The Magic and Reality of Performance Tuning
 
Developing a Globally Distributed Purging System
Developing a Globally Distributed Purging SystemDeveloping a Globally Distributed Purging System
Developing a Globally Distributed Purging System
 
Wordpress optimization
Wordpress optimizationWordpress optimization
Wordpress optimization
 
Dealing with Enterprise Level Data
Dealing with Enterprise Level DataDealing with Enterprise Level Data
Dealing with Enterprise Level Data
 
Intro to advanced web development
Intro to advanced web developmentIntro to advanced web development
Intro to advanced web development
 
I Can Haz More Performanz?
I Can Haz More Performanz?I Can Haz More Performanz?
I Can Haz More Performanz?
 
Tips to improve your website performance
Tips to improve your website performanceTips to improve your website performance
Tips to improve your website performance
 
L hammonds adventure
L hammonds adventureL hammonds adventure
L hammonds adventure
 
Scalable Web Arch
Scalable Web ArchScalable Web Arch
Scalable Web Arch
 
Scalable Web Architectures - Common Patterns & Approaches
Scalable Web Architectures - Common Patterns & ApproachesScalable Web Architectures - Common Patterns & Approaches
Scalable Web Architectures - Common Patterns & Approaches
 
Presentation3
Presentation3Presentation3
Presentation3
 
Apache Traffic Server
Apache Traffic ServerApache Traffic Server
Apache Traffic Server
 

Recently uploaded

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Recently uploaded (20)

A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 

Talk Nerdy to Me: Optimizing big websites

  • 1. Optimizing big websites Talk Nerdy to Me December 8th, 2010 Andreas Creten
  • 3. We are madewithlove, so are our products.
  • 4.  
  • 6.  
  • 7.  
  • 9. wireframes back-end design support front-end hosting concept
  • 11. Wireframes Not to complex? How many information do we need to show?
  • 16.  
  • 17.  
  • 18.  
  • 19.  
  • 21.  
  • 22.  
  • 23. 336 Bytes 133 Bytes
  • 28. Caching Performing a lot of queries on a database server might overload it, especially when a lot of users are using the application. Server Can you give me an overview of all our clients? Yeah, sure! I’ll load them from the database. Pff, I’ll get me a coffee in meanwhile. Database Dude, calm down, I’m still getting the first one! Database, can you give me client 1? Database, can you give me client 2? Database, can you give me client 3? Database, can you give me client 4? Database, can you give me client 5? Database, can you give me client 6? It’s getting hot in here The database gets overloaded
  • 29. Caching By storing the results from the database in a temporary in-memory cache we reduce the number of database request and decrease the page load time. Server Can you give me an overview of all our clients? Yeah, sure! I’ll check if I can remember them, otherwise I’ll load them from the database. Wow, I’ll have to call my secretary to bring some coffee. Database Database, can you give me client 4? Database, can you give me client 6? I’m bored Client 1 Client 2 Client 3 Client 5 Client 6 Client 4
  • 30. Background workers When a user performs a server intensive action it might slow down the whole server. By executing the tasks in the background we off-load the server. Ex: the user request a zip file of all the photos he uploaded.
  • 31. Background workers When a user performs a server intensive action it might slow down the whole server. By executing the tasks in the background we off-load the server. Server Can you send me all my photo’s in a zip archive? Yeah, sure! But it might take a while. Dude, this takes for hours! And the site is super slow now! I told you. I can’t do everything at once.
  • 32. Background workers When a user performs a server intensive action it might slow down the whole server. By executing the tasks in the background we off-load the server. Server Can you send me all my photo’s in a zip archive? Yeah, sure! I’ll send it to a worker, come back in 10 mins. Hey, thanks, that was fast! Worker Ok, I’ll do it straight away I’m ready, that was an easy one!
  • 36. Clusters When a user logs in, a session file is created on the server. This file us used as a temporary store. Ex: it enables us to keep a user logged in while browsing a site.
  • 37. Cluster support The first time a user opens a site we store a session cookie containing his session id. When they navigate to the next page they send us the session id and we know which session to load. Server Session 3 Session 2 Session 1 I want to see my account page Cool, who are you? I’m that guy from Session 1 Ok, there you go!
  • 38. Cluster support On a cluster the users are send to servers based on the server load. Server Server Load balancer I want to see my account page Ok, you can do it. Hey, I’ve nothing to do!
  • 39. Cluster support So their next request might get handled by another server Server Server Load balancer I want to see the homepage page Ok, you can do it. Hey, I’ve nothing to do!
  • 40. Cluster support Since the sessions are stored on the server, the second server doesn’t know about the user’s session. Server Server Load balancer I want to see my account page What’s your session id? Session 1 My session has id 1 Hmm, I don’t know about that session
  • 41. Cluster support Since the sessions are stored on the server, the second server doesn’t know about the user’s session. Server Server Load balancer I want to see my account page Session 1 Hmm, I don’t know about that session The second server is not aware of the session on the first one
  • 42. Cluster support We solve this problem by storing the sessions into a central database. Database Server Server Load balancer I want to see my account page What’s your session id? My session has id 1 Let me check for that session in the database There you go Session 1
  • 43. Hosted vs. Managed vs. Cloud vs. In-house
  • 46. Team/company Picking the right people
  • 47. wireframes back-end design support front-end hosting concept
  • 48. Interns To do the impossible
  • 49.  
  • 50.  
  • 51.  
  • 52.  
  • 53. Thanks. Any questions? [email_address] - @andreascreten
  • 54.