SlideShare a Scribd company logo
1 of 56
Download to read offline
Answers to the Scaling Challenge: A Case Study with Answers.com on Scaling with Memcached and MySQL,[object Object],Presenters:,[object Object],	Dan Marriott, Director - Production Operations, Answers.com,[object Object],	Joaquín Ruiz, EVP Products, Gear6,[object Object]
Answers to the Scaling Challenge:,[object Object],A Case Study With Answers.com on Scaling With Memcached and MySQL,[object Object],April 14, 2010,[object Object],Dan MarriottDirector - Production Operationsdanm@answers.com,[object Object]
Overview,[object Object],The world’s leading Q&A site,[object Object],3,[object Object]
Overview,[object Object],Answers.com,[object Object],[object Object]
Users can ask anything and automatically receive the best available answer.
WikiAnswersCommunity generated social knowledge Q&A platform, leveraging wiki-based technologies - answers improve over time.,[object Object],[object Object],Content on millions of topics from over 250 licensed dictionaries and encyclopedias from leading publishers.,[object Object],4,[object Object]
Answers.com Sites,[object Object],Rank in top Web properties,[object Object],[object Object]
#31worldwide (02/2010)(1)Unique monthly visitors,[object Object],[object Object]
72 million worldwide (02/2010)(1)WikiAnswers domain fastest growing in U.S.:,[object Object],[object Object]
2008 unique visitors grew 154%(#1 of top 200 Web domains) (1)
2009 unique visitors grew 74% (#2 of top 50 Web domains) (1)5,[object Object],(1) Source: comScore – Hybrid Measurement Methodology (U.S. only) beginning August 2009,[object Object]
Answers.com Sites,[object Object],6,[object Object],50MM Unique Monthly U.S. Visitors = #18,[object Object],Feb 2010,[object Object],Source: comScore – Hybrid Measurement Methodology  for Answers sites beginning August 2009,[object Object]
ReferenceAnswers,[object Object],7,[object Object]
WikiAnswers: Q&A the Wiki Way,[object Object],8,[object Object]
Some key infrastructure elements,[object Object],2 Data Centers – Active/Active,[object Object],HP Blade Servers (BL460) and 2U Servers (DL380),[object Object],Fusion-io SSDs in all large MySQL DB servers,[object Object],VMware,[object Object],HP/LeftHand SAN,[object Object],Hardware Load-Balancers,[object Object],9,[object Object]
Software,[object Object],10,[object Object],Linux – mainly CentOS 5.x/64bit,[object Object],Apache/JBOSS,[object Object],Lucene / Solr,[object Object],Memcached,[object Object],MySQL 5.0.x,[object Object],Apache-Tomcat,[object Object],Memcached,[object Object],MySQL 5.0.x,[object Object]
Secret to Web 2.0,[object Object],Everything runs from memory in Web 2.0.,[object Object],Evan Weaver – Twitter,[object Object],11,[object Object]
Questions: How do I Scale????,[object Object],Four answers to the scaling challenge from Answers.com:,[object Object],Use Enterprise-grade PCI-SSDs in your MySQL servers,[object Object],Enhance Memcached tier,[object Object],Controlling DB Slave server clusters,[object Object],Hardware Load-Balancers,[object Object],12,[object Object]
Scaling Answer #1,[object Object],Use Enterprise-grade SSDs in your MySQL servers,[object Object],13,[object Object]
Using SSDs in your MySQL servers,[object Object],If you have a large DB read clusters,[object Object],Can improve DB server queries/sec by 900%,[object Object],[object Object],Can improve overall app speed,[object Object],Use PCI-based SSDs,[object Object],[object Object],Give yourself at least 50% headroom ,[object Object],[object Object],14,[object Object]
Quick plug  :-),[object Object],Panel:,[object Object],How Solid-state Technologies are ,[object Object],Transforming MySQL Server Performance,[object Object], and the Datacenter Architectures,[object Object],Sumeet Bansal (Fusion-io),[object Object],Ryan White (Cloudmark),[object Object],Dan Marriott (Answers.com),[object Object],Vadim Tkachenko (Percona Inc),[object Object],Jeremy Zawodny (craigslist.org) ,[object Object],Weds 5:15pm - Ballroom D,[object Object],15,[object Object]
Scaling Answer #2,[object Object],Enhance Memcached tier,[object Object],16,[object Object]
Memcached tier - before,[object Object],10 x 16/32GB RAM Memcached Servers per Data Center,[object Object],Divided into several clusters,[object Object],Striped instances across each cluster,[object Object],10’s millions items/instance,[object Object],17,[object Object]
Memcached tier – Challenges,[object Object],No redundancy	,[object Object],Lose 25% of cache (or worse) on any server failure,[object Object],Loss of cache = poor performance/user experience,[object Object],Costly (OpEx: Rackspace, power, cooling, maint, admin),[object Object],18,[object Object]
Cache data critical to performance,[object Object],10’s of millions of pages,[object Object],Pages are dynamic – always publishing,[object Object],Unify data on same topic from different data sources onto one page,[object Object],19,[object Object]
Multiple entries/page,[object Object],[Illustrate mult. data entries/page],[object Object],20,[object Object]
21,[object Object]
22,[object Object]
Cache data critical to performance,[object Object],Multiple data sources (entries) per page,[object Object],Each entry can have multiple links to other entries,[object Object],Cache metadata:,[object Object],[object Object]
Internal links for each entry23,[object Object]
Lose memcached node?,[object Object],Lose 25% cached data (or more),[object Object],2-20 addit. MySQL queries to retrieve metadata and data needed to construct page,[object Object],Heavy load on MySQL Servers,[object Object],Longer page load times,[object Object],Site slows down,[object Object],24,[object Object]
Original plan to solve memcached weakness,[object Object],Engineering team to develop memcached wrapper,[object Object],Mirrored memcached server clusters (2x hardware),[object Object],6 man-months to develop:,[object Object],[object Object]
Handle node failure
Handle cache data restore when node becomes available againAlso: Address memcached slab issues,[object Object],25,[object Object]
Alternative solution – Gear6,[object Object],Built-in redundancy function (pair of boxes),[object Object],Mirroring (writes *everything* to both nodes),[object Object],200GB Memcached space per box (RAM+SSD),[object Object],Uses standard VIP mechanism,[object Object],Graceful failover (no impact),[object Object],Automatic cache-sync on node recovery,[object Object],Auto fail-back and rebalance VIP,[object Object],No code changes necessary,[object Object],26,[object Object]
Gear6 GUI config example,[object Object],27,[object Object]
Testing,[object Object],Same blisteringly fast memcached performance ,[object Object],[object Object],Tried to break it,[object Object],[object Object],Try software upgrade,[object Object],[object Object],Discovered vastly improved slab management,[object Object],[object Object],Scalable,[object Object],[object Object],28,[object Object]
Value-add with Gear6 memcached,[object Object],Improve app reliability,[object Object],Ensure no SPOF at memcached layer,[object Object],Scale up our database infrastructure safely,[object Object],Significantly reduce TCO by decommissioning 20 servers,[object Object],Save 6 man-months of custom memcached wrapper development,[object Object],29,[object Object]
Gear6 Value-add                          …cont’d,[object Object],Insight into memcached performance,[object Object],GUI helped us troubleshoot app issues,[object Object],First class support (even at 4:00am!),[object Object],New in v3.0: Ability to dynamically resize memcached instances with no cache loss!!,[object Object],30,[object Object]
Scaling Answer #3,[object Object],Controlling DB Slave server clusters,[object Object],31,[object Object]
Controlling DB Slave server clusters,[object Object],Maint. required sending command to Load Balancer to disable slave node in cluster,[object Object],On DB node failure, lost ‘000s queries before monitoring noticed and issued LB command,[object Object],----------,[object Object],Solution: Install lighty (lighttpd) on every DB server,[object Object],32,[object Object]
Using Lighty to Control DB Slave clusters,[object Object],Config lighty to make lightweight “healthcheck” call to local DB (SHOW STATUS LIKE 'Threads_running'),[object Object],Can set maint. flag on any DB server,[object Object],Have LB monitor make http call to lighty (http://servername:3300/dbcheck?p=3309),[object Object],[object Object],33,[object Object]
Lighty DB health-check,[object Object],34,[object Object]
Lighty script logic,[object Object],if maint_flag = TRUE,[object Object],		return “red”,[object Object],elseif dbcall not good,[object Object],		return “red”,[object Object],else,[object Object],		return “green”,[object Object],end,[object Object],35,[object Object]
Scaling Answer #4,[object Object],HW Load Balancers,[object Object],36,[object Object]
Hardware Load Balancers,[object Object],Avoid making firewall your bottleneck,[object Object],Immense flexibility [CLI, stats, ecv],[object Object],Quick reconfigs, adds/changes/deletes,[object Object],Highly secure,[object Object],Caching, Compression, GSLB, throttle for safety,[object Object],37,[object Object]
Which Hardware Load Balancers?,[object Object],Citrix & F5,[object Object],[object Object]
Amazing performance
Supremely flexible
Advanced GSLB
ExpensiveA10 Networks,[object Object],[object Object]
Great performance
Decent feature set
Cost-effective (certainly for internal load-balancing)38,[object Object]
39,[object Object],Thank you.,[object Object],Slides: http://tinyurl.com/mysqlconf2010-scaling-tips,[object Object]
Gear6: 	Perspectives on the scaling challenge,[object Object]

More Related Content

What's hot

Java MySQL Connector & Connection Pool Features & Optimization
Java MySQL Connector & Connection Pool Features & OptimizationJava MySQL Connector & Connection Pool Features & Optimization
Java MySQL Connector & Connection Pool Features & OptimizationKenny Gryp
 
Webinar slides: Introducing Galera 3.0 - Now supporting MySQL 5.6
Webinar slides: Introducing Galera 3.0 - Now supporting MySQL 5.6Webinar slides: Introducing Galera 3.0 - Now supporting MySQL 5.6
Webinar slides: Introducing Galera 3.0 - Now supporting MySQL 5.6Severalnines
 
Active mq Installation and Master Slave setup
Active mq Installation and Master Slave setupActive mq Installation and Master Slave setup
Active mq Installation and Master Slave setupRamakrishna Narkedamilli
 
Docker Java App with MariaDB – Deployment in Less than a Minute
Docker Java App with MariaDB – Deployment in Less than a MinuteDocker Java App with MariaDB – Deployment in Less than a Minute
Docker Java App with MariaDB – Deployment in Less than a Minutedchq
 
How to optimize your Magento store
How to optimize your Magento store How to optimize your Magento store
How to optimize your Magento store Rasbor.com
 
Make Your Site SpEEdy
Make Your Site SpEEdyMake Your Site SpEEdy
Make Your Site SpEEdyRuthie BenDor
 
Was liberty at scale
Was liberty at scaleWas liberty at scale
Was liberty at scalesflynn073
 
Repair & Recovery for your MySQL, MariaDB & MongoDB / TokuMX Clusters - Webin...
Repair & Recovery for your MySQL, MariaDB & MongoDB / TokuMX Clusters - Webin...Repair & Recovery for your MySQL, MariaDB & MongoDB / TokuMX Clusters - Webin...
Repair & Recovery for your MySQL, MariaDB & MongoDB / TokuMX Clusters - Webin...Severalnines
 
Windows server 2016 storage step by step complete lab
Windows server 2016 storage step by step complete labWindows server 2016 storage step by step complete lab
Windows server 2016 storage step by step complete labAhmed Abdelwahed
 
Messaging With ActiveMQ
Messaging With ActiveMQMessaging With ActiveMQ
Messaging With ActiveMQBruce Snyder
 
Java troubleshooting thread dump
Java troubleshooting thread dumpJava troubleshooting thread dump
Java troubleshooting thread dumpejlp12
 
Galera cluster for MySQL - Introduction Slides
Galera cluster for MySQL - Introduction SlidesGalera cluster for MySQL - Introduction Slides
Galera cluster for MySQL - Introduction SlidesSeveralnines
 
Changes in WebLogic 12.1.3 Every Administrator Must Know
Changes in WebLogic 12.1.3 Every Administrator Must KnowChanges in WebLogic 12.1.3 Every Administrator Must Know
Changes in WebLogic 12.1.3 Every Administrator Must KnowBruno Borges
 
10135 a 07
10135 a 0710135 a 07
10135 a 07Bố Su
 
Using and Benchmarking Galera in different architectures (PLUK 2012)
Using and Benchmarking Galera in different architectures (PLUK 2012)Using and Benchmarking Galera in different architectures (PLUK 2012)
Using and Benchmarking Galera in different architectures (PLUK 2012)Henrik Ingo
 
Inform2015 - What's New in Domino 9 & 9.0.1 for Admins
Inform2015 - What's New in Domino 9 & 9.0.1 for AdminsInform2015 - What's New in Domino 9 & 9.0.1 for Admins
Inform2015 - What's New in Domino 9 & 9.0.1 for AdminsJared Roberts
 
NTC 324 Enhance teaching - snaptutorial.com
NTC 324  Enhance teaching - snaptutorial.comNTC 324  Enhance teaching - snaptutorial.com
NTC 324 Enhance teaching - snaptutorial.comDavisMurphyA65
 
Securing Your MongoDB Deployment
Securing Your MongoDB DeploymentSecuring Your MongoDB Deployment
Securing Your MongoDB DeploymentMongoDB
 

What's hot (20)

Java MySQL Connector & Connection Pool Features & Optimization
Java MySQL Connector & Connection Pool Features & OptimizationJava MySQL Connector & Connection Pool Features & Optimization
Java MySQL Connector & Connection Pool Features & Optimization
 
Webinar slides: Introducing Galera 3.0 - Now supporting MySQL 5.6
Webinar slides: Introducing Galera 3.0 - Now supporting MySQL 5.6Webinar slides: Introducing Galera 3.0 - Now supporting MySQL 5.6
Webinar slides: Introducing Galera 3.0 - Now supporting MySQL 5.6
 
Active mq Installation and Master Slave setup
Active mq Installation and Master Slave setupActive mq Installation and Master Slave setup
Active mq Installation and Master Slave setup
 
Docker Java App with MariaDB – Deployment in Less than a Minute
Docker Java App with MariaDB – Deployment in Less than a MinuteDocker Java App with MariaDB – Deployment in Less than a Minute
Docker Java App with MariaDB – Deployment in Less than a Minute
 
How to optimize your Magento store
How to optimize your Magento store How to optimize your Magento store
How to optimize your Magento store
 
Make Your Site SpEEdy
Make Your Site SpEEdyMake Your Site SpEEdy
Make Your Site SpEEdy
 
AppFabric Velocity
AppFabric VelocityAppFabric Velocity
AppFabric Velocity
 
Was liberty at scale
Was liberty at scaleWas liberty at scale
Was liberty at scale
 
Repair & Recovery for your MySQL, MariaDB & MongoDB / TokuMX Clusters - Webin...
Repair & Recovery for your MySQL, MariaDB & MongoDB / TokuMX Clusters - Webin...Repair & Recovery for your MySQL, MariaDB & MongoDB / TokuMX Clusters - Webin...
Repair & Recovery for your MySQL, MariaDB & MongoDB / TokuMX Clusters - Webin...
 
Windows server 2016 storage step by step complete lab
Windows server 2016 storage step by step complete labWindows server 2016 storage step by step complete lab
Windows server 2016 storage step by step complete lab
 
Messaging With ActiveMQ
Messaging With ActiveMQMessaging With ActiveMQ
Messaging With ActiveMQ
 
Java troubleshooting thread dump
Java troubleshooting thread dumpJava troubleshooting thread dump
Java troubleshooting thread dump
 
Galera cluster for MySQL - Introduction Slides
Galera cluster for MySQL - Introduction SlidesGalera cluster for MySQL - Introduction Slides
Galera cluster for MySQL - Introduction Slides
 
Changes in WebLogic 12.1.3 Every Administrator Must Know
Changes in WebLogic 12.1.3 Every Administrator Must KnowChanges in WebLogic 12.1.3 Every Administrator Must Know
Changes in WebLogic 12.1.3 Every Administrator Must Know
 
10135 a 07
10135 a 0710135 a 07
10135 a 07
 
Using and Benchmarking Galera in different architectures (PLUK 2012)
Using and Benchmarking Galera in different architectures (PLUK 2012)Using and Benchmarking Galera in different architectures (PLUK 2012)
Using and Benchmarking Galera in different architectures (PLUK 2012)
 
The Domino 10 RHEL 7 Primer
The Domino 10 RHEL 7 PrimerThe Domino 10 RHEL 7 Primer
The Domino 10 RHEL 7 Primer
 
Inform2015 - What's New in Domino 9 & 9.0.1 for Admins
Inform2015 - What's New in Domino 9 & 9.0.1 for AdminsInform2015 - What's New in Domino 9 & 9.0.1 for Admins
Inform2015 - What's New in Domino 9 & 9.0.1 for Admins
 
NTC 324 Enhance teaching - snaptutorial.com
NTC 324  Enhance teaching - snaptutorial.comNTC 324  Enhance teaching - snaptutorial.com
NTC 324 Enhance teaching - snaptutorial.com
 
Securing Your MongoDB Deployment
Securing Your MongoDB DeploymentSecuring Your MongoDB Deployment
Securing Your MongoDB Deployment
 

Viewers also liked

All Your IOPS Are Belong To Us - A Pinteresting Case Study in MySQL Performan...
All Your IOPS Are Belong To Us - A Pinteresting Case Study in MySQL Performan...All Your IOPS Are Belong To Us - A Pinteresting Case Study in MySQL Performan...
All Your IOPS Are Belong To Us - A Pinteresting Case Study in MySQL Performan...Ernie Souhrada
 
2015: Whats New in MySQL 5.7, At Oracle Open World, November 3rd, 2015
2015: Whats New in MySQL 5.7, At Oracle Open World, November 3rd, 2015 2015: Whats New in MySQL 5.7, At Oracle Open World, November 3rd, 2015
2015: Whats New in MySQL 5.7, At Oracle Open World, November 3rd, 2015 Geir Høydalsvik
 
PayPal Big Data and MySQL Cluster
PayPal Big Data and MySQL ClusterPayPal Big Data and MySQL Cluster
PayPal Big Data and MySQL ClusterMat Keep
 
Scaling Twitter
Scaling TwitterScaling Twitter
Scaling TwitterBlaine
 
Eval 4 evaluation
Eval 4 evaluationEval 4 evaluation
Eval 4 evaluationhamsterlife
 
Social Media Week 2012 Panel : Beyond Facebook and Twitter
Social Media Week 2012 Panel : Beyond Facebook and TwitterSocial Media Week 2012 Panel : Beyond Facebook and Twitter
Social Media Week 2012 Panel : Beyond Facebook and TwitterMichoel Ogince
 
Community Directed Interventions to Improve Malaria in Pregnancy Control Serv...
Community Directed Interventions to Improve Malaria in Pregnancy Control Serv...Community Directed Interventions to Improve Malaria in Pregnancy Control Serv...
Community Directed Interventions to Improve Malaria in Pregnancy Control Serv...jehill3
 
The U.S. Government’s Global Health Initiative
The U.S. Government’s Global Health InitiativeThe U.S. Government’s Global Health Initiative
The U.S. Government’s Global Health Initiativejehill3
 
OGFT Spring 2010 photos 1
OGFT Spring 2010 photos 1OGFT Spring 2010 photos 1
OGFT Spring 2010 photos 1plantnutty
 
LAVC Opening Day power pt.
LAVC Opening Day power pt.LAVC Opening Day power pt.
LAVC Opening Day power pt.polaselm
 
Molnet, mobilen, med mera...
Molnet, mobilen, med mera...Molnet, mobilen, med mera...
Molnet, mobilen, med mera...Dag Forsén
 
28 5-1431
28 5-143128 5-1431
28 5-1431wxw
 
η ελληνίδα την περίοδο του μεσοπολέμου
η ελληνίδα την περίοδο του μεσοπολέμουη ελληνίδα την περίοδο του μεσοπολέμου
η ελληνίδα την περίοδο του μεσοπολέμουEllh
 
PSI’s experience in Community Case Management programs
PSI’s experience in Community Case Management programsPSI’s experience in Community Case Management programs
PSI’s experience in Community Case Management programsjehill3
 

Viewers also liked (20)

All Your IOPS Are Belong To Us - A Pinteresting Case Study in MySQL Performan...
All Your IOPS Are Belong To Us - A Pinteresting Case Study in MySQL Performan...All Your IOPS Are Belong To Us - A Pinteresting Case Study in MySQL Performan...
All Your IOPS Are Belong To Us - A Pinteresting Case Study in MySQL Performan...
 
2015: Whats New in MySQL 5.7, At Oracle Open World, November 3rd, 2015
2015: Whats New in MySQL 5.7, At Oracle Open World, November 3rd, 2015 2015: Whats New in MySQL 5.7, At Oracle Open World, November 3rd, 2015
2015: Whats New in MySQL 5.7, At Oracle Open World, November 3rd, 2015
 
PayPal Big Data and MySQL Cluster
PayPal Big Data and MySQL ClusterPayPal Big Data and MySQL Cluster
PayPal Big Data and MySQL Cluster
 
Scaling Twitter
Scaling TwitterScaling Twitter
Scaling Twitter
 
Eval 4 evaluation
Eval 4 evaluationEval 4 evaluation
Eval 4 evaluation
 
Nz powerpoint
Nz powerpointNz powerpoint
Nz powerpoint
 
Vpe otp
Vpe otp Vpe otp
Vpe otp
 
Social Media Week 2012 Panel : Beyond Facebook and Twitter
Social Media Week 2012 Panel : Beyond Facebook and TwitterSocial Media Week 2012 Panel : Beyond Facebook and Twitter
Social Media Week 2012 Panel : Beyond Facebook and Twitter
 
Community Directed Interventions to Improve Malaria in Pregnancy Control Serv...
Community Directed Interventions to Improve Malaria in Pregnancy Control Serv...Community Directed Interventions to Improve Malaria in Pregnancy Control Serv...
Community Directed Interventions to Improve Malaria in Pregnancy Control Serv...
 
The U.S. Government’s Global Health Initiative
The U.S. Government’s Global Health InitiativeThe U.S. Government’s Global Health Initiative
The U.S. Government’s Global Health Initiative
 
Transit 2050 (oct 2012)
Transit 2050 (oct 2012)Transit 2050 (oct 2012)
Transit 2050 (oct 2012)
 
Flowers
FlowersFlowers
Flowers
 
OGFT Spring 2010 photos 1
OGFT Spring 2010 photos 1OGFT Spring 2010 photos 1
OGFT Spring 2010 photos 1
 
LAVC Opening Day power pt.
LAVC Opening Day power pt.LAVC Opening Day power pt.
LAVC Opening Day power pt.
 
Change attitudes and behaviors
Change attitudes and behaviorsChange attitudes and behaviors
Change attitudes and behaviors
 
Molnet, mobilen, med mera...
Molnet, mobilen, med mera...Molnet, mobilen, med mera...
Molnet, mobilen, med mera...
 
28 5-1431
28 5-143128 5-1431
28 5-1431
 
Lions
LionsLions
Lions
 
η ελληνίδα την περίοδο του μεσοπολέμου
η ελληνίδα την περίοδο του μεσοπολέμουη ελληνίδα την περίοδο του μεσοπολέμου
η ελληνίδα την περίοδο του μεσοπολέμου
 
PSI’s experience in Community Case Management programs
PSI’s experience in Community Case Management programsPSI’s experience in Community Case Management programs
PSI’s experience in Community Case Management programs
 

Similar to Case Study with Answers.com on Scaling with Memcached and MySQL

Membase Meetup 2010
Membase Meetup 2010Membase Meetup 2010
Membase Meetup 2010Membase
 
Running a Megasite on Microsoft Technologies
Running a Megasite on Microsoft TechnologiesRunning a Megasite on Microsoft Technologies
Running a Megasite on Microsoft Technologiesgoodfriday
 
Beyond relational database - Building high performance websites using Redis a...
Beyond relational database - Building high performance websites using Redis a...Beyond relational database - Building high performance websites using Redis a...
Beyond relational database - Building high performance websites using Redis a...Dinh Pham
 
Drizzle Keynote at the MySQL User's Conference
Drizzle Keynote at the MySQL User's ConferenceDrizzle Keynote at the MySQL User's Conference
Drizzle Keynote at the MySQL User's ConferenceBrian Aker
 
http://www.hfadeel.com/Blog/?p=151
http://www.hfadeel.com/Blog/?p=151http://www.hfadeel.com/Blog/?p=151
http://www.hfadeel.com/Blog/?p=151xlight
 
WordPress Cluster for Enterprise High-Availability and On-Demand Scaling
WordPress Cluster for Enterprise High-Availability and On-Demand ScalingWordPress Cluster for Enterprise High-Availability and On-Demand Scaling
WordPress Cluster for Enterprise High-Availability and On-Demand ScalingJelastic Multi-Cloud PaaS
 
How to scale your web app
How to scale your web appHow to scale your web app
How to scale your web appGeorgio_1999
 
Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
Maginatics Cloud Storage Platform - MCSP 3.0 Technical HighlightsMaginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
Maginatics Cloud Storage Platform - MCSP 3.0 Technical HighlightsMaginatics
 
DOs and DONTs on the way to 10M users
DOs and DONTs on the way to 10M usersDOs and DONTs on the way to 10M users
DOs and DONTs on the way to 10M usersYoav Avrahami
 
VMworld 2013: Maximize Database Performance in Your Software-Defined Data Center
VMworld 2013: Maximize Database Performance in Your Software-Defined Data CenterVMworld 2013: Maximize Database Performance in Your Software-Defined Data Center
VMworld 2013: Maximize Database Performance in Your Software-Defined Data CenterVMworld
 
A26 MariaDB : The New&Implemented MySQL Branch by Colin Charles
A26 MariaDB : The New&Implemented MySQL Branch by Colin CharlesA26 MariaDB : The New&Implemented MySQL Branch by Colin Charles
A26 MariaDB : The New&Implemented MySQL Branch by Colin CharlesInsight Technology, Inc.
 
Maria db the new mysql (Colin Charles)
Maria db the new mysql (Colin Charles)Maria db the new mysql (Colin Charles)
Maria db the new mysql (Colin Charles)Ontico
 
Deploying MediaWiki On IBM DB2 in The Cloud Presentation
Deploying MediaWiki On IBM DB2 in The Cloud PresentationDeploying MediaWiki On IBM DB2 in The Cloud Presentation
Deploying MediaWiki On IBM DB2 in The Cloud PresentationLeons Petražickis
 
Dot Net Nuke Presentation
Dot Net Nuke PresentationDot Net Nuke Presentation
Dot Net Nuke PresentationTony Cosentino
 
Исполнение JS на сервере при масштабировании - что может пойти не так, Brian ...
Исполнение JS на сервере при масштабировании - что может пойти не так, Brian ...Исполнение JS на сервере при масштабировании - что может пойти не так, Brian ...
Исполнение JS на сервере при масштабировании - что может пойти не так, Brian ...Ontico
 
Sunserver Open Solaris
Sunserver Open SolarisSunserver Open Solaris
Sunserver Open Solarispankaj009
 
Gaming across multiple devices
Gaming across multiple devicesGaming across multiple devices
Gaming across multiple devicesPatric Boscolo
 
Sql 2012 always on
Sql 2012 always onSql 2012 always on
Sql 2012 always ondilip nayak
 
Zabbix 2014 Conference : Implementing Zabbix in large Banking Environment
Zabbix 2014 Conference : Implementing Zabbix in large Banking EnvironmentZabbix 2014 Conference : Implementing Zabbix in large Banking Environment
Zabbix 2014 Conference : Implementing Zabbix in large Banking EnvironmentAlain Ganuchaud
 

Similar to Case Study with Answers.com on Scaling with Memcached and MySQL (20)

Membase Meetup 2010
Membase Meetup 2010Membase Meetup 2010
Membase Meetup 2010
 
How To Scale v2
How To Scale v2How To Scale v2
How To Scale v2
 
Running a Megasite on Microsoft Technologies
Running a Megasite on Microsoft TechnologiesRunning a Megasite on Microsoft Technologies
Running a Megasite on Microsoft Technologies
 
Beyond relational database - Building high performance websites using Redis a...
Beyond relational database - Building high performance websites using Redis a...Beyond relational database - Building high performance websites using Redis a...
Beyond relational database - Building high performance websites using Redis a...
 
Drizzle Keynote at the MySQL User's Conference
Drizzle Keynote at the MySQL User's ConferenceDrizzle Keynote at the MySQL User's Conference
Drizzle Keynote at the MySQL User's Conference
 
http://www.hfadeel.com/Blog/?p=151
http://www.hfadeel.com/Blog/?p=151http://www.hfadeel.com/Blog/?p=151
http://www.hfadeel.com/Blog/?p=151
 
WordPress Cluster for Enterprise High-Availability and On-Demand Scaling
WordPress Cluster for Enterprise High-Availability and On-Demand ScalingWordPress Cluster for Enterprise High-Availability and On-Demand Scaling
WordPress Cluster for Enterprise High-Availability and On-Demand Scaling
 
How to scale your web app
How to scale your web appHow to scale your web app
How to scale your web app
 
Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
Maginatics Cloud Storage Platform - MCSP 3.0 Technical HighlightsMaginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
 
DOs and DONTs on the way to 10M users
DOs and DONTs on the way to 10M usersDOs and DONTs on the way to 10M users
DOs and DONTs on the way to 10M users
 
VMworld 2013: Maximize Database Performance in Your Software-Defined Data Center
VMworld 2013: Maximize Database Performance in Your Software-Defined Data CenterVMworld 2013: Maximize Database Performance in Your Software-Defined Data Center
VMworld 2013: Maximize Database Performance in Your Software-Defined Data Center
 
A26 MariaDB : The New&Implemented MySQL Branch by Colin Charles
A26 MariaDB : The New&Implemented MySQL Branch by Colin CharlesA26 MariaDB : The New&Implemented MySQL Branch by Colin Charles
A26 MariaDB : The New&Implemented MySQL Branch by Colin Charles
 
Maria db the new mysql (Colin Charles)
Maria db the new mysql (Colin Charles)Maria db the new mysql (Colin Charles)
Maria db the new mysql (Colin Charles)
 
Deploying MediaWiki On IBM DB2 in The Cloud Presentation
Deploying MediaWiki On IBM DB2 in The Cloud PresentationDeploying MediaWiki On IBM DB2 in The Cloud Presentation
Deploying MediaWiki On IBM DB2 in The Cloud Presentation
 
Dot Net Nuke Presentation
Dot Net Nuke PresentationDot Net Nuke Presentation
Dot Net Nuke Presentation
 
Исполнение JS на сервере при масштабировании - что может пойти не так, Brian ...
Исполнение JS на сервере при масштабировании - что может пойти не так, Brian ...Исполнение JS на сервере при масштабировании - что может пойти не так, Brian ...
Исполнение JS на сервере при масштабировании - что может пойти не так, Brian ...
 
Sunserver Open Solaris
Sunserver Open SolarisSunserver Open Solaris
Sunserver Open Solaris
 
Gaming across multiple devices
Gaming across multiple devicesGaming across multiple devices
Gaming across multiple devices
 
Sql 2012 always on
Sql 2012 always onSql 2012 always on
Sql 2012 always on
 
Zabbix 2014 Conference : Implementing Zabbix in large Banking Environment
Zabbix 2014 Conference : Implementing Zabbix in large Banking EnvironmentZabbix 2014 Conference : Implementing Zabbix in large Banking Environment
Zabbix 2014 Conference : Implementing Zabbix in large Banking Environment
 

Recently uploaded

Where developers are challenged, what developers want and where DevEx is going
Where developers are challenged, what developers want and where DevEx is goingWhere developers are challenged, what developers want and where DevEx is going
Where developers are challenged, what developers want and where DevEx is goingFrancesco Corti
 
Extra-120324-Visite-Entreprise-icare.pdf
Extra-120324-Visite-Entreprise-icare.pdfExtra-120324-Visite-Entreprise-icare.pdf
Extra-120324-Visite-Entreprise-icare.pdfInfopole1
 
Planetek Italia Srl - Corporate Profile Brochure
Planetek Italia Srl - Corporate Profile BrochurePlanetek Italia Srl - Corporate Profile Brochure
Planetek Italia Srl - Corporate Profile BrochurePlanetek Italia Srl
 
How to become a GDSC Lead GDSC MI AOE.pptx
How to become a GDSC Lead GDSC MI AOE.pptxHow to become a GDSC Lead GDSC MI AOE.pptx
How to become a GDSC Lead GDSC MI AOE.pptxKaustubhBhavsar6
 
LF Energy Webinar - Unveiling OpenEEMeter 4.0
LF Energy Webinar - Unveiling OpenEEMeter 4.0LF Energy Webinar - Unveiling OpenEEMeter 4.0
LF Energy Webinar - Unveiling OpenEEMeter 4.0DanBrown980551
 
Q4 2023 Quarterly Investor Presentation - FINAL - v1.pdf
Q4 2023 Quarterly Investor Presentation - FINAL - v1.pdfQ4 2023 Quarterly Investor Presentation - FINAL - v1.pdf
Q4 2023 Quarterly Investor Presentation - FINAL - v1.pdfTejal81
 
Keep Your Finger on the Pulse of Your Building's Performance with IES Live
Keep Your Finger on the Pulse of Your Building's Performance with IES LiveKeep Your Finger on the Pulse of Your Building's Performance with IES Live
Keep Your Finger on the Pulse of Your Building's Performance with IES LiveIES VE
 
TrustArc Webinar - How to Live in a Post Third-Party Cookie World
TrustArc Webinar - How to Live in a Post Third-Party Cookie WorldTrustArc Webinar - How to Live in a Post Third-Party Cookie World
TrustArc Webinar - How to Live in a Post Third-Party Cookie WorldTrustArc
 
IT Service Management (ITSM) Best Practices for Advanced Computing
IT Service Management (ITSM) Best Practices for Advanced ComputingIT Service Management (ITSM) Best Practices for Advanced Computing
IT Service Management (ITSM) Best Practices for Advanced ComputingMAGNIntelligence
 
CyberSecurity - Computers In Libraries 2024
CyberSecurity - Computers In Libraries 2024CyberSecurity - Computers In Libraries 2024
CyberSecurity - Computers In Libraries 2024Brian Pichman
 
3 Pitfalls Everyone Should Avoid with Cloud Data
3 Pitfalls Everyone Should Avoid with Cloud Data3 Pitfalls Everyone Should Avoid with Cloud Data
3 Pitfalls Everyone Should Avoid with Cloud DataEric D. Schabell
 
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptxEmil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptxNeo4j
 
2024.03.12 Cost drivers of cultivated meat production.pdf
2024.03.12 Cost drivers of cultivated meat production.pdf2024.03.12 Cost drivers of cultivated meat production.pdf
2024.03.12 Cost drivers of cultivated meat production.pdfThe Good Food Institute
 
UiPath Studio Web workshop Series - Day 3
UiPath Studio Web workshop Series - Day 3UiPath Studio Web workshop Series - Day 3
UiPath Studio Web workshop Series - Day 3DianaGray10
 
AI Workshops at Computers In Libraries 2024
AI Workshops at Computers In Libraries 2024AI Workshops at Computers In Libraries 2024
AI Workshops at Computers In Libraries 2024Brian Pichman
 
20140402 - Smart house demo kit
20140402 - Smart house demo kit20140402 - Smart house demo kit
20140402 - Smart house demo kitJamie (Taka) Wang
 
Novo Nordisk's journey in developing an open-source application on Neo4j
Novo Nordisk's journey in developing an open-source application on Neo4jNovo Nordisk's journey in developing an open-source application on Neo4j
Novo Nordisk's journey in developing an open-source application on Neo4jNeo4j
 
Patch notes explaining DISARM Version 1.4 update
Patch notes explaining DISARM Version 1.4 updatePatch notes explaining DISARM Version 1.4 update
Patch notes explaining DISARM Version 1.4 updateadam112203
 
Automation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projectsAutomation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projectsDianaGray10
 

Recently uploaded (20)

Where developers are challenged, what developers want and where DevEx is going
Where developers are challenged, what developers want and where DevEx is goingWhere developers are challenged, what developers want and where DevEx is going
Where developers are challenged, what developers want and where DevEx is going
 
Extra-120324-Visite-Entreprise-icare.pdf
Extra-120324-Visite-Entreprise-icare.pdfExtra-120324-Visite-Entreprise-icare.pdf
Extra-120324-Visite-Entreprise-icare.pdf
 
Planetek Italia Srl - Corporate Profile Brochure
Planetek Italia Srl - Corporate Profile BrochurePlanetek Italia Srl - Corporate Profile Brochure
Planetek Italia Srl - Corporate Profile Brochure
 
How to become a GDSC Lead GDSC MI AOE.pptx
How to become a GDSC Lead GDSC MI AOE.pptxHow to become a GDSC Lead GDSC MI AOE.pptx
How to become a GDSC Lead GDSC MI AOE.pptx
 
LF Energy Webinar - Unveiling OpenEEMeter 4.0
LF Energy Webinar - Unveiling OpenEEMeter 4.0LF Energy Webinar - Unveiling OpenEEMeter 4.0
LF Energy Webinar - Unveiling OpenEEMeter 4.0
 
Q4 2023 Quarterly Investor Presentation - FINAL - v1.pdf
Q4 2023 Quarterly Investor Presentation - FINAL - v1.pdfQ4 2023 Quarterly Investor Presentation - FINAL - v1.pdf
Q4 2023 Quarterly Investor Presentation - FINAL - v1.pdf
 
Keep Your Finger on the Pulse of Your Building's Performance with IES Live
Keep Your Finger on the Pulse of Your Building's Performance with IES LiveKeep Your Finger on the Pulse of Your Building's Performance with IES Live
Keep Your Finger on the Pulse of Your Building's Performance with IES Live
 
TrustArc Webinar - How to Live in a Post Third-Party Cookie World
TrustArc Webinar - How to Live in a Post Third-Party Cookie WorldTrustArc Webinar - How to Live in a Post Third-Party Cookie World
TrustArc Webinar - How to Live in a Post Third-Party Cookie World
 
IT Service Management (ITSM) Best Practices for Advanced Computing
IT Service Management (ITSM) Best Practices for Advanced ComputingIT Service Management (ITSM) Best Practices for Advanced Computing
IT Service Management (ITSM) Best Practices for Advanced Computing
 
CyberSecurity - Computers In Libraries 2024
CyberSecurity - Computers In Libraries 2024CyberSecurity - Computers In Libraries 2024
CyberSecurity - Computers In Libraries 2024
 
3 Pitfalls Everyone Should Avoid with Cloud Data
3 Pitfalls Everyone Should Avoid with Cloud Data3 Pitfalls Everyone Should Avoid with Cloud Data
3 Pitfalls Everyone Should Avoid with Cloud Data
 
SheDev 2024
SheDev 2024SheDev 2024
SheDev 2024
 
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptxEmil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
 
2024.03.12 Cost drivers of cultivated meat production.pdf
2024.03.12 Cost drivers of cultivated meat production.pdf2024.03.12 Cost drivers of cultivated meat production.pdf
2024.03.12 Cost drivers of cultivated meat production.pdf
 
UiPath Studio Web workshop Series - Day 3
UiPath Studio Web workshop Series - Day 3UiPath Studio Web workshop Series - Day 3
UiPath Studio Web workshop Series - Day 3
 
AI Workshops at Computers In Libraries 2024
AI Workshops at Computers In Libraries 2024AI Workshops at Computers In Libraries 2024
AI Workshops at Computers In Libraries 2024
 
20140402 - Smart house demo kit
20140402 - Smart house demo kit20140402 - Smart house demo kit
20140402 - Smart house demo kit
 
Novo Nordisk's journey in developing an open-source application on Neo4j
Novo Nordisk's journey in developing an open-source application on Neo4jNovo Nordisk's journey in developing an open-source application on Neo4j
Novo Nordisk's journey in developing an open-source application on Neo4j
 
Patch notes explaining DISARM Version 1.4 update
Patch notes explaining DISARM Version 1.4 updatePatch notes explaining DISARM Version 1.4 update
Patch notes explaining DISARM Version 1.4 update
 
Automation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projectsAutomation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projects
 

Case Study with Answers.com on Scaling with Memcached and MySQL

Editor's Notes

  1. These three are interrelated Content is Dynamic and PersonalTake a step back…Many more people and not just in the USATraffic (cisco petabyte data): measuring in petabytes per monthApplications: Dynamic and personalized
  2. A lot of this population is coming into US-based social networking, gaming, media sites… distance means latency issue.Proliferation of broadband drove users to the net.USA #33 in broadband (>2Mbps); #16 in average speed. Miniwatts data shows the shift to Europe and Asia in particular.World internet usage is only NOW @ 1.6b now (24% according to 50x15 site)NOW MOBILE is adding rapidly to this population explosion.Akamai state of the internet report for q1 2009 gives very insightful information of current data trends.
  3. Consumer is driving the traffic growth (3x of business)>40% CAGR growth (4x in 4 years)
  4. How do sites make the same software stack go faster
  5. Why we are here again:Scalable stack framework for LAMP and Java had/have to emerge in order to accelerate stack and provide distribution services
  6. Why we are here again:Scalable stack framework for LAMP and Java had/have to emerge in order to accelerate stack and provide distribution services
  7. 100ms latency introduced by traversing internet to origin site Typically +0.1 secs means 2-4% DROP in revenue
  8. 100ms latency introduced by traversing internet to origin site Typically +0.1 secs means 2-4% DROP in revenue
  9. Maslow's Hierarchy Of Needs
  10. Increases revenue via being able to economically scale and support more members, services and transactionsScalable stack framework delivered as a network service addressable by all stack componentsOnramp information into Memory ASAPMemcached has emerged as de facto protocol to load information into memory BUT a lot more is neededMemcached ++ Focused on caching functions Advance network-based distributed services Non relational functions
  11. Web 2.0 driving user & traffic growth Key Apps: Entertainment, Communication, Social Networking Key Drivers: Mobile, Broadband, International, ConsumerMobile applications – 3G+ is 22% by 2010 (Mobile goes hi speed)Consumer Internet Traffic 2006–2012 This category encompasses any IP traffic that crosses the Internet and is not confined to a single service provider’s network. Peer-to-peer (P2P) traffic, still the largest share of Internet traffic today, will decrease as a percentage of overall Internet traffic. Internet video streaming and downloads are beginning to take a larger share of bandwidth, and will grow to nearly 50 percent of all consumer Internet traffic in 2012.
  12. We talked about “Universal Distro” and EC2 beforeGear6 Web Cache Software requirements:Certified on HP, Dell, Rackable…Requires dedicated serverRedundant GE ports or 10 GE ports64-bit (x86 64) server with 32GB or more of RAMIDE/SATA HD with 80GB+Option: 2.5” SATA drive bays for Flash SSDs - Intel X25-E or SamsungGear6 Web Cache delivers:High availability and consistent scalable high performance50k-200k Memcached ops per sec32-300+GB Memcached space per rack unitFault toleranceComplete cache control and visibility of resourcesCost effective mechanism of scaling database and application tiers
  13. We talked about “Universal Distro” and EC2 beforeGear6 Web Cache Software requirements:Certified on HP, Dell, Rackable…Requires dedicated serverRedundant GE ports or 10 GE ports64-bit (x86 64) server with 32GB or more of RAMIDE/SATA HD with 80GB+Option: 2.5” SATA drive bays for Flash SSDs - Intel X25-E or SamsungGear6 Web Cache delivers:High availability and consistent scalable high performance50k-200k Memcached ops per sec32-300+GB Memcached space per rack unitFault toleranceComplete cache control and visibility of resourcesCost effective mechanism of scaling database and application tiers