Scaling With Sun Systems For MySQL Jan09

1,244 views

Published on

Scaling Concepts and Approaches
Recommendations When/How to Scale
Scaling Test Results
Sun Systems for MySQL

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,244
On SlideShare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
41
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Scaling With Sun Systems For MySQL Jan09

  1. 1. GET MORE FROM YOUR WEB SERVICE Scaling MySQL By Leveraging Sun Systems Steve Staso Chief Architect, Web Infrastructure Solutions Global Systems Practice 1
  2. 2. Agenda Scaling Concepts and Approaches Recommendations When/How to Scale Scaling Test Results Sun Systems for MySQL Learn more 2
  3. 3. Dramatically Change Economics of Web Service Delivery Drive better performance, value ● Get greater performance ● Improve price performance, reduce costs ● Operating System, processor choice Simplify Deployments ● Leverage best practices, Blue Prints, reference architectures, subscriptions, systems, software, management expertise Scale for explosive Growth ● Scale to +1M concurrent users ● Choose best deployment technologies ● Predict performance under stress 3
  4. 4. Agenda Scaling Concepts and Approaches Recommendations When/How to Scale Scaling Test Results Sun Systems for MySQL Learn more 4
  5. 5. How to Scale? Network • Distribute the connections over multiple servers Load • Increase the number of NICs and networks • More CPUs help up to optimal thread count, more than that is useless CPU • Scale-out can impact app server Load activity, scalability can be difficult • Reduce the logic in the DB server • More memory is always good RAM/ • A scale-out can increase the complexity of the environment Caching • External distributed caching • Faster disks and controllers always I/O help Load • Scale-out is the best option after an initial optimization at server level Storage • SAN and NAS for large data centers Requirement • Scale-out is often cost effective 5
  6. 6. Choose the Right Server Architecture Server Scale-up vs. Scale-out for Database Deployments Scaling Up Scaling Out 6
  7. 7. Choose the Right Server Architecture Server Scale-up vs. Scale-out for Database Deployments Scaling Up Scaling Out 7
  8. 8. Choose the Right Server Architecture Server Scale-up vs. Scale-out for Database Deployments Scaling Up g alin l Sc ona Diag Scaling Out 8
  9. 9. Virtualize Methods, benefits, recommendations Memory latency Compute Build Next Generation Virtual Datacenter Increase utilization, less heat and energy usage Up to 10 x better price/performance 9
  10. 10. Implementations of Virtualization Type I Type I Type II App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App OS OS OS OS OS OS Zone OS OS LD LD Zone VM VM VM VM Hypervisor Hypervisor Zone Support OS Software Hypervisor Hardware Hardware Virtualization Enablement Layer Hardware OS Hardware Hardware Hardware Hardware Hardware based Software based Desktop OS Virtualization 10 Partitioning System Virtualization Virtualization
  11. 11. Leading Virtualization Choices Different approaches, benefits in virtualizing web stack (future plans) Hyper-V BSD opensolaris™ opensolaris™ Sun xVM LDOMS 11
  12. 12. Server/OS Virtualization Sun Server Virtualization = Decreased Costs, Reduced Complexity CoolThreads Servers x64/x86 Servers • Integrated, open source, no cost, and • Most powerful, scalable, virtualized flexible virtualization technology – designs, operating on today’s range of Logical Domains (LDoms) OS options • Record-breaking performance • Choice of hypervisor and OS allows for • Breakthrough energy and space investment protection efficiency • Available in racks or blades • Available in racks or blades LDOMS 12
  13. 13. Agenda Scaling Concepts and Approaches Recommendations When/How to Scale Scaling Test Results Sun Systems for MySQL Learn more 13
  14. 14. The Benchmark ● Red Hat Ent Linux 5.1 64 bit MySQL testbed ● Solaris 10 x86_64 and SPARC 64 mysql 5.1.26 rc 64 bit environment ● ● mysql coolstack 1.3.1 (based on 5.1.26) 64 bit ● 100 warehouses created with the datagen utility DBT2 ● 15 GB of data generated for each DB Extra table used to set random conditions datagen ● ● Extra tables added for transaction count SP calls to: DBT2 ● Delivery ● Order Status Stock Level New Order Stored Procedures ● ● ● Payment ● 100 calls: DBT2 call set with ● 4 Delivery ● 4 Order Status 4 Stock Level random IDs 45 New Order ● ● ● 43 Payment ● + internal SP calls ● Shoot-out with: ● 512k complex transactions ● 1,2,4,8,16,32,64,128,256 concurrent connections ● 51,200 per iteration mysqlslap ● 10 iterations ● 250M single queries ● Warm-up (cold) and hot phases ● high peak of 40k qps with “s” 14
  15. 15. The Systems For MySQL Scaling ● 2xAMD 2220 Dual Core 2.8Ghz, 1MB Cache/core ● 12 GB RAM, 73 GB SAS Drives 15krpm ● 2U Rack Unit, 550PS ● MySQL x 1 instance 8GB buffer pool Sun Fire x4200 Server ● Estimated List Price: US$5,888 ● 8xAMD 8220 Dual Core 2.8Ghz, 1MB Cache/core ● 64 GB RAM, 73 GB 15k SAS Drives+External Storage ● 4U Rack Unit, 850PS ● MySQL x 4 instances 6GB buffer pool Sun Fire x4600 Server ● Estimated List Price: US$29,995 ● 1T2 8 Cores 64 Threads 1.4Ghz, 4MB Cache ● 64 GB RAM, 73 GB 15k SAS Drives+External Storage ● 2U Rack Unit, 750PS ● MySQL x 6 instances 6GB buffer pool Sun Fire T5220 Server ● Estimated List Price: US$32,115 15
  16. 16. The Database MySQL Enterprise Solution Enterprise software and services delivered in an annual subscription ● The most up-to-date MySQL Enterprise software Database ● Monthly rapid updates ● Quarterly service packs ● Hot-fix program • Subscription: ● Indemnification • MySQL Enterprise • License (OEM): • Embedded Server ● Virtual database assistant • Support ● Global monitoring of all servers • MySQL Cluster Carrier-Grade Monitoring ● Web-based central console ● • Training Built-in advisors, expert advice ● • Consulting Problem query detection/analysis • NRE ● Online self-help MySQL Knowledge Base ● 24/7 problem resolution with priority Support escalation ● Consultative help ● High-Availability and Scale-Out 16
  17. 17. Test Results: Single Instance Sun Fire x4200 17
  18. 18. Test Results: Single Instance Sun Fire x4600 Sun Fire T5220 18
  19. 19. Test Results: Four Instances Sun Fire x4600 19
  20. 20. Test Results: Six Instances Sun Fire T5220 20
  21. 21. Agenda Scaling Concepts and Approaches Recommendations When/How to Scale Scaling Test Results Sun Systems for MySQL Learn more 21
  22. 22. The application life-cycle The takeaway for how and when to scale Start-up ● Single instance ● Small box or full virtualization Sun Fire x4200 Digital Entrepreneur Sun Fire x4200 ● Multiple instances ● Virtualized, consolidated environment Sun Fire x4600 Enterprise ● Multiple instances ● Virtualized, consolidated Sun FireT5220 environment 22
  23. 23. What Can Sun Systems for MySQL Do for Your Web Deployments ● Linux, OpenSolaris, Solaris and Windows; Intel, AMD and SPARC ● Up to 3x more transactions, 3x less power & space,10x price/performance ● Open Storage delivers 2x better storage density, 2x better price/performance,10x the capacity ● Deliver competitive advantage with fast I/O, large memory, optimized Web Stack, system design innovations, SSDs, open source virtualization ● Reduce power, space, cooling costs ● Get to market faster with new Web services ● Scalability to support millions of users ● Free 60 day Try & Buy of systems plus MySQL Enterprise, get up to 40% off to keep 23
  24. 24. World Record Performance Best19% Faster than the Dell PE R900 x86 single Java Virtual Machine SPEC® JBB2005 performance on SPEC®jbb2005 benchmark Sun Fire X4450 Server • Solaris 10 10/08 Operating system • Java HotSpot™software version 1.6.0_06 Performance Release Targeted at enterprise customers looking for exceptional business process performance in a dense 2RU, 24-processor core platform Source: SPEC and SPECjbb are registered trademarks of the Standard Performance Evaluation Corporation. Competitive benchmark results reflect data published as of 9/12/08. For the latest results, visit http://www.spec.org.Sun Fire X4450 24 (Intel Xeon X7460, 24 cores, 4 chips, 6 cores/chip, Solaris 10): 448,262 SPECjbb2005 bops, 448,262 SPECjbb2005 bops/JVM.
  25. 25. Half the Space! X4450 DL580 G5 PE R900 X3850 M2 Reduced Operating Costs for the Eco Enterprise 25
  26. 26. Sun™ Blade Servers: Superior Flexibility and Efficiency Modular architecture delivers flexibility and efficiencies • Aggregation of multiple servers Power • Common power, cooling, and I/O improves efficiency Compute and reliability • Modular hot-swappable Storage Modular form factor improves serviceability computing Cooling I/O Management 26
  27. 27. ● DTrace: safe, comprehensive observability ● Predictive Self Healing for reliability ● ZFS: innovative approach to data Mgmt, scalability, integrity and performance ● Record setting performance ● Built-in virtualization ● Over 1000 x86 and SPARC systems supported ● 180+ open source applications Fast and Open; Optimized for the Web 27
  28. 28. Professional Network Site Increases Performance by 54% on MySQL Business Issues • Fast growth was causing reduced MySQL database response times • Needed scale and manageability for exponential growth Sun Solution “By using Sun products and Sun • Sun & MySQL Enterprise Platinum, Professional Services for our Professional Services solution, we can scale horizontally, • Sun Servers & Solaris and we can scale vertically. And we don't have to change one line of Business Results our software code to run dual-core, • 54% improvement in query quad-core, or sixteen-core performance machines – or any other hardware • 39% reduction in database footprint that Sun provides. ” • Scalable, manageable infrastructure ― Jean-Luc Vaillant, CTO, LinkedIn for further growth sun.com/customers 28
  29. 29. Sun Systems for MySQL Virtualization Reduce Environmental Costs, Virtualize & Scale for Maximum Eco-Efficiency ● 10x prove price/performance, 3x more throughput, 83% less power ● Fast, free, open hypervisor, low cost storage arrays ● Breakthrough throughput, eco- efficiency and reliability ● Consolidate up to 128 virtual MySQL servers in 1U/blade format ● Scale MySQL with TomCat, Apache, Lighttpd, SugarCRM, Drupal, others ● Try risk, cost, hassle free, get up to 40% off to convert Try & Buy T5220 T6320 Scaling Sky-high for MySQL Virtualization 29
  30. 30. Virtualization with LDoms Tomcat running JPetStore, MySQL Backend 9000 Transactions per Second (TPS) 8000 7000 6000 5000 4000 3000 2000 1000 0 1 2 4 6 8 10 12 Number of Logical Domains • LDoms & CoolThreads improve scalability and utilization • Blueprint demonstrating how LDoms enabled a TomCat / MySQL service to scale 10x when compared to a single application instance. • http://wikis.sun.com/download/attachments/24543563/820-4995.pdf 30
  31. 31. Messaging Services Innovator Gets 10X Better MySQL Price/Performance Business Issues •Deliver highly scalable advanced messaging services •Process messages faster and at reduced cost, operate more efficiently Sun Solution “We are a company that believes •Sun & MySQL Enterprise Platinum, in empowering our customers, Professional Services and that power for us comes from •Sun Servers & Solaris Sun. With Sun technology, the only limitation on what we can Business Results deliver is our ability to dream. If •4.5x higher performance, 2x headroom we can dream it, we can do it ” •4x less, 83% less power use ― Jason Williams, CTO at DigiTar •Storage admin from weeks to hours www.sun.com/customers •10x better $/performance for MySQL infrastructure 31
  32. 32. Sun Systems MySQL Rich Media Storage Gain Control of Exploding Storage Costs for Rich Media ● 2x cost/performance over closest competitive offering ● Industry's highest data throughput ● 15% less than HP with 2x density, 10% less Dell at nearly 3x density ● Up to 70% less power, cooling J7000 ● Reduces common admin tasks by as much as 82% J4200 x4540 ● Ideal for rapid Rich Media growth: photo, video, audio ● Try risk, cost and hassle free, get 20% off to convert Try & Buy Store Rich Media Without Paying the Price 32
  33. 33. Tune and Scale MySQL: Providing Unprecedented Storage Analytics • Automatic real-time visualization of application and storage related workloads • Solve performance issues through understanding data usage • Simple, sophisticated instrumentation with real-time comprehensive analysis • Supports multiple simultaneous application and workload analysis in real- time • Analysis can be saved, exported and replayed for further analysis. • Built on DTrace instrumentation 33
  34. 34. ZFS Hybrid Storage Pool Sun X4250 Storage Server Example Configuration A Configuration B ● 4 Xeon 7350 Processors ● 32GB FB DDR2 ECC DRAM ● OpenSolaris with ZFS (1) 80G SSD Cache Device (1) 32G SSD ZIL Device (7) 146GB 10,000 RPM SAS Drives (5) 400GB 4200 RPM SATA Drives 34
  35. 35. ZFS Hybrid Pool Example Based on Actual Benchmark Results 4.9x 3.2x 4% 2x 11% Read IOPs Write IOPs Cost Storage Power Raw Capacity (Watts) (TB) Hybrid Storage Pool (DRAM + Read SSD + Write SSD + 5x 4200 RPM SATA) Traditional Storage Pool (DRAM + 7x 10K RPM 2.5”) 35
  36. 36. MySQL Unlimited • Fixed annual subscription MySQL > Unlimited servers Enterprise > Unlimited CPUs Unlimited > Unlimited cores • Simplify > No counting > No compliance issues • Pricing > No proprietary DBMS license fees > Price starts at $40K/year 36
  37. 37. Agenda Scaling Concepts and Approaches Recommendations When/How to Scale Scaling Test Results Sun Systems for MySQL Learn more 37
  38. 38. Start Scaling Your MySQL With Sun Systems for MySQL Learn More Try it Yourself • Try a Sun system free for 60 days with • Download MySQL TCO White MySQL Enterprise paper • Kick the tires. Check under the hood. • Download “Scaling Beyond Test it. Stress it. x86: Using LDOMS” • Get up to 40% to convert Try & Buy to purchase • Buy it or return it and pay nothing – not even shipping sun.com/mysqlsystems sun.com/tryandbuy 38
  39. 39. Performance Tuning - Benchmarks - Cloud Computing Data Warehousing - Business Intelligence - Replication Scale-Out - Java, PHP, .NET, Ruby & AJAX High Availability - MySQL Cluster - And much more… Early Registration Now Open! https://en.oreilly.com/mysql2009/public/register/ 39
  40. 40. GET MORE FROM YOUR WEB SERVICE Scaling MySQL By Leveraging Sun Systems Learn More: http://www.sun.com/mysqlsystems Steve Staso Sun Microsystems 40

×