Database and the Cloud IGT Cloud Computing WG 20/4/2009 [email_address] http://top-performance.blogspot.com

RockeTier Methodology RockeTier specializes in analyzing and boosting existing software performance and developing efficient high-load systems with a unique methodology: Detect Rate Immediate Effective Relief Roadmap Scale up and Scale out

RockeTier specializes in analyzing and boosting existing software performance and developing efficient high-load systems with a unique methodology:

Detect

Rate

Immediate Effective Relief

Roadmap

Scale up and Scale out

Assumptions Cloud Computing  Virtualization Virtualization  Low end servers Very large databases  High end servers Therefore: Very large databases ≠ Cloud Computing

Cloud Computing  Virtualization

Virtualization  Low end servers

Very large databases  High end servers

Therefore:

Very large databases ≠ Cloud Computing

Assumptions…

Major Options

Presentation Objectives Who is using MySQL? MySQL Limitations How to get over this? Move to another DB and scale up… Vertical Sharding Horizontal Sharding Sharding test case

Who is using MySQL?

MySQL Limitations

How to get over this?

Move to another DB and scale up…

Vertical Sharding

Horizontal Sharding

Sharding test case

Who is Using MySQL?

MySQL Limitations Table sizes: 50-100M records per table Reads: 50 queries/second

Table sizes: 50-100M records per table

Reads: 50 queries/second

Why Do I Care? From 0 to 100 (US mass adaptation) Phone: 100 yrs Radio: 40 yrs TV: 30 yrs Mobile: 20 yrs Internet: 10 yrs Facebook: 2 yrs

From 0 to 100 (US mass adaptation)

Phone: 100 yrs

Radio: 40 yrs

TV: 30 yrs

Mobile: 20 yrs

Internet: 10 yrs

Facebook: 2 yrs

100K New Users/Week

The Network Effect

What Should I Do? Oracle SQL Server $$$

Oracle

SQL Server

$$$

Sharding

Vertical Sharding

Horizontal Sharding Static Hashing Complex growth Simple Mod 10 = 0 Mod 10 = 1 Mod 10 = 2 Mod 10 = 3 Mod 10 = 4 Mod 10 = 5 Mod 10 = 6 Mod 10 = 7 Mod 10 = 8 Mod 10 = 9

Static Hashing

Complex growth

Simple

Key locations are defined in a directory Simple growth Directory is SPOF Horizontal Sharding

Key locations are defined in a directory

Simple growth

Directory is SPOF

Horizontal Sharding Static hashing with directory mapping Simple growth Small Directory still SPOF Mod 1000 = 4

Static hashing with directory mapping

Simple growth

Small Directory still SPOF

Horizontal Sharding Each key signed by DB# generated on creation Simple growth New key generation is SPOF

Each key signed by DB# generated on creation

Simple growth

New key generation is SPOF

Sharding Management No mature tools in the market Hibernate Shards – not recommended Hibernate… Beta Required Mechanisms Distribution of changes in DB schema

No mature tools in the market

Hibernate Shards – not recommended

Hibernate…

Beta

Required Mechanisms

Distribution of changes in DB schema

Reporting

Best Practices $connection = new_db_connection (" customer :// 1234 ") ; $statement = $connection->prepare( $sql_statement, $params ); $result = $statement->execute();

$connection = new_db_connection (" customer :// 1234 ") ;

$statement = $connection->prepare( $sql_statement, $params );

$result = $statement->execute();

Lessons Vertical Sharding: User Actions, Users, Comments, Items Horizontal Sharding Denormalization MySQL Replication

Vertical Sharding:

User Actions, Users, Comments, Items

Horizontal Sharding

Denormalization

MySQL Replication

Lessons Vertical Sharding: User Actions, Users, Comments, Items Horizontal Sharding Denormalization MySQL Replication

Vertical Sharding:

User Actions, Users, Comments, Items

Horizontal Sharding

Denormalization

MySQL Replication

Lessons 100M views per day The path to Sharding: Single server Single master with multiple read slaves Partitioned Sharding

100M views per day

The path to Sharding:

Single server

Single master with multiple read slaves

Partitioned

Sharding

Lessons Master-Master replication Each Shard is 50% loaded 40K queries/second

Master-Master replication

Each Shard is 50% loaded

40K queries/second

Ad Network Reference Architecture

The Bottom Line: Grow ∞

Startup your Engines Thank you [email_address] http://top-performance.blogspot.com Our Methodology Performance problems are extremely complex and due to the diferent technologies deployed, each case is unique. A “typical” performance problem requires delving into databases, application servers, client technology, code in difering programming languages and system and software architectures. RockeTier implements a unique methodology in order to simplify the problem and evaluate each performance bottleneck, providing both an immediate efective relief and when necessary, design a gradual roadmap to speed up your software system and make it scalable and robust. Our 5 steps methodology : 1. Detect: Pinpoint your performance bottlenecks using various tools including load and stress tools, code profiling, database profiling, network sniffing and code review to detect performance bottlenecks in specific components. 2. Rate: Grade each bottleneck by importance and provide immediate practical recommendations and performance boost estimations. 3. Immediate effective relief: Provide immediate fixes and workarounds in a short time frame helping you meet your urgent business needs. 4. Roadmap Planning: When necessary, redesign next generation Solutions, using proven robust and scalable solutions such as grid and in memory databases. 5. Scale up and Scale out: In cases where redesign is necessary - RockeTier provides implementation or software design description (SDD), and guidance for in house programmers for the implementation of the next generation scalable system, which will meet your growing business needs. Your Value Business: Achieve your business performance requirements. GreenIT: Protect the environment and reduce CO2 emissions. Bottom Line: Reducing hardware and 3rd party software cost. The Performance Experts Success Stories The Finance Sector: An international insurance company managing over 20 Billion US dollars in assets was facing poor performance in its core life insurance policy software system. The RockeTier team detected bottlenecks originating from several software infrastructure modules. A practical solution was implemented. The customer’s success criteria was a 20% decrease in insurance policy creation run time, Our solution provided a 40% decrease in run time! Telecom: A VC backed start-up company was facing critical installation problems in the leading Israeli cellular operator. Knowing that existing system performance would not meet client requirements, the company asked RockeTier to help it boost its performance. RockeTier evaluated the system and implemented a workaround to the system database architecture, boosting the overall system performance by 30%. Following that. the RockeTier team designed the company’s next generation architecture, meeting a throughput of 3000Mbps by design. RockeTier at a Glance RockeTier is a software solutions company, which utilizes its knowledge and skills to help companies from both the enterprise sector and the start-up industry. RockeTier has numerous success stories in solving customers’ system performance bottlenecks and scale out limitations, providing immediate improvements and workarounds in a short time frame and, when necessary, redesign and implementation of the next generation solutions employing grid and/or in- memory databases in the Web 2.0, Telecom and finance markets. Web 2.0: a start-up company providing an innovative electronic advertising and billing system was facing its technological limits. The RockeTier team evaluated and redesigned its system architecture and is currently implementing a scale out grid mechanism and caching algorithms. The solution supports 20 times the original capacity using the same hardware. Moreover it supports semi-linear growth (by simple scale out) and high availability requirements. “ 20% reduction in transaction time within 3 months” “ Boost Performance by a factor of 200” “ 200 million events per day”