MySQL conference 2010 ignite talk on InfiniDBPresentation Transcript
Robin Schumacher VP Products Calpont Calpont’s InfiniDB
Who the Heck are We…?
InfiniDB by Calpont is… A column-oriented database engine A great option for analytics, data warehousing, and read-intensive apps A scale up and out design that future proofs your systems
InfiniDB scales up… It will address all the CPU’s/cores on your machine. InfiniDB runs great on a single machine as well as on multiple boxes. 87% 22.14 164.12 Q3.2 83% 55.04 316.79 Q3.1 87% 15.94 121.33 Q2.3 87% 19.70 151.20 Q2.2 79% 44.65 210.21 Q2.1 Overall Percent Reduction with additional cores InfiniDB 8 cores (elapsed time in seconds) InfiniDB 1 Core (elapsed time in seconds) SSB Query (@100 scale)
InfiniDB scales out… It does MPP across multiple nodes, with auto-failover. PM = Performance Module, which handles I/O operations for InfiniDB 87% 77.74 148.49 297.46 597.97 Q3.2 84% 134.21 316.50 425.25 848.79 Q3.1 87% 51.36 96.03 192.03 386.66 Q2.3 87% 56.41 106.37 214.87 430.25 Q2.2 87% 68.21 129.90 261.35 531.34 Q2.1 Overall Percent Reduction from 1 – 8 PM’s 8 PM (elapsed time in seconds) 4 PM (elapsed time in seconds) 2 PM (elapsed time in seconds) 1 PM (elapsed time in seconds) SSB Query @1000
InfiniDB has… Plenty of features to support demanding environments
MySQL front end
Multi-Terabyte database capable
High-Speed bulk loader w/ no blocking queries while loading
Transaction support (ACID compliant)
INSERT/UPDATE/DELETE (DML) support
No indexing necessary
Automatic partitioning of data
MVCC support – snapshot read (readers don’t block writers)
Alter Table with online add column capability
High concurrency supported
Logical data compression
Multi-Node, MPP scale out capable w/ failover
GPL and Commercial Editions
InfiniDB is designed for fast load and query performance
InfiniDB vs. “Leading” Row Database InfiniDB takes up 22% less space InfiniDB loaded data 22% faster InfiniDB total query times were 65% less InfiniDB average query times were 59% less Notice not only are the queries faster, but also more predictable * Tests run on standalone machine: 16 CPU, 16GB RAM, CentOS 5.4 with 2TB of raw data
Percona’s Test of Open Source Column Databases 610 GB of raw data; 8 Core Machine http://www.mysqlperformanceblog.com/2010/01/07/star-schema-bechmark-infobright-infinidb-and-luciddb/ (lower is better)
Internal MPP Stress Test using SSB Benchmark Six Performance Modules against data size of Percona tests and then 10x the size. Shows predictable performance, MPP linear speed gains over standalone implmentation, and capabilities that other open source databases don’t have. http://www.infinidb.org/infinidb-blog/mysql-parallel-query-processing-of-60-billion-rows-via-infinidb.html Predictable Performance with More Data
What else should I know…?
Connectors and More… From a dev perspective, use InfiniDB as you would standard MySQL All connectors, tools, dev IDE’s, etc., should work fine with InfiniDB
Use InfiniDB & Other Engines… Other MySQL engines can be used with InfiniDB in the same database/instance
Use InfiniDB & Other Engines… Other engines can also be used with InfiniDB in an MPP fashion
Our Commitment… 1.0 now available for all Release early/often with monthly maintenance updates for Community Go where the Community and Customers send us
What is coming next…?
Coming Attractions for InfiniDB… July 2010: InfiniDB 1.1 High-speed subqueries, UTF8, Windows port, and more. December 2010: InfiniDB 1.5-2.0 Shared nothing support, physical compression, and more. 2011: InfiniDB 2.x-3.x You tell us…!
How can I get it…?
Download InfiniDB Community Edition
Download/View Free InfiniDB documentation
Read InfiniDB technical white papers and articles
Read InfiniDB intro articles on MySQL dev zone
Visit InfiniDB online forums
Trial the InfiniDB Enterprise Edition: http://www.calpont.com
Robin Schumacher VP Products Calpont [email_address] Thanks!