Your SlideShare is downloading. ×
0
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

InfiniDB 3 - Speeding Big Data Analytics in Amazon EC2

19,470

Published on

Calpont CTO Jim Tommaney provides an overview InfiniDB 3, Calpont’s analytic data platform. …

Calpont CTO Jim Tommaney provides an overview InfiniDB 3, Calpont’s analytic data platform.

Discussion Topics
•How InfiniDB is architected for Big Data analytics
•How InfiniDB is provisioned for Amazon EC2 with an AMI
•How to quickly create a small or large cluster
•How InfiniDB’s parallel load capabilities deliver linear load scaling

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
19,470
On Slideshare
0
From Embeds
0
Number of Embeds
21
Actions
Shares
0
Downloads
40
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Calpont InfiniDB®Accelerating Data Insights ®InfiniDB 3: Speeding Big Data Analytics in Amazon EC2 Jim Tommaney, CTO Calpont June 2012
  • 2. Today’s Presenter - Jim Tommaney • Calpont’s Chief Technologist • Architect of InfiniDB • 25 years experience in applied data technologies for BI and analytics • Drives InfiniDB roadmap and futures • Closely engaged in client deployments and POCsInfiniDB® Scalable. Fast. Simple. 2 © 2012 Calpont. All Rights Reserved.
  • 3. Today’s Discussion • Introduction • InfiniDB Architecture for Big Data Analytics • InfiniDB 3 o Provisioned for Amazon EC2 o Demo – Creating a small or large cluster o Parallel load options for load scaling o Demo – Cpimport Load for MPPInfiniDB® Scalable. Fast. Simple. 3 © 2012 Calpont. All Rights Reserved.
  • 4. How Fast is the World’s Big Data Footprint Growing? How Big is a Byte? How is Data Growing Daily? 1 gigabyte 1000000000 bytes 15 petabytes of new information is 1000 gigabytes 1 terabyte created each day – 8x more information than in all the libraries 1 million terabytes 1 Exabyte in the United States 1 billion terabytes 1 Zettabyte Experiments at the CERN laboratory generate 40 TBs of data every second IT Implications of Big Data Wal-Mart - one million transactions every hour, feeding databases that store 2.5 petabytes – 167 times the books in American’s Library of CongressInfiniDB® Scalable. Fast. Simple. 4 © 2012 Calpont. All Rights Reserved.
  • 5. Evolution of the Analytic Platform OLAP Analytic DBMS MOLAP Platforms Relational Extensions Cubes Systems Commercialize Relational Prototypes First DBMS (IDS) 1960s 1970s 1980s 1990s 2000s 2010+InfiniDB® Scalable. Fast. Simple. © 2012 Calpont. All Rights Reserved.
  • 6. What is InfiniDB? Simple, Powerful Platform for Big Data Analytics Columnar Performance Efficiency Widely used MySQL Interface MPP, MapReduce style Query Execution 6InfiniDB® Scalable. Fast. Simple. © 2012 Calpont. All Rights Reserved.
  • 7. Benefits of InfiniDB Real-time, Consistent Query Performance Linear Scale for Massive Data Removes Limits to Dimensions and Granularity Easy to Deploy and MaintainInfiniDB® Scalable. Fast. Simple. 7 © 2012 Calpont. All Rights Reserved.
  • 8. How InfiniDB is Used Analytic Needs Analytic Data Environment Data Integration Big Data Sources Data Warehouse ETL Transactional Dimensional Analytics Hadoop Operational Analytic Data MDM Data Discovery Store Legacy Direct Load Model RDBMS Predictive AnalyticsInfiniDB® Scalable. Fast. Simple. © 2012 Calpont. All Rights Reserved.
  • 9. Big Data Reference Architecture Analytic Needs Analytic Data Environment Data Integration Big Data Sources ETL Transactional Dimensional Analytics Hadoop Operational Data Discovery MDM Legacy RDBMS Predictive AnalyticsInfiniDB® Scalable. Fast. Simple. © 2012 Calpont. All Rights Reserved.
  • 10. InfiniDB Product Evolution InfiniDB 3 InfiniDB 2.0 InfiniDB 1.5 • Parallel Load for Big Data • UDFs for In-database • Transparent provisioning analytics and run time operations on • Real-time compression InfiniDB 1.0 • Enhanced partitioning Amazon EC2 • Full parallel sub-query • UTF-8 Support • Enhanced parallelization • Expanded SQL support • Added support for additional Linux • 100% Columnar platforms • Full scale-out MPP • Fully integrated map reduction operations • High speed data loadInfiniDB® Scalable. Fast. Simple. 10 © 2012 Calpont. All Rights Reserved.
  • 11. InfiniDB 3 Increasing Flexibility while Preserving Simplicity and Speed Unmatched Deployment Simplicity and Flexibility Speed Easier to… • Take advantage of Cloud deployments • Load Massive Data for Distributed HWInfiniDB® Scalable. Fast. Simple. 11 © 2012 Calpont. All Rights Reserved.
  • 12. InfiniDB 3 - New Capabilities Prepackaged AMI for Transparent support of EC2 automatic provisioning of virtual storage and data InfiniDB nodes on EC2 redundancy (EBS) policesInfiniDB® Scalable. Fast. Simple. 12 © 2012 Calpont. All Rights Reserved.
  • 13. Accessing the InfiniDB AMI Trial 1. Calpont.com/tryinfiniDB 2. Select the AMI option 3. Provide AWS # 4. Calpont will provide access within 24 hrsInfiniDB® Scalable. Fast. Simple. 13 © 2012 Calpont. All Rights Reserved.
  • 14. Big Data Reference Architecture Analytic Needs Analytic Data Environment Data Integration Big Data Sources ETL Transactional Dimensional Analytics Hadoop Operational User Module Data Discovery Performance Module MDM Legacy RDBMS Predictive AnalyticsInfiniDB® Scalable. Fast. Simple. © 2012 Calpont. All Rights Reserved.
  • 15. InfiniDB AMI DEMO
  • 16. InfiniDB 3 - New Capabilities • Parallel Data Load designed for Big Data SIMPLE Same simple command Several data load configurations possible SCALABLE Linear performance as more nodes participate in the loading FAST No query performance degradation during data loadInfiniDB® Scalable. Fast. Simple. 16 © 2012 Calpont. All Rights Reserved.
  • 17. InfiniDB 3 - Parallel Data Load Options Single Bulk Parallel Bulk Bulk Load, Load, Load, Central Partitioned Partitioned n partitioned n partitioned 1 data source data sources data sources 1 single 1 single n bulk load command command commands Auto distribution n Performance n Performance across S/N Module nodes ModulesInfiniDB® Scalable. Fast. Simple. 17 © 2012 Calpont. All Rights Reserved.
  • 18. InfiniDB Cpimport Load DEMO
  • 19. InfiniDB 3 – Key Takeaways Scalable with Amazon but same platform you are used to on-premise “Based on this survey, the data warehouse vendor with Easier to deploy with AMI the happiest customers in 2011 was Teradata, followed by CALPONT, then IBM, Extended load performance to MPP followed by Kognitio and deployments Kalido” Andy Hayler Information Difference 2011 DW Landscape SurveyInfiniDB® Scalable. Fast. Simple. © 2012 Calpont. All Rights Reserved.
  • 20. ® www.calpont.com@Calpont, @InfiniDB

×