Ibm accelerating analitics with blu


Published on

IBM Accelerating Analytics with BLU

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Ibm accelerating analitics with blu

  1. 1. Accelerating Analytics with BLU Session Number 3949 Scott Bergquist Director, Information Management Business Development, IBM Louise McEvoy, IBM WW Business Development, DB2 with BLU Acceleration, IBM © 2013 IBM Corporation
  2. 2.
  3. 3. Agenda Introducing DB2 with BLU Acceleration  what makes BLU different and why should you care? The deeper dive content  How BLU works and how the competition stacks up Wrapping it up…  Partner Resources, Teams to support you and a download package just for you
  4. 4. What is DB2 with BLU Acceleration?  Large order of magnitude benefits – Performance – Storage savings – Time to value  New technology in DB2 for analytic queries – – – – – CPU-optimized unique runtime handling Unique encoding for speed and compression Unique memory management Columnar storage, vector processing Built directly into the DB2 kernel  Revolution or evolution – BLU tables coexists with traditional row tables - in same schema, storage, and memory – Query any combination of row or BLU tables – Easy conversion of tables to BLU tables • Change everything, or change incrementally
  5. 5. How fast is BLU? Customer Speedup over DB2 10.1 10x-25x improvement is common Large Financial Services Company 46.8x Global ISV Mart Workload 37.4x >1000x Analytics Reporting Vendor 13.0x Many Cases Global Retailer 6.1x Large European Bank 5.6x “It was amazing to see the faster query times compared to the performance results with our row-organized tables. The performance of four of our queries improved by over 100-fold! The best outcome was a query that finished 137x faster by using BLU Acceleration.” - Kent Collins, Database Solutions Architect, BNSF Railway © 2013 IBM Corporation
  6. 6. Seamless Integration into DB2  Built seamlessly into DB2 – integration and coexistence – Column-organized tables can coexist with existing, traditional, tables • Same schema, same storage, same memory – Integrated tooling support • Optim Query Workload Tuner recommends BLU Acceleration deployments  Same SQL, language interfaces, administration – Column-organized tables or combinations of column-organized and roworganized tables can be accessed within the same SQL statement  Dramatic simplification – Just “Load and Go” – Faster deployment • Fewer database objects required to achieve same outcome – Requires less ongoing management due to it’s optimized query processing and fewer database objects required – Simple migration • • • • Conversion from traditional row table to BLU Acceleration is easy DB2 Workload Manager identifies workloads to tune Optim Query Workload Tuner recommends BLU Acceleration table transformations Users only notice speed up; DBA’s only notice less work! – Management of single server solutions less expensive than clustered solutions © 2013 IBM Corporation
  7. 7. Analytic Database Management Complexity Repeat Database BLU Design Tuning DB2 with Design and and Tuning • Decide on partition strategies • Select Compression Strategy • Create Table • Load data • Create Auxiliary Performance Structures • Materialized views • Create indexes • B+ indexes • Bitmap indexes • Tune memory • Tune I/O • Add Optimizer hints • Statistics collection © 2013 IBM Corporation
  8. 8. Simple to Deploy and Operate  Operations DB2 WITH BLU – Simply Load and Go – Installation to business value in ~2 days – Ease of evaluation and performs as advertised ACCELERATION  BI developers and DBAs – faster delivery – No configuration or physical modeling – No indexes or tuning – out of the box performance – Data Architects/DBA focus on business value, not physical design  ETL developers Super analytics Super easy – No aggregate tables needed – simpler ETL logic – Faster load and transformation times  Business analysts – Train of thought analysis – 10x to 1000x faster – True ad-hoc queries – no tuning, no indexes – Ask complex queries against large datasets © 2013 IBM Corporation
  9. 9. Client Experiences with BLU Acceleration “We were very impressed with the performance and simplicity of BLU. We found that some queries achieved an almost 100x speed up with literally no tuning!” – Lennart Henäng, IT Architect “We tested some representative queries taken from our existing SAP application and tested them on DB2 with BLU Acceleration and observed performance improvements in many of our query response times. For example, one of our most time consuming queries experienced a 50x performance improvement.” - Richard Simms, Director of Infrastructure, Fossil “The BLU Acceleration technology makes our analytical queries run 4-15x faster and decreases the size of our tables by 10x. But it’s all the things I don't have to do with BLU that make me appreciate the technology even more: no tuning, no partitioning, no indexes, no aggregates.” - Andrew Juarez, Lead SAP Basis and DBA 9
  10. 10. Client Video (1:51)
  11. 11. Where are the opportunities for Business Partners? Revisit existing customers and approach new prospects, here are a sampling of reasons… Are your customers already running on DB2? – this is low-hanging fruit  BLU is baked into the DB2 kernel, it doesn’t require application recoding to take advantage of BLU Do your customers have existing transactional applications and data that need to coexist with analytic workloads?  DB2 BLU allows for coexistence of traditional tables and columnar tables Are your customers using Cognos?  BLU is optimized to work efficiently with the Cognos BI platform DB2 with BLU includes 5 user licenses of Cognos BI and the analytics is already built in Are your customers on Power?  There’s a deep integration between Power and DB2 In addition to AIX, DB2 BLU is currently available on Linux for Intel platforms (SystemX) and in a cloud offering Are your customers part of the SAP Ecosystem  DB2 is the database of choice for SAP application workloads – with BLU, BPs can provide a more compelling story than HANA Do you have customers on Oracle?  Compatibility features are built into DB2, making it easy for clients to migrate from Oracle to DB2 with BLU 11 BLU is unique and differentiated – THIS IS NOT THE SAME OLD DB2 STORY
  12. 12. Agenda Introducing DB2 with BLU Acceleration  what makes BLU different and why should you care? The deeper dive content  How BLU works and how the competition stacks up Wrapping it up…  1 Partner Resources, Teams to support you and a download package just for you
  13. 13. Introducing BLU Acceleration A new generation of data management innovation • 10-25x faster reporting and analytics1 - more than 1000x seen in many cases2 BLU Acceleration • 10x storage space savings3 seen during beta tests • 10x faster than SAP HANA4 on intermediate reports at less than 1/10th the cost • 5x faster than SAP on complex reports Speed of Thought Analytics HANA4 1 Based on internal IBM testing of sample analytic workloads comparing queries accessing row-based tables on DB2 10.1 vs. columnar tables on DB2 10.5. Performance improvement figures are cumulative of all queries in the workload. Individual results will vary depending on individual workloads, configurations and conditions. 2 Based on internal IBM tests of pure analytic workloads comparing queries accessing row-based tables on DB2 10.1 vs. columnar tables on DB2 10.5. Results not typical. Individual results will vary depending on individual workloads, configurations and conditions, including size and content of the table, and number of elements being queried from a given table. 3 Client-reported testing results in DB2 10.5 early release program. Individual results will vary depending on individual workloads, configurations and conditions, including table size and content. 4 Based on internal IBM testing of sample analytic workloads comparing queries accessing competitor database vs. columnar tables on DB2 10.5. Individual results will vary depending on individual workloads, configurations and conditions. Individual results will vary depending on individual workloads, configurations and conditions, including table size and content. IBM Confidential
  14. 14. Introducing BLU Acceleration IBM Research & Development Lab Innovations Super Fast, Super Easy — Create, Load and Go! No Indexes, No Aggregates, No Tuning, No SQL changes, No schema changes 14
  15. 15. BLU Acceleration Illustration 10TB query in seconds or less  The System: 32 cores, 1TB memory, 10TB table with 100 columns and 10 years of data  The Query: How many “sales” did we have in 2010? SELECT COUNT(*) from MYTABLE where YEAR = ‘2010’  The Result: In seconds or less as each CPU core examines the equivalent of just 8MB of data DATA DATA DATA DATA DATA DATA DATA DATA DATA Actionable Compression reduces to 1TB In-memory Column Processing reduces to 10GB Data Skipping reduces to 1GB DATA DATA DATA 10TB data Parallel Processing 32MB linear scan on each core via Answer in seconds or less DATA 15 Vector Processing Scans as fast as 8MB through SIMD DATA DATA
  16. 16. Data Mart Snapshot from Transactional Data ERP or other transactional system Transactional Database OLAP Application Create, Load and Go!  Instant performance boost  Handles terabytes of data  No indexes/aggregates to create and tune  Multi-platform software flexibility Easily create and load a BLU Acceleration data mart Cognos BI with BLU Acceleration Analytic Data Mart (BLU Tables) Multi-platform software 16
  17. 17. Cognos BI and DB2 with BLU Acceleration on Power Fast on Fast on Fast 38x Average Acceleration Dynamic Query Dynamic Cubes Compatible Query C1 C2 C3 C4 C5 C6 C7 C8 of database queries for reporting1 DB2 with BLU 1. Based on internal tests comparing DB2 10.1 traditional row store vs DB2 10.5 with BLU Acceleration. Result refers to database processing time for SQL queries for 20 different reports and dashboards in isolation, and excludes time for full report generation time, data transfer and processing by the BI server. Performance gains will vary by workload and system specifications.
  18. 18. DB2 BLU Acceleration & Power Delivering Clear Advantages Speed and Simplicity Accelerated Performance Faster Time to Value • Top 5 SAP Benchmarks Users per core on SAP 2-Tier SD benchmark • 8x to 25x for typical analytic workloads1 • More predictable performance2 • • • • Simple load & go in-memory support No change to applications needed Integrated administration for DBAs Simple upgrade to deploy Business Proven Lower Risk • Accelerates SAP BW without application upgrade • Proven technology leadership including 10+ years of SAP optimization • 1/6th the downtime compared to other platforms3 • Integrated security to simplify regulatory compliance • Large number of client references Transparent Scalability • Efficient and application transparent database scalability • Most efficient use of resources • Automated workload management with shared-everything resource pools • No penalty if all data doesn‘t fit in memory Lower Cost Lower Acquisition Costs • 7x-14x lower year 1 • Flexible hardware options • Flexible software licensing options including new IULA • Leverage existing investment • CoD, SubCap, TB based Licensing TCA4 18 Lower Operating Costs • Storage savings ranging from 1.6x to 2.6x, through increased compression5 • Option to use lower cost near line storage • Mature technology not requiring frequent patching
  19. 19. BLU Acceleration On Power 740 Beats In-Memory Analytics System At Lower Cost 220GB Deep Analytics workload BLU Acceleration on Power 740 16 cores, 4.2 GHz POWER7+ 512GB RAM DB2 v10.5, AIX v6.1 622 RPHi Intermediate Reports/Hour 3YR TCA $163,000 9.25 RPHc Complex Reports/Hour  6x Faster Intermediate reports  1.7x Faster Complex reports Pre-integrated in-memory Database Appliance Competitor v3 40 Intel Westmere cores 512GB RAM 8x900 HDDs 1.2TB SSD  14x Lower Cost 3YR TCA $2,312,000 102.8 RPHi Intermediate Reports/Hour 5.27 RPHc Complex Reports/Hour Based on IBM internal tests comparing IBM BLU Acceleration system with a comparably priced, comparably tuned competitor configuration (version available as of 09/01/2013) executing a materially identical 220GB deep analytics workload in a controlled laboratory environment. Test measured 24 concurrent user report throughput executing identical SQL query workloads. 3YR Total Cost of Acquisition (TCA) based on publicly available U.S. prices current as of September 1, 2013, including hardware, software, and maintenance. Compared prices exclude applicable taxes, and are subject to change without notice. Competitor configuration: 40 Intel Westmere cores, 512GB RAM, 1.2TB SSD + 8x900 GB HDD. IBM configuration: IBM Power 740+, 16 cores, 512GB RAM, DB2 v10.5 FP1 AWSE. Results may not be typical and will vary based on actual workload, configuration, applications, queries and other variables in a production environment. Users of this document should verify the applicable data for their specific environment. Contact IBM and see what we can do for you.
  20. 20. DB2 has proven 98% Compatibility with Oracle  Compatibility through native support, not emulation  Compile and run most Oracle applications  Application changes are the exception, not the norm  Faster, easier migration  Minimal code changes Oracle Database  Use current skills  Better performance Oracle Database Consolidated DB2 system 20
  21. 21. Simplified DB2 Packaging Single set of DB2 Editions Something for everyone DB2 Advanced Workgroup DB2 Advanced Enterprise Advanced capabilities with required capacity Single users  Highest Value No InfoSphere Warehouse Editions  Small businesses Departments Large enterprises DB2 Enterprise Core capabilities with unlimited capacity DB2 Workgroup DB2 Express DB2 Express-C Core capabilities and capacity Low or no cost of entry 21 Unlimited capacity
  22. 22. DB2 BLU Overview Video (3:21)
  23. 23. Agenda Introducing DB2 with BLU Acceleration  what makes BLU different and why should you care? The deeper dive content  How BLU works and how the competition stacks up Wrapping it up…  Partner Resources, Teams to support you and a download package just for you
  24. 24. Download your Business Partner package  BLU Intro: An email template that introduces your customers to BLU and includes the top 3 links: DB2 10.5 Trial Code YouTube Videos I s som hi ng el se et needed? Just ask! BLU homepage  Scripted slides: a scripted presentation so you can pitch BLU to your customers  Sales kit: to help you sell BLU  Ready to Execute campaigns: to help you build demand generation campaigns Leave your business card and we’ll email the package to you – or watch for the download on the BP Connections site We’re here to help grow your business… Information Management - Business Development Contacts Louise McEvoy (, DB2 BLU Channel Strategy Peter Mostrey (, DB2 BLU Technical 24
  25. 25. Embed BLU in your Solutions Seeding Business Partners with a flexible revenue share model Partner Value Drivers A pre-approved, simple low cost Percent of Revenue (PoR) pricing model for DB2 Benefits • Integrate BLU into your solutions for radical performance • Technical optimization not just compatibility • Eliminate need for your customer to make a separate database decision • No risk – no pre-payment or commitment required • Increase Wallet Share • Deliver radically performing analytic solutions • Save you and your customers 30% or greater on db cost Customer Value Drivers Designed to save customers 30% or more on their database cost when purchasing an IBM Partner solution Benefits • Lowest TCO purchasing path • Dollars saved can be reinvested in business applications / services • No need to track PVUs, Terabytes or Users • Single point of contact for support
  26. 26. IM Technology Ecosystem (IMTE) - Experience, Reliability and Quality What kind of support can the IM Technology Ecosystem provide? Information Management Technology Ecosystem - Worldwide Skills Transfer (Bootcamps): Teach Business Partners deep product implementation skills required for real project execution Skilled & certified Dublin U.S. Multiple Cities Strong driver for a successful project Provide consultative support to you in real life projects Mentoring: Create more value by helping Business Partners navigate the wealth of the IM portfolio and apply technology in solutions Build deep relationship with you for repeatable success 26 Boeblingen Toronto Beijing Seoul Tokyo Cairo Legend Project Specific Enablement: Provide implementation assistance to Business Partners to accelerate time-to-value and mitigate risk Krakow India Multiple Cities Guadalajara - DB2 - InfoSphere MDM - InfoSphere CDC - InfoSphere IIS - InfoSphere DataStage - InfoSphere QualityStage - InfoSphere Warehouse - Initiate - Informix - Optim/Guardium - Netezza - SAP DB2/IDS - SAP Avalanche Kuala Lumpur Sao Paulo 300 Experts IMTE has the breadth and depth of experience – Experience and track record – Proven implementation methodology – World class capabilities Singapore
  27. 27. IMTE: a fully-funded team to support Business Partners Partner Benefits Partner Enablement Offerings • Strategic and Architecture Overview • Skills Transfer • Project Mentoring • Success Story / References • • • • • • Conversion Support • Sizing Guides PoT / PoC Support • Best Practices Performance Analysis Guide Release Upgrades • Lab Advocacy Solution Consulting Solution Certification and Validation • Close more deals, faster by gaining access to: • Support in competitive discussions on product differences and similarities • Guidance on technical assets and methodology • Demos and assistance on PoTs/PoCs • PoT materials and (in some cases) onsite PoC support • Assistance in initial deployment • Access to latest client presentations and presales materials • Direct partnership with top rated IBM lab staff Note: Specific product offerings may differ from the list above Oracle: DB2 with BLU Conversion • DB2 10 proven compatibility of 98% or more with Oracle • Database Conversion Workbench provides overview of conversion effort and compatibility • Strong project management and quality assurance • Skills transfer and DB2 ramp up • Develop and build ongoing production environment • IBM provides code conversion and unit testing • You own the final testing of business logic (UAT) and deployment. • Assisting staff during UAT and deployment from IBM optional 27 SAP: Joint Development, Test and Support • • • • • • • • Define joint DB2 optimized for SAP roadmap Ensure tight interlock between SAP & IBM DB2 development Evaluate and implement future differentiators for SAP on DB2 Ensure SAP DB2 shipments on time and with excellent quality DB2/SAP aligned release and fixpack testing to ensure near DB2 GA SAP certification Optimize DB2 and SAP applications on DB2 to better integrate with SAP, e.g. Retail, Bank Analyzer Support customers through one stop support architecture Develop and maintain SAP on DB2 documentation like installation, admin guides and SAP OSS notes
  28. 28. Join our BLU Acceleration for Cloud Technology Preview Self-Service Warehouse and BI in the Cloud Technology Preview Get involved today! Visit Visit Booth 324. Get a demo at The BLU Experience (MR05) Cheaper to Buy  Choice of providers  No contracts  Pay nothing up-front  Pay as you go Fast and Easy to Get  Everything in! BI tools, data warehouse, data modeling & movement tools  Includes commonly used schemas, dashboards and reports  Just load your data and go Simple and Secure to Use  Easy web interface and console  Infrastructure and tuning built-in; no need for IT support  Enterprise class security and reliability  Free online courses
  29. 29. Experience DB2 BLU at IOD BUSINESS PARTNER SUMMIT EXPO HALL DEMO ROOM  Sunday event exclusively for Business Partners • Keynote: Let’s Talk Partner • IM Product & Strategy SessionIncludes BLU • Featured BLU Acceleration Session • Information Concierge • BP Café- Ask me about DB2 with BLU Acceleration! • BLU giveaways • Peds in Big Data & Analytics area & IM area • BLU Business Partner signage indicating BLU Business Partner THE BLU Experience. Ready to meet the future of database technology? Ready for 10-20x faster performance right out of the box? Step into the World of BLU. The Demo Room will feature 12 individual demo peds and a theater presentation area designed to showcase the BLU breakthrough experience with speed and simplicity to gain the competitive advantage. BLU sessions & activities for various skills and roles • 18 BLU sessions across tracks • 5 Hand-on-Labs • 1 Ask the Expert session • 1 BLU BoF session • Break Free Forum (1BP on Panel) • BLU Guided Tours for BPs and Customers • DB2- House of Blues Foundation Room Reception- Monday, 7-10 PM
  30. 30. Wrapping it up.. look for these customers 1 Customers who are looking for a cost-effective, high performance solution with built-in analytics, available in the cloud Look at your Cognos customers, they’re prime candidates 2 2 3 Are your customers on older versions of DB2? migration is easy and IBM can help 4 Look at your customers on SAP and Oracle; we have migrations paths and teams to support you Attend the BLU Acceleration sessions listed in the conference handbook. 18 sessions – something for everyone! 30
  31. 31. Questions?
  32. 32. Business Intelligence Across the Spectrum of Information Management Needs
  33. 33. Please note IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion. Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.
  34. 34. Acknowledgements and Disclaimers Availability. References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results. © Copyright IBM Corporation 2013. All rights reserved. •U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. IBM, the IBM logo,, Information Management and IBM DB2 are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at Other company, product, or service names may be trademarks or service marks of others, including SAP and Oracle.
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.