SlideShare a Scribd company logo
1 of 18
Download to read offline
dBConf 2014
High-performance Business Intelligence
solution based on IBM Cognos and
ParAccel Analytic Database
Karol Chlasta
Agenda
About me
Plan for today:
– Business Intelligence Concepts & Technologies
IBM Cognos Business Intelligence
ParAccel Analytic Database
– Roll out in an Investment Banking division of a global
bank
– Adoption by Client & Sales BI Unit
Reporting execution summary
Report conversion results
Issues discovered & their solutions
Next steps
Credits: Sanjeev Aggarwal, Technology Architect
Motto
We did this to solve a business issue and not because
of technology...
The business need for and expectations of MI are evolving
rapidly as is the value we can deliver.
The current technology architecture struggles
(and sometimes fails) to deliver the complexity of
information required in a timely manner to the dispersed,
diverse user community via their channels of choice.
Business Intelligence
 Good decisions are the building blocks of great business performance.
 Understand and improve your business based on:
 How are we doing?
Monitoring KPIs with dashboards and scorecards, tracking key metrics.
 Why?
Reporting and analysis to get close to your data, gain context,
understand trends, and spot anomalies.
 What should we be doing?
Planning, budgets, and forecasts let you set and share a reliable view of
the future.
 Business intelligence (BI) is the set of techniques and tools for the
transformation of raw data into meaningful and useful information to get
competitive advantage:
Data → Information → Knowledge → Action
Concepts - BI System
Query & reporting
Analysis
Dashboards for on-line and off-line analysis
Scorecards
Planning & budgets
Statistics, predictive modeling & advanced
analytics
Real-time monitoring
Collaboration & social networking
Mobile applications
Concepts - DWH System
Real-Time
Massively Parallel Processing
(MPP):
 Shared Nothing vs Shared
Everything
 Near-linear Scalability
Big Data:
“Big data is like teenage sex:
everyone talks about it,
nobody really knows how to do
it, everyone thinks everyone
else is doing it, so everyone
claims they are doing it…”
–Dan Ariely
MPP OLAP
Database
Typical OLTP
Database
Large volumes of
data (TB to PB)
Smaller volumes of
data (GB to TB)
Low number of
power database
users
High number of
concurrent light
users
Complex analytic
queries
Optimized of single
row access
Low level of data
granularity (Facts)
High use of tuning
structures
Decision support,
and what if
scenarios
Transaction
processing
and data integrity
Bulk data loading
(TB / day is typical)
Low volume data
loading
References: Press, G. (2013, June 03). [Text]. Retrieved from
http://whatsthebigdata.com/2013/06/03/big-data-quotes/
BI Platforms
Business Intelligence (BI) and
analytics systems are applications
and technologies for gathering,
storing, analyzing, and accessing
information for better business
decision making to gain
competitive advantage.
What is IBM Cognos BI?
What is ParAccel Analytic Database
(PADB)?
Strong hints:
- on my employer's name
- on why we actually should it PADB
- Data sheet Data sheet of
a new product References: Henschen, D. (2014, February 26). Gartner BI Magic Quadrant: Winners & Losers [Image
file]. Retrieved from http://www.informationweek.com/big-data/big-data-analytics/gartner-bi-magic-
quadrant-winners-and-losers/d/d-id/1114013
References: Manoria, V. (2012, May 3). IBM Cognos 10 BI: Components & User Interfaces
[Image files]. Retrieved from https://www.ibm.com/developerworks/community/blogs/ibm-bi-
capabilities/entry/ibm_cognos_10_bi_components_user_interfaces1?lang=en
IBM Cognos BI
Actian Analytics Database
 Created by ParAccel, and known as ParAccel
Analytic DataBase (PADB), now re-branded
to Actian Analytics Database - Matrix
 Parallel processing database management
system designed for high performance
advanced analytics for business
intelligence:
 I/O: Columnar & Compressed
 CPU: Fully Compiled Queries
 Interconnect: MPP Grid Protocol for inter-
node communications.
 Core Components
 Leader node
 Compute node
 Interconnect
 SAN Integration
 Runs on Red Hat or Cent OS! References: Anderson, D. (2012, July 24). Column Oriented Database Technologies [Image files].
Retrieved from http://www.dbbest.com/blog/column-oriented-database-technologies/
 Adaptive Compression (~4x) and no
performance structures:
 Using columnar storage, each block holds
column field values for more records then in
row-based storage. As a result reading the
same number of column fields for the same
number of records requires proportionally
less I/O operations
 Blocks hold the same data type, so
compression can can be selected based on
the column type of data stored in a block
(mostly, delta, bytedict, runlength, text)
 High-performance MPP optimizer (Omne)
 Cost-based, Columnar aware
●
Founded on PostgreSQL Planner/Optimizer
 Unlimited Table Join Ability (patented) for
use in complex database schema
referenced by views
 View Folding for planning through views,
eliminating unused columns
References: Saama blog (2014, October 20). On Big Data and In-Memory Data Clouds [Image file].
Retrieved from http://www.saama.com/on-big-data-and-in-memory-data-clouds/
 Columnar storage vs row-wise database
storage:
 Data blocks store column values for
consecutive rows
 Data blocks store values for
consecutive rows making up the entire
record
Actian Analytics Database
Business Case
Business drivers:
Improved decision making
Reduced data latency
Perform deep, near real time analytics not possible on current platform
Simplified BI infrastructure
(We need to initiate, choose, purchase, engineer & implement the MPP
database)
Landscape before the solution:
 MS SQL Server 2008 with aggregate tables & MSAS cubes
 A number of front-ends to access data, incl.:
• Dozens of QlikView dashboards
• Hundreds of Cognos BI reports
• Reporting packs not always reconciling to each other due to timing
difference or system issues
• Additional manual processing, or inputs needed to build complex reports
Front Office Implementation
PoC was done in 2011 and that PADB
was the best fit for the business use
case, winning with Sybase IQ SMP &
PlexQ.
Implementation happened in Q3
2012 and brought:
- Introduction of MPP Database
technology reduced query times
from minutes to sub seconds
- Reduced data processing from T+1
to near real-time
(within 5 minutes from trade
received to available for reporting)
- Introduction of high performance
analytics
New strategic platform delivered to
bank's clients
References: Slicker city blog (2014, June 24). Rogers' technology adoption curve [Image file]. Retrieved
from http://slickercity.net/tag/information-communication-technology/
Adoption by Finance BI
Client & Sales BI function based in Warsaw, Poland
Project Summary: Who is it about? What happens?
When did it take place? Where did it take place?
Why did it happen?
Report Execution Summary
Report Conversion Results
Region
Report
Type
(D/W/M)
Original Package
Original Execution Time
(min:sec)
PABD Execution
Time
(min:sec)
Result
EMEA D Aggregated Relational 16:56 05:00 339%
EMEA W Standard Relational 20:00 03:30 571%
US D Aggregated Relational 01:20 00:40 200%
US D Aggregated Relational 01:46 00:32 331%
US M Aggregated Relational 00:17 00:19 89%
US D Aggregated Relational 01:38 00:22 445%
US D Aggregated Relational 04:01 00:52 463%
US M Aggregated Relational 00:25 00:35 71%
US D Aggregated Relational 08:01 00:15 3207%
Report Issues & Solutions
Issue Description Solution
Report page containing list does not
run returning error RQP-DEF-0177.
(this is despite an underlying query
returning tabular data with no issues).
Default list header might use ‘Data Item Label’ as
a column source type. After changing the setting
from ‘Data Item Label’ to ‘Text’ the error
disappears.
Rank in not working as expected when
applied in the filters, returning incorrect
sequence.
Set Application to After Auto Aggregation.
When using case when {expression}
then … end the returned else result
expression type is always BLOB.
Report fails to run.
Perform CAST to char or any other desired type in
the case statement definition.
PADB does not handle DATETIME
data type.
Use TRUNC (date) function to return date with no
time portion
Adoption Next Steps
Next steps are to:
Deliver additional end-user trainings
Finalize report conversion exercise
Add additional facts and dimensions to PADB
Connect ALL remaining standard MI reports to a single
real-time Cognos data source (PADB Cognos package)
Decommission:
aggregate tables in SQL Server
redundant Cognos packages
Make a better use of off-the-shelf PABD analytic
functions with Cognos
Monitor and optimize...
Last slide
Thanks
Any questions?

More Related Content

What's hot

business_intelligence_overview
business_intelligence_overviewbusiness_intelligence_overview
business_intelligence_overviewChris D'Mello
 
Business Intelligence - Intro
Business Intelligence - IntroBusiness Intelligence - Intro
Business Intelligence - IntroDavid Hubbard
 
Business Intelligence Overview
Business Intelligence Overview Business Intelligence Overview
Business Intelligence Overview Vibloo
 
Business Intelligence
Business IntelligenceBusiness Intelligence
Business IntelligenceSukirti Garg
 
Top SAP Online training institute in Hyderabad
Top SAP Online training institute in HyderabadTop SAP Online training institute in Hyderabad
Top SAP Online training institute in HyderabadAadhyaKrishnan
 
Foundation for Success: How Big Data Fits in an Information Architecture
Foundation for Success: How Big Data Fits in an Information ArchitectureFoundation for Success: How Big Data Fits in an Information Architecture
Foundation for Success: How Big Data Fits in an Information ArchitectureInside Analysis
 
Datawarehousing and Business Intelligence
Datawarehousing and Business IntelligenceDatawarehousing and Business Intelligence
Datawarehousing and Business IntelligencePrithwis Mukerjee
 
Types of business intelligence tools
Types of business intelligence toolsTypes of business intelligence tools
Types of business intelligence toolsgreenliondigital
 
Overview of analytics and big data in practice
Overview of analytics and big data in practiceOverview of analytics and big data in practice
Overview of analytics and big data in practiceVivek Murugesan
 
Business Intelligence Presentation 1 (15th March'16)
Business Intelligence Presentation 1 (15th March'16)Business Intelligence Presentation 1 (15th March'16)
Business Intelligence Presentation 1 (15th March'16)Muhammad Fahad
 
Advanced Topics In Business Intelligence
Advanced Topics In Business IntelligenceAdvanced Topics In Business Intelligence
Advanced Topics In Business Intelligenceguest1a9ef2
 
Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION
Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATIONBig Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION
Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATIONMatt Stubbs
 
SplunkLive! Splunk for Business Analytics
SplunkLive! Splunk for Business AnalyticsSplunkLive! Splunk for Business Analytics
SplunkLive! Splunk for Business AnalyticsSplunk
 
Use cases for Hadoop and Big Data Analytics - InfoSphere BigInsights
Use cases for Hadoop and Big Data Analytics - InfoSphere BigInsightsUse cases for Hadoop and Big Data Analytics - InfoSphere BigInsights
Use cases for Hadoop and Big Data Analytics - InfoSphere BigInsightsGord Sissons
 
Business intelligence in the real time economy
Business intelligence in the real time economyBusiness intelligence in the real time economy
Business intelligence in the real time economyJohan Blomme
 
Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...
Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...
Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...Denodo
 
What exactly is Business Intelligence?
What exactly is Business Intelligence?What exactly is Business Intelligence?
What exactly is Business Intelligence?James Serra
 

What's hot (20)

business_intelligence_overview
business_intelligence_overviewbusiness_intelligence_overview
business_intelligence_overview
 
Business Intelligence - Intro
Business Intelligence - IntroBusiness Intelligence - Intro
Business Intelligence - Intro
 
Business Intelligence Overview
Business Intelligence Overview Business Intelligence Overview
Business Intelligence Overview
 
Business Intelligence
Business IntelligenceBusiness Intelligence
Business Intelligence
 
Top SAP Online training institute in Hyderabad
Top SAP Online training institute in HyderabadTop SAP Online training institute in Hyderabad
Top SAP Online training institute in Hyderabad
 
Foundation for Success: How Big Data Fits in an Information Architecture
Foundation for Success: How Big Data Fits in an Information ArchitectureFoundation for Success: How Big Data Fits in an Information Architecture
Foundation for Success: How Big Data Fits in an Information Architecture
 
Datawarehousing and Business Intelligence
Datawarehousing and Business IntelligenceDatawarehousing and Business Intelligence
Datawarehousing and Business Intelligence
 
Project+team+1 slides (2)
Project+team+1 slides (2)Project+team+1 slides (2)
Project+team+1 slides (2)
 
Spring 2017 Sage 300 (Accpac) Users Group
Spring 2017 Sage 300 (Accpac) Users GroupSpring 2017 Sage 300 (Accpac) Users Group
Spring 2017 Sage 300 (Accpac) Users Group
 
Types of business intelligence tools
Types of business intelligence toolsTypes of business intelligence tools
Types of business intelligence tools
 
Overview of analytics and big data in practice
Overview of analytics and big data in practiceOverview of analytics and big data in practice
Overview of analytics and big data in practice
 
Business Intelligence Presentation 1 (15th March'16)
Business Intelligence Presentation 1 (15th March'16)Business Intelligence Presentation 1 (15th March'16)
Business Intelligence Presentation 1 (15th March'16)
 
Advanced Topics In Business Intelligence
Advanced Topics In Business IntelligenceAdvanced Topics In Business Intelligence
Advanced Topics In Business Intelligence
 
Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION
Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATIONBig Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION
Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION
 
SplunkLive! Splunk for Business Analytics
SplunkLive! Splunk for Business AnalyticsSplunkLive! Splunk for Business Analytics
SplunkLive! Splunk for Business Analytics
 
Use cases for Hadoop and Big Data Analytics - InfoSphere BigInsights
Use cases for Hadoop and Big Data Analytics - InfoSphere BigInsightsUse cases for Hadoop and Big Data Analytics - InfoSphere BigInsights
Use cases for Hadoop and Big Data Analytics - InfoSphere BigInsights
 
Business intelligence in the real time economy
Business intelligence in the real time economyBusiness intelligence in the real time economy
Business intelligence in the real time economy
 
Business intelligence
Business intelligenceBusiness intelligence
Business intelligence
 
Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...
Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...
Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...
 
What exactly is Business Intelligence?
What exactly is Business Intelligence?What exactly is Business Intelligence?
What exactly is Business Intelligence?
 

Similar to High Performance BI with Cognos and ParAccel Analytic Database

Building a Big Data Solution
Building a Big Data SolutionBuilding a Big Data Solution
Building a Big Data SolutionJames Serra
 
MongoDB in a Mainframe World
MongoDB in a Mainframe WorldMongoDB in a Mainframe World
MongoDB in a Mainframe WorldMongoDB
 
The Double win business transformation and in-year ROI and TCO reduction
The Double win business transformation and in-year ROI and TCO reductionThe Double win business transformation and in-year ROI and TCO reduction
The Double win business transformation and in-year ROI and TCO reductionMongoDB
 
Capturing big value in big data
Capturing big value in big data Capturing big value in big data
Capturing big value in big data BSP Media Group
 
sap hana|sap hana database| Introduction to sap hana
sap hana|sap hana database| Introduction to sap hanasap hana|sap hana database| Introduction to sap hana
sap hana|sap hana database| Introduction to sap hanaJames L. Lee
 
DAMA Webinar: Turn Grand Designs into a Reality with Data Virtualization
DAMA Webinar: Turn Grand Designs into a Reality with Data VirtualizationDAMA Webinar: Turn Grand Designs into a Reality with Data Virtualization
DAMA Webinar: Turn Grand Designs into a Reality with Data VirtualizationDenodo
 
Business Analytics Training
Business Analytics TrainingBusiness Analytics Training
Business Analytics TrainingNatalija Pavic
 
Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...
Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...
Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...Denodo
 
CGE-BI and BOARD Business Intelligence
CGE-BI and BOARD Business IntelligenceCGE-BI and BOARD Business Intelligence
CGE-BI and BOARD Business IntelligenceDannyDuffy
 
Become More Data-driven by Leveraging Your SAP Data
Become More Data-driven by Leveraging Your SAP DataBecome More Data-driven by Leveraging Your SAP Data
Become More Data-driven by Leveraging Your SAP DataDenodo
 
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...Daniel Zivkovic
 
Building an Effective Data Warehouse Architecture
Building an Effective Data Warehouse ArchitectureBuilding an Effective Data Warehouse Architecture
Building an Effective Data Warehouse ArchitectureJames Serra
 
Accelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and VisualizationAccelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and VisualizationDenodo
 
Webinar: BI Team Backlogged with Information Demands?
Webinar: BI Team Backlogged with Information Demands?Webinar: BI Team Backlogged with Information Demands?
Webinar: BI Team Backlogged with Information Demands?Balanced Insight, Inc.
 
Enable Better Decision Making with Power BI Visualizations & Modern Data Estate
Enable Better Decision Making with Power BI Visualizations & Modern Data EstateEnable Better Decision Making with Power BI Visualizations & Modern Data Estate
Enable Better Decision Making with Power BI Visualizations & Modern Data EstateCCG
 
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Denodo
 
Introduction to HANA in-memory from SAP
Introduction to HANA in-memory from SAPIntroduction to HANA in-memory from SAP
Introduction to HANA in-memory from SAPugur candan
 
Business intelligence: A tool that could help your business
Business intelligence: A tool that could help your businessBusiness intelligence: A tool that could help your business
Business intelligence: A tool that could help your businessBeyond Intelligence
 

Similar to High Performance BI with Cognos and ParAccel Analytic Database (20)

Building a Big Data Solution
Building a Big Data SolutionBuilding a Big Data Solution
Building a Big Data Solution
 
MongoDB in a Mainframe World
MongoDB in a Mainframe WorldMongoDB in a Mainframe World
MongoDB in a Mainframe World
 
The Double win business transformation and in-year ROI and TCO reduction
The Double win business transformation and in-year ROI and TCO reductionThe Double win business transformation and in-year ROI and TCO reduction
The Double win business transformation and in-year ROI and TCO reduction
 
Capturing big value in big data
Capturing big value in big data Capturing big value in big data
Capturing big value in big data
 
IT Ready - DW: 1st Day
IT Ready - DW: 1st Day IT Ready - DW: 1st Day
IT Ready - DW: 1st Day
 
sap hana|sap hana database| Introduction to sap hana
sap hana|sap hana database| Introduction to sap hanasap hana|sap hana database| Introduction to sap hana
sap hana|sap hana database| Introduction to sap hana
 
DAMA Webinar: Turn Grand Designs into a Reality with Data Virtualization
DAMA Webinar: Turn Grand Designs into a Reality with Data VirtualizationDAMA Webinar: Turn Grand Designs into a Reality with Data Virtualization
DAMA Webinar: Turn Grand Designs into a Reality with Data Virtualization
 
BigData Analysis
BigData AnalysisBigData Analysis
BigData Analysis
 
Business Analytics Training
Business Analytics TrainingBusiness Analytics Training
Business Analytics Training
 
Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...
Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...
Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...
 
CGE-BI and BOARD Business Intelligence
CGE-BI and BOARD Business IntelligenceCGE-BI and BOARD Business Intelligence
CGE-BI and BOARD Business Intelligence
 
Become More Data-driven by Leveraging Your SAP Data
Become More Data-driven by Leveraging Your SAP DataBecome More Data-driven by Leveraging Your SAP Data
Become More Data-driven by Leveraging Your SAP Data
 
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
 
Building an Effective Data Warehouse Architecture
Building an Effective Data Warehouse ArchitectureBuilding an Effective Data Warehouse Architecture
Building an Effective Data Warehouse Architecture
 
Accelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and VisualizationAccelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and Visualization
 
Webinar: BI Team Backlogged with Information Demands?
Webinar: BI Team Backlogged with Information Demands?Webinar: BI Team Backlogged with Information Demands?
Webinar: BI Team Backlogged with Information Demands?
 
Enable Better Decision Making with Power BI Visualizations & Modern Data Estate
Enable Better Decision Making with Power BI Visualizations & Modern Data EstateEnable Better Decision Making with Power BI Visualizations & Modern Data Estate
Enable Better Decision Making with Power BI Visualizations & Modern Data Estate
 
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
 
Introduction to HANA in-memory from SAP
Introduction to HANA in-memory from SAPIntroduction to HANA in-memory from SAP
Introduction to HANA in-memory from SAP
 
Business intelligence: A tool that could help your business
Business intelligence: A tool that could help your businessBusiness intelligence: A tool that could help your business
Business intelligence: A tool that could help your business
 

Recently uploaded

08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 

Recently uploaded (20)

08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 

High Performance BI with Cognos and ParAccel Analytic Database

  • 1. dBConf 2014 High-performance Business Intelligence solution based on IBM Cognos and ParAccel Analytic Database Karol Chlasta
  • 2. Agenda About me Plan for today: – Business Intelligence Concepts & Technologies IBM Cognos Business Intelligence ParAccel Analytic Database – Roll out in an Investment Banking division of a global bank – Adoption by Client & Sales BI Unit Reporting execution summary Report conversion results Issues discovered & their solutions Next steps Credits: Sanjeev Aggarwal, Technology Architect
  • 3. Motto We did this to solve a business issue and not because of technology... The business need for and expectations of MI are evolving rapidly as is the value we can deliver. The current technology architecture struggles (and sometimes fails) to deliver the complexity of information required in a timely manner to the dispersed, diverse user community via their channels of choice.
  • 4. Business Intelligence  Good decisions are the building blocks of great business performance.  Understand and improve your business based on:  How are we doing? Monitoring KPIs with dashboards and scorecards, tracking key metrics.  Why? Reporting and analysis to get close to your data, gain context, understand trends, and spot anomalies.  What should we be doing? Planning, budgets, and forecasts let you set and share a reliable view of the future.  Business intelligence (BI) is the set of techniques and tools for the transformation of raw data into meaningful and useful information to get competitive advantage: Data → Information → Knowledge → Action
  • 5. Concepts - BI System Query & reporting Analysis Dashboards for on-line and off-line analysis Scorecards Planning & budgets Statistics, predictive modeling & advanced analytics Real-time monitoring Collaboration & social networking Mobile applications
  • 6. Concepts - DWH System Real-Time Massively Parallel Processing (MPP):  Shared Nothing vs Shared Everything  Near-linear Scalability Big Data: “Big data is like teenage sex: everyone talks about it, nobody really knows how to do it, everyone thinks everyone else is doing it, so everyone claims they are doing it…” –Dan Ariely MPP OLAP Database Typical OLTP Database Large volumes of data (TB to PB) Smaller volumes of data (GB to TB) Low number of power database users High number of concurrent light users Complex analytic queries Optimized of single row access Low level of data granularity (Facts) High use of tuning structures Decision support, and what if scenarios Transaction processing and data integrity Bulk data loading (TB / day is typical) Low volume data loading References: Press, G. (2013, June 03). [Text]. Retrieved from http://whatsthebigdata.com/2013/06/03/big-data-quotes/
  • 7. BI Platforms Business Intelligence (BI) and analytics systems are applications and technologies for gathering, storing, analyzing, and accessing information for better business decision making to gain competitive advantage. What is IBM Cognos BI? What is ParAccel Analytic Database (PADB)? Strong hints: - on my employer's name - on why we actually should it PADB - Data sheet Data sheet of a new product References: Henschen, D. (2014, February 26). Gartner BI Magic Quadrant: Winners & Losers [Image file]. Retrieved from http://www.informationweek.com/big-data/big-data-analytics/gartner-bi-magic- quadrant-winners-and-losers/d/d-id/1114013
  • 8. References: Manoria, V. (2012, May 3). IBM Cognos 10 BI: Components & User Interfaces [Image files]. Retrieved from https://www.ibm.com/developerworks/community/blogs/ibm-bi- capabilities/entry/ibm_cognos_10_bi_components_user_interfaces1?lang=en IBM Cognos BI
  • 9. Actian Analytics Database  Created by ParAccel, and known as ParAccel Analytic DataBase (PADB), now re-branded to Actian Analytics Database - Matrix  Parallel processing database management system designed for high performance advanced analytics for business intelligence:  I/O: Columnar & Compressed  CPU: Fully Compiled Queries  Interconnect: MPP Grid Protocol for inter- node communications.  Core Components  Leader node  Compute node  Interconnect  SAN Integration  Runs on Red Hat or Cent OS! References: Anderson, D. (2012, July 24). Column Oriented Database Technologies [Image files]. Retrieved from http://www.dbbest.com/blog/column-oriented-database-technologies/
  • 10.  Adaptive Compression (~4x) and no performance structures:  Using columnar storage, each block holds column field values for more records then in row-based storage. As a result reading the same number of column fields for the same number of records requires proportionally less I/O operations  Blocks hold the same data type, so compression can can be selected based on the column type of data stored in a block (mostly, delta, bytedict, runlength, text)  High-performance MPP optimizer (Omne)  Cost-based, Columnar aware ● Founded on PostgreSQL Planner/Optimizer  Unlimited Table Join Ability (patented) for use in complex database schema referenced by views  View Folding for planning through views, eliminating unused columns References: Saama blog (2014, October 20). On Big Data and In-Memory Data Clouds [Image file]. Retrieved from http://www.saama.com/on-big-data-and-in-memory-data-clouds/  Columnar storage vs row-wise database storage:  Data blocks store column values for consecutive rows  Data blocks store values for consecutive rows making up the entire record Actian Analytics Database
  • 11. Business Case Business drivers: Improved decision making Reduced data latency Perform deep, near real time analytics not possible on current platform Simplified BI infrastructure (We need to initiate, choose, purchase, engineer & implement the MPP database) Landscape before the solution:  MS SQL Server 2008 with aggregate tables & MSAS cubes  A number of front-ends to access data, incl.: • Dozens of QlikView dashboards • Hundreds of Cognos BI reports • Reporting packs not always reconciling to each other due to timing difference or system issues • Additional manual processing, or inputs needed to build complex reports
  • 12. Front Office Implementation PoC was done in 2011 and that PADB was the best fit for the business use case, winning with Sybase IQ SMP & PlexQ. Implementation happened in Q3 2012 and brought: - Introduction of MPP Database technology reduced query times from minutes to sub seconds - Reduced data processing from T+1 to near real-time (within 5 minutes from trade received to available for reporting) - Introduction of high performance analytics New strategic platform delivered to bank's clients References: Slicker city blog (2014, June 24). Rogers' technology adoption curve [Image file]. Retrieved from http://slickercity.net/tag/information-communication-technology/
  • 13. Adoption by Finance BI Client & Sales BI function based in Warsaw, Poland Project Summary: Who is it about? What happens? When did it take place? Where did it take place? Why did it happen?
  • 15. Report Conversion Results Region Report Type (D/W/M) Original Package Original Execution Time (min:sec) PABD Execution Time (min:sec) Result EMEA D Aggregated Relational 16:56 05:00 339% EMEA W Standard Relational 20:00 03:30 571% US D Aggregated Relational 01:20 00:40 200% US D Aggregated Relational 01:46 00:32 331% US M Aggregated Relational 00:17 00:19 89% US D Aggregated Relational 01:38 00:22 445% US D Aggregated Relational 04:01 00:52 463% US M Aggregated Relational 00:25 00:35 71% US D Aggregated Relational 08:01 00:15 3207%
  • 16. Report Issues & Solutions Issue Description Solution Report page containing list does not run returning error RQP-DEF-0177. (this is despite an underlying query returning tabular data with no issues). Default list header might use ‘Data Item Label’ as a column source type. After changing the setting from ‘Data Item Label’ to ‘Text’ the error disappears. Rank in not working as expected when applied in the filters, returning incorrect sequence. Set Application to After Auto Aggregation. When using case when {expression} then … end the returned else result expression type is always BLOB. Report fails to run. Perform CAST to char or any other desired type in the case statement definition. PADB does not handle DATETIME data type. Use TRUNC (date) function to return date with no time portion
  • 17. Adoption Next Steps Next steps are to: Deliver additional end-user trainings Finalize report conversion exercise Add additional facts and dimensions to PADB Connect ALL remaining standard MI reports to a single real-time Cognos data source (PADB Cognos package) Decommission: aggregate tables in SQL Server redundant Cognos packages Make a better use of off-the-shelf PABD analytic functions with Cognos Monitor and optimize...