© Lighthouse Computer Services, All rights reserved
Robb Sinclair
- 22 Years delivering
Business Analytics and Data Analytics
- Working with a team of 30 professionals in
data, reporting, planning and predictive
- Former IBM Customer, IBMer and Partner for
20 years
VP Services @ Creative
© Lighthouse Computer Services, All rights reserved
Agenda
• About Us
• Information Integration & Governance
• Predictive Analytics
• Business Analytics
• Demo
• Follow up
• Lets play Ball
© Lighthouse Computer Services, All rights reserved
Topics
Today’s Analytics require modern reporting, data discovery,
profiling, integration, governance and grooming.
The presentation will provide an introduction to these topics followed by
a brief demonstration of the capabilities from the IBM portfolio.
Time will be available to answer questions and discuss your specific
needs.
© Lighthouse Computer Services, All rights reserved
The Basics
 Founded in 1991
 Headquartered in Lincoln, RI
 Approximately 30 employees
 New England Focus, Office in Canada
IBM Brand Certifications
 Business Analytics
 Business Analytics Solutions
 Information Management
Creative Computing: Just the Facts
Industry Focus
 Healthcare
 Higher Education
 Manufacturing
 Retail
 Finance
Analytics Focus Areas
 IBM Software
 IBM Training
 Installation Configuration
 Implementation Services
 Project Services
© Lighthouse Computer Services, All rights reserved
Lighthouse Expertise:
On-premise and Cloud Solutions
Full spectrum
of Cloud
Computing
services
Complement
ary practices
Expert Pre & Post
Sales Services
Expert Project
Management
Skills
© Lighthouse Computer Services, All rights reserved
Budgeting &
Forecasting
Ad Hoc Reports,
OLAP & Dashboards
Descriptive &
Predictive Modeling
Why Did It Happen
Data Information Knowledge Insight Action
Raw Data
Standard
Reports
Structured
Data
What Happened
What’s Likely to Happen
Value of
Information
How to Make it Happen
Business Optimization
& Planning
Analysis
IM BI PM AA
Analytics Journey…
© Lighthouse Computer Services, All rights reserved
Information Integration and
Governance
© Lighthouse Computer Services, All rights reserved
Information Integration and Governance
Information
from Everywhere
Radical
Flexibility
Extreme
Scalability
Tweets created daily
million
from CERN Hadron Collider
terabytes
per second
trade events per second
million
We are all facing a new era of computing …
© Lighthouse Computer Services, All rights reserved
Information Integration and Governance
Traditional Approach
Structured, analytical, logical
New Approach
Creative, holistic, intuitive
Internal App Data
Data
Warehouse
Traditional
Sources
Structured
Repeatable
Linear
Transaction Data
ERP data
Mainframe Data
OLTP System Data
Hadoop
Streams
New
Sources
Unstructured
Exploratory
Iterative
Web Logs
Social Data
Text & Images
Sensor Data
RFID
Data
Warehouse
Hadoop
Streams
Traditional
Sources
New
Sources
IIG
© Lighthouse Computer Services, All rights reserved
Information Integration and Governance
Information
Governance
Catalog
Understand & Collaborate
• Catalog technical metadata &
align w/ business language
• Mange (big) data lineage
• New compliance reporting
Data
Quality
Cleanse & Monitor
• Analyze & validate
w/ enhanced classification
• Cleanse & standardize
• Define, manage & monitor
data rules + exceptions
Data
Integration
Transform & Deliver
• Massive scalability
• Power for any complexity
• Deliver in batch and/or real-
time with change capture
.. powered by Information Server
Integrating and transforming data and content to deliver
accurate, consistent, timely and complete information on a
single platform unified by a common metadata layer
InfoSphere
Information
Server
Information
Governance
Catalog
Data
Integration
Data
Quality
• common connectivity • shared metadata • security (new data privacy functions included)
• common execution engine with flexible deployments (new native on YARN)
© Lighthouse Computer Services, All rights reserved
Information Integration and Governance
Data Quality: Cleanse data & monitor quality, turning data assets into trusted
information
Analyze data, cleanse data & control
quality
Analyze
Use source system analysis to
understand your issues
automated discovery of critical data and
hidden data relationships
Cleanse
Investigate, standardize, match and
survive data
most comprehensive & customizable
solution
Control & monitor quality
Assess and monitor the quality of your data in
any place (database/or data flow) and across
systems
unique capability to align DQ metrics with
business & governance objectives
© Lighthouse Computer Services, All rights reserved
Information Integration and Governance
InfoSphere Information Governance Catalog: Understand data & govern using a meaningful directory of
governed information
Simple search
Understand
• Leverage a comprehensive catalog of information assets
• Establish responsibility & accountability throughout the information
development lifecycle
• Support collections of assets for team collaboration
• Provides business context & governance for IT assets
• Dramatically increases business confidence in information assets
Govern
• Collaboratively establish a governed business vocabulary
• Create stewards, assign responsibilities for information domains
• Rely on end-to-end lineage across information assets
• Links business terms & information governance rules to
information assets & operational rules
• Integrate with other products for operational governance
© Lighthouse Computer Services, All rights reserved
Information Integration and Governance
Data Integration: Transform and deliver data to any system, improving time to value
Deliver data efficiently according
to your business requirements
Deliver
 Leverage unique capabilities to:
 Read from low-impact DBMS logs
 Apply any level of complex data
integration/data quality logic
 Guarantee delivery through two-phased
commit to one or more DBMS or MQ
targets
 Support the most complex & challenging
real-time integration requirements
Federation
ETL
Bulk Transformation
(ETL and ELT)
Incremental Replication (CDC)
Business
Application
Message
Queue
ETL
© Lighthouse Computer Services, All rights reserved
Data Warehouse Appliance – buy not build
Bring the analytics to the data not
the data to the analytics
Use cases
Features
 Built-in, in-database analytic functions
– Data mining, prediction, transformations, statistics,
geospatial, data preparation
 Full integration with tools for BI & visualization
– IBM Cognos, Microstrategy, Business Objects, SAS,
MS Excel, SSRS, Kognitio, Qlikview
 Full integration tools for model building & scoring
– IBM SPSS, SAS, Open Source R, Fuzzy Logix
 Full integration for custom analytics
– Open Source R, Java, C, C++, Python, LUA
 Reduce hospital admissions or personalize
disease treatments
 Achieve an order of magnitude improvement in
manufacturing quality
 Better understand the risk of catastrophic events
and many more use cases
Data
Preparation
Predictive
Analytics
Geospatial
Analytics
Advanced
Statistics
In-database Analytics For Every Role in Your Enterprise
© Lighthouse Computer Services, All rights reserved
Cloud Data Services
In-database analytics capabilities for best performance atop a fully-managed warehouse
BLU
Acceleration
Netezza
In-Database
Analytics
Cloudant
NoSQL
Integration
dashDB
MPP
 Fully-managed data warehouse on cloud
 DB2 BLU columnar technology +
Netezza in-database analytics
– BLU in-memory processing, data skipping,
actionable compression, parallel vector
processing, “Load & Go” administration
– Netezza predictive analytic algorithms,
fully integrated RStudio & R language
 Oracle compatibility
 Massively Parallel Processing (MPP)
© Lighthouse Computer Services, All rights reserved
Master Data Management
© Lighthouse Computer Services, All rights reserved
Predictive Analytics
© Lighthouse Computer Services, All rights reserved
Advanced Analytics - Predictive
Operational analytics
 Manage
 Maintain
 Maximize
Analytic
Server
Modeler CPLEX StudioStatistics
IBM® (SPSS®) Predictive Analytics
Customer analytics
 Acquire
 Grow
 Retain
Threat & Fraud analytics
 Monitor
 Detect
 Prevent
IBM® Prescriptive Analytics
Decision Optimization
Center (DOC)
DOCloud
© Lighthouse Computer Services, All rights reserved
Advanced Analytics – From/To Anywhere
Data
Preparation
Analytics at
Scale
Insight to
Action
ALL Data
(Structured, Unstructured,
Streaming)
All Decisions
(People, Systems,
Strategic, Operational,
Real-Time)
• Predictive models
• Machine Learning
• Statistical Analysis
• Decision Optimization
• Real-Time Scoring
• Optimized Decisions
• APIs & services
• Dashboards / Interactive
apps
• Data models
• Data connectors
• Data Wrangling
© Lighthouse Computer Services, All rights reserved
Advanced Analytics – For all
Expert User
Deep Predictive Capabilities With In-
database, R and Python Integration, and
Integrated Deployment
Intermediate User
Visual Workbench for Building Models
of Any Complexity With Ability to
Automate and Combine Tasks
Novice
Simple, Easy-to-Use, Visual, Guided
Analytical Discovery, Intelligent
Automation and Visual Storytelling
© Lighthouse Computer Services, All rights reserved
Business Analytics
© Lighthouse Computer Services, All rights reserved
Business Analytics
© Lighthouse Computer Services, All rights reserved
© Lighthouse Computer Services, All rights reserved
© Lighthouse Computer Services, All rights reserved
Our Demonstration
© Lighthouse Computer Services, All rights reserved
Our Demo Company - MAJiCo
© Lighthouse Computer Services, All rights reserved
The Players
Data Pro
Data Scientist
Business Analyst
Ben
Chris Sara
© Lighthouse Computer Services, All rights reserved
Our Data Pro
• Our data professional has a tough job of attesting to the quality of information, delivering in a
timely manner, defending against other sources or methods of data access and understanding
both how the transaction system records data but also how the users need to use and see data.
• We have taken a traditional approach to data integration for a company that has grown over
time – the corporate data warehouse.
• And have standard tools for data integration (ETL) and storage (Data warehouse).
• He understands the needs of his user community for corporate data, business / management
data and external data comparative and transitive data.
• He also understands that corporate data accuracy and availability is his responsibility.
© Lighthouse Computer Services, All rights reserved
Our Data Pro
• Chris will now demonstrate the cloud based development environment for data integration and
governance activities as well as the data warehouse in the cloud dashDB
• Chris will cover the metadata and master data management to govern data elements, profile the
data and identify where data quality can be improved
• Chris will now apply data quality fixes to improve data for the whole enterprise
Link to Video 1
Link to Video 2
Link to Video 3
© Lighthouse Computer Services, All rights reserved
Our Data Scientist
• Our data scientist has been working with some information that we received from data
warehouse and customer call center.
• Our data scientist has imperfect set of data (combining multiple sets of external
sources)
• He begins by preparing data discovery, profiling and grooming activities.
• He prepares a prediction on revenue numbers to support some new business ideas
Link to Video
© Lighthouse Computer Services, All rights reserved
Our Business Analyst
• Our business analyst is responsible for information delivery and the process or
requirement extraction, modeling, agreement, build and test in order to delivery
quality information sets.
• Our company uses standard list and cross tab reports, some graphical dashboards
and board books and raw access to data to support specific department uses of data.
• Lately our business analyst is getting more request for raw access to data to support
other tools and information delivery exercises (external bureau based agencies).
• The big request has been to support the business with information to try and
understand GROWTH options for geographic, line of business, market or other ways
to expand.
© Lighthouse Computer Services, All rights reserved
Our Business Analyst
• Sara will demonstrate the information use as the VP of Watches including mobile
device and online
• Sara will show how data from Ben and SPSS has been into reporting available to
users
• Sara will show the use of dynamic filters by an user
• Sara will leverage the Cognos Search capabilities to find new insights and sources
• Sara will run the content found and drill into details
• Finally Sara will demonstrate self services to build a set of dashboards and reports
including the word cloud tab
Link to Video
© Lighthouse Computer Services, All rights reserved
Our Demo Company - MAJiCo
© Lighthouse Computer Services, All rights reserved
Question and Answers
© Lighthouse Computer Services, All rights reserved
Follow up:
Discuss with your Lighthouse partner
for options to continue the
conversation.
We can offer an assessment, health
check, whiteboard or an engagement to
prepare a roadmap for your
Modern Analytics Journey.
Lets enjoy the game and I am around for
any questions that you have.
28
© Lighthouse Computer Services, All rights reserved
Thank You

IBM Modern Analytics Journey

  • 2.
    © Lighthouse ComputerServices, All rights reserved Robb Sinclair - 22 Years delivering Business Analytics and Data Analytics - Working with a team of 30 professionals in data, reporting, planning and predictive - Former IBM Customer, IBMer and Partner for 20 years VP Services @ Creative
  • 3.
    © Lighthouse ComputerServices, All rights reserved Agenda • About Us • Information Integration & Governance • Predictive Analytics • Business Analytics • Demo • Follow up • Lets play Ball
  • 4.
    © Lighthouse ComputerServices, All rights reserved Topics Today’s Analytics require modern reporting, data discovery, profiling, integration, governance and grooming. The presentation will provide an introduction to these topics followed by a brief demonstration of the capabilities from the IBM portfolio. Time will be available to answer questions and discuss your specific needs.
  • 5.
    © Lighthouse ComputerServices, All rights reserved The Basics  Founded in 1991  Headquartered in Lincoln, RI  Approximately 30 employees  New England Focus, Office in Canada IBM Brand Certifications  Business Analytics  Business Analytics Solutions  Information Management Creative Computing: Just the Facts Industry Focus  Healthcare  Higher Education  Manufacturing  Retail  Finance Analytics Focus Areas  IBM Software  IBM Training  Installation Configuration  Implementation Services  Project Services
  • 6.
    © Lighthouse ComputerServices, All rights reserved Lighthouse Expertise: On-premise and Cloud Solutions Full spectrum of Cloud Computing services Complement ary practices Expert Pre & Post Sales Services Expert Project Management Skills
  • 7.
    © Lighthouse ComputerServices, All rights reserved Budgeting & Forecasting Ad Hoc Reports, OLAP & Dashboards Descriptive & Predictive Modeling Why Did It Happen Data Information Knowledge Insight Action Raw Data Standard Reports Structured Data What Happened What’s Likely to Happen Value of Information How to Make it Happen Business Optimization & Planning Analysis IM BI PM AA Analytics Journey…
  • 8.
    © Lighthouse ComputerServices, All rights reserved Information Integration and Governance
  • 9.
    © Lighthouse ComputerServices, All rights reserved Information Integration and Governance Information from Everywhere Radical Flexibility Extreme Scalability Tweets created daily million from CERN Hadron Collider terabytes per second trade events per second million We are all facing a new era of computing …
  • 10.
    © Lighthouse ComputerServices, All rights reserved Information Integration and Governance Traditional Approach Structured, analytical, logical New Approach Creative, holistic, intuitive Internal App Data Data Warehouse Traditional Sources Structured Repeatable Linear Transaction Data ERP data Mainframe Data OLTP System Data Hadoop Streams New Sources Unstructured Exploratory Iterative Web Logs Social Data Text & Images Sensor Data RFID Data Warehouse Hadoop Streams Traditional Sources New Sources IIG
  • 11.
    © Lighthouse ComputerServices, All rights reserved Information Integration and Governance Information Governance Catalog Understand & Collaborate • Catalog technical metadata & align w/ business language • Mange (big) data lineage • New compliance reporting Data Quality Cleanse & Monitor • Analyze & validate w/ enhanced classification • Cleanse & standardize • Define, manage & monitor data rules + exceptions Data Integration Transform & Deliver • Massive scalability • Power for any complexity • Deliver in batch and/or real- time with change capture .. powered by Information Server Integrating and transforming data and content to deliver accurate, consistent, timely and complete information on a single platform unified by a common metadata layer InfoSphere Information Server Information Governance Catalog Data Integration Data Quality • common connectivity • shared metadata • security (new data privacy functions included) • common execution engine with flexible deployments (new native on YARN)
  • 12.
    © Lighthouse ComputerServices, All rights reserved Information Integration and Governance Data Quality: Cleanse data & monitor quality, turning data assets into trusted information Analyze data, cleanse data & control quality Analyze Use source system analysis to understand your issues automated discovery of critical data and hidden data relationships Cleanse Investigate, standardize, match and survive data most comprehensive & customizable solution Control & monitor quality Assess and monitor the quality of your data in any place (database/or data flow) and across systems unique capability to align DQ metrics with business & governance objectives
  • 13.
    © Lighthouse ComputerServices, All rights reserved Information Integration and Governance InfoSphere Information Governance Catalog: Understand data & govern using a meaningful directory of governed information Simple search Understand • Leverage a comprehensive catalog of information assets • Establish responsibility & accountability throughout the information development lifecycle • Support collections of assets for team collaboration • Provides business context & governance for IT assets • Dramatically increases business confidence in information assets Govern • Collaboratively establish a governed business vocabulary • Create stewards, assign responsibilities for information domains • Rely on end-to-end lineage across information assets • Links business terms & information governance rules to information assets & operational rules • Integrate with other products for operational governance
  • 14.
    © Lighthouse ComputerServices, All rights reserved Information Integration and Governance Data Integration: Transform and deliver data to any system, improving time to value Deliver data efficiently according to your business requirements Deliver  Leverage unique capabilities to:  Read from low-impact DBMS logs  Apply any level of complex data integration/data quality logic  Guarantee delivery through two-phased commit to one or more DBMS or MQ targets  Support the most complex & challenging real-time integration requirements Federation ETL Bulk Transformation (ETL and ELT) Incremental Replication (CDC) Business Application Message Queue ETL
  • 15.
    © Lighthouse ComputerServices, All rights reserved Data Warehouse Appliance – buy not build Bring the analytics to the data not the data to the analytics Use cases Features  Built-in, in-database analytic functions – Data mining, prediction, transformations, statistics, geospatial, data preparation  Full integration with tools for BI & visualization – IBM Cognos, Microstrategy, Business Objects, SAS, MS Excel, SSRS, Kognitio, Qlikview  Full integration tools for model building & scoring – IBM SPSS, SAS, Open Source R, Fuzzy Logix  Full integration for custom analytics – Open Source R, Java, C, C++, Python, LUA  Reduce hospital admissions or personalize disease treatments  Achieve an order of magnitude improvement in manufacturing quality  Better understand the risk of catastrophic events and many more use cases Data Preparation Predictive Analytics Geospatial Analytics Advanced Statistics In-database Analytics For Every Role in Your Enterprise
  • 16.
    © Lighthouse ComputerServices, All rights reserved Cloud Data Services In-database analytics capabilities for best performance atop a fully-managed warehouse BLU Acceleration Netezza In-Database Analytics Cloudant NoSQL Integration dashDB MPP  Fully-managed data warehouse on cloud  DB2 BLU columnar technology + Netezza in-database analytics – BLU in-memory processing, data skipping, actionable compression, parallel vector processing, “Load & Go” administration – Netezza predictive analytic algorithms, fully integrated RStudio & R language  Oracle compatibility  Massively Parallel Processing (MPP)
  • 17.
    © Lighthouse ComputerServices, All rights reserved Master Data Management
  • 18.
    © Lighthouse ComputerServices, All rights reserved Predictive Analytics
  • 19.
    © Lighthouse ComputerServices, All rights reserved Advanced Analytics - Predictive Operational analytics  Manage  Maintain  Maximize Analytic Server Modeler CPLEX StudioStatistics IBM® (SPSS®) Predictive Analytics Customer analytics  Acquire  Grow  Retain Threat & Fraud analytics  Monitor  Detect  Prevent IBM® Prescriptive Analytics Decision Optimization Center (DOC) DOCloud
  • 20.
    © Lighthouse ComputerServices, All rights reserved Advanced Analytics – From/To Anywhere Data Preparation Analytics at Scale Insight to Action ALL Data (Structured, Unstructured, Streaming) All Decisions (People, Systems, Strategic, Operational, Real-Time) • Predictive models • Machine Learning • Statistical Analysis • Decision Optimization • Real-Time Scoring • Optimized Decisions • APIs & services • Dashboards / Interactive apps • Data models • Data connectors • Data Wrangling
  • 21.
    © Lighthouse ComputerServices, All rights reserved Advanced Analytics – For all Expert User Deep Predictive Capabilities With In- database, R and Python Integration, and Integrated Deployment Intermediate User Visual Workbench for Building Models of Any Complexity With Ability to Automate and Combine Tasks Novice Simple, Easy-to-Use, Visual, Guided Analytical Discovery, Intelligent Automation and Visual Storytelling
  • 22.
    © Lighthouse ComputerServices, All rights reserved Business Analytics
  • 23.
    © Lighthouse ComputerServices, All rights reserved Business Analytics
  • 24.
    © Lighthouse ComputerServices, All rights reserved
  • 25.
    © Lighthouse ComputerServices, All rights reserved
  • 26.
    © Lighthouse ComputerServices, All rights reserved Our Demonstration
  • 27.
    © Lighthouse ComputerServices, All rights reserved Our Demo Company - MAJiCo
  • 28.
    © Lighthouse ComputerServices, All rights reserved The Players Data Pro Data Scientist Business Analyst Ben Chris Sara
  • 29.
    © Lighthouse ComputerServices, All rights reserved Our Data Pro • Our data professional has a tough job of attesting to the quality of information, delivering in a timely manner, defending against other sources or methods of data access and understanding both how the transaction system records data but also how the users need to use and see data. • We have taken a traditional approach to data integration for a company that has grown over time – the corporate data warehouse. • And have standard tools for data integration (ETL) and storage (Data warehouse). • He understands the needs of his user community for corporate data, business / management data and external data comparative and transitive data. • He also understands that corporate data accuracy and availability is his responsibility.
  • 30.
    © Lighthouse ComputerServices, All rights reserved Our Data Pro • Chris will now demonstrate the cloud based development environment for data integration and governance activities as well as the data warehouse in the cloud dashDB • Chris will cover the metadata and master data management to govern data elements, profile the data and identify where data quality can be improved • Chris will now apply data quality fixes to improve data for the whole enterprise Link to Video 1 Link to Video 2 Link to Video 3
  • 31.
    © Lighthouse ComputerServices, All rights reserved Our Data Scientist • Our data scientist has been working with some information that we received from data warehouse and customer call center. • Our data scientist has imperfect set of data (combining multiple sets of external sources) • He begins by preparing data discovery, profiling and grooming activities. • He prepares a prediction on revenue numbers to support some new business ideas Link to Video
  • 32.
    © Lighthouse ComputerServices, All rights reserved Our Business Analyst • Our business analyst is responsible for information delivery and the process or requirement extraction, modeling, agreement, build and test in order to delivery quality information sets. • Our company uses standard list and cross tab reports, some graphical dashboards and board books and raw access to data to support specific department uses of data. • Lately our business analyst is getting more request for raw access to data to support other tools and information delivery exercises (external bureau based agencies). • The big request has been to support the business with information to try and understand GROWTH options for geographic, line of business, market or other ways to expand.
  • 33.
    © Lighthouse ComputerServices, All rights reserved Our Business Analyst • Sara will demonstrate the information use as the VP of Watches including mobile device and online • Sara will show how data from Ben and SPSS has been into reporting available to users • Sara will show the use of dynamic filters by an user • Sara will leverage the Cognos Search capabilities to find new insights and sources • Sara will run the content found and drill into details • Finally Sara will demonstrate self services to build a set of dashboards and reports including the word cloud tab Link to Video
  • 34.
    © Lighthouse ComputerServices, All rights reserved Our Demo Company - MAJiCo
  • 35.
    © Lighthouse ComputerServices, All rights reserved Question and Answers
  • 36.
    © Lighthouse ComputerServices, All rights reserved Follow up: Discuss with your Lighthouse partner for options to continue the conversation. We can offer an assessment, health check, whiteboard or an engagement to prepare a roadmap for your Modern Analytics Journey. Lets enjoy the game and I am around for any questions that you have. 28
  • 37.
    © Lighthouse ComputerServices, All rights reserved Thank You

Editor's Notes

  • #28 Modern Analytics Journey Company – Sells products for the outdoor market – Cameras, Watches, Lenses, and survival gear. We have a reporting warehouse to report on sales by month, product for units and revenue. Executive, management and the sales team have access to reporting on a timely basis. They are satisfied with reporting. There are some conventional wisdom / tribal knowledge / assumptions about the profile of our customer. We have been successful for years and we have built marketing, business development, sales, customer rep, support and post care around these assumptions. We are doing well but not continuing our historical growth. We know how to approach our ideal customer – or what we think is our ideal customer. We know our success – we don’t know what we don’t know.
  • #35 To review we have: Provided the foundation understanding of the modern analytics journey using the IBM platform. This includes Information Integration and Governance, Predictive and modern reporting, search, dash boarding and self service. Demonstrated the application of the cloud, mobile and on premise from this platform to provide IT with the tools they need to be successful and the business with the tools that they need to perform their jobs in the modern era.