www.globalbigdataconference.com
Twitter : @bigdataconf
Implementing Predictive
Analytics into
Operational Workflows
Derek Wilson
CDO Advisors
02/03/18 1:40 - 2:20
Agenda
• What is Predictive Analytics
• Predictive Analytics Framework
• Customer Churn
• Cross Selling
copyright 2018 CDO Advisors - www.cdoadvisors.com 3
What is Predictive Analytics?
Predictive Analytics is used to improve the performance of your business by
focusing on:
• Improving Revenue
• Decreasing Expenses
• Improving Service for Internal or External Customers
Predictive Analytics uncovers patterns and relationships in data by leveraging
historical data to apply to current information.
Predictive Analytics is forward looking and attempts to anticipate outcomes
and behaviors based on mathematical models not assumptions or gut
feeling.
copyright 2018 CDO Advisors - www.cdoadvisors.com 4
Predictive Analytics Framework
Preparation - Initial phase that focuses on partnering with the
business to determine what is to be
accomplished.
Investigation - Exploring the organizations data assets to see
what data is available
Modeling - Is where the data experimentation takes place
Evaluation - Reviewing the best performing models with the
business users
Deployment - Model is loaded with production data to creation
actionable insights
copyright 2018 CDO Advisors - www.cdoadvisors.com 5
Customer Churn Questions
• Can we predict which customers have the highest risk of churn?
• Do we have data that can be useful to understand patterns in why
customers have churned?
• Can we access and process the data?
• Is the data of sufficient quality?
• What kind of models can we build?
• How accurate are the models?
• How do we make the model’s outcome actionable?
copyright 2018 CDO Advisors - www.cdoadvisors.com 6
Customer Churn - Preparation
Business Users – Problem Statement
• Define the business problem that you want to better
understand
• How will you track Experimental and Control group to track the
impact of the analytics
• Establish the current Churn Rate baseline
• Define the parameters of the project
• Line of Business, Product, Segmentation
• Amount of time to spend on the problem
• Determine where model output will be used in operations
Data Scientists – Questions
• How will you use the output from the model?
• What prior analysis has been done?
• What has been done successfully to reduce churn in the past?
copyright 2018 CDO Advisors - www.cdoadvisors.com 7
Telco Churn Sample Data Elements
• Spouse
• Dependents
• Internet Service
• Online Security
• Tech Support
• Contract Type
• Paperless Billing
• Payment Method
• Lifetime Months Tenure
• Monthly Charges
copyright 2018 CDO Advisors - www.cdoadvisors.com 8
Customer Churn - Investigation
Business Users – Process Clarification
• Ensure the process for customer lifecycle is well defined
• What applications have data that would be beneficial to use?
• Are there known external data that could be used?
Data Scientists – Data and Process Questions
• What data is available?
• Leverage a variety of tools and methods to understand the
data?
• Visualization tools
• Statistical analytics
• What is the quality of the data?
• Distribution of data
• Quality of data
• Volume of data
copyright 2018 CDO Advisors - www.cdoadvisors.com 9
Customer Churn - Modeling
Business Users – Engagement on Modeling
• Review output of trial models as requested
• Check assumptions that are made on the data
• Ensure output will satisfy business problem
Data Scientists – Experimentation of Models
• Create and build models
• Trial and error on the output of the models
• Experimentation on different data elements
• Model accuracy
• Different algorithms
• Optimization of models
• Testing of the model
copyright 2018 CDO Advisors - www.cdoadvisors.com 10
Data Mining – Decision Tree (Partial)
copyright 2018 CDO Advisors - www.cdoadvisors.com 11
Customer Churn - Evaluation
Business Users
• Review model source data, modifications and process
• Review output of best performing models
• Ensure output can be used in business operations
Data Scientists
• Present models to the business users
• Share discovers in the data:
• What patterns were observed
• Review data chosen, modifications, quality issues
addressed
• Review how the model output will be shared with the business
• Excel output
• Written to a database
copyright 2018 CDO Advisors - www.cdoadvisors.com 12
Predictive Analytics - Evaluation
copyright 2018 CDO Advisors - www.cdoadvisors.com 13
Customer Churn - Deployment
Business Users – Operational Actions
• Implement changes to operational processes based on the new data
from the model
Data Scientists – Monitoring and Progress of Actions
• Monitor the progress of the control and experimental group
• Review results of the operational changes monthly with business
users
• If the model is reducing churn, expand to other areas and start the
process from the preparation stage
• Determine when to re-evaluate the model, when does the current
models accuracy no longer work
copyright 2018 CDO Advisors - www.cdoadvisors.com 14
Applying the Model
copyright 2018 CDO Advisors - www.cdoadvisors.com 15
Marketing Response Questions
• Can we predict which people are most likely to respond to our campaign?
• What kind of campaign are we doing? (email, mail, sms)
• Do we have data that can be useful to understand patterns prior
campaigns?
• Can we access and process the data?
• Is the data of sufficient quality?
• What kind of models can we build?
• How accurate are the models?
• How do we make the model’s outcome actionable?
copyright 2018 CDO Advisors - www.cdoadvisors.com 16
Marketing Response Sample Data Elements
• Age
• Gender
• Job
• Marital Status
• Education
• Housing Loan
• Personal Loan
• Automobile Ownership
• Postal Code
• Census Block
• Contact (method)
copyright 2018 CDO Advisors - www.cdoadvisors.com 17
Marketing Response - Flow
Preparation - Initial phase that focuses on partnering with the
business to determine what is to be accomplished.
Investigation - Exploring the organizations data assets to see what data
is available
Modeling - Is where the data experimentation takes place
Evaluation - Reviewing the best performing models with the
business users
Deployment - Model is loaded with production data to creation
actionable insights
copyright 2018 CDO Advisors - www.cdoadvisors.com 18
Applying the Model
4/10/2018 www.cdoadvisors.com 19
Getting started with Predictive Analytics?
• Start with the data you have
• Identify a core business problem that you want to solve
• Determine the required data elements and quality of data
• Build models….Evaluate models…test models….
• Implement the model
• Limited scope to build confidence
• A/B Testing to show actual performance of the model versus control group
• Monitor and measure the results
• How is the model performing versus normal business operations?
4/10/2018 www.cdoadvisors.com 20
Questions or Follow Up
Derek Wilson, CEO – CDO Advisors
dwilson@cdoadvisors.com
www.cdoadvisors.com
Office : 832-819-5744
Connect with me on LinkedIn –
https://www.linkedin.com/in/derekewilson/
copyright 2018 CDO Advisors - www.cdoadvisors.com 21

Primed-AP Methodology

  • 1.
  • 2.
    Implementing Predictive Analytics into OperationalWorkflows Derek Wilson CDO Advisors 02/03/18 1:40 - 2:20
  • 3.
    Agenda • What isPredictive Analytics • Predictive Analytics Framework • Customer Churn • Cross Selling copyright 2018 CDO Advisors - www.cdoadvisors.com 3
  • 4.
    What is PredictiveAnalytics? Predictive Analytics is used to improve the performance of your business by focusing on: • Improving Revenue • Decreasing Expenses • Improving Service for Internal or External Customers Predictive Analytics uncovers patterns and relationships in data by leveraging historical data to apply to current information. Predictive Analytics is forward looking and attempts to anticipate outcomes and behaviors based on mathematical models not assumptions or gut feeling. copyright 2018 CDO Advisors - www.cdoadvisors.com 4
  • 5.
    Predictive Analytics Framework Preparation- Initial phase that focuses on partnering with the business to determine what is to be accomplished. Investigation - Exploring the organizations data assets to see what data is available Modeling - Is where the data experimentation takes place Evaluation - Reviewing the best performing models with the business users Deployment - Model is loaded with production data to creation actionable insights copyright 2018 CDO Advisors - www.cdoadvisors.com 5
  • 6.
    Customer Churn Questions •Can we predict which customers have the highest risk of churn? • Do we have data that can be useful to understand patterns in why customers have churned? • Can we access and process the data? • Is the data of sufficient quality? • What kind of models can we build? • How accurate are the models? • How do we make the model’s outcome actionable? copyright 2018 CDO Advisors - www.cdoadvisors.com 6
  • 7.
    Customer Churn -Preparation Business Users – Problem Statement • Define the business problem that you want to better understand • How will you track Experimental and Control group to track the impact of the analytics • Establish the current Churn Rate baseline • Define the parameters of the project • Line of Business, Product, Segmentation • Amount of time to spend on the problem • Determine where model output will be used in operations Data Scientists – Questions • How will you use the output from the model? • What prior analysis has been done? • What has been done successfully to reduce churn in the past? copyright 2018 CDO Advisors - www.cdoadvisors.com 7
  • 8.
    Telco Churn SampleData Elements • Spouse • Dependents • Internet Service • Online Security • Tech Support • Contract Type • Paperless Billing • Payment Method • Lifetime Months Tenure • Monthly Charges copyright 2018 CDO Advisors - www.cdoadvisors.com 8
  • 9.
    Customer Churn -Investigation Business Users – Process Clarification • Ensure the process for customer lifecycle is well defined • What applications have data that would be beneficial to use? • Are there known external data that could be used? Data Scientists – Data and Process Questions • What data is available? • Leverage a variety of tools and methods to understand the data? • Visualization tools • Statistical analytics • What is the quality of the data? • Distribution of data • Quality of data • Volume of data copyright 2018 CDO Advisors - www.cdoadvisors.com 9
  • 10.
    Customer Churn -Modeling Business Users – Engagement on Modeling • Review output of trial models as requested • Check assumptions that are made on the data • Ensure output will satisfy business problem Data Scientists – Experimentation of Models • Create and build models • Trial and error on the output of the models • Experimentation on different data elements • Model accuracy • Different algorithms • Optimization of models • Testing of the model copyright 2018 CDO Advisors - www.cdoadvisors.com 10
  • 11.
    Data Mining –Decision Tree (Partial) copyright 2018 CDO Advisors - www.cdoadvisors.com 11
  • 12.
    Customer Churn -Evaluation Business Users • Review model source data, modifications and process • Review output of best performing models • Ensure output can be used in business operations Data Scientists • Present models to the business users • Share discovers in the data: • What patterns were observed • Review data chosen, modifications, quality issues addressed • Review how the model output will be shared with the business • Excel output • Written to a database copyright 2018 CDO Advisors - www.cdoadvisors.com 12
  • 13.
    Predictive Analytics -Evaluation copyright 2018 CDO Advisors - www.cdoadvisors.com 13
  • 14.
    Customer Churn -Deployment Business Users – Operational Actions • Implement changes to operational processes based on the new data from the model Data Scientists – Monitoring and Progress of Actions • Monitor the progress of the control and experimental group • Review results of the operational changes monthly with business users • If the model is reducing churn, expand to other areas and start the process from the preparation stage • Determine when to re-evaluate the model, when does the current models accuracy no longer work copyright 2018 CDO Advisors - www.cdoadvisors.com 14
  • 15.
    Applying the Model copyright2018 CDO Advisors - www.cdoadvisors.com 15
  • 16.
    Marketing Response Questions •Can we predict which people are most likely to respond to our campaign? • What kind of campaign are we doing? (email, mail, sms) • Do we have data that can be useful to understand patterns prior campaigns? • Can we access and process the data? • Is the data of sufficient quality? • What kind of models can we build? • How accurate are the models? • How do we make the model’s outcome actionable? copyright 2018 CDO Advisors - www.cdoadvisors.com 16
  • 17.
    Marketing Response SampleData Elements • Age • Gender • Job • Marital Status • Education • Housing Loan • Personal Loan • Automobile Ownership • Postal Code • Census Block • Contact (method) copyright 2018 CDO Advisors - www.cdoadvisors.com 17
  • 18.
    Marketing Response -Flow Preparation - Initial phase that focuses on partnering with the business to determine what is to be accomplished. Investigation - Exploring the organizations data assets to see what data is available Modeling - Is where the data experimentation takes place Evaluation - Reviewing the best performing models with the business users Deployment - Model is loaded with production data to creation actionable insights copyright 2018 CDO Advisors - www.cdoadvisors.com 18
  • 19.
    Applying the Model 4/10/2018www.cdoadvisors.com 19
  • 20.
    Getting started withPredictive Analytics? • Start with the data you have • Identify a core business problem that you want to solve • Determine the required data elements and quality of data • Build models….Evaluate models…test models…. • Implement the model • Limited scope to build confidence • A/B Testing to show actual performance of the model versus control group • Monitor and measure the results • How is the model performing versus normal business operations? 4/10/2018 www.cdoadvisors.com 20
  • 21.
    Questions or FollowUp Derek Wilson, CEO – CDO Advisors dwilson@cdoadvisors.com www.cdoadvisors.com Office : 832-819-5744 Connect with me on LinkedIn – https://www.linkedin.com/in/derekewilson/ copyright 2018 CDO Advisors - www.cdoadvisors.com 21

Editor's Notes

  • #4 How many people are business operations? How many people are data scientist?
  • #6 PRIMED-AP Analytic Process
  • #8 Determine which segment of customers to model churn Is it by geographic area, product line, new customers versus established.
  • #12 Walkthrough the decision tree