SlideShare a Scribd company logo
1 of 25
The Price Is
Right
THE PRICE
IS RIGHT
USING MACHINE TO MAXIMIZE COMPANY PROFIT
Agenda
• About me!?
• Dynamic Deal Scoring
• How do we do it?
• Project outcome…
• Q&A
Am I relevant ?
198
4
Dynamic Deal Scoring
(a.k.a. The Price is Right)
Motivation
• For every product, we should be able to find
the optimal price that a customer is willing to
pay
• We would factor in highly specific insights
that would influence the price
• Customer has ~750k of custom products – manual
practices for setting prices make it virtually
impossible to see the pricing patterns
• Dynamic deal scoring integrated into the core
commercial process will help organization to
price smarter, streamline the approval process,
and win more deals
Fact finding mission
• Sales reps often argue that higher discounts
are necessary to win deals
• FALSE - research across companies consistently
shows the opposite to be true: successful deals
almost always have lower average discounts than
deals that were lost
• A pricing infrastructure can be difficult and
costly to create
• TRUE - It requires investing appropriately,
empowering the right people, articulating clear
targets and goals, and managing risk, but….
Dynamic Deal Scoring
• is certainly not new, having been pioneered by
airlines in the ‘70s and now widely used by
hotels, airlines, and car rental and tour
operators
• it’s not only being used in online
environments. Traditional bricks and mortar
companies are also revolutionizing how they
monetize, finding new ways to tap into
customers’ willingness to pay
• can be located within a broader move towards
customization and personalization with the
emergence of data
Dynamic Deal Scoring
• On average, a 1% price increase translates into
an 8.7% increase in operating profits (assuming
no loss of volume, of course)
• 30% of all pricing decisions companies make
every year fail to deliver the best price!!! –
a lot of lost revenue
• CAUTION! Dynamic Deal Scoring when used blindly
or in isolation , i.e. without human oversight
and a clear strategy, can at worst destroy
reputation and erode consumer trust
How do we do it?
Requires (some) technical
skills
Hard work and long nights …
• Hypotheses
• Apply experiments
• Read measurement
• Deduce next steps
• We used CRISP methodology
Six steps to build the model
Data prepStep
▪ A piece of R code
takes the invoice
data and:
– Filters out
data that
should not be
considered in
the model
– Creates
synthetic
variables based
upon the
existing data
– Combines
invoices into
deals (there
are multiple
invoices
associated with
each deal)
▪ A piece of R code
calculates the
margin cutoffs
for A, B, C, D,
and F deals
within each node
▪ An tool shows the
distribution of
grades across
various
dimensions
including
Industry, and
Product Group.
Where there
exists a strong
skew towards A
grades or F
grades, the tool
will be used to
adjust margin
cutoffs to reduce
the uneven
distribution
▪ The DW team
provides invoice
data with margins
adjusted to match
the P&L and
additional
variables mapped
in from sources
outside the ERP
▪ The DDS model
embedded within
SalesForce
Detail
Input data DDS tree building Scoring Adjustments Output to tool
1 2 3 4 5 6
▪ Building the tree
involves two sub-
steps:
– Choosing
appropriate
variables based
on business
logic and
predictive
power
– Using the
regular method
to grow the
tree within the
bounds of best
practices. All
deals will be
sorted into
nodes of
similar
business
characteristics
and margin
3a
3b
Data prep
Data prep flow
This flow filters data, applies sales adjustments, and applies cost
adjustments
X
Sales adjustments
Cost adjustments
X
X
Filters
Combined invoice file
=
Sales + cost file by invoice
The output is a file with the sales and cost for each invoice
line. This file is mapped into the R data prep code
Data prep
Synthetic
variables
▪ Top Customer: This variables has 7 values; the 6 largest customers
and “other”
▪ Annual customer spend: The spend for the top customer for 2018
▪ Product Super Group: Assigned based on product group
▪ No of items in platform: sums up number of unique items within a
platform
▪ Deal size: Sum of invoice sales for that deal (as defined below)
▪ Spend per customer per item: % of a customer’s annual sales
represented by that item
▪ Platform: binary yes/no; is that item part of a platform
▪ Make vs Buy: binary make/buy
▪ No items in quote: “Quote” is same Sales Rep, same Customer, same
Order Date
Filters
▪ Intercompany sales
▪ Tooling and engineering charges
▪ Returns
▪ Invoices with sales > $10M or < -$10M
▪ Deals with margin > 100% or < 0%
▪ MOV/MOQ’s
Combining
invoices into
deals
▪ Deals are defined as the same customer, same item, same invoiced
price; all invoices fitting this criteria are combined
DDS tree building
Choosing
Variables
DDS Tree
3a
3b
▪ Before running the tree code, it is necessary to select final list of
variables to be used in tree
▪ The selection criteria should be a combination of the relative
predictive power and the business logic of the variables
▪ The tree should not branch on something that shouldn't be
prescriptive, even though it is descriptive of today’s behavior
(e.g., month of year)
▪ The variable should be capturable as an input during quotation
process
▪ With the list of variables finalized, manually select the branches of
the first two or three levels of the tree
▪ The remaining levels can be built automatically (allow the code to
select the most logical branching), but throughout the process, apply
best practices to guide and adjust the tree
▪ The “N” of terminal nodes should be no less than 50 and the P-value
of each branch should be below 0.05
▪ Best practice is for the R-square of the tree as a whole to be
greater than 30%.
Validate against Best Practice

Proposed modelBest practice
4220+
175-10+
31%130%+
Number of deal parameters analyzed
Number of deal parameters found predictive and
used for deal scoring
Predictive power of the scoring algorithm (R2)
Price realization uplift expected 2-3%2-7%1
Cutoff adjustment
Pre-adjustment distribution
Post-adjustment
distribution
Project outcome…
Project outcome…
• Project engagement: 8 weeks over 3 month period
• Project cost: 90% of cost was pure R’n’R –
traveling and accommodation cost due client
world wide presence
• 3 for 3 : project was fully paid of by correct
and timely pricing within 3 months of use in
production and measured above product price
baseline
• now in Revenue share mode 
www.atmc.ai
info@atmc.ai
The price is right - Tomislav Krizan

More Related Content

What's hot

Sonum Procurement Operations Planning
Sonum Procurement Operations Planning  Sonum Procurement Operations Planning
Sonum Procurement Operations Planning Anaplan
 
Profit is an Opinion,but Cash or lack thereof, is Cold Hard Reality
Profit is an Opinion,but Cash or lack thereof, is Cold Hard RealityProfit is an Opinion,but Cash or lack thereof, is Cold Hard Reality
Profit is an Opinion,but Cash or lack thereof, is Cold Hard RealityDennis L. Thompson, CPA, CFE
 
Earning capacity ratios
Earning capacity ratiosEarning capacity ratios
Earning capacity ratiosCollege
 
Earning capacity ratios
Earning capacity ratiosEarning capacity ratios
Earning capacity ratiosCollege
 
Financial reports and ratios
Financial reports and ratiosFinancial reports and ratios
Financial reports and ratiosCollege
 
150928 MAP Economics v1
150928 MAP Economics v1150928 MAP Economics v1
150928 MAP Economics v1Warren Leow
 
Incentive based IT outsourcing
Incentive based IT outsourcingIncentive based IT outsourcing
Incentive based IT outsourcingJohn UE
 
Pace 2009 Effective Financial Management
Pace 2009 Effective Financial ManagementPace 2009 Effective Financial Management
Pace 2009 Effective Financial ManagementLinnea Blair
 
5 Essential Startup Metrics
5 Essential Startup Metrics5 Essential Startup Metrics
5 Essential Startup MetricsReuven Cohen
 
Comparative analysis of fair value and historical cost accounting on reported...
Comparative analysis of fair value and historical cost accounting on reported...Comparative analysis of fair value and historical cost accounting on reported...
Comparative analysis of fair value and historical cost accounting on reported...Alexander Decker
 
Managerial Economics Scope by Bedaduri rama murthy
Managerial Economics Scope by Bedaduri rama murthyManagerial Economics Scope by Bedaduri rama murthy
Managerial Economics Scope by Bedaduri rama murthyB S R MURTHY
 
Types of Financial Model - Financial Modeling by EduCBA
Types of Financial Model - Financial Modeling by EduCBATypes of Financial Model - Financial Modeling by EduCBA
Types of Financial Model - Financial Modeling by EduCBAeduCBA
 
Financial modelling 2016 WEB VERSION
Financial modelling 2016 WEB VERSIONFinancial modelling 2016 WEB VERSION
Financial modelling 2016 WEB VERSIONAlistair Hynd
 
SPEND ANALYSIS KEY TO PURCHASING SUCCESS
SPEND ANALYSIS KEY TO PURCHASING SUCCESSSPEND ANALYSIS KEY TO PURCHASING SUCCESS
SPEND ANALYSIS KEY TO PURCHASING SUCCESSBill Kohnen
 
When is Driver-Based Modeling Applicable
When is Driver-Based Modeling ApplicableWhen is Driver-Based Modeling Applicable
When is Driver-Based Modeling ApplicableNilly Essaides
 
Home assignment - Tal Elor
Home assignment   - Tal ElorHome assignment   - Tal Elor
Home assignment - Tal Elorssuser88467b
 
Technical Interview Workshop Sept 17 2007 V2 Website
Technical Interview Workshop Sept 17 2007 V2 WebsiteTechnical Interview Workshop Sept 17 2007 V2 Website
Technical Interview Workshop Sept 17 2007 V2 WebsiteMcGill Investment Club
 

What's hot (20)

Sonum Procurement Operations Planning
Sonum Procurement Operations Planning  Sonum Procurement Operations Planning
Sonum Procurement Operations Planning
 
Profit is an Opinion,but Cash or lack thereof, is Cold Hard Reality
Profit is an Opinion,but Cash or lack thereof, is Cold Hard RealityProfit is an Opinion,but Cash or lack thereof, is Cold Hard Reality
Profit is an Opinion,but Cash or lack thereof, is Cold Hard Reality
 
Return on Investment
Return on InvestmentReturn on Investment
Return on Investment
 
Earning capacity ratios
Earning capacity ratiosEarning capacity ratios
Earning capacity ratios
 
Earning capacity ratios
Earning capacity ratiosEarning capacity ratios
Earning capacity ratios
 
Financial reports and ratios
Financial reports and ratiosFinancial reports and ratios
Financial reports and ratios
 
CMI Slides
CMI SlidesCMI Slides
CMI Slides
 
150928 MAP Economics v1
150928 MAP Economics v1150928 MAP Economics v1
150928 MAP Economics v1
 
Incentive based IT outsourcing
Incentive based IT outsourcingIncentive based IT outsourcing
Incentive based IT outsourcing
 
Pace 2009 Effective Financial Management
Pace 2009 Effective Financial ManagementPace 2009 Effective Financial Management
Pace 2009 Effective Financial Management
 
5 Essential Startup Metrics
5 Essential Startup Metrics5 Essential Startup Metrics
5 Essential Startup Metrics
 
Comparative analysis of fair value and historical cost accounting on reported...
Comparative analysis of fair value and historical cost accounting on reported...Comparative analysis of fair value and historical cost accounting on reported...
Comparative analysis of fair value and historical cost accounting on reported...
 
Managerial Economics Scope by Bedaduri rama murthy
Managerial Economics Scope by Bedaduri rama murthyManagerial Economics Scope by Bedaduri rama murthy
Managerial Economics Scope by Bedaduri rama murthy
 
Nobel overview
Nobel overviewNobel overview
Nobel overview
 
Types of Financial Model - Financial Modeling by EduCBA
Types of Financial Model - Financial Modeling by EduCBATypes of Financial Model - Financial Modeling by EduCBA
Types of Financial Model - Financial Modeling by EduCBA
 
Financial modelling 2016 WEB VERSION
Financial modelling 2016 WEB VERSIONFinancial modelling 2016 WEB VERSION
Financial modelling 2016 WEB VERSION
 
SPEND ANALYSIS KEY TO PURCHASING SUCCESS
SPEND ANALYSIS KEY TO PURCHASING SUCCESSSPEND ANALYSIS KEY TO PURCHASING SUCCESS
SPEND ANALYSIS KEY TO PURCHASING SUCCESS
 
When is Driver-Based Modeling Applicable
When is Driver-Based Modeling ApplicableWhen is Driver-Based Modeling Applicable
When is Driver-Based Modeling Applicable
 
Home assignment - Tal Elor
Home assignment   - Tal ElorHome assignment   - Tal Elor
Home assignment - Tal Elor
 
Technical Interview Workshop Sept 17 2007 V2 Website
Technical Interview Workshop Sept 17 2007 V2 WebsiteTechnical Interview Workshop Sept 17 2007 V2 Website
Technical Interview Workshop Sept 17 2007 V2 Website
 

Similar to The price is right - Tomislav Krizan

Leveraging Data Analysis for Sales
Leveraging Data Analysis for SalesLeveraging Data Analysis for Sales
Leveraging Data Analysis for SalesAditya Ratnaparkhi
 
Multiquip Goes AI with Involve
Multiquip Goes AI with InvolveMultiquip Goes AI with Involve
Multiquip Goes AI with InvolveRazaSiddiqui9
 
Vendavo Pricing Guidance - Deliver 2-5% Margin Improvement in Weeks
Vendavo Pricing Guidance - Deliver 2-5% Margin Improvement in WeeksVendavo Pricing Guidance - Deliver 2-5% Margin Improvement in Weeks
Vendavo Pricing Guidance - Deliver 2-5% Margin Improvement in WeeksCaroline Burns
 
Financial Modeling
Financial ModelingFinancial Modeling
Financial ModelingJeremy Horn
 
Sales White Paper: ROI On Sales Effectiveness
Sales White Paper: ROI On Sales EffectivenessSales White Paper: ROI On Sales Effectiveness
Sales White Paper: ROI On Sales EffectivenessAltify
 
Confessions of a RevOps Curmudgeon - How sales leaders can get the greenligh...
Confessions of a RevOps Curmudgeon  - How sales leaders can get the greenligh...Confessions of a RevOps Curmudgeon  - How sales leaders can get the greenligh...
Confessions of a RevOps Curmudgeon - How sales leaders can get the greenligh...Tenbound
 
Pricing for product managers vancouver nov 2017
Pricing for product managers vancouver nov 2017Pricing for product managers vancouver nov 2017
Pricing for product managers vancouver nov 2017Steven Forth
 
20120628 building the sfdc business case-ar-mad
20120628 building the sfdc business case-ar-mad20120628 building the sfdc business case-ar-mad
20120628 building the sfdc business case-ar-madFlorian Zink
 
What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...
What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...
What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...Demandbase
 
TPM Retail Increasing Business Value - Joel Cartwright
TPM Retail Increasing Business Value - Joel CartwrightTPM Retail Increasing Business Value - Joel Cartwright
TPM Retail Increasing Business Value - Joel CartwrightGlobal Creative Group, Inc
 
MonetizingStatistics
MonetizingStatisticsMonetizingStatistics
MonetizingStatisticsAaron Sankey
 
Best Practices in Sales Operations v5
Best Practices in Sales Operations v5Best Practices in Sales Operations v5
Best Practices in Sales Operations v5565 Business Group
 
Creating a Business Case for Global Payroll - APA Fall Forum
Creating a Business Case for Global Payroll - APA Fall ForumCreating a Business Case for Global Payroll - APA Fall Forum
Creating a Business Case for Global Payroll - APA Fall ForumCatriona Keevans
 
How to Measure the Impact of Quote-to-Cash Business Transformation
How to Measure the Impact of Quote-to-Cash Business TransformationHow to Measure the Impact of Quote-to-Cash Business Transformation
How to Measure the Impact of Quote-to-Cash Business TransformationApttus
 
Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...
Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...
Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...Zuora, Inc.
 

Similar to The price is right - Tomislav Krizan (20)

Leveraging Data Analysis for Sales
Leveraging Data Analysis for SalesLeveraging Data Analysis for Sales
Leveraging Data Analysis for Sales
 
Multiquip Goes AI with Involve
Multiquip Goes AI with InvolveMultiquip Goes AI with Involve
Multiquip Goes AI with Involve
 
Competitive Analysis & Intelligence
Competitive Analysis & IntelligenceCompetitive Analysis & Intelligence
Competitive Analysis & Intelligence
 
Vendavo Pricing Guidance - Deliver 2-5% Margin Improvement in Weeks
Vendavo Pricing Guidance - Deliver 2-5% Margin Improvement in WeeksVendavo Pricing Guidance - Deliver 2-5% Margin Improvement in Weeks
Vendavo Pricing Guidance - Deliver 2-5% Margin Improvement in Weeks
 
Financial Modeling
Financial ModelingFinancial Modeling
Financial Modeling
 
Sales White Paper: ROI On Sales Effectiveness
Sales White Paper: ROI On Sales EffectivenessSales White Paper: ROI On Sales Effectiveness
Sales White Paper: ROI On Sales Effectiveness
 
Confessions of a RevOps Curmudgeon - How sales leaders can get the greenligh...
Confessions of a RevOps Curmudgeon  - How sales leaders can get the greenligh...Confessions of a RevOps Curmudgeon  - How sales leaders can get the greenligh...
Confessions of a RevOps Curmudgeon - How sales leaders can get the greenligh...
 
Pricing for product managers vancouver nov 2017
Pricing for product managers vancouver nov 2017Pricing for product managers vancouver nov 2017
Pricing for product managers vancouver nov 2017
 
20120628 building the sfdc business case-ar-mad
20120628 building the sfdc business case-ar-mad20120628 building the sfdc business case-ar-mad
20120628 building the sfdc business case-ar-mad
 
What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...
What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...
What's an ABM Solution Really Worth? Understanding the Total Economic Impact ...
 
TPM Retail Increasing Business Value - Joel Cartwright
TPM Retail Increasing Business Value - Joel CartwrightTPM Retail Increasing Business Value - Joel Cartwright
TPM Retail Increasing Business Value - Joel Cartwright
 
MonetizingStatistics
MonetizingStatisticsMonetizingStatistics
MonetizingStatistics
 
Wettemann
WettemannWettemann
Wettemann
 
Best Practices in Sales Operations v5
Best Practices in Sales Operations v5Best Practices in Sales Operations v5
Best Practices in Sales Operations v5
 
Creating a Business Case for Global Payroll - APA Fall Forum
Creating a Business Case for Global Payroll - APA Fall ForumCreating a Business Case for Global Payroll - APA Fall Forum
Creating a Business Case for Global Payroll - APA Fall Forum
 
CaseStudy.pptx
CaseStudy.pptxCaseStudy.pptx
CaseStudy.pptx
 
How to Measure the Impact of Quote-to-Cash Business Transformation
How to Measure the Impact of Quote-to-Cash Business TransformationHow to Measure the Impact of Quote-to-Cash Business Transformation
How to Measure the Impact of Quote-to-Cash Business Transformation
 
Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...
Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...
Subscribed NYC 2017: Aligning Pricing and Revenue – Two Sides Of A Very Valua...
 
TradeSmart Case Studies
TradeSmart Case StudiesTradeSmart Case Studies
TradeSmart Case Studies
 
IT Cost Benefits Strategy
IT Cost Benefits StrategyIT Cost Benefits Strategy
IT Cost Benefits Strategy
 

More from Institute of Contemporary Sciences

Building valuable (online and offline) Data Science communities - Experience ...
Building valuable (online and offline) Data Science communities - Experience ...Building valuable (online and offline) Data Science communities - Experience ...
Building valuable (online and offline) Data Science communities - Experience ...Institute of Contemporary Sciences
 
Data Science Master 4.0 on Belgrade University - Drazen Draskovic
Data Science Master 4.0 on Belgrade University - Drazen DraskovicData Science Master 4.0 on Belgrade University - Drazen Draskovic
Data Science Master 4.0 on Belgrade University - Drazen DraskovicInstitute of Contemporary Sciences
 
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...Deep learning fast and slow, a responsible and explainable AI framework - Ahm...
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...Institute of Contemporary Sciences
 
Solving churn challenge in Big Data environment - Jelena Pekez
Solving churn challenge in Big Data environment  - Jelena PekezSolving churn challenge in Big Data environment  - Jelena Pekez
Solving churn challenge in Big Data environment - Jelena PekezInstitute of Contemporary Sciences
 
Application of Business Intelligence in bank risk management - Dimitar Dilov
Application of Business Intelligence in bank risk management - Dimitar DilovApplication of Business Intelligence in bank risk management - Dimitar Dilov
Application of Business Intelligence in bank risk management - Dimitar DilovInstitute of Contemporary Sciences
 
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...Institute of Contemporary Sciences
 
Recommender systems for personalized financial advice from concept to product...
Recommender systems for personalized financial advice from concept to product...Recommender systems for personalized financial advice from concept to product...
Recommender systems for personalized financial advice from concept to product...Institute of Contemporary Sciences
 
Advanced tools in real time analytics and AI in customer support - Milan Sima...
Advanced tools in real time analytics and AI in customer support - Milan Sima...Advanced tools in real time analytics and AI in customer support - Milan Sima...
Advanced tools in real time analytics and AI in customer support - Milan Sima...Institute of Contemporary Sciences
 
Complex AI forecasting methods for investments portfolio optimization - Pawel...
Complex AI forecasting methods for investments portfolio optimization - Pawel...Complex AI forecasting methods for investments portfolio optimization - Pawel...
Complex AI forecasting methods for investments portfolio optimization - Pawel...Institute of Contemporary Sciences
 
Reality and traps of real time data engineering - Milos Solujic
Reality and traps of real time data engineering - Milos SolujicReality and traps of real time data engineering - Milos Solujic
Reality and traps of real time data engineering - Milos SolujicInstitute of Contemporary Sciences
 
Sensor networks for personalized health monitoring - Vladimir Brusic
Sensor networks for personalized health monitoring - Vladimir BrusicSensor networks for personalized health monitoring - Vladimir Brusic
Sensor networks for personalized health monitoring - Vladimir BrusicInstitute of Contemporary Sciences
 
Prediction of good patterns for future sales using image recognition
Prediction of good patterns for future sales using image recognitionPrediction of good patterns for future sales using image recognition
Prediction of good patterns for future sales using image recognitionInstitute of Contemporary Sciences
 
Using data to fight corruption: full budget transparency in local government
Using data to fight corruption: full budget transparency in local governmentUsing data to fight corruption: full budget transparency in local government
Using data to fight corruption: full budget transparency in local governmentInstitute of Contemporary Sciences
 
Machine Learning-Driven Injury Prediction for a Professional Sports Team
Machine Learning-Driven Injury Prediction for a Professional Sports TeamMachine Learning-Driven Injury Prediction for a Professional Sports Team
Machine Learning-Driven Injury Prediction for a Professional Sports TeamInstitute of Contemporary Sciences
 

More from Institute of Contemporary Sciences (20)

First 5 years of PSI:ML - Filip Panjevic
First 5 years of PSI:ML - Filip PanjevicFirst 5 years of PSI:ML - Filip Panjevic
First 5 years of PSI:ML - Filip Panjevic
 
Building valuable (online and offline) Data Science communities - Experience ...
Building valuable (online and offline) Data Science communities - Experience ...Building valuable (online and offline) Data Science communities - Experience ...
Building valuable (online and offline) Data Science communities - Experience ...
 
Data Science Master 4.0 on Belgrade University - Drazen Draskovic
Data Science Master 4.0 on Belgrade University - Drazen DraskovicData Science Master 4.0 on Belgrade University - Drazen Draskovic
Data Science Master 4.0 on Belgrade University - Drazen Draskovic
 
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...Deep learning fast and slow, a responsible and explainable AI framework - Ahm...
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...
 
Solving churn challenge in Big Data environment - Jelena Pekez
Solving churn challenge in Big Data environment  - Jelena PekezSolving churn challenge in Big Data environment  - Jelena Pekez
Solving churn challenge in Big Data environment - Jelena Pekez
 
Application of Business Intelligence in bank risk management - Dimitar Dilov
Application of Business Intelligence in bank risk management - Dimitar DilovApplication of Business Intelligence in bank risk management - Dimitar Dilov
Application of Business Intelligence in bank risk management - Dimitar Dilov
 
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...
 
Recommender systems for personalized financial advice from concept to product...
Recommender systems for personalized financial advice from concept to product...Recommender systems for personalized financial advice from concept to product...
Recommender systems for personalized financial advice from concept to product...
 
Advanced tools in real time analytics and AI in customer support - Milan Sima...
Advanced tools in real time analytics and AI in customer support - Milan Sima...Advanced tools in real time analytics and AI in customer support - Milan Sima...
Advanced tools in real time analytics and AI in customer support - Milan Sima...
 
Complex AI forecasting methods for investments portfolio optimization - Pawel...
Complex AI forecasting methods for investments portfolio optimization - Pawel...Complex AI forecasting methods for investments portfolio optimization - Pawel...
Complex AI forecasting methods for investments portfolio optimization - Pawel...
 
From Zero to ML Hero for Underdogs - Amir Tabakovic
From Zero to ML Hero for Underdogs  - Amir TabakovicFrom Zero to ML Hero for Underdogs  - Amir Tabakovic
From Zero to ML Hero for Underdogs - Amir Tabakovic
 
Data and data scientists are not equal to money david hoyle
Data and data scientists are not equal to money   david hoyleData and data scientists are not equal to money   david hoyle
Data and data scientists are not equal to money david hoyle
 
When it's raining gold, bring a bucket - Andjela Culibrk
When it's raining gold, bring a bucket - Andjela CulibrkWhen it's raining gold, bring a bucket - Andjela Culibrk
When it's raining gold, bring a bucket - Andjela Culibrk
 
Reality and traps of real time data engineering - Milos Solujic
Reality and traps of real time data engineering - Milos SolujicReality and traps of real time data engineering - Milos Solujic
Reality and traps of real time data engineering - Milos Solujic
 
Sensor networks for personalized health monitoring - Vladimir Brusic
Sensor networks for personalized health monitoring - Vladimir BrusicSensor networks for personalized health monitoring - Vladimir Brusic
Sensor networks for personalized health monitoring - Vladimir Brusic
 
Improving Data Quality with Product Similarity Search
Improving Data Quality with Product Similarity SearchImproving Data Quality with Product Similarity Search
Improving Data Quality with Product Similarity Search
 
Prediction of good patterns for future sales using image recognition
Prediction of good patterns for future sales using image recognitionPrediction of good patterns for future sales using image recognition
Prediction of good patterns for future sales using image recognition
 
Using data to fight corruption: full budget transparency in local government
Using data to fight corruption: full budget transparency in local governmentUsing data to fight corruption: full budget transparency in local government
Using data to fight corruption: full budget transparency in local government
 
Geospatial Analysis and Open Data - Forest and Climate
Geospatial Analysis and Open Data - Forest and ClimateGeospatial Analysis and Open Data - Forest and Climate
Geospatial Analysis and Open Data - Forest and Climate
 
Machine Learning-Driven Injury Prediction for a Professional Sports Team
Machine Learning-Driven Injury Prediction for a Professional Sports TeamMachine Learning-Driven Injury Prediction for a Professional Sports Team
Machine Learning-Driven Injury Prediction for a Professional Sports Team
 

Recently uploaded

1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样vhwb25kk
 
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...Suhani Kapoor
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Sapana Sha
 
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Callshivangimorya083
 
Customer Service Analytics - Make Sense of All Your Data.pptx
Customer Service Analytics - Make Sense of All Your Data.pptxCustomer Service Analytics - Make Sense of All Your Data.pptx
Customer Service Analytics - Make Sense of All Your Data.pptxEmmanuel Dauda
 
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一F La
 
vip Sarai Rohilla Call Girls 9999965857 Call or WhatsApp Now Book
vip Sarai Rohilla Call Girls 9999965857 Call or WhatsApp Now Bookvip Sarai Rohilla Call Girls 9999965857 Call or WhatsApp Now Book
vip Sarai Rohilla Call Girls 9999965857 Call or WhatsApp Now Bookmanojkuma9823
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxStephen266013
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationshipsccctableauusergroup
 
Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingNeil Barnes
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDRafezzaman
 
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...ThinkInnovation
 
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPramod Kumar Srivastava
 
Call Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceCall Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceSapana Sha
 
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝DelhiRS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhijennyeacort
 
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptSonatrach
 
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)jennyeacort
 
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理e4aez8ss
 

Recently uploaded (20)

1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
 
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
 
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
 
Customer Service Analytics - Make Sense of All Your Data.pptx
Customer Service Analytics - Make Sense of All Your Data.pptxCustomer Service Analytics - Make Sense of All Your Data.pptx
Customer Service Analytics - Make Sense of All Your Data.pptx
 
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
 
vip Sarai Rohilla Call Girls 9999965857 Call or WhatsApp Now Book
vip Sarai Rohilla Call Girls 9999965857 Call or WhatsApp Now Bookvip Sarai Rohilla Call Girls 9999965857 Call or WhatsApp Now Book
vip Sarai Rohilla Call Girls 9999965857 Call or WhatsApp Now Book
 
Call Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort ServiceCall Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort Service
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docx
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships
 
Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data Storytelling
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
 
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
 
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
 
Call Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceCall Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts Service
 
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
 
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝DelhiRS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
 
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
 
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
 
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
 

The price is right - Tomislav Krizan

  • 2. THE PRICE IS RIGHT USING MACHINE TO MAXIMIZE COMPANY PROFIT
  • 3. Agenda • About me!? • Dynamic Deal Scoring • How do we do it? • Project outcome… • Q&A
  • 4. Am I relevant ? 198 4
  • 5. Dynamic Deal Scoring (a.k.a. The Price is Right)
  • 6. Motivation • For every product, we should be able to find the optimal price that a customer is willing to pay • We would factor in highly specific insights that would influence the price • Customer has ~750k of custom products – manual practices for setting prices make it virtually impossible to see the pricing patterns • Dynamic deal scoring integrated into the core commercial process will help organization to price smarter, streamline the approval process, and win more deals
  • 7. Fact finding mission • Sales reps often argue that higher discounts are necessary to win deals • FALSE - research across companies consistently shows the opposite to be true: successful deals almost always have lower average discounts than deals that were lost • A pricing infrastructure can be difficult and costly to create • TRUE - It requires investing appropriately, empowering the right people, articulating clear targets and goals, and managing risk, but….
  • 8. Dynamic Deal Scoring • is certainly not new, having been pioneered by airlines in the ‘70s and now widely used by hotels, airlines, and car rental and tour operators • it’s not only being used in online environments. Traditional bricks and mortar companies are also revolutionizing how they monetize, finding new ways to tap into customers’ willingness to pay • can be located within a broader move towards customization and personalization with the emergence of data
  • 9. Dynamic Deal Scoring • On average, a 1% price increase translates into an 8.7% increase in operating profits (assuming no loss of volume, of course) • 30% of all pricing decisions companies make every year fail to deliver the best price!!! – a lot of lost revenue • CAUTION! Dynamic Deal Scoring when used blindly or in isolation , i.e. without human oversight and a clear strategy, can at worst destroy reputation and erode consumer trust
  • 10. How do we do it?
  • 12. Hard work and long nights … • Hypotheses • Apply experiments • Read measurement • Deduce next steps • We used CRISP methodology
  • 13. Six steps to build the model Data prepStep ▪ A piece of R code takes the invoice data and: – Filters out data that should not be considered in the model – Creates synthetic variables based upon the existing data – Combines invoices into deals (there are multiple invoices associated with each deal) ▪ A piece of R code calculates the margin cutoffs for A, B, C, D, and F deals within each node ▪ An tool shows the distribution of grades across various dimensions including Industry, and Product Group. Where there exists a strong skew towards A grades or F grades, the tool will be used to adjust margin cutoffs to reduce the uneven distribution ▪ The DW team provides invoice data with margins adjusted to match the P&L and additional variables mapped in from sources outside the ERP ▪ The DDS model embedded within SalesForce Detail Input data DDS tree building Scoring Adjustments Output to tool 1 2 3 4 5 6 ▪ Building the tree involves two sub- steps: – Choosing appropriate variables based on business logic and predictive power – Using the regular method to grow the tree within the bounds of best practices. All deals will be sorted into nodes of similar business characteristics and margin 3a 3b
  • 14.
  • 15.
  • 16. Data prep Data prep flow This flow filters data, applies sales adjustments, and applies cost adjustments X Sales adjustments Cost adjustments X X Filters Combined invoice file = Sales + cost file by invoice The output is a file with the sales and cost for each invoice line. This file is mapped into the R data prep code
  • 17. Data prep Synthetic variables ▪ Top Customer: This variables has 7 values; the 6 largest customers and “other” ▪ Annual customer spend: The spend for the top customer for 2018 ▪ Product Super Group: Assigned based on product group ▪ No of items in platform: sums up number of unique items within a platform ▪ Deal size: Sum of invoice sales for that deal (as defined below) ▪ Spend per customer per item: % of a customer’s annual sales represented by that item ▪ Platform: binary yes/no; is that item part of a platform ▪ Make vs Buy: binary make/buy ▪ No items in quote: “Quote” is same Sales Rep, same Customer, same Order Date Filters ▪ Intercompany sales ▪ Tooling and engineering charges ▪ Returns ▪ Invoices with sales > $10M or < -$10M ▪ Deals with margin > 100% or < 0% ▪ MOV/MOQ’s Combining invoices into deals ▪ Deals are defined as the same customer, same item, same invoiced price; all invoices fitting this criteria are combined
  • 18. DDS tree building Choosing Variables DDS Tree 3a 3b ▪ Before running the tree code, it is necessary to select final list of variables to be used in tree ▪ The selection criteria should be a combination of the relative predictive power and the business logic of the variables ▪ The tree should not branch on something that shouldn't be prescriptive, even though it is descriptive of today’s behavior (e.g., month of year) ▪ The variable should be capturable as an input during quotation process ▪ With the list of variables finalized, manually select the branches of the first two or three levels of the tree ▪ The remaining levels can be built automatically (allow the code to select the most logical branching), but throughout the process, apply best practices to guide and adjust the tree ▪ The “N” of terminal nodes should be no less than 50 and the P-value of each branch should be below 0.05 ▪ Best practice is for the R-square of the tree as a whole to be greater than 30%.
  • 19. Validate against Best Practice  Proposed modelBest practice 4220+ 175-10+ 31%130%+ Number of deal parameters analyzed Number of deal parameters found predictive and used for deal scoring Predictive power of the scoring algorithm (R2) Price realization uplift expected 2-3%2-7%1
  • 21.
  • 23. Project outcome… • Project engagement: 8 weeks over 3 month period • Project cost: 90% of cost was pure R’n’R – traveling and accommodation cost due client world wide presence • 3 for 3 : project was fully paid of by correct and timely pricing within 3 months of use in production and measured above product price baseline • now in Revenue share mode 