SlideShare a Scribd company logo
Responsible
Model
Development
Sell
Data Management
&

Sensitivity Analysis
When the client asks how wrong the model
can be, we should be able to look into his eyes
and say,
The recommendation based on the modeling
results has an error of $0.5Million.
Tell the client the model can be wrong is

And

the right thing to do.

to do the thing right, we need to tell how wrong it is.

And that’s something we believe can

sell.
Right and wrong are just the
flip sides of

RISKs.
Asset Management Guys tell us:

Business Risk Exposure =
Probability of Failure
X

Consequences of Failure
How Wrong the Model is?
Business Risk Exposure =
Probability of Model being Wrong
X
Consequences of Model being Wrong
An Example
Pipe 1

Pipe 1

Pipe 2
If GIS is right

Pipe 2
If GIS is wrong

Pipe 3

Pipe 3
Consequences of being wrong:

spend $30,000 on a good pipe

Probability of being wrong: GIS with no source attribution, 70% chance of a typo.

The error of the recommendation is
$30,000 * 70% =

$21,000
More generic formula

BRE = $30,000 * (0.2+0) = $6,000
It is the modeler’s responsibility to inform the client the limitation of the
model, and the extent.
It is a good way to sell Data Management and Sensitivity Analysis services.
It is a good way to add

true value and gain trust.
Model responsibly.

Reference: Rules for responsible modeling, James, William, CHI
http://www.chiwater.com/Publications/Books/r184.asp

More Related Content

Similar to Responsible model development

Growth Hacking with Cassie Lancellotti-Young
Growth Hacking with Cassie Lancellotti-YoungGrowth Hacking with Cassie Lancellotti-Young
Growth Hacking with Cassie Lancellotti-Young
Mattan Griffel
 
Metrics that Matter: The 360-Degree Customer
Metrics that Matter: The 360-Degree CustomerMetrics that Matter: The 360-Degree Customer
Metrics that Matter: The 360-Degree Customer
Cassie Lancellotti-Young
 
LTK - FC - Supply Chain - Startup Challenge v3.pdf
LTK - FC - Supply Chain - Startup Challenge v3.pdfLTK - FC - Supply Chain - Startup Challenge v3.pdf
LTK - FC - Supply Chain - Startup Challenge v3.pdf
jeroen_tjepkema
 
MidTerm memo
MidTerm memoMidTerm memo
MidTerm memo
Gaurav Purohit
 
Spreadsheet Errors
Spreadsheet ErrorsSpreadsheet Errors
Spreadsheet Errors
kmannix
 
Data Visions Big Data Visual Analytics Tool
Data Visions Big Data Visual Analytics ToolData Visions Big Data Visual Analytics Tool
Data Visions Big Data Visual Analytics Tool
Double Check ĆŐNSULTING
 
Storyfying your Data: How to go from Data to Insights to Stories
Storyfying your Data: How to go from Data to Insights to StoriesStoryfying your Data: How to go from Data to Insights to Stories
Storyfying your Data: How to go from Data to Insights to Stories
Gramener
 
It's Social Business (Not Social Media)
It's Social Business (Not Social Media)It's Social Business (Not Social Media)
It's Social Business (Not Social Media)
Jason Lauritzen
 
Combining Art & Science in Modern Marketing
Combining Art & Science in Modern MarketingCombining Art & Science in Modern Marketing
Combining Art & Science in Modern Marketing
Scott Brinker
 
How to Talk about AI to Non-analaysts - Stampedecon AI Summit 2017
How to Talk about AI to Non-analaysts - Stampedecon AI Summit 2017How to Talk about AI to Non-analaysts - Stampedecon AI Summit 2017
How to Talk about AI to Non-analaysts - Stampedecon AI Summit 2017
StampedeCon
 
New Product Launch Plan Powerpoint Presentation Slides
New Product Launch Plan Powerpoint Presentation SlidesNew Product Launch Plan Powerpoint Presentation Slides
New Product Launch Plan Powerpoint Presentation Slides
SlideTeam
 
Multilevel Regression and Post-stratification (MRP) for Brand Tracking: PyCon...
Multilevel Regression and Post-stratification (MRP) for Brand Tracking: PyCon...Multilevel Regression and Post-stratification (MRP) for Brand Tracking: PyCon...
Multilevel Regression and Post-stratification (MRP) for Brand Tracking: PyCon...
Latana
 
Benchmarking Impacts
Benchmarking ImpactsBenchmarking Impacts
Benchmarking Impacts
Penn State University
 
5 Conversion Mistakes You're Probably Making
5 Conversion Mistakes You're Probably Making5 Conversion Mistakes You're Probably Making
5 Conversion Mistakes You're Probably Making
Slices Consulting
 
5 Conversion Mistakes You're Probably Making (And How to Fix Them)
5 Conversion Mistakes You're Probably Making (And How to Fix Them)5 Conversion Mistakes You're Probably Making (And How to Fix Them)
5 Conversion Mistakes You're Probably Making (And How to Fix Them)
Louis Grenier
 
Teaching students how to critically appraise organizational data
Teaching students how to critically appraise organizational dataTeaching students how to critically appraise organizational data
Teaching students how to critically appraise organizational data
Center for Evidence-Based Management
 
Entering the Data Analytics industry
Entering the Data Analytics industryEntering the Data Analytics industry
Entering the Data Analytics industry
Gramener
 
"No Decision": The blind spot that prevents lawyers from doubling their income
"No Decision": The blind spot that prevents lawyers from doubling their income"No Decision": The blind spot that prevents lawyers from doubling their income
"No Decision": The blind spot that prevents lawyers from doubling their income
Mike O'Horo
 
Data mining - Machine Learning
Data mining - Machine LearningData mining - Machine Learning
Data mining - Machine Learning
RupaDutta3
 
Ultimate Guide to SaaS Pricing
Ultimate Guide to SaaS PricingUltimate Guide to SaaS Pricing
Ultimate Guide to SaaS Pricing
Kissmetrics on SlideShare
 

Similar to Responsible model development (20)

Growth Hacking with Cassie Lancellotti-Young
Growth Hacking with Cassie Lancellotti-YoungGrowth Hacking with Cassie Lancellotti-Young
Growth Hacking with Cassie Lancellotti-Young
 
Metrics that Matter: The 360-Degree Customer
Metrics that Matter: The 360-Degree CustomerMetrics that Matter: The 360-Degree Customer
Metrics that Matter: The 360-Degree Customer
 
LTK - FC - Supply Chain - Startup Challenge v3.pdf
LTK - FC - Supply Chain - Startup Challenge v3.pdfLTK - FC - Supply Chain - Startup Challenge v3.pdf
LTK - FC - Supply Chain - Startup Challenge v3.pdf
 
MidTerm memo
MidTerm memoMidTerm memo
MidTerm memo
 
Spreadsheet Errors
Spreadsheet ErrorsSpreadsheet Errors
Spreadsheet Errors
 
Data Visions Big Data Visual Analytics Tool
Data Visions Big Data Visual Analytics ToolData Visions Big Data Visual Analytics Tool
Data Visions Big Data Visual Analytics Tool
 
Storyfying your Data: How to go from Data to Insights to Stories
Storyfying your Data: How to go from Data to Insights to StoriesStoryfying your Data: How to go from Data to Insights to Stories
Storyfying your Data: How to go from Data to Insights to Stories
 
It's Social Business (Not Social Media)
It's Social Business (Not Social Media)It's Social Business (Not Social Media)
It's Social Business (Not Social Media)
 
Combining Art & Science in Modern Marketing
Combining Art & Science in Modern MarketingCombining Art & Science in Modern Marketing
Combining Art & Science in Modern Marketing
 
How to Talk about AI to Non-analaysts - Stampedecon AI Summit 2017
How to Talk about AI to Non-analaysts - Stampedecon AI Summit 2017How to Talk about AI to Non-analaysts - Stampedecon AI Summit 2017
How to Talk about AI to Non-analaysts - Stampedecon AI Summit 2017
 
New Product Launch Plan Powerpoint Presentation Slides
New Product Launch Plan Powerpoint Presentation SlidesNew Product Launch Plan Powerpoint Presentation Slides
New Product Launch Plan Powerpoint Presentation Slides
 
Multilevel Regression and Post-stratification (MRP) for Brand Tracking: PyCon...
Multilevel Regression and Post-stratification (MRP) for Brand Tracking: PyCon...Multilevel Regression and Post-stratification (MRP) for Brand Tracking: PyCon...
Multilevel Regression and Post-stratification (MRP) for Brand Tracking: PyCon...
 
Benchmarking Impacts
Benchmarking ImpactsBenchmarking Impacts
Benchmarking Impacts
 
5 Conversion Mistakes You're Probably Making
5 Conversion Mistakes You're Probably Making5 Conversion Mistakes You're Probably Making
5 Conversion Mistakes You're Probably Making
 
5 Conversion Mistakes You're Probably Making (And How to Fix Them)
5 Conversion Mistakes You're Probably Making (And How to Fix Them)5 Conversion Mistakes You're Probably Making (And How to Fix Them)
5 Conversion Mistakes You're Probably Making (And How to Fix Them)
 
Teaching students how to critically appraise organizational data
Teaching students how to critically appraise organizational dataTeaching students how to critically appraise organizational data
Teaching students how to critically appraise organizational data
 
Entering the Data Analytics industry
Entering the Data Analytics industryEntering the Data Analytics industry
Entering the Data Analytics industry
 
"No Decision": The blind spot that prevents lawyers from doubling their income
"No Decision": The blind spot that prevents lawyers from doubling their income"No Decision": The blind spot that prevents lawyers from doubling their income
"No Decision": The blind spot that prevents lawyers from doubling their income
 
Data mining - Machine Learning
Data mining - Machine LearningData mining - Machine Learning
Data mining - Machine Learning
 
Ultimate Guide to SaaS Pricing
Ultimate Guide to SaaS PricingUltimate Guide to SaaS Pricing
Ultimate Guide to SaaS Pricing
 

More from Mel Meng

USING GIS TO IDENTIFY CRITICAL PIPES IN THE COLLECTION SYSTEM- 2012 owea coll...
USING GIS TO IDENTIFY CRITICAL PIPES IN THE COLLECTION SYSTEM- 2012 owea coll...USING GIS TO IDENTIFY CRITICAL PIPES IN THE COLLECTION SYSTEM- 2012 owea coll...
USING GIS TO IDENTIFY CRITICAL PIPES IN THE COLLECTION SYSTEM- 2012 owea coll...
Mel Meng
 
Smart Phones Move the Field Forces Forward - 2011 Ohio GIS Conference
Smart Phones Move the Field Forces Forward - 2011 Ohio GIS ConferenceSmart Phones Move the Field Forces Forward - 2011 Ohio GIS Conference
Smart Phones Move the Field Forces Forward - 2011 Ohio GIS Conference
Mel Meng
 
Envision version 2.0
Envision version 2.0Envision version 2.0
Envision version 2.0
Mel Meng
 
Master planning app
Master planning appMaster planning app
Master planning app
Mel Meng
 
Why should we develop an app
Why should we develop an appWhy should we develop an app
Why should we develop an app
Mel Meng
 
Disruptive technologies
Disruptive technologiesDisruptive technologies
Disruptive technologies
Mel Meng
 
The data is the model period.
The data is the model period.The data is the model period.
The data is the model period.
Mel Meng
 
Hybrid planning
Hybrid planningHybrid planning
Hybrid planning
Mel Meng
 
Test driven model development
Test driven model developmentTest driven model development
Test driven model development
Mel Meng
 
Dont make me think
Dont make me thinkDont make me think
Dont make me think
Mel Meng
 
Smart infrastructure
Smart infrastructureSmart infrastructure
Smart infrastructure
Mel Meng
 

More from Mel Meng (11)

USING GIS TO IDENTIFY CRITICAL PIPES IN THE COLLECTION SYSTEM- 2012 owea coll...
USING GIS TO IDENTIFY CRITICAL PIPES IN THE COLLECTION SYSTEM- 2012 owea coll...USING GIS TO IDENTIFY CRITICAL PIPES IN THE COLLECTION SYSTEM- 2012 owea coll...
USING GIS TO IDENTIFY CRITICAL PIPES IN THE COLLECTION SYSTEM- 2012 owea coll...
 
Smart Phones Move the Field Forces Forward - 2011 Ohio GIS Conference
Smart Phones Move the Field Forces Forward - 2011 Ohio GIS ConferenceSmart Phones Move the Field Forces Forward - 2011 Ohio GIS Conference
Smart Phones Move the Field Forces Forward - 2011 Ohio GIS Conference
 
Envision version 2.0
Envision version 2.0Envision version 2.0
Envision version 2.0
 
Master planning app
Master planning appMaster planning app
Master planning app
 
Why should we develop an app
Why should we develop an appWhy should we develop an app
Why should we develop an app
 
Disruptive technologies
Disruptive technologiesDisruptive technologies
Disruptive technologies
 
The data is the model period.
The data is the model period.The data is the model period.
The data is the model period.
 
Hybrid planning
Hybrid planningHybrid planning
Hybrid planning
 
Test driven model development
Test driven model developmentTest driven model development
Test driven model development
 
Dont make me think
Dont make me thinkDont make me think
Dont make me think
 
Smart infrastructure
Smart infrastructureSmart infrastructure
Smart infrastructure
 

Recently uploaded

Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Kumud Singh
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
Rohit Gautam
 
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Zilliz
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIEnchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Vladimir Iglovikov, Ph.D.
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
Pixlogix Infotech
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Neo4j
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 

Recently uploaded (20)

Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
 
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIEnchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 

Responsible model development

  • 3. When the client asks how wrong the model can be, we should be able to look into his eyes and say, The recommendation based on the modeling results has an error of $0.5Million.
  • 4. Tell the client the model can be wrong is And the right thing to do. to do the thing right, we need to tell how wrong it is. And that’s something we believe can sell.
  • 5. Right and wrong are just the flip sides of RISKs.
  • 6. Asset Management Guys tell us: Business Risk Exposure = Probability of Failure X Consequences of Failure
  • 7. How Wrong the Model is? Business Risk Exposure = Probability of Model being Wrong X Consequences of Model being Wrong
  • 9. Pipe 1 Pipe 1 Pipe 2 If GIS is right Pipe 2 If GIS is wrong Pipe 3 Pipe 3
  • 10. Consequences of being wrong: spend $30,000 on a good pipe Probability of being wrong: GIS with no source attribution, 70% chance of a typo. The error of the recommendation is $30,000 * 70% = $21,000
  • 11. More generic formula BRE = $30,000 * (0.2+0) = $6,000
  • 12. It is the modeler’s responsibility to inform the client the limitation of the model, and the extent. It is a good way to sell Data Management and Sensitivity Analysis services. It is a good way to add true value and gain trust.
  • 13. Model responsibly. Reference: Rules for responsible modeling, James, William, CHI http://www.chiwater.com/Publications/Books/r184.asp