SlideShare a Scribd company logo
Credit Limit
Debt to Income
Credit Report
Credit History
Low Score leads to rejection of application or with
higher interest rates
Identify credit-
worthy customers
High Credit score attracts applications of high credit worthy
customers and hence the approval process is quick with lowest
interest rates.
Practical Observations and growing need of
Scorecard Model
-By Mary Suma Thiburtius
Using historical data to assesses the credit worthiness of
borrower
http://www.linkedin.com/in/sumayyappan | https://twitter.com/tmarysuma
Score Card based model and Probability of Default
 Credit Score access the likelihood that the borrower will exhibit characteristics associated with poor performance by
assessing the historical default rate of borrowers with similar characteristics.
 Credit Scores are good for identifying relative risk of borrower in a population.
 Once the credit scoring model is built, it can be used to decide whether the credit application should be accepted or
rejected or to derive the probability of a future default.
 Probability of default take into account the economic conditions when predicting the future default rate.
 Probability of default represents risk as a percentage likelihood that the borrower will fail to make a payment on loan.
 Default probability is the likelihood over a specified period, usually one year, that a borrower will not be able to make
scheduled repayments. Default probability (PD), depends not only on the borrower's characteristics but also on the economic
conditions.
1. Scorecard based model
2. Probability of Default
Note: In general, defaults may come from 10% to 20% of the lending segments and hence profiling risky segment is
important to reveal useful information.
http://www.linkedin.com/in/sumayyappan | https://twitter.com/tmarysuma
1. Develop score card model using Logistic Regression
Find scores for variables based on weight of evidence bin and
logistic regression:
Probability Distribution of Score for Train Data
Find Scorecard point for all observations from train data
In the example
• For Default cases – Score Ranges from 65 to 753 with a
mean 374
• For Non Default cases – Score Ranges from 186 to 814
with a mean 591
Inference:
• < 600 - Indicates poor score and more likely to default
• 600-700 – Less default rate and more likely to get
approved for loan
• >700 - Excellent Score.
http://www.linkedin.com/in/sumayyappan | https://twitter.com/tmarysuma
Probability Distribution of Score for Test Data
Scorecard point for all observations from test
data set
• For Default cases – Score Ranges from 19 to
797 with a mean 381
• For Non Default cases – Score Ranges from 106
to 814 with a mean 587
0.70
0.87
0.20
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
500 510 520 530 540 550 560 570 580 590 600 610 620 630 640 650 660 670 680 690 700
Accuracy Default NonDefault Kappa Sensitivity Specificity
How to find the optimal threshold of score to maximize the accuracy?
Scorecard performance on test data
Scorecard at Maximum Accuracy of 0.7 is at 700
• For default cases, scorecard at Maximum accuracy of 0.87 is
700
• For non-default cases, scorecard at Maximum accuracy of 0.2 is
500
Accuracy Rate for different Thresholds ( for Score Card )
http://www.linkedin.com/in/sumayyappan | https://twitter.com/tmarysuma
Find Scorecard point for all observations from train data
Calculate optimal threshold for probability to maximize the accuracy.
Probability of default provide more information than the
scores.
• For Default cases – Mean probability of default is 0.52
• For Non Default cases – Mean probability of default is
0.12
Accuracy Rate for different Thresholds ( for Probability)
Threshold at Maximum Accuracy of 0.87 is 0.5
• For default cases, threshold at Maximum accuracy of
0.96 is 0.9
• For non-default cases, threshold at Maximum accuracy
of 0.87 is 0.1
Distribution of Probability of Default
0.87
0.996
0.87
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9
Accuracy Default NonDefault Sensitivity Specificity Kappa
2. Probabilities of Default on test observations
Accuracy is used to evaluate model performance. This is
affected by the selected threshold. Below is an approach to
find optimal threshold that maximizes accuracy.
http://www.linkedin.com/in/sumayyappan | https://twitter.com/tmarysuma

More Related Content

Similar to Score Card Model

Group 1 p53
Group 1 p53Group 1 p53
Group 1 p53
Amit Kulkarni
 
The Credit Management Analysis Of Customers Traffic Flows And Pattern[1].pptx
The Credit Management Analysis Of Customers Traffic Flows And Pattern[1].pptxThe Credit Management Analysis Of Customers Traffic Flows And Pattern[1].pptx
The Credit Management Analysis Of Customers Traffic Flows And Pattern[1].pptx
karthiknat1807
 
Choosing The Right Credit Decisioning Model
Choosing The Right Credit Decisioning ModelChoosing The Right Credit Decisioning Model
Choosing The Right Credit Decisioning Model
Experian
 
Applied Machine Learning Days Lausanne 2018
Applied Machine Learning Days Lausanne 2018Applied Machine Learning Days Lausanne 2018
Applied Machine Learning Days Lausanne 2018
Stefano Tempesta
 
Credit Score Basics-04-17
Credit Score Basics-04-17Credit Score Basics-04-17
Credit Score Basics-04-17
Barbara O'Neill
 
Credit Risk Evaluation Model
Credit Risk Evaluation ModelCredit Risk Evaluation Model
Credit Risk Evaluation Model
Mihai Enescu
 
Sap credit management_overview
Sap credit management_overviewSap credit management_overview
Sap credit management_overview
SUNIT KATOCH
 
Model building in credit card and loan approval
Model building in credit card and loan approval Model building in credit card and loan approval
Model building in credit card and loan approval
Venkata Reddy Konasani
 
sandip nayek CRM ASSIGNMENT.PPTX 2023.pptx
sandip nayek CRM ASSIGNMENT.PPTX 2023.pptxsandip nayek CRM ASSIGNMENT.PPTX 2023.pptx
sandip nayek CRM ASSIGNMENT.PPTX 2023.pptx
SANDIPNAYEK1
 
A New Approach to Consumer Credit
A New Approach to Consumer CreditA New Approach to Consumer Credit
A New Approach to Consumer Credit
Rabindran Abraham
 
Valiance Portfolio
Valiance PortfolioValiance Portfolio
Valiance Portfolio
Rohit Pandey
 
Introduction to predictive modeling v1
Introduction to predictive modeling v1Introduction to predictive modeling v1
Introduction to predictive modeling v1
Venkata Reddy Konasani
 
Decoding Loan Approval: Predictive Modeling in Action
Decoding Loan Approval: Predictive Modeling in ActionDecoding Loan Approval: Predictive Modeling in Action
Decoding Loan Approval: Predictive Modeling in Action
Boston Institute of Analytics
 
Case studies to engage
Case studies to engageCase studies to engage
Case studies to engage
Aditya Madiraju
 
Insurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis ProjectInsurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis Project
Boston Institute of Analytics
 
Credit Scoring ppt.ppt
Credit Scoring ppt.pptCredit Scoring ppt.ppt
Credit Scoring ppt.ppt
etebarkhmichale
 
The Mindset of Decision-Making: Best Practices to Increase Agility and Visibi...
The Mindset of Decision-Making: Best Practices to Increase Agility and Visibi...The Mindset of Decision-Making: Best Practices to Increase Agility and Visibi...
The Mindset of Decision-Making: Best Practices to Increase Agility and Visibi...
Prolifics
 
Credit scorecard
Credit scorecardCredit scorecard
Credit scorecard
Tuhin AI Advisory
 
Best Approach to Finance SMEs-Program Lending
Best Approach to Finance SMEs-Program Lending Best Approach to Finance SMEs-Program Lending
Best Approach to Finance SMEs-Program Lending
rabbani63
 
Loan approval prediction based on machine learning approach
Loan approval prediction based on machine learning approachLoan approval prediction based on machine learning approach
Loan approval prediction based on machine learning approach
Eslam Nader
 

Similar to Score Card Model (20)

Group 1 p53
Group 1 p53Group 1 p53
Group 1 p53
 
The Credit Management Analysis Of Customers Traffic Flows And Pattern[1].pptx
The Credit Management Analysis Of Customers Traffic Flows And Pattern[1].pptxThe Credit Management Analysis Of Customers Traffic Flows And Pattern[1].pptx
The Credit Management Analysis Of Customers Traffic Flows And Pattern[1].pptx
 
Choosing The Right Credit Decisioning Model
Choosing The Right Credit Decisioning ModelChoosing The Right Credit Decisioning Model
Choosing The Right Credit Decisioning Model
 
Applied Machine Learning Days Lausanne 2018
Applied Machine Learning Days Lausanne 2018Applied Machine Learning Days Lausanne 2018
Applied Machine Learning Days Lausanne 2018
 
Credit Score Basics-04-17
Credit Score Basics-04-17Credit Score Basics-04-17
Credit Score Basics-04-17
 
Credit Risk Evaluation Model
Credit Risk Evaluation ModelCredit Risk Evaluation Model
Credit Risk Evaluation Model
 
Sap credit management_overview
Sap credit management_overviewSap credit management_overview
Sap credit management_overview
 
Model building in credit card and loan approval
Model building in credit card and loan approval Model building in credit card and loan approval
Model building in credit card and loan approval
 
sandip nayek CRM ASSIGNMENT.PPTX 2023.pptx
sandip nayek CRM ASSIGNMENT.PPTX 2023.pptxsandip nayek CRM ASSIGNMENT.PPTX 2023.pptx
sandip nayek CRM ASSIGNMENT.PPTX 2023.pptx
 
A New Approach to Consumer Credit
A New Approach to Consumer CreditA New Approach to Consumer Credit
A New Approach to Consumer Credit
 
Valiance Portfolio
Valiance PortfolioValiance Portfolio
Valiance Portfolio
 
Introduction to predictive modeling v1
Introduction to predictive modeling v1Introduction to predictive modeling v1
Introduction to predictive modeling v1
 
Decoding Loan Approval: Predictive Modeling in Action
Decoding Loan Approval: Predictive Modeling in ActionDecoding Loan Approval: Predictive Modeling in Action
Decoding Loan Approval: Predictive Modeling in Action
 
Case studies to engage
Case studies to engageCase studies to engage
Case studies to engage
 
Insurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis ProjectInsurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis Project
 
Credit Scoring ppt.ppt
Credit Scoring ppt.pptCredit Scoring ppt.ppt
Credit Scoring ppt.ppt
 
The Mindset of Decision-Making: Best Practices to Increase Agility and Visibi...
The Mindset of Decision-Making: Best Practices to Increase Agility and Visibi...The Mindset of Decision-Making: Best Practices to Increase Agility and Visibi...
The Mindset of Decision-Making: Best Practices to Increase Agility and Visibi...
 
Credit scorecard
Credit scorecardCredit scorecard
Credit scorecard
 
Best Approach to Finance SMEs-Program Lending
Best Approach to Finance SMEs-Program Lending Best Approach to Finance SMEs-Program Lending
Best Approach to Finance SMEs-Program Lending
 
Loan approval prediction based on machine learning approach
Loan approval prediction based on machine learning approachLoan approval prediction based on machine learning approach
Loan approval prediction based on machine learning approach
 

Recently uploaded

一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
hyfjgavov
 
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
agdhot
 
Econ3060_Screen Time and Success_ final_GroupProject.pdf
Econ3060_Screen Time and Success_ final_GroupProject.pdfEcon3060_Screen Time and Success_ final_GroupProject.pdf
Econ3060_Screen Time and Success_ final_GroupProject.pdf
blueshagoo1
 
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
nyvan3
 
一比一原版南昆士兰大学毕业证如何办理
一比一原版南昆士兰大学毕业证如何办理一比一原版南昆士兰大学毕业证如何办理
一比一原版南昆士兰大学毕业证如何办理
ugydym
 
Experts live - Improving user adoption with AI
Experts live - Improving user adoption with AIExperts live - Improving user adoption with AI
Experts live - Improving user adoption with AI
jitskeb
 
Drownings spike from May to August in children
Drownings spike from May to August in childrenDrownings spike from May to August in children
Drownings spike from May to August in children
Bisnar Chase Personal Injury Attorneys
 
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
ytypuem
 
Template xxxxxxxx ssssssssssss Sertifikat.pptx
Template xxxxxxxx ssssssssssss Sertifikat.pptxTemplate xxxxxxxx ssssssssssss Sertifikat.pptx
Template xxxxxxxx ssssssssssss Sertifikat.pptx
TeukuEriSyahputra
 
Cell The Unit of Life for NEET Multiple Choice Questions.docx
Cell The Unit of Life for NEET Multiple Choice Questions.docxCell The Unit of Life for NEET Multiple Choice Questions.docx
Cell The Unit of Life for NEET Multiple Choice Questions.docx
vasanthatpuram
 
一比一原版爱尔兰都柏林大学毕业证(本硕)ucd学位证书如何办理
一比一原版爱尔兰都柏林大学毕业证(本硕)ucd学位证书如何办理一比一原版爱尔兰都柏林大学毕业证(本硕)ucd学位证书如何办理
一比一原版爱尔兰都柏林大学毕业证(本硕)ucd学位证书如何办理
hqfek
 
一比一原版悉尼大学毕业证如何办理
一比一原版悉尼大学毕业证如何办理一比一原版悉尼大学毕业证如何办理
一比一原版悉尼大学毕业证如何办理
keesa2
 
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
z6osjkqvd
 
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
Timothy Spann
 
Overview IFM June 2024 Consumer Confidence INDEX Report.pdf
Overview IFM June 2024 Consumer Confidence INDEX Report.pdfOverview IFM June 2024 Consumer Confidence INDEX Report.pdf
Overview IFM June 2024 Consumer Confidence INDEX Report.pdf
nhutnguyen355078
 
Module 1 ppt BIG DATA ANALYTICS_NOTES FOR MCA
Module 1 ppt BIG DATA ANALYTICS_NOTES FOR MCAModule 1 ppt BIG DATA ANALYTICS_NOTES FOR MCA
Module 1 ppt BIG DATA ANALYTICS_NOTES FOR MCA
yuvarajkumar334
 
[VCOSA] Monthly Report - Cotton & Yarn Statistics May 2024
[VCOSA] Monthly Report - Cotton & Yarn Statistics May 2024[VCOSA] Monthly Report - Cotton & Yarn Statistics May 2024
[VCOSA] Monthly Report - Cotton & Yarn Statistics May 2024
Vietnam Cotton & Spinning Association
 
How To Control IO Usage using Resource Manager
How To Control IO Usage using Resource ManagerHow To Control IO Usage using Resource Manager
How To Control IO Usage using Resource Manager
Alireza Kamrani
 
一比一原版(lbs毕业证书)伦敦商学院毕业证如何办理
一比一原版(lbs毕业证书)伦敦商学院毕业证如何办理一比一原版(lbs毕业证书)伦敦商学院毕业证如何办理
一比一原版(lbs毕业证书)伦敦商学院毕业证如何办理
ywqeos
 
一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理
一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理
一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理
eoxhsaa
 

Recently uploaded (20)

一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
 
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
 
Econ3060_Screen Time and Success_ final_GroupProject.pdf
Econ3060_Screen Time and Success_ final_GroupProject.pdfEcon3060_Screen Time and Success_ final_GroupProject.pdf
Econ3060_Screen Time and Success_ final_GroupProject.pdf
 
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
 
一比一原版南昆士兰大学毕业证如何办理
一比一原版南昆士兰大学毕业证如何办理一比一原版南昆士兰大学毕业证如何办理
一比一原版南昆士兰大学毕业证如何办理
 
Experts live - Improving user adoption with AI
Experts live - Improving user adoption with AIExperts live - Improving user adoption with AI
Experts live - Improving user adoption with AI
 
Drownings spike from May to August in children
Drownings spike from May to August in childrenDrownings spike from May to August in children
Drownings spike from May to August in children
 
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
 
Template xxxxxxxx ssssssssssss Sertifikat.pptx
Template xxxxxxxx ssssssssssss Sertifikat.pptxTemplate xxxxxxxx ssssssssssss Sertifikat.pptx
Template xxxxxxxx ssssssssssss Sertifikat.pptx
 
Cell The Unit of Life for NEET Multiple Choice Questions.docx
Cell The Unit of Life for NEET Multiple Choice Questions.docxCell The Unit of Life for NEET Multiple Choice Questions.docx
Cell The Unit of Life for NEET Multiple Choice Questions.docx
 
一比一原版爱尔兰都柏林大学毕业证(本硕)ucd学位证书如何办理
一比一原版爱尔兰都柏林大学毕业证(本硕)ucd学位证书如何办理一比一原版爱尔兰都柏林大学毕业证(本硕)ucd学位证书如何办理
一比一原版爱尔兰都柏林大学毕业证(本硕)ucd学位证书如何办理
 
一比一原版悉尼大学毕业证如何办理
一比一原版悉尼大学毕业证如何办理一比一原版悉尼大学毕业证如何办理
一比一原版悉尼大学毕业证如何办理
 
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
 
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
 
Overview IFM June 2024 Consumer Confidence INDEX Report.pdf
Overview IFM June 2024 Consumer Confidence INDEX Report.pdfOverview IFM June 2024 Consumer Confidence INDEX Report.pdf
Overview IFM June 2024 Consumer Confidence INDEX Report.pdf
 
Module 1 ppt BIG DATA ANALYTICS_NOTES FOR MCA
Module 1 ppt BIG DATA ANALYTICS_NOTES FOR MCAModule 1 ppt BIG DATA ANALYTICS_NOTES FOR MCA
Module 1 ppt BIG DATA ANALYTICS_NOTES FOR MCA
 
[VCOSA] Monthly Report - Cotton & Yarn Statistics May 2024
[VCOSA] Monthly Report - Cotton & Yarn Statistics May 2024[VCOSA] Monthly Report - Cotton & Yarn Statistics May 2024
[VCOSA] Monthly Report - Cotton & Yarn Statistics May 2024
 
How To Control IO Usage using Resource Manager
How To Control IO Usage using Resource ManagerHow To Control IO Usage using Resource Manager
How To Control IO Usage using Resource Manager
 
一比一原版(lbs毕业证书)伦敦商学院毕业证如何办理
一比一原版(lbs毕业证书)伦敦商学院毕业证如何办理一比一原版(lbs毕业证书)伦敦商学院毕业证如何办理
一比一原版(lbs毕业证书)伦敦商学院毕业证如何办理
 
一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理
一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理
一比一原版多伦多大学毕业证(UofT毕业证书)学历如何办理
 

Score Card Model

  • 1. Credit Limit Debt to Income Credit Report Credit History Low Score leads to rejection of application or with higher interest rates Identify credit- worthy customers High Credit score attracts applications of high credit worthy customers and hence the approval process is quick with lowest interest rates. Practical Observations and growing need of Scorecard Model -By Mary Suma Thiburtius Using historical data to assesses the credit worthiness of borrower http://www.linkedin.com/in/sumayyappan | https://twitter.com/tmarysuma
  • 2. Score Card based model and Probability of Default  Credit Score access the likelihood that the borrower will exhibit characteristics associated with poor performance by assessing the historical default rate of borrowers with similar characteristics.  Credit Scores are good for identifying relative risk of borrower in a population.  Once the credit scoring model is built, it can be used to decide whether the credit application should be accepted or rejected or to derive the probability of a future default.  Probability of default take into account the economic conditions when predicting the future default rate.  Probability of default represents risk as a percentage likelihood that the borrower will fail to make a payment on loan.  Default probability is the likelihood over a specified period, usually one year, that a borrower will not be able to make scheduled repayments. Default probability (PD), depends not only on the borrower's characteristics but also on the economic conditions. 1. Scorecard based model 2. Probability of Default Note: In general, defaults may come from 10% to 20% of the lending segments and hence profiling risky segment is important to reveal useful information. http://www.linkedin.com/in/sumayyappan | https://twitter.com/tmarysuma
  • 3. 1. Develop score card model using Logistic Regression Find scores for variables based on weight of evidence bin and logistic regression: Probability Distribution of Score for Train Data Find Scorecard point for all observations from train data In the example • For Default cases – Score Ranges from 65 to 753 with a mean 374 • For Non Default cases – Score Ranges from 186 to 814 with a mean 591 Inference: • < 600 - Indicates poor score and more likely to default • 600-700 – Less default rate and more likely to get approved for loan • >700 - Excellent Score. http://www.linkedin.com/in/sumayyappan | https://twitter.com/tmarysuma
  • 4. Probability Distribution of Score for Test Data Scorecard point for all observations from test data set • For Default cases – Score Ranges from 19 to 797 with a mean 381 • For Non Default cases – Score Ranges from 106 to 814 with a mean 587 0.70 0.87 0.20 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 500 510 520 530 540 550 560 570 580 590 600 610 620 630 640 650 660 670 680 690 700 Accuracy Default NonDefault Kappa Sensitivity Specificity How to find the optimal threshold of score to maximize the accuracy? Scorecard performance on test data Scorecard at Maximum Accuracy of 0.7 is at 700 • For default cases, scorecard at Maximum accuracy of 0.87 is 700 • For non-default cases, scorecard at Maximum accuracy of 0.2 is 500 Accuracy Rate for different Thresholds ( for Score Card ) http://www.linkedin.com/in/sumayyappan | https://twitter.com/tmarysuma Find Scorecard point for all observations from train data
  • 5. Calculate optimal threshold for probability to maximize the accuracy. Probability of default provide more information than the scores. • For Default cases – Mean probability of default is 0.52 • For Non Default cases – Mean probability of default is 0.12 Accuracy Rate for different Thresholds ( for Probability) Threshold at Maximum Accuracy of 0.87 is 0.5 • For default cases, threshold at Maximum accuracy of 0.96 is 0.9 • For non-default cases, threshold at Maximum accuracy of 0.87 is 0.1 Distribution of Probability of Default 0.87 0.996 0.87 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 Accuracy Default NonDefault Sensitivity Specificity Kappa 2. Probabilities of Default on test observations Accuracy is used to evaluate model performance. This is affected by the selected threshold. Below is an approach to find optimal threshold that maximizes accuracy. http://www.linkedin.com/in/sumayyappan | https://twitter.com/tmarysuma