BookmarkSubscribeRSS Feed
Ronein
Meteorite | Level 14
Hello
I am building a credit score model.
I almost finished build the model and I calculated Gini .
The model is developed based on data from Jan 2023 and then check default in Feb 2023 till Jan 2024( 12 months).
Note that the data divided to train (70%) and test (30%).
I was asked to do the following-
Find customers with very bad elements that are "Indeterminate" (in Jan 2023) but still not in default (in Jan 2023).
It means that these customers are very  close to be defaulted and already have days past due (but still not enough to be in default) .
I read that these type of customers are called "Indeterminate".
My question-
The task is to find if the model has good separation power for the "good " customers (customers who are not Indeterminate).
The idea is that for customers who are not indeterminate it is more difficult to predict default.
What is the way to check it( if the modelhas good separation power for the "good " customers)?
4 REPLIES 4
Ronein
Meteorite | Level 14
There is gini that common to use. My question is about the Indeterminate customers.how should I.make the analysis?
Ksharp
Super User
gini is the same as roc:
gini =2*roc-1

You should firstly identify these " Indeterminate customers" ,then do ROC analysis or GOF of logistic ,or Confusion Matrix .
SASKiwi
PROC Star

What percentage of your customers are "bad" but not in default versus good? In my experience, a good lending portfolio will have over 90% good customers, less than 3% in default and the remainder with minor arrears. How does the gini of your "indeterminate" customers compare with your good customers? I would expect to see a higher gini for indeterminate's as these are the most likely to go into default.

hackathon24-white-horiz.png

The 2025 SAS Hackathon Kicks Off on June 11!

Watch the live Hackathon Kickoff to get all the essential information about the SAS Hackathon—including how to join, how to participate, and expert tips for success.

YouTube LinkedIn

How to choose a machine learning algorithm

Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 4 replies
  • 1599 views
  • 0 likes
  • 3 in conversation