Hello
I build a credit risk model on 100,000 customers.
I split the data into train 70% and test 30% and built the model on train data.
Then ,the results are Gini 79% on train data.
I calculated PD based on model coefficients on out of time data.
Gini of Out of time data is 80%
My question- is this difference of 1% between out of time and train is okay or mention a problem ?
What other tests would you do in such case?
I checked PSI for all predictors and it show high stability for each of predictors
@Ronein wrote:
No. Here is out of time vs train data and other question was train data vs test data
Changing a few of the words doesn't change the meaning of the question. Your two posts have the same meaning, and likely the same answer.
You are asking the same question as https://communities.sas.com/t5/SAS-Data-Science/Gini-credit-risk-model/m-p/954433#M10965
Please do not double post questions.
PS: There is an answer at your other thread.
@Ronein wrote:
No. Here is out of time vs train data and other question was train data vs test data
Changing a few of the words doesn't change the meaning of the question. Your two posts have the same meaning, and likely the same answer.
Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.
Find more tutorials on the SAS Users YouTube channel.