topic SAS Miner model for monitoring the Production data in SAS Data Science

SAS Miner model for monitoring the Production data

ggfggrr — Thu, 31 Jan 2019 23:45:29 GMT

Hello Everyone,

We have an application score model built in SAS E-miner. And for the production data, we wish to estimate the important measures C-Stat and KS statistics on the production data for monitoring purposes. Wish to know some guidance and an easy way to estimate these. Can someone help on this?

Thanks

Kind regards,

Re: SAS Miner model for monitoring the Production data

Ksharp — Fri, 01 Feb 2019 14:02:07 GMT

It must be Credit Scorecard .

data have;
 set sashelp.class(keep=sex height rename=(sex=good_bad height=total_score));
run;

proc logistic data=have ;
model good_bad(event='M')=total_score/nofit;
roc 'Test ROC' pred=total_score;
run;

/********KS**********/
proc npar1way data=have edf  ;
class good_bad;
var total_score;
run;

Re: SAS Miner model for monitoring the Production data

ggfggrr — Sun, 03 Feb 2019 20:51:59 GMT

Hi, Thanks for your help. I see that you train the dataset and see the ROC and KS. In my case, kindly note that I am already having a model in SAS E-Miner (Scorecard) and wish to add a new Test dataset for scoring to have fit statistics including ROC/KS. This is basically to monitor the scorecard model for the production data over the period. Thanks so much for taking your time

Kind regards,

Re: SAS Miner model for monitoring the Production data

Ksharp — Mon, 04 Feb 2019 10:54:39 GMT

There is a SCORE node . connent your scorecard node and test dataset node to it .

Re: SAS Miner model for monitoring the Production data

ggfggrr — Thu, 07 Feb 2019 09:35:47 GMT

Thank you so much. However, the score node does not provide the Fit Statistics. I see few ways using the following threads and will try that. Thanks a lot.

https://communities.sas.com/t5/SAS-Data-Mining-and-Machine/SAS-Enterprise-Miner-fit-statistics-for-scored-data/td-p/194524

https://communities.sas.com/t5/SAS-Data-Mining-and-Machine/Scoring-data-and-fit-statistics-in-SAS-E-Miner/td-p/375563?nobounce

Kind regards,