topic Re: Model Selection in SAS Enterprise Guide and SAS Enterprise Miner in SAS Data Science

Model Selection in SAS Enterprise Guide and SAS Enterprise Miner

grezek — Sun, 13 May 2018 11:23:58 GMT

In Enterprise Miner I used Interactive grouping to binning my input variables. I connected to the unbinned variables the regression node and ran a logistic regression. Then from the Interactive Grouping node I ran a logistic regression and a scorecard.

The results were ROC for the logistic regression without binning was .839; an improvement was seen in the logistic regression run on the binned variables (ROC = .892); the scorecard run off of the binned variables gave an ROC of .888. (see attached image)

I expected the binned variables to give a higher ROC than unbinned, but I'm unsure why the regression and scorecard yielded different results. The Model Comparison node compares the output statistics very conveniently; is there a way to compare the relevant settings between the regression and scorecard.

Thanks in advance for any suggestions. -- George Rezek

Re: Model Selection in SAS Enterprise Guide and SAS Enterprise Miner

AnnaBrown — Fri, 18 May 2018 14:46:10 GMT

HI @grezek,

Thanks for your question! Perhaps this webinar and community article will help here? Model Selection in SAS Enterprise Guide and SAS Enterprise Miner

Best,

Anna

Re: Model Selection in SAS Enterprise Guide and SAS Enterprise Miner

WendyCzika — Fri, 18 May 2018 17:10:16 GMT

If you are just running the Regression and Scorecard nodes after the Interactive Grouping node with defaults, then one thing you might want to check are the inputs used in the Regression node - by default, it is using both the GRP_ and the WOE_ variables for each input whereas the Scorecard node is only using the WOE_ variables. When I set Use=No for the GRP_ variables in the variables editor for the Regression node, then my assessment results matched.

Re: Model Selection in SAS Enterprise Guide and SAS Enterprise Miner

grezek — Fri, 18 May 2018 17:21:48 GMT

Thanks, Wendy! Now I get the same results are well. - George Rezek

Re: Model Selection in SAS Enterprise Guide and SAS Enterprise Miner

grezek — Fri, 18 May 2018 18:25:01 GMT

Thanks, Anna. I'll check it out. -- George Rezek