topic Re: How to use the scoring code from gradient boosting? in SAS Data Science

How to use the scoring code from gradient boosting?

munitech4u — Wed, 13 Apr 2016 13:21:22 GMT

I ran gradient boosting in EM and want to use the attached scoring code to the new dataset. How can I use it for scoring, as its written without setting a dataset and even some variables used are not present.

Re: How to use the scoring code from gradient boosting?

Reeza — Wed, 13 Apr 2016 13:37:00 GMT

You can't easily. How are you getting data in without a SET statement?

Re: How to use the scoring code from gradient boosting?

WendyCzika — Wed, 13 Apr 2016 15:46:41 GMT

Just like with all data step score code from EM:

data /* name of data set containing scores */;
  set /* data that you want to score */;
  %inc "/app/sasdata/EBI_ADVANL/EM_Projects/churn/Workspaces/EMWS1/Boost/EMPUBLISHSCORE.sas " /* or paste in the score code */;
run;

Re: How to use the scoring code from gradient boosting?

munitech4u — Wed, 13 Apr 2016 16:24:59 GMT

But my dataset, does not have some variables, which are there in code. I am not sure, how this code is generated.

Re: How to use the scoring code from gradient boosting?

Reeza — Wed, 13 Apr 2016 16:50:55 GMT

If you built a model that requires certain variables and you want to score with the same model you need those variables. If you don't have those variables, then either remove them and rebuild your model, OR change your model so it can handle missing values by including missing values for that variable in the training data.

Re: How to use the scoring code from gradient boosting?

munitech4u — Wed, 13 Apr 2016 16:52:38 GMT

Well, my input dataset does not have some of these variables like those starting with "_". but they are in scoring code. So that is what I am confused about.

Re: How to use the scoring code from gradient boosting?

Reeza — Wed, 13 Apr 2016 16:56:23 GMT

Did you build your model?

In the process did you create any new variables? SAS may have automatically named them. SAS may also be creating automatic variables required in your model, for intermediate steps.

Your input dataset needs to match the structure of your training data set. Same variables, same names, same types and same levels for categorical data.

My suggestion would be to try and see what happens.

@WendyCzika has shown the correct way to score a new dataset.

Re: How to use the scoring code from gradient boosting?

munitech4u — Wed, 13 Apr 2016 17:06:40 GMT

I had applied one oversampling step. But i think that should affect only the target variable and nothing new else

Re: How to use the scoring code from gradient boosting?

WendyCzika — Wed, 13 Apr 2016 17:17:14 GMT

I'm guessing the _ variables that you mean, if they are not input variables, are created BY the scoring code - they don't need to be in the data you are scoring, so it should be fine.

Re: How to use the scoring code from gradient boosting?

munitech4u — Wed, 13 Apr 2016 17:21:20 GMT

If you look at top of the code, you notice:

********** LEAF 1 NODE 2467 ***************;
IF _ARB_BADF_ EQ 0 THEN DO;

will it not throw the error?

Re: How to use the scoring code from gradient boosting?

WendyCzika — Wed, 13 Apr 2016 17:24:44 GMT

It's defined above that:

_ARB_BADF_ = 0;

Re: How to use the scoring code from gradient boosting?

munitech4u — Wed, 13 Apr 2016 17:27:07 GMT

Oh, I overlooked that. Seems like I am good to go then. Thanks!

Re: How to use the scoring code from gradient boosting?

JasonXin — Thu, 14 Apr 2016 11:43:33 GMT

Hi, When we build EM flows, it actually writes out SAS code in the background behind each (most) node. When a model is built and scoring code is built, it typically retains all the analytically relevant pre-codes leading towards the final scoring equation. For example, if a variable transformation node is involved in the flow, all the transformations are automatically retained including all the renames, what-if... There is also a separate SAS Score Code Node that helps. One may ask: I transformed 800 variables + derived 1000 variables, but only used 12 in the final model. Does the scoring have all of them? No, the scoring code only contains what survives into the final model. If you see score code and optimized score code, make sure you pick the optimized one. Exception to that is: if you insert your custom code by using SAS Code node, they are not automatically copied over. Also this 'way' may not work for some methods like random forest. But I recall gradient boosting is fine. Over the years I have seen EM users going back to transformation node to pick up the code behind the scene, study and improve their SAS programming that way. Although conventions like _ appear a bit odd, coding there is 'best'. Enjoy. Jason Xin