Where are variables/model effects stored for looped models in eminer?

frankie_s_tyo — Wed, 23 Jan 2019 02:44:46 GMT

I am using an ensemble model in SAS eminer to join a Decision Tree and two Regression Models and need to collect the variables in SAS Eguide for scoring new data.

All three models are looped over a segment (of which there are 30) with start and end groups.

I know that for a regression model variables are stored in emws1/reg_effects and worked out that emws1/reg_effects_loop will provide all input variables for each looped regression model.

However, I am unable to find a similar file for decision trees or other models.

I can find for example emws1/tree_variableset - but this has too few variables (I think it is for a single segment - presumably the last).

Of course, if there is a final list somewhere (maybe in the ensemble model file?) that contains all variables used in all parts of the model that would be the best (rather than importing separately for each model).

Thanks in advance and please let me know if anything is unclear.

Below is the code I'm using (in this case, reg_effects_loop will pull all variables happily, whereas the other two seem to be pulling variables for only one segment).

data frankie.&projx._eff_tree (keep=variable);
rename name=variable;
set  &SEM..tree_variableset (where=(role='INPUT'));
run;
data frankie.&projx._eff_reg (keep=variable);
rename name=variable;
set  &SEM..reg_effects_loop (where=(role='INPUT'));
run;
data frankie.&projx._eff_princomp (keep=variable);
rename name=variable;
set  &SEM..princomp_variableset (where=(role='INPUT'));
run;

data frankie.&projx.eff_all;
set 
frankie.&projx._eff_reg
frankie.&projx._eff_tree
frankie.&projx._eff_princomp
;
run;

Re: Where are variables/model effects stored for looped models in eminer?

WendyCzika — Thu, 24 Jan 2019 17:56:22 GMT

The tree_outimport data set has the variable importance for the inputs for the Decision Tree node, so you can use that to subset the variables, you would just need to filter out the rows that have importance=0 to remove the un-used inputs.

Re: Where are variables/model effects stored for looped models in eminer?

frankie_s_tyo — Mon, 28 Jan 2019 01:34:38 GMT

Many thanks - there exists a file 'tree_outimport_loop' which has all iterations inside that I was able to use.

topic Re: Where are variables/model effects stored for looped models in eminer? in SAS Data Science

Where are variables/model effects stored for looped models in eminer?

Re: Where are variables/model effects stored for looped models in eminer?

Re: Where are variables/model effects stored for looped models in eminer?