topic Re: Getting all variables in SAS E Miner 13.2 in SAS Data Science

Getting all variables in SAS E Miner 13.2

pulkit3478 — Mon, 09 Mar 2015 12:31:11 GMT

I am working on segmentation of a Data (around 2500 obs) for designing a Scorecard model. I have created all variables that are required for segmenting.

When I start with interactive decision tree, I dont get all the variables in the Split Node Window. Can someone guide me on how to tackle this problem?

Re: Getting all variables in SAS E Miner 13.2

mohamed_zaki — Mon, 09 Mar 2015 13:46:55 GMT

This depend on the Subtree Method you chosed in the decision tree options. The default method (Assessment) give you the smallest subtree with best value. Check the other options Largest and N. And the final decision tree could be affected by the other options too.

Re: Getting all variables in SAS E Miner 13.2

WendyCzika — Mon, 09 Mar 2015 20:41:14 GMT

Can you check in the Variables dialog for the Decision Tree node that all the variables you are expecting to see are set as Input?

Re: Getting all variables in SAS E Miner 13.2

pulkit3478 — Tue, 10 Mar 2015 06:02:02 GMT

Hi WendyCzika,

I have checked the variables dialog and all the variables except one target variables are set as input.

Re: Getting all variables in SAS E Miner 13.2

pulkit3478 — Tue, 10 Mar 2015 06:44:07 GMT

I think changing Subtree Method will have any effect if one is automatically training a decision tree, but in this case I want interactive Decision Tree.

Anyways, I changed the Subtree Method to Largest and N but still I couldnt see all the variables in Split Node Window.

Is there any upper limit of variables in input data set (I have around 3300 variables)??

Re: Getting all variables in SAS E Miner 13.2

mohamed_zaki — Tue, 10 Mar 2015 12:32:10 GMT

Did you tried to open the interactive mode just after connecting the node to the data set without running the decision node. But you should run the data set first.

Also i find sometimes after working with the interactive mode i need to prune the tree and reopen it to find all the variables again, because the refresh option in split node will not work.

Re: Getting all variables in SAS E Miner 13.2

pulkit3478 — Tue, 10 Mar 2015 13:14:11 GMT

Yes I did not run the decision node and opened the interactive decision tree window but still some of the variables are missing in Split Node window.

Yes sometimes only some of the variables (default value is 5) are shown as it depends on the number specified in Number of Rules in Node properties of the decision tree node.

Re: Getting all variables in SAS E Miner 13.2

mohamed_zaki — Tue, 10 Mar 2015 21:41:10 GMT

Can you try to run the decision tree with the same data set but include some dimension (for example only 50) not all the 3300. Just to make sure it is because the dimension not something else in your data.

Re: Getting all variables in SAS E Miner 13.2

pulkit3478 — Wed, 11 Mar 2015 10:56:20 GMT

I tried with lesser no of variables (only 100) and surprisingly every variable was coming in Split Node Window. But I want to try segmentation with all the variables.

Is there any way around for that?

Re: Getting all variables in SAS E Miner 13.2

mohamed_zaki — Wed, 11 Mar 2015 12:18:27 GMT

If the other dimension data is similar to the 100 variables you choosed previously, then i think it is a the dimension. Hope WendyCzika to return to you by a limit considerations. Although, i hope you keep increase it and tell us the limit you found.

And it is always valid advice to tell you to try a dimension reduction technique EM provide you with.

Re: Getting all variables in SAS E Miner 13.2

WendyCzika — Wed, 11 Mar 2015 14:59:55 GMT

Yes there seems to be some sort of limit around 2000 variables in the UI. I tried changing various properties - Significance Level (to 1), Leaf Size (to 1), and Exhaustive (to a very large number), turning off all p-value adjustments... but it still only shows around 2000 inputs for me as well in the Split Node dialog.