topic Re: Rejecting high percent mode in Enterprise Miner in SAS Academy for Data Science

Rejecting high percent mode in Enterprise Miner

TrishPaquette — Thu, 04 Oct 2018 23:48:54 GMT

In the case study solution to Module 3, the author rejects variables with a high percent mode (>97%). Is this done in the metadata node? I can choose statistics to filter on, but mode is not an option.

Re: Rejecting high percent mode in Enterprise Miner

RobertBlanchard — Fri, 05 Oct 2018 16:03:13 GMT

Hello Trish,

Yes, the variables with the large mode percentage are set to rejected using the metadata node.

One alternative to the provided solution may be to set the data partition node to perform a stratified simple random sample, stratifying on those variables with a large mode to ensure all values in the variables exist in each partition. To do this, click the variables ellipsis in the data partition node. Then change the Partition Role value from default to Stratification for the categorical variables of interest. If a level is VERY rare, then sometimes this approach may not work and you'll receive an error from the node.

Good luck!

Best,

Robert

Re: Rejecting high percent mode in Enterprise Miner

TrishPaquette — Tue, 23 Oct 2018 12:44:13 GMT

Revisiting this because I can't seem to reject automatically in
the Metadata node. I am offered some statistics on which to reject, but
percent mode is not one of them. How can I do this automatically?

Re: Rejecting high percent mode in Enterprise Miner

RobertBlanchard — Fri, 09 Nov 2018 13:43:12 GMT

Hey,

I believe one would have to reject the variables manually in this scenario.

Best,

Robert