topic Re: removing impute node from path after imputation is complete in SAS Data Science

removing impute node from path after imputation is complete

Roal — Thu, 02 Mar 2017 16:36:31 GMT

Hi. running models in SAS EM but for each run the process goes through the impute node which is taking a long time to run. Is it OK to remove it from the path once it's completes it's first run?

Thanks,

Re: removing impute node from path after imputation is complete

WendyCzika — Thu, 02 Mar 2017 16:45:11 GMT

No, but it shouldn't be re-running unless you are changing a property for one of the nodes that is before it in the flow or you have the Rerun property set to Yes in the Input Data node.

Re: removing impute node from path after imputation is complete

Roal — Thu, 02 Mar 2017 16:49:50 GMT

Thanks for the quick response. I will check the re-run property. Under what section in the property box will I be able to find this setting?

Thanks!

Re: removing impute node from path after imputation is complete

WendyCzika — Thu, 02 Mar 2017 16:51:21 GMT

In the Train section of the Input Data node properties. Hope that helps!

Re: removing impute node from path after imputation is complete

Roal — Thu, 02 Mar 2017 17:30:42 GMT

my rerun setting is "no". For some reason all the preceding nodes get run everytime I run a new model, including patitioning. Could it be the order of my path? input date >> partitioning>> impute>>Metadata>>models

thanks again!

Re: removing impute node from path after imputation is complete

MelodieRush — Thu, 02 Mar 2017 21:05:51 GMT

Check the rerun property for all those nodes. If any node is set to rerun all the nodes after it will rerun everytime you run the flow.

Re: removing impute node from path after imputation is complete

Roal — Fri, 03 Mar 2017 11:06:40 GMT

How do I check the rerun properties for individual nodes? I've only seen that option for the input data node.

The impute node is running extremely slow. I am working with 2 millioin records with a 60/40 partition split. I am using a combination of impute methods, tree, constant,count and mean. I am also using unique indicator variable with input role.

Thanks,

Roal

Re: removing impute node from path after imputation is complete

MelodieRush — Fri, 03 Mar 2017 14:49:34 GMT

Oops I was wrong, you are right. If you are still seeing this node rerunning each time you run without making a change to anything in the node or a node before, please contact Tech Support. support@sas.com or http://support.sas.com/en/technical-support.html#contact-technical-support

Re: removing impute node from path after imputation is complete

Roal — Mon, 06 Mar 2017 10:20:40 GMT

Will do. Thanks!