topic Partition Question in SAS Data Science

Partition Question

AnnaGeorge1 — Thu, 29 Jul 2021 02:43:31 GMT

How do you use a user-defined partition in Enterprise Miner?

Re: Partition Question

gcjfernandez — Thu, 29 Jul 2021 06:25:39 GMT

You can use data partition node and input user-defined train, validation and test percentages:

Re: Partition Question

AnnaGeorge1 — Thu, 29 Jul 2021 14:15:58 GMT

I am not asking how to partition the data. My data set has a validation column where the observations are already identified as test, train, or valid. What I want to know is how I can use that to communicate with Enterprise Miner that the data are already partitioned.

Re: Partition Question

gcjfernandez — Thu, 29 Jul 2021 15:27:00 GMT

First separate training and validation data based on partition indicator variable in SAS EG or using SAS code node and save to project Library.

Then using SAMPLE -> Input data node add these two data into the process flow, and assign their respective roles (Train or valid).

Re: Partition Question

MelodieRush — Thu, 29 Jul 2021 18:51:00 GMT

You can use the following code in the SAS Code node to divide your data into training, validation and test datasets to be used for Enterprise Miner nodes

data &EM_EXPORT_TRAIN &EM_EXPORT_VALIDATE &EM_EXPORT_TEST;

set &EM_IMPORT_DATA;

if partition_key=1 then output &EM_EXPORT_TRAIN;

else if partition_key=2 then output &EM_EXPORT_VALIDATE;

else if partition_key=3 then output &EM_EXPORT_TEST;

run;

Put this code in the training code section which is the top icon selected in the image below.

Your flow would/could look something like this: