Hey ujjawal, To make things easier let's call your "out-of-time validation sample" a test partition. The way to incorporate a test partition in Enterprise Miner, is to set the role of a data source as Test. You can specify the role of a data source during step 7 of the Create A Data Source wizard. Another alternative, once you drag-and-drop your data into a diagram, specify the train property "role" as Test. You can connect your Test partition to your flow diagram. I tend to connect my test data after a partition node, but you can connect it directly to a Model Comparison node. The Model Comparison will calculate several fit statistics for all your partitions, including the area under the ROC curve (note that it is called roc index in this node). The exported set for your test partition will also have the predicted probability as a new column with the prefix p_<target>. It is a good practice to include a Data Partition node so that you don't end up with an overtrained model. Since you already have a test partition, you can specify 70 for training and 30 for validation in your data partition node. Your flow would look like this: Good luck! -Miguel
... View more