topic Re: MBR prediction error and confusional matrix in SAS Enterprise Guide

MBR prediction error and confusional matrix

lele241 — Fri, 04 Jul 2014 08:52:09 GMT

How to find the total predictional error on the test set and the confusional matrix on validation set for MBR classificator on SAS enterprise miner?

Answere asap.

thank you very much

Re: MBR prediction error and confusional matrix

fef92 — Fri, 04 Jul 2014 09:09:55 GMT

I have the same problem :smileyshocked:

Re: MBR prediction error and confusional matrix

gergely_batho — Fri, 04 Jul 2014 10:17:54 GMT

Connect a Model Comparison Node to MBR.

There you should see it.

Re: MBR prediction error and confusional matrix

fef92 — Fri, 04 Jul 2014 10:29:53 GMT

I found the confusional matrix, but not the error of test set

Re: MBR prediction error and confusional matrix

gergely_batho — Fri, 04 Jul 2014 10:50:01 GMT

In Model Comparison results look at the Fit Statistics table.

Some of the last columns are: Test ASE, Test RASE, Test MSE, Test RMSE, Test Misc.Rate, etc.

Make also sure, that you have a Partition Node in the flow, and test set percent is not 0%.

Re: MBR prediction error and confusional matrix

fef92 — Sat, 05 Jul 2014 09:22:00 GMT

Thank you very much!

In the Partition Node test set percent is not 0%, but the value of final prediction error is " . " .I had a filter node for the target before the Partition, maybe I have deleted something important...

Re: MBR prediction error and confusional matrix

gergely_batho — Mon, 07 Jul 2014 09:45:40 GMT

As a first step try to connect a Model Comparison Node directly to the MBR node.

What does your Filter Node do? Hopefully not dropping all the test observation.

You can select the Model Comparison Node, then click on Imported Data, and Browse directly the Test Data. Does it have predictions (not missing)? Is the target variable OK (not missing)?

Are you saying that Test ASE, etc are all missing in the Fit Statistic Table?