topic Re: SAS Enterprise Miner: Produce Precision, Recall and F1 Score in SAS Data Science

SAS Enterprise Miner: Produce Precision, Recall and F1 Score

filbert2021 — Mon, 17 Oct 2022 08:44:41 GMT

Hi, I have an enquiry on how to generate confusion matrix in SAS Enterprise Miner?

I am interested in calculating Precision, Recall and F1 Score of my model but I can't find it anywhere on EM.

Thank you.

- Filbert

Re: SAS Enterprise Miner: Produce Precision, Recall and F1 Score

sbxkoenk — Mon, 17 Oct 2022 13:00:48 GMT

Hello,

I had a nice program for that , but lost it due to our document retention policy.

I had forgotten to label it for "more than x-year preservation".

But in fact, it's easy.

Suppose your (binary) target variable is named "BM".

Then submit this code :

proc freq data=my_dataset;
 tables F_BM * I_BM / missing list out=work.ConfusionMatrix;
run;

... and calculate all your wished for metrics from there using a datastep with retain statement.

But only the F1-score needs to be calculated , if I remember well.

All other metrics are given by Enterprise Miner already.

Remember this :

In binary classification, recall is called sensitivity.
Recall is also known as True Positive Rate (TPR), probability of detection, hit rate.
Precision = Positive Predictive Value (PPV)

Cheers,

Koen

Re: SAS Enterprise Miner: Produce Precision, Recall and F1 Score

filbert2021 — Tue, 18 Oct 2022 02:53:44 GMT

Hi Koen,

Thank you for your prompt reply.

For the existing metric given by Enterprise Miner like precision and recall. How do I access this information?

I can't seem to find it at my model outputs.

- Filbert

Re: SAS Enterprise Miner: Produce Precision, Recall and F1 Score

sbxkoenk — Tue, 18 Oct 2022 19:40:33 GMT

Hello,

In your diagram, add the Cutoff node from the Assess group.

Run it and open the Results.
"View" pull-down menu --> Classification Rates

"View" pull-down menu --> Precision Rates

Koen