Building models with SAS Enterprise Miner, SAS Factory Miner, SAS Visual Data Mining and Machine Learning or just with programming

Fine tune my SVM in EM

Reply
Occasional Contributor
Posts: 14

Fine tune my SVM in EM

Hi,

I have heard many success story using SVM in predictive modeling but according to my own experience, my SVM didn't outperform my basic Logistic regression in Enterprise Miner.

Could someone help me in fine tuning my SVM?  I believe I haven't done a great job in fine tuning my SVM in EMiner and that caused the underperformance of my SVM.

Any papers or any tutorials are more than welcome!

SAS Employee
Posts: 340

Re: Fine tune my SVM in EM

I guess you want to compare a linear SVM to your Logistic Regression. (Otherwise it's not fair Smiley Happy )

Basically there is only one parameter, that you can use for tuning the linear SVM, it is the penalty value (C).

SVMs do not outperform Logistic Regression in every situation.

They are stable, work very well with high dimensional data...

SVMs are maximal margin classifiers. They work the best if there is a margin. In business terms this means your event and non-event cases are very different. There are only a few "in the middle".

Logistic Regression assumes a smooth transition of the probability as features change.

Don't forget to compare your models on an independent test set.

Ask a Question
Discussion stats
  • 1 reply
  • 448 views
  • 0 likes
  • 2 in conversation