Building models with SAS Enterprise Miner, SAS Factory Miner, SAS Visual Data Mining and Machine Learning or just with programming

Multilevel classification using Gradient boosting SAS

Reply
Regular Contributor
Posts: 190

Multilevel classification using Gradient boosting SAS

I have 6 target classes in my input data and i have specified their data type as nominal.I have tried oversampling and decision node with Gradient boosting, but nothing seems to be producing any result? Are there any specific settings for multi-classification for gradient boosting node in EM?

SAS Employee
Posts: 37

Re: Multilevel classification using Gradient boosting SAS

Posted in reply to munitech4u

The boosting node handles nominal targets automatically.  No special settings are necessary other than declaring the target as nominal.   There should be a result, even if the result is to predict all observations the same way.

 

 

Regular Contributor
Posts: 190

Re: Multilevel classification using Gradient boosting SAS

Posted in reply to PadraicGNeville

But it assigns all classes to 1. and variable importance is empty. I expected GBM results to be better than a single decision tree node. 

SAS Employee
Posts: 37

Re: Multilevel classification using Gradient boosting SAS

Posted in reply to munitech4u

This is constant prediction.  Either no split is created or many trees were created and then pruned back with validation data.

 

If many trees are created and then pruned, then there should be an iteration sequence.

 

If no split is created, then yes, some special handling of the settings is necessary.  For example, setting the leafsize = 1.  Without seeing the data I cannot help much with this. 

 

 

Regular Contributor
Posts: 190

Re: Multilevel classification using Gradient boosting SAS

Posted in reply to PadraicGNeville

I am attaching the settings and logs. Let me know, if you need to look into anything else.


settings1.jpgsettings2.jpg
Ask a Question
Discussion stats
  • 4 replies
  • 425 views
  • 0 likes
  • 2 in conversation