For my dataset, I run Regression, Neural Network, Decision Trees & Gradient Boosting Nodes. GB node always has the highest MSE, even higher than Regression. Even after I changed N interations to 200, it is still the worst one. Could you suggest what other parameters I can try out to improve the outcome? I run my dataset on R & Python, GB from both give very good results. Don't know what is wrong with SAS's GB node. My problem is of regression, not of classification.
One thing to try would be using a smaller value for Leaf Fraction - could be too high to find splits.
May I know what is leaf fraction and why we need to use a smaller for it?
May I know what is leaf fraction in Gradient Boosting?
Use the Leaf Fraction property to specify the smallest number of training observations a new branch may have, expressed as the proportion of the number N of available training observations in the data. N may be less than the total number of observations in the data set because observations with a missing target value are excluded.
So setting this to a smaller value grows larger trees.
April 27 – 30 | Gaylord Texan | Grapevine, Texas
Walk in ready to learn. Walk out ready to deliver. This is the data and AI conference you can't afford to miss.
Register now and save with the early bird rate—just $795!
Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.
Find more tutorials on the SAS Users YouTube channel.