2) When to use Gradient Boosting, Decision Tree & Logistic Regression? Accuracy of classification depends on both ML algorithm(Gradient Boosting, Decistion tree etc) and dataset. Just my experience, most of time Gradient Boosting is more accurate than decision tree in binary classification. However, It's fairly easy to put all these algorithms together and do a model comparison.   3) How to reduce misclassification rate? Try different parameter settings. For example, increase the default number of iterations; Decrease the leaf fraction; change the default number of bin. ... View more