Hi, I have a dataset of 957 predictors and a binary target. Many predictors are highly correlated so I want to run a random forest model to select a subset of predictors for further modeling. I set the 'Variable Selection' option of the HP Forest node to 'Yes' and then attached another HP Forest node to it so I can use only the selected variables for modeling. However, I am not sure how the variables are selected. First, when I look at the 'Variable Importance' tab of the 1st HP Forest node, the variables can be ranked by their 'Number of Splitting Rules' and 'Gini Reduction'. As I understand, 0 on both statistics mean that the variable is not important. Does it also mean Random Forest doesn't use those variables at all (as no splitting rules are made based on those variables)? Second, when I check the 'Variable Importance' tab of the 2nd HP Forest node, I see there are only 586 variables, but many variables are those that have '0' importance (Based on Num of Splitting Rules and Gini Reduction) based on the 'Variable Importance' ranking in the 1st HP Forest node. Can someone explain to me how does HP Forest do variable selection?
... View more