In EM, there is setting where you can find the default score cut above which your prediction is flagged as yes. Otherwise NO. I think that default is 0.5. Play with different cut-off values to see you can just manage away the problem. This is perfectly legal. Nobody says you have to accept 0.5 as cut-off. This is low-hanging fruit kind of approach.
A bit harder route is when you exhaust your play above and the symptom remains. To find out, take the validation data set from EM. Now the prediction 1 and 0 based on your 'optimized' score cut above is the new prediction target. Run another model, preferably intuitive decision tree which allows you see the drivers in the background. You cannot do this with your original target because that means you simply are adding a separate stand alone model alongside your ensemble.
Jia Xin
