BookmarkSubscribeRSS Feed
ravnen55
Calcite | Level 5

Hi

 

I have a bit of a weird problem:

 

I constructed a project in model studio in Viya, and used event-based sampling. The different models all had Roc/accuracy curves that looked something like this:

 

ravnen55_0-1593004500027.png

Great, that is what I expected.

 

Now I had some issues with modelmanager, and I had to reconstruct the project. Using the same dataset, the same models and again using event-based sampling, the curves now looked like this:

ravnen55_1-1593004722450.png

The probabilites were now around 95 % for an event=1, whick was in accordance with the distribution in the original dataset but NOT what i would expect after having done evet-based-sampling.

 

Obviously I must have done something different in the second project...But any ideas of WHAT box I might have ticked or what I might have otherwise done, that can cause this difference, would be much appreciated

thx

 

Ready to join fellow brilliant minds for the SAS Hackathon?

Build your skills. Make connections. Enjoy creative freedom. Maybe change the world. Registration is now open through August 30th. Visit the SAS Hackathon homepage.

Register today!
How to choose a machine learning algorithm

Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 0 replies
  • 712 views
  • 0 likes
  • 1 in conversation