BookmarkSubscribeRSS Feed
Ullsokk
Pyrite | Level 9

I have a data source with 14000 obs. But I noticed today that my regression only had 1400 observations in it. I had partitioned it, so it should have 50% for Train, and thus be 7500. But no matter what I did - even removing all analytical and partition nodes and just running a descriptive node, gave me about 2900 obs. 

 

In desperation, I tried creating a new datasource, selected the same source. This finally solved the problem, but both data sources say the same - 14000 obs. But the first one only yields 2900 in any analysis or count. The new data source does not have the problem. What is going on? Tried refreshing meta data, but to no help. Very strange bug. 

 

Has anyone else encountered this?

1 REPLY 1
JasonXin
SAS Employee
Hi, In EM, like in many other SAS analytics procedures, if one input variable has missing values on a group of observations, that group of observations will be excluded from the procedure execution. So check the missingness of your input variables. Collectively, missingness can delete the observations by the % you are reporting here. In EM, please consider using Impute Node before regression. Hope this helps. Jason Xin

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

How to choose a machine learning algorithm

Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • 778 views
  • 0 likes
  • 2 in conversation