topic Re: what is the solution when we can not perform the simple search on SAS EG in SAS Programming

what is the solution when we can not perform the simple search on SAS EG

Phil_NZ — Sat, 27 Feb 2021 04:30:58 GMT

Hi everyone,

I am dealing with a sas7bdat dataset file of around 120 GB. After using SAS EG to open it, I perform a quick search for IID="01W", the program stuck and suspend for a long time and still not working so far.

Could you please tell me what should be the solution here? Talk to the tech guy and what should I talk to them?

Warm regards.

Re: what is the solution when we can not perform the simple search on SAS EG

ballardw — Sat, 27 Feb 2021 06:21:56 GMT

If you mean you are searching in the table viewer then it is just a resource limitation. The window into a data set takes resources and 120GB is pretty big. You would be much better off using a query to subset the data into a new data set to the given values and open that. Unless you are going to have 100GB resulting from that query.

You will find a number of posts in the forum about how to disable the automatic table viewer when working with large data sets.

Re: what is the solution when we can not perform the simple search on SAS EG

Phil_NZ — Sat, 27 Feb 2021 07:35:16 GMT

Hi @ballardw

Is there any requirement for the RAM or ROM if I deal with a dataset around 1TB by using SAS EG?

It is my current computer status

Warm regards.

Re: what is the solution when we can not perform the simple search on SAS EG

SASKiwi — Sat, 27 Feb 2021 23:08:59 GMT

If you are running into resource issues subsetting in the SAS table viewer then try reducing the number of rows in your table first to see what the maximum number of rows gives good responses. View the SMALL table and try subsetting it.

data small;
  set big (obs = 100000);
run;