CAS Disconnecting with large Data

[Kyle4]

Hi everyone,

I am trying to copy data from CAS (in memory table) to SQL. I haven't been successful. I have narrowed down the problem - I can't even replicate the table into another CAS Table. The data is not that big. I am trying to write 16m rows with two columns. It disconnects at approx. 8m rows. The log doesn't populate with an error (the log clears) and my session simply disconnects. I have gradually increased the obs, and at approx. 8m it stops working.

data public.test2;
set public.test1 (datalimit = all obs=10000000);
run;

The log doesn't display anything:

I have previously been able to do this with 3.4 (in fact much larger data sets - many more rows and columns). We have recently upgraded to 3.5 and since then it doesn't work. There is plenty of memory available.   

Does anyone have an idea? Is there maybe a setting in cas management?

Kind Regards,

Kyle 

[alexal]

@Kyle4 ,

I would like to see the SAS log with the following option enabled:

options set=CASCLIENTDEBUG=1;

as well as the most recent CAS server logs from all nodes.

[Kyle4]

Thanks @alexal 

Funny, but this morning I can copy from CAS table to CAS table. I still can't copy to work (spre). I used the CASClientDebug, but the log is still empty - the session completely disconnects. 

I will get the logs and send it to you.

[Kyle4 · Accepted solution]

Hi @alexal 

Thanks for you willingness to assist.

We resolved the issue by increasing the memsize setting.

Regards,

Kyle