topic Re: Moving data from CAS to SAS library (>100mb) in Developers

Moving data from CAS to SAS library (>100mb)

MikeFranz — Fri, 10 Nov 2017 15:43:29 GMT

Hi,

I have managed to import my data into CAS library through the data import GUI. I am now trying to move it from CAS to SAS (partly because it is a lot of data and I neither need nor want it stored in in-memory).

I’m using the code below to move it to my SAS library:

DATA transactions_2017_02;
                set casuser.account (keep = CodeGeneralledgeraccount NameGeneralledgeraccount Transactiondate Period Code1 Name Balance);
RUN;

However, it keeps giving me the error:

ERROR: The maximum allowed bytes (104857600) of data have been fetched from Cloud Analytic Services. Use the DATALIMIT option to

increase the maximum value.

How would I implement this data limit option? I have tried the following:

DATA transactions_2017_02;
                set casuser.account (keep = CodeGeneralledgeraccount NameGeneralledgeraccount Transactiondate Period Code1 Name Balance);
                datalimit = “All”;

RUN;

Any ideas on how to up the data limit?

Re: Moving data from CAS to SAS library (>100mb)

jklaverstijn — Sat, 11 Nov 2017 14:25:17 GMT

Hi,

I am a bit out onb a limb here as I have net yet done anything with Viya (shame on me). But there is an obvious anwer to your question.

First of all your attempt would merely copy the data and add a variable called Datalimit to the copy with value "All" in every row. From the doc I can tell that this would be your best bet:

DATA transactions_2017_02;
                set casuser.account (datalimit="All" keep = CodeGeneralledgeraccount NameGeneralledgeraccount Transactiondate Period Code1 Name Balance);
RUN;

The option is documented as a dataset option so it can occur between the parentheses after the input dataset. The doc also confirms that you are running into the 100MB (104857600 bytes) default.

EDIT: On second thought, the variable Datalimit would not be in the output dataset as it does not occur on the KEEP statement. It would however be created at datastep run time.

Hope this helps,

- Jan

Re: Moving data from CAS to SAS library (>100mb)

MikeFranz — Tue, 14 Nov 2017 15:40:58 GMT

Thank you Jan. Just a quick note, I needed to remove the quotes around the "All", otherwise worked perfectly.