topic Re: ERROR: Could not open file to flush memory contents.sas viya 3.3 in Developers

ERROR: Could not open file to flush memory contents.sas viya 3.3

AmitSri — Tue, 20 Mar 2018 07:32:38 GMT

Hi, When I try to load a csv file of 1gb into caslib, im getting the below error. What does this error mean? Thanks!!

1          OPTIONS NONOTES NOSTIMER NOSOURCE NOSYNTAXCHECK;
72
73         proc casutil;
NOTE: The UUID '146fa91a-5361-f54a-91ff-c53d52ea3a52' is connected using session MYSESSION.
74         load casdata="20180226_all_markets_export_5gb_without_header.csv" incaslib="testload"
75         casout="20180226_all_markets_export_5gb_without_header" outcaslib="testload" promote;
ERROR: Could not open file to flush memory contents.
ERROR: Could not open file to flush memory contents. Permission denied
ERROR: The action stopped due to errors.
NOTE: The Cloud Analytic Services server processed the request in 41.482808 seconds.
76         run;

77
78         OPTIONS NONOTES NOSTIMER NOSOURCE NOSYNTAXCHECK;
91

Re: ERROR: Could not open file to flush memory contents.sas viya 3.3

alexal — Tue, 20 Mar 2018 12:32:15 GMT

@AmitSri,

ERROR: Could not open file to flush memory contents.

This means the CAS disk cache directory is not open to your users to create files. You can verify the location of this directory by checking the following:

Open the /opt/sas/viya/config/etc/cas/default/casconfig.lua file.
Check the following setting env.CAS_DISK_CACHE = '/var/tmp' to determine the directory that needs 777 permission (or permission for users using CAS).
Make sure this is done on all CAS nodes (controller and worker).

Once, this is done, the code executed will work.

Re: ERROR: Could not open file to flush memory contents.sas viya 3.3

AmitSri — Tue, 20 Mar 2018 13:03:52 GMT

Hi Alex, I had done this, and got rid of that error. However, When I execute this:

proc casutil;
load casdata="test_1235.csv" incaslib="DBDATA"
importoptions=(filetype="csv" delimiter="," getnames="true")
casout="test_1235" outcaslib="DBDATA" promote;
run;

proc casutil;
save casdata="test_12345" incaslib="DBDATA"
casout="test" outcaslib="DBDATA";
run;

ERROR: The file or path 'test_12345' is not available in the file system.
ERROR: Table 'test_12345' could not be loaded.
ERROR: Failure opening table 'test_12345': A table could not be loaded.
ERROR: The action stopped due to errors.
NOTE: The Cloud Analytic Services server processed the request in 0.000122 seconds.
ERROR: Failed to save the table "test_12345" from the "DBDATA" caslib to the "DBDATA" caslib.

When I try to load the file again, it says
ERROR: The table TEST_1235 already exists in caslib DBDATA.
ERROR: The action stopped due to errors.but its not saving the table.

Re: ERROR: Could not open file to flush memory contents.sas viya 3.3

alexal — Tue, 20 Mar 2018 13:17:17 GMT

@AmitSri,

That's correct, because you have to provide full path to test_1235.csv here:

proc casutil;
load casdata="test_1235.csv"

Re: ERROR: Could not open file to flush memory contents.sas viya 3.3

AmitSri — Tue, 20 Mar 2018 13:42:01 GMT

Yes, While loading I have given the full name.

proc casutil;
load casdata="test_1235.csv" incaslib="DBDATA"
importoptions=(filetype="csv" delimiter="," getnames="true")
casout="test_1235" outcaslib="DBDATA" promote;
run;

and while saving it says file does not exist.

Re: ERROR: Could not open file to flush memory contents.sas viya 3.3

alexal — Tue, 20 Mar 2018 13:44:55 GMT

@AmitSri,

You need full path, such as /this/is/folder/with/my/files/test_1235.csv

Re: ERROR: Could not open file to flush memory contents.sas viya 3.3

AmitSri — Wed, 21 Mar 2018 07:07:07 GMT

Okay.. The file is located at /db_data.

proc casutil;
load casdata="root/db_data/test_1235.csv" incaslib="DBDATA"
casout="test_12345" outcaslib="DBDATA" promote;
run;

ERROR: Failed to open the file root/db_data/test_1235.csv. Make sure the file exists and that you have permission to read the file.
Note that Cloud Analytic Services attempts to open a file that is not stored in HDFS.
ERROR: The action stopped due to errors.

But, the file has 777permissions.

And, now I am getting the error as:

Re: ERROR: Could not open file to flush memory contents.sas viya 3.3

AmitSri — Wed, 21 Mar 2018 07:25:00 GMT

And when I try this:

proc casutil;
load casdata="/db_data/test_1235.csv" incaslib="DBDATA"
importoptions=(filetype="csv" delimiter="," getnames="true")
casout="test_12345" outcaslib="DBDATA" promote;
run;

ERROR: Path '/db_data/test_1235.csv' for caslib 'DBDATA' appears to be an absolute path. Paths should be relative to the caslib
root.
ERROR: The action stopped due to errors.

Re: ERROR: Could not open file to flush memory contents.sas viya 3.3

alexal — Wed, 21 Mar 2018 16:09:59 GMT

@AmitSri,

I suggest you open a technical support track. Either I or my colleagues will be able to assist you.

Re: ERROR: Could not open file to flush memory contents.sas viya 3.3

alexal — Wed, 21 Mar 2018 16:10:23 GMT

@AmitSri,

Do not forget to attach full SAS log.