"Insufficient memory" error when importing XML, but not using much memory!

tsg — Sat, 08 Sep 2018 12:46:59 GMT

I am importing a mildly large ~3gb xml file into SAS 9.4 on Windows. When I do, I run into "The SAS System stopped processing this step because of insufficient memory." However, when I (1) run this on a large-memory server and (2) increase the memsize and memmaxsz options to 500 gb each (verifying using proc options), it still gives the error. I don't believe memory is actually the problem, because when I run "options fullstimer" I receive the results:

NOTE: DATA statement used (Total process time):
real time 3:12.07
user cpu time 2:38.18
system cpu time 31.65 seconds
memory 1758.46k
OS Memory 15864.00k
Timestamp 09/08/2018 08:37:18 AM
Step Count 5 Switch Count 3

Which suggests that the process isn't actually using much memory at all! Any suggestions would be appreciated.

The full code I use is:

proc options;
run;

options fullstimer;
libname in xml 'Y:\Flexibility\Devices.xml';
data Device;
set in.Device (keep = device1 devicedescription devicecategory deviceregion devicepurpose price);
run;

proc export data = Device outfile='Y:\Device\Devices.txt' dbms=tab replace;
run;

Re: "Insufficient memory" error when importing XML, but not using much memory!

Tom — Sat, 08 Sep 2018 16:16:26 GMT

Create an xml map that will tell SAS how to parse the XML file.

topic "Insufficient memory" error when importing XML, but not using much memory! in SAS Programming

"Insufficient memory" error when importing XML, but not using much memory!

Re: "Insufficient memory" error when importing XML, but not using much memory!