BookmarkSubscribeRSS Feed
tsg
Calcite | Level 5 tsg
Calcite | Level 5

I am importing a mildly large ~3gb xml file into SAS 9.4 on Windows.  When I do, I run into "The SAS System stopped processing this step because of insufficient memory."  However, when I (1) run this on a large-memory server and (2) increase the memsize and memmaxsz options to 500 gb each (verifying using proc options), it still gives the error.  I don't believe memory is actually the problem, because when I run "options fullstimer" I receive the results:

NOTE: DATA statement used (Total process time):

      real time           3:12.07

      user cpu time       2:38.18

      system cpu time     31.65 seconds

      memory              1758.46k

      OS Memory           15864.00k

      Timestamp           09/08/2018 08:37:18 AM

      Step Count                        5  Switch Count  3

Which suggests that the process isn't actually using much memory at all!  Any suggestions would be appreciated.

 

The full code I use is: 

 

proc options;
run;

options fullstimer;
libname in xml 'Y:\Flexibility\Devices.xml';
data Device;
set in.Device (keep = device1 devicedescription devicecategory deviceregion devicepurpose price);
run;

proc export data = Device outfile='Y:\Device\Devices.txt' dbms=tab replace;
run;

 

1 REPLY 1
Tom
Super User Tom
Super User

Create an xml map that will tell SAS how to parse the XML file.

SAS Innovate 2025: Call for Content

Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 16. Read more here about why you should contribute and what is in it for you!

Submit your idea!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 1 reply
  • 525 views
  • 0 likes
  • 2 in conversation