topic Re: Import 100,000 individual files in SAS Programming

Import 100,000 individual files

Malathi13 — Mon, 04 Dec 2017 21:03:02 GMT

Hi,

I have 100,000 xml files that I want to import into SAS. Is this possible to do so? I might have to convert the xml files to sas datasets or excel format. I tried doing it but I was not successful in converting xml files to sas datasets.

Can someone help me in converting xml file to sas datasets/ excel files? Also, I want to know if I can import more than 100,000 individual xml files into sas.

Thank you

Re: Import 100,000 individual files

Reeza — Mon, 04 Dec 2017 21:05:31 GMT

Figure out how to do one first. Then it's easy to automate it for the remaining.

Do you have working code for one file?

@Malathi13 wrote:

Hi,

I have 100,000 xml files that I want to import into SAS. Is this possible to do so? I might have to convert the xml files to sas datasets or excel format. I tried doing it but I was not successful in converting xml files to sas datasets.

Can someone help me in converting xml file to sas datasets/ excel files? Also, I want to know if I can import more than 100,000 individual xml files into sas.

Thank you

M

Re: Import 100,000 individual files

ChrisBrooks — Tue, 05 Dec 2017 01:11:30 GMT

To import XML into SAS a simple Google search gives lots of results - the first three being

http://support.sas.com/resources/papers/proceedings12/253-2012.pdf

https://communities.sas.com/t5/Base-SAS-Programming/How-can-I-import-XML-file-into-SAS/td-p/283948

http://support.sas.com/resources/papers/proceedings17/1318-2017.pdf

The bottom line is - much depends on the structure of your XML.....

Re: Import 100,000 individual files

ChrisNZ — Wed, 06 Dec 2017 05:05:52 GMT

2 steps:

1- As mentioned, figure out the logic to read one file

2- You can then read all the files in one fell swoop once the logic is know; it will be much faster than 100,000 different steps. Look at the FILEVAR= option.