Import 100,000 individual files

Reply
Contributor
Posts: 73

Import 100,000 individual files

Hi,

I have 100,000 xml files that I want to import into SAS. Is this possible to do so? I might have to convert the xml files to sas datasets or excel format. I tried doing it but I was not successful in converting xml files to sas datasets.

 

Can someone help me in converting xml file to sas datasets/ excel files? Also, I want to know if I can import more than 100,000 individual xml files into sas.

 

Thank you

M

Super User
Posts: 23,323

Re: Import 100,000 individual files

Posted in reply to Malathi13

Figure out how to do one first. Then it's easy to automate it for the remaining. 

 

Do you have working code for one file?

 


Malathi13 wrote:

Hi,

I have 100,000 xml files that I want to import into SAS. Is this possible to do so? I might have to convert the xml files to sas datasets or excel format. I tried doing it but I was not successful in converting xml files to sas datasets.

 

Can someone help me in converting xml file to sas datasets/ excel files? Also, I want to know if I can import more than 100,000 individual xml files into sas.

 

Thank you

M


 

Valued Guide
Posts: 572

Re: Import 100,000 individual files

Posted in reply to Malathi13

To import XML into SAS a simple Google search gives lots of results - the first three being

 

http://support.sas.com/resources/papers/proceedings12/253-2012.pdf

 

https://communities.sas.com/t5/Base-SAS-Programming/How-can-I-import-XML-file-into-SAS/td-p/283948

 

http://support.sas.com/resources/papers/proceedings17/1318-2017.pdf

 

The bottom line is - much depends on the structure of your XML.....

PROC Star
Posts: 2,319

Re: Import 100,000 individual files

Posted in reply to Malathi13

2 steps:

1- As mentioned, figure out the logic to read one file

2- You can then read all the files in one fell swoop once the logic is know; it will be much faster than 100,000 different steps. Look at the FILEVAR= option. 

Ask a Question
Discussion stats
  • 3 replies
  • 142 views
  • 2 likes
  • 4 in conversation