topic Re: How to import 17,000 XML files into SAS datasets . in SAS Programming

How to import 17,000 XML files into SAS datasets .

Prudhvi_007 — Sun, 08 May 2022 12:49:45 GMT

I have a requirement to import 17,000 xml files from client into single SAS dataset . I have tried VB script for converting XML to Excel so that i could write a macro in sas to convert these Excel files to SAS datasets, but not working. Please provide your valuable suggestions .

Re: How to import 17,000 XML files into SAS datasets .

Kurt_Bremser — Sun, 08 May 2022 16:10:17 GMT

Start with code to read a single XML file. Do your files have identical structure?

Re: How to import 17,000 XML files into SAS datasets .

Prudhvi_007 — Sun, 08 May 2022 16:41:41 GMT

Yes , file structure is identical for all the files.

Re: How to import 17,000 XML files into SAS datasets .

Kurt_Bremser — Sun, 08 May 2022 16:54:41 GMT

Do a Google search for "SAS read xml data". You will get lots of results. Once you have code to read a single file, post it, so we can make suggestions for automation.

Re: How to import 17,000 XML files into SAS datasets .

Ksharp — Mon, 09 May 2022 04:03:54 GMT

Firstly ,pick up one XML to test and find which dataset you need to keep .

filename x temp;
libname x xmlv2 'c:\temp\define.xml' xmlmap=x automap=replace ;
proc copy in=x out=work;
run;

Re: How to import 17,000 XML files into SAS datasets .

Prudhvi_007 — Mon, 09 May 2022 09:20:03 GMT

Hi . Thank you for the code . I tried your code on one xml file . It worked . One xml file is split into 8 datasets . It threw the below error .

Can we convert one xml to one dataset instead of 7-8 sub datasets. Once it can be done , we can automate the code for 1000 xmls.

Re: How to import 17,000 XML files into SAS datasets .

Prudhvi_007 — Mon, 09 May 2022 09:21:11 GMT

Thank you for the sources . Its very helpful.

Re: How to import 17,000 XML files into SAS datasets .

Ksharp — Mon, 09 May 2022 10:47:16 GMT

You need option CHARMULTIPLIER= to extend your variable length.

https://documentation.sas.com/doc/en/pgmsascdc/9.4_3.5/engxml/n0kvon2742e4c7n1qxt6truvio5y.htm

If you have XML Map file, that maybe could import one dataset.

Search the usage of XML engine or XMLV2 engine at support.sas.com

https://documentation.sas.com/doc/en/pgmsascdc/9.4_3.5/engxml/p0rkqlpx0jxrgun0zidmv4ecr4c9.htm
https://support.sas.com/en/search.html?q=xmlv2

You could find more example .