data extraction from web, using soap: dumps all data into single xml tag

rrr123 — Mon, 01 May 2017 17:34:27 GMT

I use Base SAS 9.3.

When using SOAP, the xml webdata is being outputted into one single xml tag with all the expected records and attributes. Need to output in multiple tags to indicate records and attributes. to convert into a dataset of rows and columns.

Since it outputs as a single xmltag, when converting to sas dataset, due to character field size limitations, even though I see all the records in the xml single tag dump, sas dataset truncates, so contains only a few records; not all from the xml extraction.

Where could the problem lie:

in the SOAP ENVELOPE? HEADER IN? am I to include HEADEROUT ALSO? if so, what should be the content of HEADEROUT?

Shall greatly appreciate some wisdom in this regard; have been sitting on it for quite some time.

Thanks.

Re: data extraction from web, using soap: dumps all data into single xml tag

statistician13 — Tue, 02 May 2017 02:29:51 GMT

If you have access to IML, I'd recommend integrating your program with R and letting R parse out the returned XML data. Its abilities to parse XML and HTML are far superior in my view. Once you have a small program constructed in R, you can use IML to send the data back to SAS to complete your processing and analysis.

topic data extraction from web, using soap: dumps all data into single xml tag in SAS Programming

data extraction from web, using soap: dumps all data into single xml tag

Re: data extraction from web, using soap: dumps all data into single xml tag