DATA Step, Macro, Functions and more

data extraction from web, using soap: dumps all data into single xml tag

Reply
Frequent Learner
Posts: 1

data extraction from web, using soap: dumps all data into single xml tag

I use Base SAS 9.3.

When using SOAP, the xml webdata is being outputted into one single xml tag with all the expected records and attributes.  Need to output in multiple tags to indicate records and attributes. to convert into a dataset of rows and columns. 

 

Since it outputs as a single xmltag, when converting to sas dataset, due to character field size limitations, even though I see all the records in the xml single tag dump, sas dataset truncates, so contains only a few records; not all from the xml extraction.

 

Where could the problem lie:

in the SOAP ENVELOPE?  HEADER IN?  am I to include HEADEROUT ALSO?  if so, what should be the content of HEADEROUT?

 

Shall greatly appreciate some wisdom in this regard; have been sitting on it for quite some time.

 

Thanks.

.

Contributor
Posts: 57

Re: data extraction from web, using soap: dumps all data into single xml tag

If you have access to IML, I'd recommend integrating your program with R and letting R parse out the returned XML data. Its abilities to parse XML and HTML are far superior in my view. Once you have a small program constructed in R, you can use IML to send the data back to SAS to complete your processing and analysis.
Ask a Question
Discussion stats
  • 1 reply
  • 103 views
  • 0 likes
  • 2 in conversation