topic Re: SDMX data from Australian Bureau of Statistics (ABS) in SAS Programming

SDMX data from Australian Bureau of Statistics (ABS)

BruceBrad — Thu, 23 Sep 2021 03:19:43 GMT

Any suggestions on the best way to import data from the ABS SDMX-json interface? I believe they use the same format as the OECD, but the SASEOECD engine doesn't allow the use of non-OECD websites. An example access url is below. This is for the population aged 0-4 in 2018Q1.

https://stat.data.abs.gov.au/sdmx-json/data/ERP_QUARTERLY/1.0.3.A04.Q/all?detail=Full&dimensionAtObservation=AllDimensions&startPeriod=2018-Q1&endPeriod=2018-Q1

Re: SDMX data from Australian Bureau of Statistics (ABS)

BruceBrad — Thu, 23 Sep 2021 03:21:23 GMT

Can a mod move this into a better forum? (I started by thinking SASEOECD was a procedure).

Re: SDMX data from Australian Bureau of Statistics (ABS)

Ksharp — Thu, 23 Sep 2021 12:25:25 GMT

If it is a JSON file . Why not use JSON engine of LIBNAME ?

Re: SDMX data from Australian Bureau of Statistics (ABS)

BruceBrad — Sun, 26 Sep 2021 05:12:07 GMT

I wasn't aware of the JSON engine. I'll look into it and report back. Thanks.

Re: SDMX data from Australian Bureau of Statistics (ABS)

BruceBrad — Thu, 06 Jan 2022 09:05:30 GMT

Returning to this problem. I have the (perhaps mistaken) guess that the solution to this should be simple. Below is my most recent attempt using the xml engine. I get an error message saying an xmlmap might be required. How do I create this? The data structure is very simple (the https file can be opened in a browser).

%let url = https://api.data.abs.gov.au/data/CPI/1.10001.10.1.Q/all?startPeriod=2019;
filename in url "&url" debug;
libname in xml xmltype=generic;
data temp;
  set in.series;
run;

Re: SDMX data from Australian Bureau of Statistics (ABS)

BruceBrad — Thu, 06 Jan 2022 10:31:46 GMT

This code runs. It returns a set of files which I would have to merge together to get the basic data table I'm after. Has this reassembly process been packaged into a procedure or macro for data in the SDMX format?

%let url = https://api.data.abs.gov.au/data/CPI/1.10001.10.1.Q/all?startPeriod=2019;
filename temp1 "%sysget(TEMP)\temp1.txt";
filename map "%sysget(TEMP)\temp.map";

proc http url="&url" out=temp1;run;

libname temp1 xmlv2 automap=replace xmlmap=map;

proc copy in=temp1 out=work;run;