Qualtrics data access via proc http

[Yiang]

Hi

I need some help please. I have read most of the online posts on qualtrics data extraction using proc http in this community. 

After trial and error using SAS 9.4, i managed to reach this stage where i can download a data file from qualtrics.

(Not that i cannot go the easy way to download a CSV file in qualtrics directly, but i hope to achieve it programmatically to  automate the process intentionally

for another objective)

This is the data download script. 

However when i use notepad to open the csv, i belief the format is incorrect.

The problem is , i do not know how exactly how to specify in SAS the format i wish to download .

Qualtrics supports manual download of these formats

When i asked the question to Qualtrics tech support, they suggested i check with SAS community instead.

I wish to seek some advice please. Thank you

[ChrisHemedinger · Accepted solution]

Hi @Yiang ,

I think that the process of exporting responses in Qualtrics requires two steps:

• First, use the export-responses API to start the export, which might take some time to complete. In this call you can state what format you want. By default it is a ZIP file, which is what I think you are seeing in your attempt. See https://api.qualtrics.com/6b00592b9c013-start-response-export. The response from this call will contain a status and a progress ID that you could use to check status of the process.
• Then, after the export is complete (you can either wait a reasonable time or check status with another API call), you can download the responses as you did -- but the format will have already been set in the first API call. See https://api.qualtrics.com/41296b6f2e828-get-response-export-file

SAS can process ZIP files if you decide that's easier to manage. 

[Yiang]

Thanks for the hint @ChrisHemedinger 

the file is in a zip format even though i downloaded it as a .CSV file.

after reading your message, i renamed the .csv to .zip and the data in CSV file can be found inside the zip file.

[w539356]

Hi @ChrisHemedinger,

I have a process that successfully requests and then imports data from Qualtrics API into SAS.  However, I have issues with finding the sweet spot for the time it takes for the extract to be complete.  Any sense of how long to wait?  Currently, I've added a 20 minute pause to allow the data to queue for import; however, sometimes it still does not extract the most recent responses, thus the wait was insufficient.  Love to figure out if there is a standard time I should use or how to explore (beside trial and error), what that ideal wait time...