topic SAS ODA times out while uploading large XPT file in SAS Studio

SAS ODA times out while uploading large XPT file

Ddormer — Thu, 03 Jun 2021 15:40:21 GMT

I am trying to upload the CDC's BRFSS2015.XPT file. The file is 917 MB so well within the %GB space allowed. However, after one hour, SAS ODA times out and the upload is cancelled. Can I extend the time out to more than one hour? If so, how?

Re: SAS ODA times out while uploading large XPT file

Tom — Thu, 03 Jun 2021 15:45:30 GMT

Did you try using URL filename engine or PROC HTTP to just pull the file from their website? Do you have a link to the file?

Re: SAS ODA times out while uploading large XPT file

ballardw — Thu, 03 Jun 2021 15:49:18 GMT

Are you trying to load it directly from the CDC site or did you copy it to your computer and load from there?

The CDC websites have traffic issues and can run pretty slow from time to time which might be an issue if that is what you attempted.

Re: SAS ODA times out while uploading large XPT file

Reeza — Thu, 03 Jun 2021 16:37:05 GMT

I thought On Demand had an upload limit, unless you have an exception somehow or an instructor?
If you aren't you may be running into the limit though it usually warns you.

Re: SAS ODA times out while uploading large XPT file

Ddormer — Thu, 03 Jun 2021 17:45:14 GMT

Thanks for the comment. The only limit I've seen is the 5GB limit for total upload and storage, which I'm not close to. If there is an upload file size limit, please let me know what it is or send me to the right source.

Thank you.

Re: SAS ODA times out while uploading large XPT file

Ddormer — Thu, 03 Jun 2021 17:50:21 GMT

I downloaded the file and unzipped it on my computer. My upload speed is quite good but my upload speed is only about 2 MBS via satellite. Even so, that should not require more than an hour to upload. At 2MBS, I should be less than 10 minutes, so all I can think is that it's a delay on the SAS side?

Open to ideas.

Thank you.

Re: SAS ODA times out while uploading large XPT file

Ddormer — Thu, 03 Jun 2021 17:54:41 GMT

Thank you. I did not try pulling the site directly from the CDC site. It's a zip file, so I thought it would be easier to unzip locally then upload. Do you advise pulling the zipped file and unzipping it within SAS Studio? Alternatively, could I upload the zip file from my computer then unzip it? I am an infrequent SAS user, so my skills are limited. Thanks in advance for your guidance.

Re: SAS ODA times out while uploading large XPT file

Ddormer — Thu, 03 Jun 2021 17:55:38 GMT

Thank you. No, I am not trying to upload directly from CDC

Re: SAS ODA times out while uploading large XPT file

Ddormer — Fri, 11 Jun 2021 11:37:08 GMT

Thanks to all for your thoughtful responses. Ultimately, I was unable to upload the file to SAS ODA- the same size and type file I used to handle without an issue with University Edition locally. Instead, I imported the ASC version of the CDC file into Excel, cleaned it up and exported it as a CSV file, which I then analyzed using Python.

I really like the new ODA interface, but that doesn't matter if I can't upload the big files (427k X 272) that I need. I'm sure there's a solution. I just didn't find it in the time I had.