topic Re: Running an uploaded data set causes errors? in SAS Programming

Running an uploaded data set causes errors?

zsmith93 — Wed, 07 Mar 2018 00:03:35 GMT

Sorry if this is the wrong forum for this type of question

Recently I've been getting an error when trying to upload data sets. It started when I tried uploading an extremely large set e.g. 150k by 200 of rows and columns.

The first thing I did(after the error) was to check the file size and it was roughly 34mb then I realized SAS studio has a 10mb upload capacity if I recall. It was odd that it uploaded but would cause an error when trying to run it.

So the next thing I did was use a much smaller sample size like 100 x 100 and the file was ~5kb. However after uploading the file then hitting run I get the same error:

"

Errors detected in submitted DATA step. Examine log.

102 rows created in WORK.IMPORT1 from REFFILE.

"

Furthermore, to make matters more confusing if I change from the proc import for the GETNAMES and set it to No and rerun the file it works?!

Any help would be greatly appreciated.

Re: Running an uploaded data set causes errors?

ChrisNZ — Wed, 07 Mar 2018 00:54:53 GMT

Could it be that you have invalid column names?

Try

 options validvarname=any;

Re: Running an uploaded data set causes errors?

zsmith93 — Wed, 07 Mar 2018 01:26:18 GMT

Sadly that didn't change anything perhaps it's the data type?

Sorry I'm not familiar with the forum rules but this where I was gathering my data from
https://datamarket.com/data/set/22wh/wolfer-sunspot-numbers-1770-to-1869#!ds=22wh&display=line

under export, they have CSV( , ) and CSV( ; ) they both output different excel file and the former doesn't give me an error when running the import.

Re: Running an uploaded data set causes errors?

ChrisNZ — Wed, 07 Mar 2018 02:17:05 GMT

The files created are not Excel files.They are flat text files.

A comma separator is the usual standard. Why not simply use it if it generates no errors?

Re: Running an uploaded data set causes errors?

zsmith93 — Wed, 07 Mar 2018 02:28:14 GMT

It's never that easy sadly,

The data I referenced via the link was additional data; I wanted to see if I could upload and run it successfully while I tried to figure out what to do with my large dataset problem.

In short, my professors wanted datasets that pertained to local areas so unfortunately the I'm a few centuries off.

Fortunately, as I'm typing this I realized my large dataset could just be broken down to its individual years then merged using SAS

So one facepalm for me /)_- and a thank you to you for, well just answering these messages haha

Cheers!