BookmarkSubscribeRSS Feed
zsmith93
Calcite | Level 5

Sorry if this is the wrong forum for this type of question

 

Recently I've been getting an error when trying to upload data sets. It started when I tried uploading an extremely large set e.g. 150k by 200 of rows and columns. 

 

The first thing I did(after the error) was to check the file size and it was roughly 34mb then I realized SAS studio has a 10mb upload capacity if I recall. It was odd that it uploaded but would cause an error when trying to run it.

 

So the next thing I did was use a much smaller sample size like 100 x 100 and the file was ~5kb. However after uploading the file then hitting run I get the same error:

"

Errors detected in submitted DATA step. Examine log.
102 rows created in WORK.IMPORT1 from REFFILE.
"

Furthermore, to make matters more confusing if I change from the proc import for the GETNAMES and set it to No and rerun the file it works?!

Any help would be greatly appreciated.
4 REPLIES 4
ChrisNZ
Tourmaline | Level 20

Could it be that you have invalid column names?  

Try 

 

 options validvarname=any;
zsmith93
Calcite | Level 5

Sadly that didn't change anything perhaps it's the data type?

Sorry I'm not familiar with the forum rules but this where I was gathering my data from
https://datamarket.com/data/set/22wh/wolfer-sunspot-numbers-1770-to-1869#!ds=22wh&display=line

under export, they have CSV( , ) and CSV( ; ) they both output different excel file and the former doesn't give me an error when running the import.

ChrisNZ
Tourmaline | Level 20

The files created are not Excel files.They are flat text files.

 

A comma separator is the usual standard. Why not simply use it if it generates no errors?

 

zsmith93
Calcite | Level 5

It's never that easy sadly,

The data I referenced via the link was additional data; I wanted to see if I could upload and run it successfully while I tried to figure out what to do with my large dataset problem.

In short, my professors wanted datasets that pertained to local areas so unfortunately the I'm a few centuries off.

 

Fortunately, as I'm typing this I realized my large dataset could just be broken down to its individual years then merged using SAS

So one facepalm for me /)_- and a thank you to you for, well just answering these messages haha

Cheers!

SAS Innovate 2025: Register Now

Registration is now open for SAS Innovate 2025 , our biggest and most exciting global event of the year! Join us in Orlando, FL, May 6-9.
Sign up by Dec. 31 to get the 2024 rate of just $495.
Register now!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

SAS Training: Just a Click Away

 Ready to level-up your skills? Choose your own adventure.

Browse our catalog!

Discussion stats
  • 4 replies
  • 810 views
  • 0 likes
  • 2 in conversation