topic Re: ERROR in Input in SAS Programming

ERROR in Input

almmotamedi — Tue, 09 Feb 2016 16:54:36 GMT

Here is my wildcard code:

data details_FEB;
infile "/v_share/Xiaomin/SCOPES/sas_dataset/Oct-08-2015/ScopesCalculations_SecondaryConstruction_*" linesize = 300 firstobs = 2;

input
C_ST $3.0
C_DSTRB_AREA $5.0
N_RSK $5.0

IsRevision9 $1.0
ScheduleNumberException $2.0
IsAsgrReportExists $2.0

ConstructionClass 1.0
COT00503.C_CSP_CONST_CLS 1.0

ERROR: DATA STEP Component Object failure. Aborted during the COMPILATION phase.
ERROR 557-185: Variable COT00503 is not an object.
COT00503.F_CSP_CONST_CLS 1.0
CombustibilityClass 1.0
COT00503.C_COMB_CLS 1.0
COT00503.F_COMB_CLS 1.0
COT00503.N_STOR 1.0
PartialSprinklerCreditFactor 1.0
LimitedSupplyCreditFactor 1.0
COT00503.C_SPK $1.0
SprinklerCreditType $1.0
COT00512.C_IPM $1.0
InternalProtectionMethod $1.0
TotalFloorArea 6.0
COT00504.R_TL_FLR_AREA 6.0
TotalRoofArea 6.0
COT00504.R_TL_RF_AREA 6.0
TotalSpecificFloorArea 6.0
COT00504.R_TL_SPEC_FLR 6.0
TotalFloorAndRoofArea 6.0
COT00520.C_SEC_CONST $1.0
COT00511.N_BGN_LVL 1.0
COT00511.N_THRU_LVL 1.0
COT00511.C_VO_PROT $1.0
COT00515.N_SCHD 15.0
FloorLevel 1.0
COT00516.N_LEN*COT00516.N_WDTH 6.0
COT00516.C_LVL_TYP $10.0
IsLowestFloor $10.0
COT00511.F_DIV_WL $10.0
COT00516.F_OTH $10.0
COT00516.C_AS_TYP $10.0
COT00520.N_SQFT $10.0
COT00520.C_RF_SRFC $10.0
COT00520.F_COMB_SB $10.0
COT00520.F_FOAM_PLSTC $10.0
COT00520.F_ACPT_TB $10.0
COT00520.R_PCT_STOR_AFCT $10.0
COT00520.R_PCT_OTH_FLR 3.0
COT00520.C_BLDG_COND $5.0
Percentage $5.0
COT00520.R_PCT_OTH_FLR $5.0
EffectiveArea $5.0
COT00520.R_TL_FLR_AREA $5.0
Charge $5.0
COT00520.R_CHRG $5.0
COT00520.F_CHRG $5.0
SecondaryConstructionCharge $5.0
COT00520.R_TL_SEC_CONST $5.0;
run;

Could you please help?

Re: ERROR in Input

Astounding — Tue, 09 Feb 2016 17:11:16 GMT

In SAS, a dot is not a valid character for naming a variable. You're limited to underscores, letters, and numbers.

Yes, there are special steps you can take to change that ... but that's not the default.

Re: ERROR in Input

almmotamedi — Tue, 09 Feb 2016 17:14:06 GMT

I see. Could you please advise how to "rename" or fix the variable name? (doing this manually is a very time consuming task). Thank you

Re: ERROR in Input

Reeza — Tue, 09 Feb 2016 17:45:10 GMT

Fix your input first!!!!!!!!!!

All these other errors, inconsistent types, invalid variable names will go away if the data is imported correctly and consistently.

Post sample data now.

Re: ERROR in Input

almmotamedi — Tue, 09 Feb 2016 17:55:53 GMT

Here is a sample of my data. Thank you for help

Re: ERROR in Input

Reeza — Tue, 09 Feb 2016 18:12:09 GMT

Do you have a data dictionary for the data?
Otherwise you sadly have the task of identifying and confirming each variable type/format.

Re: ERROR in Input

almmotamedi — Tue, 09 Feb 2016 18:40:32 GMT

Fortunately, I do have a data dictionary indicating the type and bytes for each variable.

Fixing this for all the variables is going to fix the issue?,

Re: ERROR in Input

Reeza — Tue, 09 Feb 2016 18:56:44 GMT

Most of them, others will probably pop up 🙂

Can you provide your data dictionary?

Re: ERROR in Input

almmotamedi — Tue, 09 Feb 2016 19:18:32 GMT

Example:

C_ST CHAR(2)
C_DSTRB_AREA CHAR(4)
N_RSK DECIMAL(6,0)
COT00503D_SRVY CHAR(6)

Re: ERROR in Input

almmotamedi — Tue, 09 Feb 2016 19:28:47 GMT

I think there is a bigger issue here:

I considered only couple of first variables with the correct format/type. Then I ran the program but as you see in the picture below, the vaules in the columns are mis-placed!!

forexample, the last column does not include any "date" !!

why?

Re: ERROR in Input

Reeza — Tue, 09 Feb 2016 19:33:59 GMT

Your still not reading it correctly.

How are you specifying the type, what does your code look like?

Here's the documentation regarding how to input files. Skip the first part and go down to the examples and see how they're importing data and how you need to specify your fields.

http://support.sas.com/documentation/cdl/en/lestmtsref/63323/HTML/default/viewer.htm#n1rill4udj0tfun1fvce3j401plo.htm

Re: ERROR in Input

almmotamedi — Tue, 09 Feb 2016 19:53:43 GMT

Here is the code (considering the first four variables, knowing that they are all character and having those numbers of byets):

data details_FEB;

infile "/v_share/Xiaomin/SCOPES/sas_dataset/Oct-08-2015/ScopesCalculations_SecondaryConstruction_*" linesize = 300 firstobs = 2;

input
@1 C_ST $2.0
@2 C_DSTRB_AREA $4.0
@3 N_RSK $6.0
@4 COT00503D_SRVY $6.0;

run;

Re: ERROR in Input

Reeza — Tue, 09 Feb 2016 20:17:12 GMT

data details_FEB;
 
infile "/v_share/Xiaomin/SCOPES/sas_dataset/Oct-08-2015/ScopesCalculations_SecondaryConstruction_Sample1.csv" linesize = 300 firstobs = 2 DSD Truncover ;

Informat 
C_ST $2
C_DSTRB_AREA $4
N_RSK $6
COT00503D_SRVY $6;


input
C_ST $
C_DSTRB_AREA $
N_RSK $
COT00503D_SRVY $;

Try the following.

Point to a specific file, don't use the wildcard until you have it working.

Since file is csv add DSD option.

Add Truncover option to allow SAS to ignore extra variables at this point.

Re: ERROR in Input

almmotamedi — Tue, 09 Feb 2016 20:28:53 GMT

I got the result for one file using the code below (a minor change for the last variable):

data details_FEB;

infile "/v_share/Xiaomin/SCOPES/sas_dataset/Oct-08-2015/ScopesCalculations_SecondaryConstruction_ 64_10122015_2339.csv" linesize = 300 firstobs = 2 DSD Truncover ;

Informat
C_ST $2.0
C_DSTRB_AREA $4.0
N_RSK $6.0
COT00503D_SRVY $10.0;

input
C_ST $
C_DSTRB_AREA $
N_RSK $
COT00503D_SRVY $;

run;

I got the result and looks good. But the last variable needs to be "date". I tried "MMDDYY10." for Informat but it did not work. please advise what to use for both informat and input.

Re: ERROR in Input

almmotamedi — Tue, 09 Feb 2016 21:07:38 GMT

The code is working now for all variables and the whole files! thank you so much 🙂

The only warning is this : WARNING: Limit set by ERRORS= option reached. Further errors of this type will not be printed.

Re: ERROR in Input

Reeza — Tue, 09 Feb 2016 21:48:59 GMT

That implies that you have errors still....but if you're happy.

Please mark the question as answered 🙂

And feel free to move towards, reading all files in now 🙂

Re: ERROR in Input

Reeza — Tue, 09 Feb 2016 22:09:40 GMT

Given your sample information, this would be closer to what you might actually need, note the informat and format for the date variable.

Informat 
C_ST $2
C_DSTRB_AREA $4
N_RSK $6
COT00503D_SRVY ddmmyy10.;
format COT00503D_SRVY date9.;

input
C_ST $
C_DSTRB_AREA $
N_RSK $
COT00503D_SRVY ;

Re: ERROR in Input

almmotamedi — Wed, 10 Feb 2016 15:18:00 GMT

Could you please give some hint regarding this warning and the possible error(s)?

Re: ERROR in Input

Reeza — Wed, 10 Feb 2016 15:23:09 GMT

No...that warning is tied to another warning. It basically means it ran into the same error over and over so stopped warning you about it.

There sould be other Warning in the logs.

Re: ERROR in Input

almmotamedi — Wed, 10 Feb 2016 16:15:10 GMT

I understand. All I see in the log is a series of "Invalid data for variable .. in line ....." for different variables and different lines.

But when I check my raw data (csv file), I don't see anything specical or wrong with the input data!!