topic Re: Warnings and Truncating will occur in PROC APPEND in SAS Programming

Warnings and Truncating will occur in PROC APPEND

siddhu1 — Fri, 11 Feb 2022 13:17:13 GMT

Hi Team,

While appending the datasets using proc append with the Force option, one variable is of different length in the source and target.
I am getting the warning message that of varying lengths and the values has been truncated for this variable.

WARNING: Variable Cur_City has different lengths on BASE and DATA files
(BASE 22 DATA 50).
NOTE: FORCE is specified, so dropping/truncating will occur.

Also checked using the Proc Print, the values of curr_city has been truncated.

I can't use the options varlenchk=nowarn as it is unacceptable for the warnings to suppress in the Live environment.

Can anyone suggest the ideas on how to proceed further without the truncated values and warnings.

Thanking You,
Siddhu1

Re: Warnings and Truncating will occur in PROC APPEND

PaigeMiller — Fri, 11 Feb 2022 13:18:37 GMT

Change the length of the variable in the BASE data set to 50, before you run PROC APPEND.

Re: Warnings and Truncating will occur in PROC APPEND

Ksharp — Fri, 11 Feb 2022 13:52:53 GMT

As Paige said , change the variable length in DATA file.

But make sure you would not lost any information in Cur_City .

data have;
set sashelp.class;
run;


proc sql;
alter table have 
modify name char(22);
quit;

Re: Warnings and Truncating will occur in PROC APPEND

PaigeMiller — Fri, 11 Feb 2022 13:54:56 GMT

@Ksharp wrote:

As Paige said , change the variable length in DATA file.

I said the opposite, change the length in the BASE data set.

Re: Warnings and Truncating will occur in PROC APPEND

Ksharp — Fri, 11 Feb 2022 13:56:36 GMT

Yeah. You are right . the longer length is more safe .

Re: Warnings and Truncating will occur in PROC APPEND

siddhu1 — Fri, 11 Feb 2022 14:34:43 GMT

I will change the variable length and try.
Thanks for the reply.

Siddhu1

Re: Warnings and Truncating will occur in PROC APPEND

Kurt_Bremser — Fri, 11 Feb 2022 16:22:18 GMT

Or use a data step:

data new_base;
if 0 then set append; /* gets length from new dataset, but does nothing else */
set
  base
  append
;
run;

Re: Warnings and Truncating will occur in PROC APPEND

AMSAS — Fri, 11 Feb 2022 17:48:44 GMT

Down side to this approach is APPEND doesn't process the base data, where as datastep will
So if you only need to append a few observations to a large base dataset then data step will be less efficient.

Re: Warnings and Truncating will occur in PROC APPEND

Kurt_Bremser — Fri, 11 Feb 2022 18:51:34 GMT

@AMSAS wrote:

Down side to this approach is APPEND doesn't process the base data, where as datastep will
So if you only need to append a few observations to a large base dataset then data step will be less efficient.

Yes, but if you need to adapt the base dataset to a new structure anyway (as in this case), the data step does both actions in one step.

Re: Warnings and Truncating will occur in PROC APPEND

Ksharp — Sat, 12 Feb 2022 03:21:54 GMT

Kurt,
I like your code.
But what if one variable is smaller in BASE, another variable is smaller in APPEND ?

Re: Warnings and Truncating will occur in PROC APPEND

Kurt_Bremser — Sat, 12 Feb 2022 06:18:16 GMT

Then we need some coding that reads the max length from dictionary.columns and builds a LENGTH statement to use in place of the IF 0 THEN SET.