topic Re: How can I avoid WARNING: The following columns could have a length in SAS of 32767... in Hadoop in SAS Programming

How can I avoid WARNING: The following columns could have a length in SAS of 32767... in Hadoop

ChrisNZ — Mon, 13 Mar 2017 02:13:31 GMT

I run this code to extract Hadoop Metadata

proc sql;
 connect to hadoop ( &hadoop_connection.);
 create table METADATA as
   select * from connection to hadoop ( describe extended &tableout. );
 disconnect from hadoop;
quit;

and I can't get rid of the dreaded Hadoop warning:

WARNING: The following columns could have a length in SAS of 32767. If so, SAS performance is impacted. See SAS/ACCESS documentation for details.

Any way to disable this pesky warning and extract the metadata ?

Re: How can I avoid WARNING: The following columns could have a length in SAS of 32767... in Hadoop

art297 — Mon, 13 Mar 2017 02:47:41 GMT

Take a look at page 20 of the following document: http://support.sas.com/resources/thirdpartysupport/v94/hadoop/sas-hadoop-performance-strategies.pdf

The answer, I think, is to issue alter statements to Hadoop in order to set the desired SAS properties.

Art, CEO, AnalystFinder.com

Re: How can I avoid WARNING: The following columns could have a length in SAS of 32767... in Hadoop

Ksharp — Mon, 13 Mar 2017 03:16:49 GMT

Not sure if this option could work.


options VARLENCHK=nowarn;

Re: How can I avoid WARNING: The following columns could have a length in SAS of 32767... in Hadoop

ChrisNZ — Mon, 13 Mar 2017 03:46:01 GMT

Thank you for your answers. Sady no luck yet.

@art297 I am not reading a table so I cannot set column properties.
@Ksharp This option is only used by data steps.

Re: How can I avoid WARNING: The following columns could have a length in SAS of 32767... in Hadoop

ChrisNZ — Sat, 18 Mar 2017 10:10:56 GMT

Not ideal but a way to avoid the message here