topic Re: Hive Statements with PROC SQL in SAS Programming

Hive Statements with PROC SQL

PhatRam33 — Tue, 07 Jan 2020 18:29:40 GMT

I am running the following statements in my pass-through query and receiving the following errors on the last two statements. I have this set after my connection string to hadoop and before my create table statement. Any idea how to fix and what they mean? Any help from the community would be greatly appreciated =).

Disregard the emoj for some reason it returned this way. Should be a semi colon followed by a closed parenthesis.

execute(set hive.auto.convert.join=false;) by hadoop;
execute(set hive.vectorized.execution.enabled=false;) by hadoop;
execute(set hive.tez.java.opts='-Xmx8192m';) by hadoop;
execute(set hive.tez.container.size=10240;) by hadoop;

Errors:

ERROR: Prepare error: Buffer overflow
on the set hive.tez.java.opts='-Xmx8192m';


ERROR: Execute error: org.apache.hive.service.cli.HiveSQLException: Error while
processing statement: 'SET hive.tez.container.size=10240;' FAILED
because hive.tez.container.size expects INT type value.

Re: Hive Statements with PROC SQL

Reeza — Tue, 07 Jan 2020 18:31:08 GMT

If you post your code using the code blocks you do not get emoji's. I've updated your post to reflect that, but unfortunately do not know the answer to your question.

I'm assuming these commands work when you use them directly on the DB though, outside of SAS?

Re: Hive Statements with PROC SQL

Steelers_In_DC — Thu, 23 Apr 2020 18:57:02 GMT

I'm not sure where in the query process these commands go, would this be after the :

PROC SQL;
CONNECT TO odbc();

(enter here)

and before the:

CREATE TABLE table AS