BookmarkSubscribeRSS Feed
dkassis
Calcite | Level 5

Hi,

 

I am trying to create tables in HIVE from hive data using the proc sql; create table option.  These queries are taking a long time and I am seeing this statement in my log:

 

Streaming read DISABLED: The original HiveQL succeeded where
the streaming read CTAS failed

 

Is this causing any of the delays?  I am seeing that my sql was passed to Hadoop from seeing the following:

 

ACCESS ENGINE: SQL statement was passed to the DBMS for
fetching data.

 

We are configured using JDBC and pre-defined libname connections.

 

Thanks,

Dan

1 REPLY 1
ChrisNZ
Tourmaline | Level 20

You should use the sastrace option to know exactly what SQL was passed to hive.

 

Even better, since you are copying from Hive to Hive, run HQL directly by using SQL passthrough:

proc sql;

   connect using HIVELIB; 

   execute by HIVELIB (create table ....); 

quit;

 

SAS Innovate 2025: Call for Content

Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 25. Read more here about why you should contribute and what is in it for you!

Submit your idea!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 1 reply
  • 921 views
  • 0 likes
  • 2 in conversation