BookmarkSubscribeRSS Feed
SASUserRocks
Calcite | Level 5

Automated few sas reports sourcing data from hive schema. Programs were running fine till yesterday, Today encountering below error  while accessing hive tables through SAS library and I am clueless. I am able to access hive tables and data through Ambari Hive.

 

219 H_BASE.ADCB_USER_PAGE_VIEWS A WHERE datepart(input(timestamp,anydtdtm.))> "&lastsdte."d ;

HADOOP_1: Prepared: on connection 0
DESCRIBE FORMATTED `db_appldigi`.`ADCB_USER_PAGE_VIEWS`

ERROR: Prepare error: Error while processing statement: FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask. cannot find field adcb_user_page_views from [0:date, 1:segmentname,
2:engagementname, 3:productlabel, 4:channelname, 5:cookie, 6:impressiontimestamp, 7:impressionid, 8:crmid]
SQL statement: DESCRIBE FORMATTED `db_appldigi`.`ADCB_USER_PAGE_VIEWS`

5 REPLIES 5
LinusH
Tourmaline | Level 20

Sounds like either the view is unavailable/change/damaged or ahve changed permissions.

Can you access the view outside the batch?

Data never sleeps
SASUserRocks
Calcite | Level 5
Yes I can access view outside in hive as well as can view data till sas data loader
SASUserRocks
Calcite | Level 5
Also getting same error while accessing any hive table inside library, each has got different definition
SuCheeTay
SAS Employee

It may have something to do with the datepart() in the WHERE clause. Try SQL_FUNCTIONS=ALL in order for the SAS/ACCESS engine to pass SAS function to Hadoop.

ballardw
Super User

Anytime a program works for a period time and then starts throwing errors the "solution" will usually come down to finding what changed.

Were user permissions changed?

Were rules for the connection to the Hive tables changed? New software on that side with different settings?

Were one or more files locations changed?

OR the more obnoxious, did someone change the layout or content of fields in the data?

sas-innovate-2024.png

Available on demand!

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

 

Register now!

Autotuning Deep Learning Models Using SAS

Follow along as SAS’ Robert Blanchard explains three aspects of autotuning in a deep learning context: globalized search, localized search and an in parallel method using SAS.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 5 replies
  • 2111 views
  • 0 likes
  • 4 in conversation