BookmarkSubscribeRSS Feed
GyaniBaba
Obsidian | Level 7

OS: AIX 6.1

SAS: SAS 9.3 M1

ODBC Driver used:- Cloudera ODBC 3.5 for Impala 2.5.30

 

Issue:- connects fine, but quering is vely slow, takes 30-40 minuts to pull 100000 rows.

 

If any one has already faced such issue and has g solution to make it fase, would be helpful.

3 REPLIES 3
SASKiwi
PROC Star

Please provide an example of your slow queries. Try doing a count on the same query instead of extracting rows (count(*)) - is that a lot faster? If it is then it is likely that Impala to SAS network connection is the bottleneck. If there is no difference in performance then it is the Impala database that is slow and you would need to talk to a DBA to find out why.

Ksharp
Super User

Add Libname option    readbuff=100000    to make it faster . 

LinusH
Tourmaline | Level 20
Have you tried the query inside Impala?
For such small queries, Hadoop is slow, at least slower than SAS.
Data never sleeps

suga badge.PNGThe SAS Users Group for Administrators (SUGA) is open to all SAS administrators and architects who install, update, manage or maintain a SAS deployment. 

Join SUGA 

CLI in SAS Viya

Learn how to install the SAS Viya CLI and a few commands you may find useful in this video by SAS’ Darrell Barton.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 3 replies
  • 1545 views
  • 0 likes
  • 4 in conversation