topic Re: connecting to Impala DB from SAS in Administration and Deployment

connecting to Impala DB from SAS

GyaniBaba — Wed, 01 Jun 2016 18:47:03 GMT

OS: AIX 6.1

SAS: SAS 9.3 M1

ODBC Driver used:- Cloudera ODBC 3.5 for Impala 2.5.30

Issue:- connects fine, but quering is vely slow, takes 30-40 minuts to pull 100000 rows.

If any one has already faced such issue and has g solution to make it fase, would be helpful.

Re: connecting to Impala DB from SAS

SASKiwi — Wed, 01 Jun 2016 20:18:22 GMT

Please provide an example of your slow queries. Try doing a count on the same query instead of extracting rows (count(*)) - is that a lot faster? If it is then it is likely that Impala to SAS network connection is the bottleneck. If there is no difference in performance then it is the Impala database that is slow and you would need to talk to a DBA to find out why.

Re: connecting to Impala DB from SAS

Ksharp — Thu, 02 Jun 2016 01:38:37 GMT

Add Libname option readbuff=100000 to make it faster .

Re: connecting to Impala DB from SAS

LinusH — Fri, 03 Jun 2016 14:35:43 GMT

Have you tried the query inside Impala?
For such small queries, Hadoop is slow, at least slower than SAS.