Architecting, installing and maintaining your SAS environment

connecting to Impala DB from SAS

Reply
Contributor
Posts: 23

connecting to Impala DB from SAS

OS: AIX 6.1

SAS: SAS 9.3 M1

ODBC Driver used:- Cloudera ODBC 3.5 for Impala 2.5.30

 

Issue:- connects fine, but quering is vely slow, takes 30-40 minuts to pull 100000 rows.

 

If any one has already faced such issue and has g solution to make it fase, would be helpful.

Super User
Posts: 3,106

Re: connecting to Impala DB from SAS

Please provide an example of your slow queries. Try doing a count on the same query instead of extracting rows (count(*)) - is that a lot faster? If it is then it is likely that Impala to SAS network connection is the bottleneck. If there is no difference in performance then it is the Impala database that is slow and you would need to talk to a DBA to find out why.

Super User
Posts: 9,681

Re: connecting to Impala DB from SAS

Add Libname option    readbuff=100000    to make it faster . 

Super User
Posts: 5,256

Re: connecting to Impala DB from SAS

Have you tried the query inside Impala?
For such small queries, Hadoop is slow, at least slower than SAS.
Data never sleeps
Ask a Question
Discussion stats
  • 3 replies
  • 276 views
  • 0 likes
  • 4 in conversation