Hi @krishnaram101
I notice that port 8443 is listed. This means Knox is probably involved... This could impact how the data is brought back to SAS.
A couple of things to look at:
1) Make sure that you aren't being hit with the 32k String Thing (this is Hive string types being brought back as 32k strings). This significantly increased the amount of network traffic and makes writing the SAS data set to disk slower. The Github link includes an example of how to tell if this is happening. You can also look at the metadata for the created table to see if there are any 32k columns included in the table. The fact that you are returning 8K means that you may be returning a lot of data. If the 32k string thing were happening it would likely fill your disk up.
2) See how long this query takes to run. if the times are similar it means most of the time is being spent by Hadoop.
create table sastest.test as select * from connection to hadoop
( select count(*) from test limit 100000);
For more information about the 32k String Thing see the slides and exercises in this workshop - https://github.com/Jeff-Bailey/SGF2016_SAS3880_Insiders_Guide_Hadoop_HOW
Also check out this SAS Global Forum paper: Ten Tips to Unlock the Power of Hadoop with SAS®
If this doesn't help, you may want to consider opening a tech support track.
Best wishes, Jeff
... View more