topic Re: Querying Table Hadoop with SAS? improve time in New SAS User

Querying Table Hadoop with SAS? improve time

ciro_fuccio — Tue, 24 Sep 2019 16:27:26 GMT

Hello guys
I wanted to know if it was possible to speed up a query using metadata. 
In practice I need the last 3 most recent values of a table of this type:

DATA work.test_;
ENTRY TO B year;
data lines;
5 01 20190105
5 01 20190102
5 01 20190422
5 02 20190422
5 01 20190601
5 01 20190622
5 01 20190601
;
TO RUN;

But it has more than 12 million record

Re: Querying Table Hadoop with SAS? improve time

Reeza — Tue, 24 Sep 2019 16:52:56 GMT

~~Is there any indexes on the table, and if so, which fields? If not, that should be your solution IMO~~

Edit: Sorry, Hadoop doesn't have the same concept of indexes that other DBs have, my mistake.

Re: Querying Table Hadoop with SAS? improve time

r_behata — Tue, 24 Sep 2019 18:37:04 GMT

- How do you connect to Hadoop from SAS ? Show the log.

- Do you have licence to SAS Access for Hadoop ?

- Is you data located in Hive or are you trying to access data from HDFS?

Re: Querying Table Hadoop with SAS? improve time

Ksharp — Wed, 25 Sep 2019 12:55:17 GMT

Try this PROC

proc univariate data=sashelp.air nextrval=3;
var date;
run;