topic Re: SAS Bigdata loading -Using the SAS/ACCESS® LIBNAME Engine - how Proc sort works in SAS Academy for Data Science

SAS Bigdata loading -Using the SAS/ACCESS® LIBNAME Engine - how Proc sort works

Ponvani — Wed, 12 Dec 2018 10:49:36 GMT

I m in the ch4 -Using the SAS/ACCESS® LIBNAME Engine under sorting and reporting.

I saw an example where the sorting in the proc sort step occurs in Hive itself using order by. Does this happens for other Databases also? i.e. instead of hive table can I do the same for oracle or teradata? will the Access engine support for other Database to sort inside the respective DB's.

Re: SAS Bigdata loading -Using the SAS/ACCESS® LIBNAME Engine - how Proc sort works

RW9 — Wed, 12 Dec 2018 11:32:41 GMT

For databases, code can be sent to the database SQL parser for processing - it is called pass-through - and then the SQL is compiled and executed in the database.

Re: SAS Bigdata loading -Using the SAS/ACCESS® LIBNAME Engine - how Proc sort works

LinusH — Thu, 13 Dec 2018 08:59:21 GMT

This is described in the SAS/ACCESS documentation, please dig in there.

In short, most ACCESS interfaces with relational data source support push down (or implicit SQL pass through) of joins, order by, BY, group by, WHERE and a selection of functions. There are also a couple of SAS PROCs that have been pass through enabled, such as FREQ and SUMMARY.