Hi, I had created a code that basically uploads the data from Netezza to SAS and then aggregrates it using the relevant variables using Proc Tabulate. However, this was utilising a lot of resources and time as the dataset size is mostly 50-100 million rows spanning 150 columns. To, avoid the resource utilization i have been trying to use in-database processing for Netezza, by providing the SQLGENERATION = DBMS option in my libname statement and the using the libname to directly input the Netezza dataset into the proc tabulate procedure. My understanding of in-database processing is that it should fire a sql query into netezza(when we use the SQLGENERATION = DBMS option in the libname) that performs the tabulation of data accordingly in Netezza and sends the summarized data to SAS. However, this hasn't been working lyk we envisaged, and has been basically firing a select * statement to Netezza and pulling the data into SAS and then performing the aggregation in SAS rather than Netezza. I have not been able to figure out why this must have been happening and some guidance on the same would be great. Thanks!
... View more