topic Re: Load Netezza table with multiple loads in parallel in SAS Programming

Load Netezza table with multiple loads in parallel

kajal_30 — Mon, 30 Jan 2023 16:40:43 GMT

Hi Team,

Currently I have one SAS program which is loading one Netezza table for one month's data.

I would like to load same Netezza table with multiple month's data.

As one month's data is taking 2 hours alone. So is there a way we can load the table for various months in parallel ? For that I have 2 below question.

1. How can we trigger the same program multiple times in parallel having parameter month_date with different values.

2. Is it possible to load Netezza table in parallel.

Regards

Kajal

Re: Load Netezza table with multiple loads in parallel

SASKiwi — Tue, 31 Jan 2023 00:36:52 GMT

Have you tried tuning your load program? Changing the number of rows specified on the INSERTBUFF option can have a major impact on performance.

To load data in parallel, just run multiple batch jobs at the same time each pointing to different month of data.

Re: Load Netezza table with multiple loads in parallel

LinusH — Tue, 31 Jan 2023 08:33:39 GMT

I guess (hope( this is an initial load activity, so maybe performance sin't critical?

Apart from tampering with INSERTBUFF, you could also investigate the bulkoad functionality.