topic Re: Parallel extraction from DBs in SAS Programming

Parallel extraction from DBs

deleted_user — Thu, 04 Jun 2009 06:14:41 GMT

Hi
i need to extract huge data from various SQL databases.
As we write our sas extraction code sequentially the data gets extracted by that sequence into respective datasets.
so to speed up the extraction can we extract data parallely. How can it be done?
is there some thing like threading here?

Regards
Avi

Re: Parallel extraction from DBs

Peter_C — Thu, 04 Jun 2009 07:31:48 GMT

will your dbms operate multiple queries in parallel? if so,your simple answer is to run multiple SAS jobs at the same time.
alternatively, look to see what options are available to your SAS/ACCESS module. it may be able to use your dbms's bulk loader/unloader.
Since you don't indicate your dbms, we can only recommend you do more research on those dbms specific areas.

good luck

PeterC

Re: Parallel extraction from DBs

ChrisNZ — Mon, 08 Jun 2009 00:00:34 GMT

All good advice from Peter.
Look at MP Connect to run multiple processes in parallel from within a sas session.

Re: Parallel extraction from DBs

deleted_user — Mon, 08 Jun 2009 03:36:32 GMT

i don't know that whether SQL server support multiple queries. Here in my case even servers are different for few queries. so even if server does not support multiple queries still queries can run parallely on diff servers.