DATA Step, Macro, Functions and more

Parallel extraction from DBs

Reply
N/A
Posts: 0

Parallel extraction from DBs

Hi
i need to extract huge data from various SQL databases.
As we write our sas extraction code sequentially the data gets extracted by that sequence into respective datasets.
so to speed up the extraction can we extract data parallely. How can it be done?
is there some thing like threading here?

Regards
Avi
Valued Guide
Posts: 2,175

Re: Parallel extraction from DBs

will your dbms operate multiple queries in parallel? if so,your simple answer is to run multiple SAS jobs at the same time.
alternatively, look to see what options are available to your SAS/ACCESS module. it may be able to use your dbms's bulk loader/unloader.
Since you don't indicate your dbms, we can only recommend you do more research on those dbms specific areas.

good luck

PeterC
PROC Star
Posts: 1,563

Re: Parallel extraction from DBs

All good advice from Peter.
Look at MP Connect to run multiple processes in parallel from within a sas session.
N/A
Posts: 0

Re: Parallel extraction from DBs

i don't know that whether SQL server support multiple queries. Here in my case even servers are different for few queries. so even if server does not support multiple queries still queries can run parallely on diff servers.
Ask a Question
Discussion stats
  • 3 replies
  • 123 views
  • 0 likes
  • 3 in conversation