SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

Parallel Processing in DI

Reply
Occasional Contributor
Posts: 6

Parallel Processing in DI

Wanted to ask about the parallel processing capabilities in DI studio.  As I understand, parallel processing in a non grid environment is only limited to the loop transformation?  Is there a way to extend this to non-loop jobs?  I can do this easily in base SAS, SAS/connect but finding it difficult using DI options.

Many thanks,

Super Contributor
Posts: 349

Re: Parallel Processing in DI

Hi,

You can try: Job properties-options->enable parallel processing macros(Macros code are generated at the top of the job code then you can write your code)

If you use Loop transformation these macros are generated default(you can find more info in Documentation).

Parallel.png.

Thanks,

Shiva

Occasional Contributor
Posts: 6

Re: Parallel Processing in DI

Is there any information within the documentation

on the generated macro and how we can use these or do I have to go through the code Smiley Sad

I have got it working within loop transformation but was wondering if these would be implemented within other transformation.  Seems like the answer is no

Super Contributor
Posts: 349

Re: Parallel Processing in DI

Hi,

You can just try reading about 

Setting Options for Parallel Processing in SAS DI documentation.

Thanks,

Shiva

Ask a Question
Discussion stats
  • 3 replies
  • 385 views
  • 0 likes
  • 2 in conversation