topic Enterprise Guide - process dependence and parallel execution in SAS Enterprise Guide

Enterprise Guide - process dependence and parallel execution

Kacper — Fri, 01 Apr 2016 11:53:14 GMT

Hello,

I am working on a project in SAS EG (7.1) which involves process dependence and parallel execution, as depicted below:

I have the following questions:

Is there a way to retrieve or set relations (i.e. process_C --> program_D) between the processes programmatically? The maintenance is becoming problematic with complex projects. Ideally, I would like to be able to re-create the links between processes from external table.
I start the whole process with the option “Run branch from <<begin>>” process. Let’s assume that we have only 2 processors available. Is there a way to set the order of execution between process_A, B, C? The critical path of the whole flow is “begin -> process_C -> process_D -> end” hence we would like it to start with process_C in order to ensure minimum execution time.

Thank you in advance.

Re: Enterprise Guide - process dependence and parallel execution

TomKari — Fri, 01 Apr 2016 12:15:46 GMT

You could check into Enterprise Guide Automation tools. I don't know off the top of my head if they contain the facilities you need, but they might.

Another option for "sequencing" your programs is to turn them into standalone code files, and inter-relate them using %include and %macro facilities.

When an EG process flow is dispatched for parallel execution, this is done under the covers using SAS code facilities. Whenever I need to do something like this, I set up a general example that doesn't do anything, get the sequence set up the way I want, and then scrape and modify the underlying SAS code as needed.

Hope this helps,

Tom

Re: Enterprise Guide - process dependence and parallel execution

LinusH — Fri, 01 Apr 2016 12:37:33 GMT

To do this by yourself, check the documentation for MP CONNECT (requires a SAS/CONNECT license). You need to use SIGNON, WAITFOR, SIGNOFF, RSUBMIT statments, and more.