topic Re: job flows and job relation in Administration and Deployment

job flows and job relation

ANLYNG — Mon, 11 Apr 2016 08:45:05 GMT

Hi,

We are currently using SMC for scheduling jobs. We build our job flows via Schedule Manager plug-in for SAS Management Console and it runs on a HP unix. Do anyone know if or where the information about job flow name and contained jobs are stored ? thanks in advance.

Re: job flows and job relation

Resa — Mon, 11 Apr 2016 09:38:37 GMT

Hi,

At our company we have created an open-source tool called EOM Job Monitor (you can find a brief explanation on/demonstration of this tool here).

The information about the job flows and the jobs that are shown in the tool is retrieved from the metadata and can give real time progress on running flows plus information on completion, warnings and errors found.

There are some prerequisites for the tool to work.

Bottomline is that this information can be retrieved from the metadata.

Re: job flows and job relation

ronan — Mon, 11 Apr 2016 09:41:14 GMT

As far as I know (I don't have much practice with this plugin-in), the corresponding information is stored :

in the SAS Metadata repository as regards Process & Scheduling information
on the SAS execution server as regards the Deployed source code (<Deployment directory>/ <Job.sas>).

Re: job flows and job relation

ronan — Mon, 11 Apr 2016 10:07:05 GMT

Add. : 3. WIP Data Server as regards Performance & Completion Statistics ('Metrics') and also, maybe, SAS web Environment Manager ACM Kit Database

Depending on your SAS licence, there is a plug-in in the SAS Environment Manager called 'SAS Job Monitor' for retrieving and displaying the previous information (never used) :

https://support.sas.com/rnd/emi/SASEnvMgr/plugin/other-job-monitor.html

Re: job flows and job relation

LinusH — Mon, 11 Apr 2016 10:48:43 GMT

How will you use this information?

Just nice-to-know, or?

Re: job flows and job relation

ANLYNG — Mon, 11 Apr 2016 10:52:04 GMT

it should help me in planning my job flows so they are distributed in a effective manner. Start og endtime.

Re: job flows and job relation

LinusH — Mon, 11 Apr 2016 12:10:00 GMT

Execution during test should give quite a good feeling about execution times etc.

If you wish to futher optimize your batch flow, I would look into what Environment Manager has to offer, in form of job statistics.

Re: job flows and job relation

SASKiwi — Mon, 11 Apr 2016 20:33:50 GMT

If you are using LSF as your scheduler then you also have the also have the Flow Manager tool that allows you to both manage, monitor plus keeps a historical record of all jobs.

Re: job flows and job relation

ANLYNG — Sun, 17 Apr 2016 12:35:12 GMT

Hi ,

We have testet a lot of possibilities on basis om the solutions mentioned here. The clue to the solution was the metadata respository. We got a macro fro SAS Support which helped us to retrieve the information from the SAS meatadata respository. Thank you all for you replies.

Re: job flows and job relation

ANLYNG — Sun, 17 Apr 2016 12:36:05 GMT

Hi ,

We have testet a lot of possibilities on basis om the solutions mentioned here. The clue to the solution was the metadata respository. We got a macro from SAS Support which helped us to retrieve the information from the SAS meatadata respository by SAS code. Thank you all for you replies.