How to get runtimes of jobs/flows from platform process manager

[DavidKess]

Hi,

I hope this is the right forum for my question and I apologize in advance but I couldn't find a simple solution for my problem.

After a lot of people got fired or left I am now the sole administrator of our Datawarehourse built with SAS. A task that goes a little over my head at times which is why I am asking this question.

We have a flow that runs multiple subflows and jobs every night to get data from source system and feed our Datawarehouse with it. I would like to be able to visualize the running times of this flow and it's subflows/jobs better. Is it possible to connect platform process manager directly and browse its database (if it has one) directly and get the running times?

I have read "Administering Platform Process Manager" and am aware of the possibilty of calling its binary, but that seems kinda unhandy which is why I am asking whether there are other possibilities.

Thank you for your help,

David

[LinusH]

What SAS version do you run?

Perhaps it's easier to use more standard logging functionality available through SAS Environment Manager. 

[DavidKess]

We run SAS 9.3_M2

As far as I can see SAS Environment Manager is only in 9.4?

[LinusH]

Yes, it seems that earliest documented release (2.1) is for 9.4.

This, among with lots other things I guess, makes a case for an upgrade to the latest release. 

[DavidKess]

While that is on the agenda there is no date set for now. That's why I am looking for a more immediate solution.

[JuanS_OCS]

Hi,

you can find your information on the history logs of the IBM Process Manager, with you can find on your Process Manager folder, then work\history. You will need probably to parse this file and translate the date/time values.

Another option is to use the jfd comandline program and get the information you need, programatically. For that, please read Administering Platform Process Manager - https://support.sas.com/rnd/scalability/platform/PSS7.1/pm8.20.pdfYou might be interested in the last topics: "About local jobs on Linux and UNIX" and "About local jobs on Windows"

[anja]

Hi,

given that it is SAS 9.3, using Audit Response Measurement (ARM) might be an option.
For increasing logging, please take a look at

SAS Logging Facility in SAS 9.3:

http://support.sas.com/documentation/cdl/en/logug/63131/HTML/default/viewer.htm#p1ux9lxccgetcgn1hmkh...

Initializing the Logging Facility for SAS programs
http://support.sas.com/documentation/cdl/en/logug/63131/HTML/default/viewer.htm#n00uahtr1g4bk2n1xkh8...

Here is some info from an old community post, which might provide you with some helpful information as well:

https://communities.sas.com/t5/General-SAS-Programming/How-to-get-LSF-flow-jobs-information-in-table...

Are there any plans to upgrade to SAS 9.4?

Thanks

Anja

[DavidKess]

Thanks, I will have a look at the links. Regarding 9.4: It will come at some point, but I there isn't a definitive date (yet).

[anja]

Hi,

as for the possible migration to SAS 9.4, are you all set with information on the different ways to upgrade, or would you like some material?

Thanks

Anja

[boemskats]

Hi @DavidKess

If migrating to 9.4 isn't an option that's immediately available to you, we offer a commercial product that will considerably help you in managing the SAS DW that you inherited. Our website is in desperate need of an update, but you can have a look at some of the early core functionalities here.

The product has come a long way in terms of enabling the kind of batch analysis you're after. If you're interested feel free to drop me a line and I can send you some more info & maybe arrange for a demo.

Nik

[prayon1]

I have recently presented a paper in SAS global forum which talks about monitoring jobs running in Process Manager.

Please have a read through it and it may well provide the solution that you are looking for.

https://www.sas.com/content/dam/SAS/support/en/sas-global-forum-proceedings/2019/3144-2019.pdf