SAS Viya 4: Externalize job informations on Workload orchestrator to Prometheus

[Simo_Salehy]

Prometheus currently only tracks active jobs, with no visibility into completed ones. Once jobs finish, their status information from the Workload Orchestrator is not available to prometheus, limiting post-completion monitoring and analysis. It would be beneficial to externalize this data to Prometheus for better job status tracking. 

[prasadpz]

Hi @Simo_Salehy Thanks for the suggestion. Currently the full Job processing information like state, times and resources are in SWO job history and can be tracked via SWO CLI. Could you pls review and confirm if that information allows you to track the post completion monitoring? 

[Simo_Salehy]

SAS Viya CLI does have the information, however, it still requires custom efforts to reflect in Grafana and establish alerting for failed jobs. If the same information from SAS Viya CLI is exposed to prometheus, that would solve the problem. 

Thanks!