Developers

A forum for collaboration, Q&A, and knowledge sharing on SAS and open source integration
BookmarkSubscribeRSS Feed
a20121248
Obsidian | Level 7

Hi experts:

We have SAS Viya 3.5 and need to deploy projects following DevOps practices for ML. We have a folder structure with .sas scripts that do the following tasks:

  1. Data Validation
  2. Feature Engineering: for now is pure CAS tasks, but in the future it will call a databricks data pipeline
  3. Model Scoring: it call a SAS Model Manager's published model
  4. Reporting: table for reporting in Visual Analytics
  5. Other steps (email/teams notification, etc.): call outook or teams API

I need to schedule these steps.

 

I learnt how to execute scripts from command line and through APIs (from MAS in SAS Model Manager and SAS Intelligent Decision), but I need a way to orchestrate these .sas files in order. I see that in SAS 9 we have SAS Management Console, jobs dependencies and flow scheduling. Is there a way to do the same in SAS Viya through SAS Workflow Manager and schedule the whole workflow? Or should I use other tools like Airflow?

 

The only way I see is to create a main .sas script that includes other scripts and schedule it throught jobs in Environment Manager, but I would like to deacople the steps.

 

Sorry if the question is basic and general. I am open to all opinions.

 

Best regards,

Javier

sas-innovate-white.png

Join us for our biggest event of the year!

Four days of inspiring keynotes, product reveals, hands-on learning opportunities, deep-dive demos, and peer-led breakouts. Don't miss out, May 6-9, in Orlando, Florida.

 

View the full agenda.

Register now!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

SAS Training: Just a Click Away

 Ready to level-up your skills? Choose your own adventure.

Browse our catalog!

Discussion stats
  • 0 replies
  • 29473 views
  • 0 likes
  • 1 in conversation