Is there a way to link 2 or more different flows into a step by step flow?
I am using SAS Studio on Viya 4. It supports drag and drop like those that we have in SAS Data Integration Studio + SAS Enterprise Guide, atleast to my understanding.
I just tried creating like 10 different flows with simple tasks such as:
Read one CSV and output as SAS dataset
<- repeat for 10 different csv in 10 different flows.
However, with many years of experience using SAS Data Integration Studio where it allows me to create multiple jobs and then in one of the jobs, i can put all other jobs in and connect them together to make it a step by step flow...however, i couldn't get SAS Studio flow to connect together.
To this point, it may sound very messy but let me explain more briefly.
I created 3 flows for Extraction
EXT_CHINA
EXT_USA
EXT_CONGO
Another 3 flows for Transformation
TRANS_CHINA
TRANS_USA
TRANS_CONGO
Another 3 flows for Loading
LOAD_CHINA
LOAD_USA
LOAD_CONGO
In each of these flows, i have simple data manipulation in it.
At the end of the day, i wish to have 1 master flow containing the 3 EXT in one flow, and the same for TRANS and LOAD.
EXT_MASTER_FLOW containing
EXT_CHINA
EXT_USA
EXT_CONGO
TRANS_MASTER_FLOW containing
TRANS_CHINA
TRANS_USA
TRANS_CONGO
LOAD_MASTER_FLOW containing
LOAD_CHINA
LOAD_USA
LOAD_CONGO
Last but not least, a main flow with the name "main_etl" schedule for daily run with the following flows:
EXT_MASTER_FLOW -> TRANS_MASTER_FLOW -> LOAD_MASTER_FLOW
I can do this easily with SAS Data Integration but i havent found the way to do it on SAS Studio.
Can anyone advise on how can i achieve this on SAS Studio? any advice or suggestions are welcomed.
I don't have Viya at my fingertips, but given the documentation there is a Sub-flow step, given that you have at least SAS Studio Analyst License:
SAS Help Center: About Subflows
If you are having many "levels" of flows, you need to use Job flows in Environment Manager (since Sub-flows can't contain other Sub-flows):
Tips for Scheduling Flows with SAS Viya Environment Manager - SAS Users
What’s the difference between SAS Enterprise Guide and SAS Studio? How are they similar? Just ask SAS’ Danny Modlin.
Find more tutorials on the SAS Users YouTube channel.
Ready to level-up your skills? Choose your own adventure.