SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

SAS Dataflux Batch Job Transformation - Lineage

Accepted Solution Solved
Reply
Occasional Contributor
Posts: 19
Accepted Solution

SAS Dataflux Batch Job Transformation - Lineage

Hi All, In SAS DI, do we have a way, where we could have an input table and output tables connected to the Dataflux Batch Job Transformation? Since we don't have nodes option in Dataflux Batch Job Transformation available by default do you see any work around to maintain lineage? Thanks, Sandeep

Accepted Solutions
Solution
‎04-23-2018 10:40 AM
SAS Super FREQ
Posts: 108

Re: SAS Dataflux Batch Job Transformation - Lineage

Posted in reply to sanalitics
I can take this as a requirement for the R&D team. This is part of my job here at SAS.

Ron

View solution in original post


All Replies
SAS Super FREQ
Posts: 108

Re: SAS Dataflux Batch Job Transformation - Lineage

Posted in reply to sanalitics

Unfortunately this is not possible to do automatically. That transformation calls out to a different server. The jobs in the DataFlux environment can contribute to the Lineage repository though. You would need to use DI Studio and and some API calls and SQL code to connect the DataFlux metadata objects to SAS object metadata in the relationship repository that SAS Lineage uses.

 

Ron

Occasional Contributor
Posts: 19

Re: SAS Dataflux Batch Job Transformation - Lineage

Posted in reply to RonAgresta

Hi Ron,

 

I was also thinking of a user written transformation that could replace the batch job transformation in DI...

But the challenge is to get the connection to the DataMangagement server and its jobs in the options in order to select these from the drop down... any thoughts on this?

 

Best Regards,

Sandeep

 

SAS Super FREQ
Posts: 108

Re: SAS Dataflux Batch Job Transformation - Lineage

Posted in reply to sanalitics
It is possible to make web service calls to DM Server for things like lists of batch jobs. The DM Server documentation covers some of this. So maybe a custom transform using web service calls could help. I don't think you can get the connection information though in the same way.
Occasional Contributor
Posts: 19

Re: SAS Dataflux Batch Job Transformation - Lineage

Posted in reply to RonAgresta
Do you think we should ask SAS to provide a solution in such cases; where we could maintain the lineage?? If you know a way where we could approach SAS to look into this... could you forward to its R&D ?
Solution
‎04-23-2018 10:40 AM
SAS Super FREQ
Posts: 108

Re: SAS Dataflux Batch Job Transformation - Lineage

Posted in reply to sanalitics
I can take this as a requirement for the R&D team. This is part of my job here at SAS.

Ron
☑ This topic is solved.

Need further help from the community? Please ask a new question.

Discussion stats
  • 5 replies
  • 175 views
  • 0 likes
  • 2 in conversation