SAS DI Studio jobs + documenting mapping from source to target

[pmksasbi]

Hi All,

i want to create a data lineage for a specific job from Source to target by making use of  SAS DI Studio job mappings.

Say for order table to be created at DDS. it has to go through several layers like staging , DIL & DDS. i want to document the mapping from source to target making use of the .spk file ,when a job is exported or make use of metadata server to find mapping information of a job . can you please help me understand how to achieve this. 

I know i can do impact analysis to find the tables that is used in all the jobs.but i have to open every job and manually check the mapping and document it. but this is a tedious job. is there an automated way to get this done. 

Thanks,

Mahesh 

[AllanBowe]

Hi Mahesh - you don't need to open the SPK file, the mappings are there in metadata. We built this functionality into Data Controller - it works at two levels:

1) Table level. This is a proc metadata call that extracts all the job mappings into a table.

2) Column level.  This is a bit more involved, with recursive queries.  For efficiency, in Data Controller, we cache the results in a table for a faster response the next time around.

If you'd like to build something similar, we made some process notes here:  https://docs.datacontroller.io/dcu-lineage/

And you can view the generated diagrams here:  https://docs.datacontroller.io/videos/#data-lineage

Data Controller is free for 5 users.

[pmksasbi]

Thank You!!