SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

DI Studio Update Metadata Pop-Up

Reply
Frequent Contributor
Posts: 88

DI Studio Update Metadata Pop-Up

Recently (the past week or so) when I run a job that updates data on a table a pop-appears with the following message:

 

"The Job [job name] updates table metadata. [job name] needs to be refreshed to use any changes made to table metadata. Refreshing [job name] will remove the ability to undo any previous changes.

 

Do you want to refresh [job name]?

 

(check box) Do not show this message again"

 

Any idea why this pop-up is now appearing? Is it a setting that was maybe switched? Is there something here I should start heeding?

 

Thanks!

Super User
Posts: 3,105

Re: DI Studio Update Metadata Pop-Up

As I understand it, tables used in DI Studio jobs are required to be registered in SAS metadata. The popup is warning you that the underlying table metadata has changed. For example this could be the result of a column addition, deletion or change.

 

If you want your DI job to take advantage of these changes then you need to do the refresh.as advised. I suggest you investigate what has changed before deciding whether to do it or not. 

Respected Advisor
Posts: 3,889

Re: DI Studio Update Metadata Pop-Up

Are you by any chance using the Transpose transformation?

Super User
Posts: 5,256

Re: DI Studio Update Metadata Pop-Up

I want to extend @Patrick's question to if you have used any User Written Transformation, self built or Institute supplied?
You recognise them with a blue ball with an arrow pointing to a yellow square icon.
They have an "Other option" called "Update target table metadata". See if it's checked.
Data never sleeps
Frequent Contributor
Posts: 88

Re: DI Studio Update Metadata Pop-Up

@Patrick, @LinusH, you are both correct. User Written/Transpose transformations are in the jobs, and buried within those, the 'Summary Tables' node has the 'Update the metada for the target tables' set to 'Yes'. I believe this is the correct setting as the Summary Tables node outputs a table summarizing the data.

 

update metadata.PNG

 

 

Super User
Posts: 5,256

Re: DI Studio Update Metadata Pop-Up

The only situation I could find this usable is when creating en user data marts, and there is no subsequent ETL that uses that data in turn.
If used in a middle of an ETL process you still need a developer intervention to map the new columns and, and job promotion and redeployment.
Data never sleeps
Frequent Contributor
Posts: 88

Re: DI Studio Update Metadata Pop-Up

[ Edited ]

So, perhaps in this case, this shouldn't be set to 'yes' then?

Super User
Posts: 5,256

Re: DI Studio Update Metadata Pop-Up

Depends on the purpose of this particular job, and you ETL design pattern/maintenance.

But generally I would avoid steps that could create variable output, could cause warnings/errors.

In the Transpose case (if transposing from long to wide) I would recommend a preceding Extract so it will be predictable which columns gets created in the Transpose.

Data never sleeps
Ask a Question
Discussion stats
  • 7 replies
  • 560 views
  • 0 likes
  • 4 in conversation