10-14-2016 12:17 PM
Recently (the past week or so) when I run a job that updates data on a table a pop-appears with the following message:
"The Job [job name] updates table metadata. [job name] needs to be refreshed to use any changes made to table metadata. Refreshing [job name] will remove the ability to undo any previous changes.
Do you want to refresh [job name]?
(check box) Do not show this message again"
Any idea why this pop-up is now appearing? Is it a setting that was maybe switched? Is there something here I should start heeding?
10-14-2016 06:56 PM
As I understand it, tables used in DI Studio jobs are required to be registered in SAS metadata. The popup is warning you that the underlying table metadata has changed. For example this could be the result of a column addition, deletion or change.
If you want your DI job to take advantage of these changes then you need to do the refresh.as advised. I suggest you investigate what has changed before deciding whether to do it or not.
10-15-2016 04:17 PM
10-17-2016 09:43 AM
@Patrick, @LinusH, you are both correct. User Written/Transpose transformations are in the jobs, and buried within those, the 'Summary Tables' node has the 'Update the metada for the target tables' set to 'Yes'. I believe this is the correct setting as the Summary Tables node outputs a table summarizing the data.
10-17-2016 12:00 PM
10-17-2016 01:57 PM
Depends on the purpose of this particular job, and you ETL design pattern/maintenance.
But generally I would avoid steps that could create variable output, could cause warnings/errors.
In the Transpose case (if transposing from long to wide) I would recommend a preceding Extract so it will be predictable which columns gets created in the Transpose.