BookmarkSubscribeRSS Feed
jwhite
Quartz | Level 8

Recently (the past week or so) when I run a job that updates data on a table a pop-appears with the following message:

 

"The Job [job name] updates table metadata. [job name] needs to be refreshed to use any changes made to table metadata. Refreshing [job name] will remove the ability to undo any previous changes.

 

Do you want to refresh [job name]?

 

(check box) Do not show this message again"

 

Any idea why this pop-up is now appearing? Is it a setting that was maybe switched? Is there something here I should start heeding?

 

Thanks!

7 REPLIES 7
SASKiwi
PROC Star

As I understand it, tables used in DI Studio jobs are required to be registered in SAS metadata. The popup is warning you that the underlying table metadata has changed. For example this could be the result of a column addition, deletion or change.

 

If you want your DI job to take advantage of these changes then you need to do the refresh.as advised. I suggest you investigate what has changed before deciding whether to do it or not. 

Patrick
Opal | Level 21

Are you by any chance using the Transpose transformation?

LinusH
Tourmaline | Level 20
I want to extend @Patrick's question to if you have used any User Written Transformation, self built or Institute supplied?
You recognise them with a blue ball with an arrow pointing to a yellow square icon.
They have an "Other option" called "Update target table metadata". See if it's checked.
Data never sleeps
jwhite
Quartz | Level 8

@Patrick, @LinusH, you are both correct. User Written/Transpose transformations are in the jobs, and buried within those, the 'Summary Tables' node has the 'Update the metada for the target tables' set to 'Yes'. I believe this is the correct setting as the Summary Tables node outputs a table summarizing the data.

 

update metadata.PNG

 

 

LinusH
Tourmaline | Level 20
The only situation I could find this usable is when creating en user data marts, and there is no subsequent ETL that uses that data in turn.
If used in a middle of an ETL process you still need a developer intervention to map the new columns and, and job promotion and redeployment.
Data never sleeps
jwhite
Quartz | Level 8

So, perhaps in this case, this shouldn't be set to 'yes' then?

LinusH
Tourmaline | Level 20

Depends on the purpose of this particular job, and you ETL design pattern/maintenance.

But generally I would avoid steps that could create variable output, could cause warnings/errors.

In the Transpose case (if transposing from long to wide) I would recommend a preceding Extract so it will be predictable which columns gets created in the Transpose.

Data never sleeps

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

How to connect to databases in SAS Viya

Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 7 replies
  • 1779 views
  • 0 likes
  • 4 in conversation