I have noticed if a file being imported by a task in EG changes (such as format or column layouts) that the import task doesn't refresh or pick up these changes unless I manually modify the task so it rereads the input file. Is there any way to have the task do this automatically when it runs in a process flow? The problem is that, if a file changes, it may not map correctly anymore. The task still processes the import and everything gets out of alignment. I may not notice it for some time and then I have to go back and reprocess numerous files. I really don't want to refresh the import tasks every time I run the process flow because that defeats the purpose of the automation.
I hope there is a way.
Sorry @elwayfan446 - no auto refresh on this. If the layout of the source file changes, then the definitions in the Import Data task need to be revisited, maybe adjusted, and confirmed.
You could use the code that the Import Data task generates as a starting point, and then build a more robust process that tolerates certain changes. But if the input files are shifting sands, then the import process is going to be shaky.
Sorry @elwayfan446 - no auto refresh on this. If the layout of the source file changes, then the definitions in the Import Data task need to be revisited, maybe adjusted, and confirmed.
You could use the code that the Import Data task generates as a starting point, and then build a more robust process that tolerates certain changes. But if the input files are shifting sands, then the import process is going to be shaky.
Ok, I was afraid of that as well. I like no-touch processes but I have to get used to the fact that it isn't always possible, ha!
I appreciate the help.
Good news: We've extended SAS Hackathon registration until Sept. 12, so you still have time to be part of our biggest event yet – our five-year anniversary!
Check out this tutorial series to learn how to build your own steps in SAS Studio.
Find more tutorials on the SAS Users YouTube channel.
Ready to level-up your skills? Choose your own adventure.