08-17-2016 06:57 AM
I have a few hundred csv files which I need to register in DI Studio (so that they either appear under External Files in the inventory or are imported straight into a SAS library) I also need to set formats and lengths etc. I'd rather not do all of this manually through te wizard but cannot find a way of registering external files fully in code. The register external files wizard doesn't produce any code, just the INFILE statement.
I have a table which contains all, table names, field names, field types and lengths within all of the csv files and was hoping to be able to use macro code to loop over this and create everything on the fly.
Does anyone please have any ideas on how could this be implemented in DI Studio?
08-17-2016 09:54 AM
09-09-2016 11:18 PM
A few hundred csv files sounds like you would want to explore some ways of automation but before going down this path:
Do all these csv's have different structures or are these just a few structures? If these are only a few structures then there are ways to create "metadata templates" instead.
I guess it's not only about the csv's but you also need the DIS jobs extracting the data and load it to somewhere. If you can give us a bit more detail what you have and how your process looks like then we can eventually show you alternative ways of how you could design and implement.