APPEND

[sasenthusiast07]

Hello my friends,

I have an question pertaining to appending the data to dataset.

Example : every week an file comes into the folder - which needs to be appended to the dataset.

I have 35 files --where in I have used infile * and created the dataset till this week -- which is all good.

Now next week if the file (.csv) come in - I want the new file to directly append to the dataset which is ready rather then reading entire 35 files+ new file and appending to the dataset.

In short question is : How can I append the data to existing dataset without reading previous files.

Thank you,

S

[Reeza · Accepted solution]

You modify your code to append to an existing data set stored in a permanent location. You need to decide how many checks you need for your process as well - for example do you ever need to handle rollbacks, do you need to deal with cases where you may need to run it multiple times a day? I separate my reporting/data management processes so this isn't an issue typically. See an example here:

https://gist.github.com/statgeek/353374a5d8ea4f0c89ce5d80a47f4a4c