I have data that I would like to append to what is already in memory; however, I would also like to update as sometimes we have deletes which would need to reflect on the visual.
Thank you for any help on this.
so for example, the following data set:
Dataset containing 10 variables and having at least a million records ( if less observations what would be the alternate approach?) in memory in SAS VA.
I want to do 2 things: (1)update the table with new records but if some older records should be deleted as given from the source, delete. (2) given the periods of time, I collect only up to 10 periods of history constantly, so when period #1 is past duee, I want to delete those from memory - to keep only the 10 most current time-periods.
If you plan on creating a data query as saspert suggested, you can schedule it to run periodically so that it picks up any changes made to the source tables. Here is some more information about scheduling data queries that may be helpful to you:
so as you and saspert mentioned, the append will also do updates? I see the append, but how will it know on what conditions should it update?
like if I wanted to specify some key or index. Or does the append checks and does something like a select * from A except select * from B ?
It looks as if a custom query needs to be written to update the table. See if Data Management community can help you better? If I were you, I would try to write sas code and use it in a stored process, register the stored process and the end table in SAS MC. I would try this process in SAS EG first if you have it then go for the stored process route.
From what it looks like, the append option in SAS VA would let you just add 2 tables - not so sure about delete option.
Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.
If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website.
See how to use one filter for multiple data sources by mapping your data from SAS’ Alexandria McCall.
Find more tutorials on the SAS Users YouTube channel.