topic Re: Incremental load with removing 10 days of data in SAS Programming

Incremental load with removing 10 days of data

Rahul_SAS — Fri, 24 Apr 2020 18:20:13 GMT

Hi Experts,

In order to automate my report, I completed all ETL precess and created a final table. Now I have to load to CAS with an incremental load. Using SQL Server as data source.

Can anyone help me to provide an efficient sample code that loads the table on a daily basis by remove the last 10 days of data and load it again.

Thanks
Rahul

Re: Incremental load with removing 10 days of data

Daryl — Sat, 25 Apr 2020 02:13:12 GMT

Rahul,
Can you give a more concrete example with a sample table please?
Daryl

Re: Incremental load with removing 10 days of data

Rahul_SAS — Sat, 25 Apr 2020 19:03:29 GMT

Hi Daryl,

Attached here the sample data. Have1 has data till 25th April 2020 and Have2 has data till 26th April i.e today and the data gets updated on a daily basis. There are chances that the last 5 days data can be modified so always while loading data I need to delete the last 5 days of data or overwrite. This how I need to set up incremental.

In data Have2 marked few rows as edited.

Thanks

Rahul

Re: Incremental load with removing 10 days of data

Rahul_SAS — Sat, 25 Apr 2020 19:18:00 GMT

Hi Daryl,

In data Have2 marked few rows as edited.

Thanks

Rahul

Re: Incremental load with removing 10 days of data

Daryl — Tue, 28 Apr 2020 19:35:02 GMT

So HAVE1 is what is loaded as of April 25. You want to drop the last 10 days of data from HAVE1 and insert the last 11 days (10 prior days, plus April 26 data) from the incremental set?