Hi @Patrick , Basically we are creating one-off job where finally SAS dataset will be going to have some millions of records. To do this we have chosen loop approach as it can take chunks of data,so that we will not be run out of WORK space created inner loop job (Parameter job) : as part of this we are creating 2 prompts (year,month) as numeric values and doing some joining finally using (table loader transformation :append to existing option(we need the data to be appended ) while loading into SAS final dataset) created one-off job(outer loop job) by following below steps 1. dragged and dropped the & SYSLAST table node into job area 2.written below mentioned code in user-written node transformation where we will get distinct year and month PROC SQL;
create table &_output. as
SELECT distinct year(Created_Date) as year, month(Created_Date) as month
FROM &SYSLAST. ;
QUIT; and above output node will have only two columns (year and month ) and output will look similar as below year month 2018 11 2018 10 2019 01 2.next Loop transformation is used (done the parameter mapping tab as year and month as mapped source column) 3.loop job added 4.loop end transformation added.please find the below screen shot and kindly ignore the error in screen shot please. Screen Shot : Patrik,currently this job will work as loop on year -2018 and month-Nov and load the final dataset and then take another record 2018 Oct and load to final SAS table and it goes till ... actually only one month per each year we are looping over loading the data to dataset right now, is it any other option that we can load instead of one month per each year,2 or 3 months like -loop over 2018 year under october and november months data to be loaded to final SAS table please to increase the efficiency. please let me know if you need any clarification or any thing which i am not clear please.kindly suggest if you have any better approach which you feel please
... View more
