topic Re: script shell to launch macro in sas server in SAS Programming

script shell to launch macro in sas server

fadel — Tue, 14 Apr 2015 09:45:26 GMT

Hi,

Im looking for how to create a script Shell in the SAS EG Server to launch my macro (with parameters) Once the data mart (in the server bibiotheques) is refreshed !

there is any solution ??

Thanks. to launch macro

Re: script shell to launch macro in sas server

Kurt_Bremser — Tue, 14 Apr 2015 10:26:51 GMT

I don't think that "Refresh" on a library can be used to trigger anything, if that's what you want.

Re: script shell to launch macro in sas server

fadel — Wed, 15 Apr 2015 09:53:19 GMT

So can the script launch macro just by click (like vbs in windows to launch excel macros)?

Re: script shell to launch macro in sas server

jakarman — Wed, 15 Apr 2015 10:29:35 GMT

You can use SAS for almost anything to start and check on conditions. Please avoid VBS complexity for that.

In the concepts you are asking for a scheduler that starts a process when a external file exists.
When you do not have it, it can be build using SAS. The design:

- Build a poller that doe a checks and verifie every x-time and than goes asleep. The Sleep function exists with SAS.

- Start a verifying condition that can be anything like other job have been run, A sas-dataset existing (internal or even external dbms) it is really anything you can do with SAS.

- Having all conditions met do a remote submit (mp-connect) or batch submit with xcmd access use a intitstmt termstmt for checking status etc

- Validate the status of those running jobs and you can email or do something different/other task.

The sky is the limit.

Launch a macro? I hope you are saying launching a sas-program. http://en.wikipedia.org/wiki/Macro_(computer_science) macro with sas are soure text manipulating. They are NOT procedures or keyboard/mouse recordings.

Re: script shell to launch macro in sas server

fadel — Thu, 16 Apr 2015 16:26:09 GMT

Thanks Karman, but i dont know how to do that !! Can you give me more explications ?

Re: script shell to launch macro in sas server

jakarman — Thu, 16 Apr 2015 19:09:52 GMT

Suppose having that polling in some code it will look like something

%let fdlstart_cntr=1;

%do %while (&fdlstart_cntr ge 1 & &sysrc=0 ) ;

%include yourcode(fdl_sasrun) ; /

%let temp = %sysfunc( sleep(20,1) ) ;

%put fdlstart polling loop sleep=&fdlsleep no &fdlstart_cntr ;

%include yourcode(fdl_checkrun) ;

%put %sysfunc( sleep(40,1) ) wait some seconds.... ;

%let fdlstart_cntr=%eval(&fdlstart_cntr +1 );

%if ( %sysfunc(fileexist(???._STOP) ) ) %then %let fdlstart_cntr=0; /* to stop the polling checking for a file created/existence */

%end;

Suppose your SAS code fdl_sasrun is having:

seljobsubmit = 1 ; /* a selection switcht allowing many testings */

if ( fdl_status in (" ","W","w") ) then do;

if ( jbwinstart > curdatetim & jbwinstart ne . ) then seljobsubmit = 0 ; /* only after a time test */

end;

if ( fdl_status in (" ","W","w") & seljobsubmit = 1 ) then do; /* validate existence tables SAS-datasets */

do i=1 to dim(trgdsn); /* work a list array of possible datasets as libname.dataset vivisible ot the polling process */

IF ( trgdsn{i} ne "" ) THEN do ; /* only do the checking when being defined as string */

if ( not exist(trgdsn{i}) ) then seljobsubmit = 0 ; /* if the mentioned does not exists the job may not start */

end;

/* many ohter possible tests can be added */h

if ( seljobsubmit = 1 ) Then do;

if ( jbstatus in("W","w") ) then fdl_status=" " ; /* after having waited now allowed to submit */

else do;

if ( jbstatus = " " ) then fdl_status="W" ; /* not allowed to run yet, set status to wait */

end;

if ( fdl_status= " " ) then do;

submitstring=' .... ' ; /* whatever is needed as batchjob using x-cmd */ Call execute(submitstring) ;

/* this can also be a mpconnect approach */

end;

Suppose your SAS code fdl_checkrun is checking your code is started (delay assumed to be max 20 seconds by the OS */

Some dataset existence being created by a you sas job. And the logic is getting completed,

Making all it all by parameters and it will become a more generic approach. That is almost similar to generic schedulers able to set triggers on existence of some dataset.

The strange thing here a compared to generic schedulers s as the SAS polling job can see those datamarts, no matter where they are created , the can be tested on an acted on. (exist function)
When having access to a creation data/time refresh indicator that can also be set and coded. Only needing to know what should be tested on.

Re: script shell to launch macro in sas server

fadel — Fri, 17 Apr 2015 09:19:20 GMT

Thank you very much Karman, but my datamart exist permanently with same name, and it is refreshed with new data each month. So i want my process to be executed after this refreshment.

Soory.

Re: script shell to launch macro in sas server

Kurt_Bremser — Fri, 17 Apr 2015 09:46:25 GMT

So your datamart is refreshed by some already existing process, right?

How is this process controlled/triggered?

Re: script shell to launch macro in sas server

jakarman — Fri, 17 Apr 2015 09:47:19 GMT

Nothing to be sorry, you did not tell anything of your datamart lay-out technical background RDBMS or SAS datasets.

When it are SAS-datasets you have the ATTRN function retrieving the CRDATE value. SAS(R) 9.4 Functions and CALL Routines: Reference, Third Edition Having a previous current one of that there you have another check.

When that datamarts are run maybe there can be made some agreement to create a file somewhere

When an external DBMS the last update is sometimes available as dictionary information.

How do you recognize there is a new one?

Re: script shell to launch macro in sas server

fadel — Fri, 17 Apr 2015 10:16:06 GMT

Yeah, its refreshed by MSI.

my datamarts looks like that:

Serveur

SASApp

Bibiotheque

DataMart

DM4_DATAMART

DM4_DATAMART_201403

DM4_DATAMART_201404

DM4_DATAMART_201405

DM4_DATAMART_201406

DM4_DATAMART_201407

....

DM4_DATAMART_201503

I know that there is a new one ( 'DM4_DATAMART') when the last one in this list is 'DM4_DATAMART_201503'. So the new one ( 'DM4_DATAMART') contains April data.

Re: script shell to launch macro in sas server

Kurt_Bremser — Fri, 17 Apr 2015 11:10:03 GMT

Could you explain what MSI is?

Re: script shell to launch macro in sas server

fadel — Fri, 17 Apr 2015 11:25:14 GMT

Sorry, Management Information System (MIS)

Re: script shell to launch macro in sas server

Kurt_Bremser — Fri, 17 Apr 2015 11:30:07 GMT

Then put your code into a .sas file and have that run in batch mode, triggered by the same MIS once the datamart update is finished.

Re: script shell to launch macro in sas server

jakarman — Fri, 17 Apr 2015 11:35:16 GMT

So the test is: When DataMart.DM4_DATAMART_201504 exist (test the existence of a dataset) then you want to start your program for the April job processing?

Seems to me a daily check for that is sufficiënt.

A process being started every day on the desired time and that one does nothing when the mentioned condition is not met.

The mind switch is: do nothing even when started

instead of only being starting when the condition is fulfilled.

Re: script shell to launch macro in sas server

fadel — Mon, 20 Apr 2015 09:59:48 GMT

Hi Karman, I tryed to do that:

%if (month(today) ge 2 & month(today) le 12) %then %do

%let mois2 = %eval(month(today) - 1);

%let annee2 = %eval(year(today));

%end

%else %do

%let mois2 = 1;

%let annee2 = %eval(year(today) - 1);

%end

%let done = 0;

%if (%sysfun(fileexist(DATAMART.DM4_DATAMART&annee2&mois2)) & (done = 0)) %then %do

%kpisgenerals(mois1 = &mois2, annee1 = &annee2); /*my macro */

done = 1;

%end

But the problem is that my loop will not stopped, it will be executed more than one time !! you see that ? how can i settle it ?

Re: script shell to launch macro in sas server

Kurt_Bremser — Mon, 20 Apr 2015 10:40:48 GMT

You are mixing macro and data step code.

%if is macro code, but the month() and year() functions are data step functions and will be treated by the macro processor as plain text(!), so you get the condition (quotes for emphasis) "month(today)" ge "2", which is always true (the character "m" has a higher ordinal than the character "2").

I guess that you get complaints in your log about

%let mois2 = %eval(month(today) - 1);

like "operator not found in expression".

I suggest to put your condition evaluation into a data _null_ step and, when you have verified that the data step activates the right branch (use a simple put "does this"; and put "does that"; to check), replace the put with a call execute to call the macro.

Re: script shell to launch macro in sas server

fadel — Mon, 20 Apr 2015 10:54:58 GMT

but the problem is not resolved yet !! the programm will be executed more than one time !

Re: script shell to launch macro in sas server

Kurt_Bremser — Mon, 20 Apr 2015 10:57:53 GMT

Post code and log.

Re: script shell to launch macro in sas server

jakarman — Mon, 20 Apr 2015 19:16:18 GMT

Make your approach more simple to understand and code.

There is a format that gives you immediate yyyymm values

http://support.sas.com/documentation/cdl/en/leforinforref/63324/HTML/default/viewer.htm#n1k45hxg0vxohqn1ktr8k1tnmrn1.htm

options mprint mlogic symbolgen source2 ;

%let today=%sysfunc(today());

%let fstmonth=%sysfunc(Putn(&today,yymmn6.) ) ;
%put &fstmonth ; /* shows the yyyymm value you are needing */

%macro kpisgenerals (mois1=,annee1=); /* your code as macro set up as dummy, just checking dates */
%put -- &mois1 -- &annee1 -- ;
%mend;

/* I do not have f DATAMART.DM4_DATAMART&fstmonth instead of that test for test.have */

/* The test you forgot is marking the run has finished. I create a data set for that with a lastrun naming.

It will execute you macro only once a month no matter how many times you call checkrun ... shifting the days as for namings using the %eval as you need */

%macro checkrun;
    %if (%sysfunc(exist(test.have ) ) And not %sysfunc(exist(test.lastrun_DM4_DATAMART&fstmonth) ) ) %then %do;
     %kpisgenerals(mois1=%substr(&fstmonth,5,2), annee1 = %substr(&fstmonth,1,4)); /*my macro */
   data test.lastrun_DM4_DATAMART&fstmonth ; /* mark job has run */
     today=today(); format today date. ;
   run;
    %end ;
%mend;

%checkrun;

Re: script shell to launch macro in sas server

fadel — Wed, 22 Apr 2015 11:21:23 GMT

Hi, Thanks it works with this code:

filename mylib "/home/sassrv/user_folder/sasuser/adnane/projet_tdb_mustapha/myautocall";

options mrecall;

options mautosource sasautos=(mylib sasautos) mautolocdisplay;

%macro rrr();

%if (%sysfunc(month("&sysdate"d)) ge 2 & %sysfunc(month("&sysdate"d)) le 12) %then %do;

%let fdlmonth = %sysfunc(month("&sysdate"d));

%let mois2 = %eval(&fdlmonth - 2);

%let annee2 = %sysfunc(year("&sysdate"d));

%let fdlyear = %sysfunc(year("&sysdate"d));

%end;

%else %do;

%let mois2 = 12;

%let fdlyear = %sysfunc(year("&sysdate"d));

%let annee2 = %eval(&fdlyear - 1);

%end;

%if ( &mois2 lt 10) %then %do;

%let mois2 = 0&mois2;

%end;

%if (%sysfunc(exist(DATAM.DM4_DATAMART_&annee2&mois2)) And not %sysfunc(exist(sasuser.lastrun_&annee2_&mois2) )) %then %do;

%kpisgenerals(mois1= &fdlmonth, annee1= &fdlyear);

data sasuser.lastrun_&annee2_&mois2 ; /* mark job has run */

today=today(); format today date. ;

run;

%end;

%mend;

%rrr()

Now i would like to schedule itin gaol be executed once a day !! (im working in SAS EG 4.3) Can you inform me about that step by step ?