Reload on Start in LASR

[nikhil_khanolkar]

Hi,

In our project we are creating and updating a Table in LASR by Processing/Joining Datasets in SAS server. After creating a data in LASR we copy that data in the HDFS. This Scheduled process executes multiple times during a day. 

Would "reload on start" funtionality work in this case? We need to reload all datasets in LASR memory every time LASR server starts.

Thanks,

Nikhil

[SnehasisTTPL]

Hi nikhil_khanolkar,

Create a data query by mentioning all the required datasets and schedule it as per your time.

Example:

NOTE:Change BOLD portion only

/** QUERY **/

%LET VDB_GRIDHOST=HOSTNAME;
%LET VDB_GRIDINSTALLLOC=/opt/TKGrid;
options set=GRIDHOST="HOSTNAME";
options set=GRIDINSTALLLOC="/opt/TKGrid";
options validvarname=any validmemname=extend;

/* Register Table Macro */
%macro registertable( REPOSITORY=Foundation, REPOSID=, LIBRARY=, TABLE=, FOLDER=, TABLEID=, PREFIX= );

/* Mask special characters */

%let REPOSITORY=%superq(REPOSITORY);
%let LIBRARY =%superq(LIBRARY);
%let FOLDER =%superq(FOLDER);
%let TABLE =%superq(TABLE);

%let REPOSARG=%str(REPNAME="&REPOSITORY.");
%if ("&REPOSID." ne "") %THEN %LET REPOSARG=%str(REPID="&REPOSID.");

%if ("&TABLEID." ne "") %THEN %LET SELECTOBJ=%str(&TABLEID.);
%else %LET SELECTOBJ=&TABLE.;

%if ("&FOLDER." ne "") %THEN
%PUT INFO: Registering &FOLDER./&SELECTOBJ. to &LIBRARY. library.;
%else
%PUT INFO: Registering &SELECTOBJ. to &LIBRARY. library.;

proc metalib;
omr (
library="&LIBRARY."
%str(&REPOSARG.)
);
%if ("&TABLEID." eq "") %THEN %DO;
%if ("&FOLDER." ne "") %THEN %DO;
folder="&FOLDER.";
%end;
%end;
%if ("&PREFIX." ne "") %THEN %DO;
prefix="&PREFIX.";
%end;
select ("&SELECTOBJ.");
run;
quit;

%mend;

LIBNAME VALIBLA SASIOLA TAG=HPS PORT=10011 HOST="HOSTNAME"

SIGNER="HOSTNAME:PORT/SASLASRAuthorization" ;
option DBIDIRECTEXEC;

/* mention Datasets required for reload */
%vdb_dt(VALIBLA.TARGETLASRTABLE);
data VALIBLA.TARGETLASRTABLE ( );
set libref.SOURCEDATA ( );
run;

[nikhil_khanolkar]

Hi Snehasis,

Thanks for the Reply. 

I am trying to use the Reload at start functionality that comes Out of the Box. Baiscally we want reload the Data in memory from a back up copy of data in Hadoop dynamically every time LASR server re starts.

Nikhil   

[rgreen33]

I know that this is an old post, but this is exaclty what I am attempting to do.  Did you every find a resolution to this...other than creating scripts and including a call to those scripts in your startup process?

Thanks,

Ricky