BookmarkSubscribeRSS Feed
nikhil_khanolkar
Calcite | Level 5

Hi,

 

In our project we are creating and updating a Table in LASR by Processing/Joining Datasets in SAS server. After creating a data in LASR we copy that data in the HDFS. This Scheduled process executes multiple times during a day. 

 

Would "reload on start" funtionality work in this case? We need to reload all datasets in LASR memory every time LASR server starts.

 

 

Thanks,

Nikhil

 

3 REPLIES 3
SnehasisTTPL
Fluorite | Level 6

Hi nikhil_khanolkar,

Create a data query by mentioning all the required datasets and schedule it as per your time.

Example:

NOTE:Change BOLD portion only

 

/** QUERY **/

%LET VDB_GRIDHOST=HOSTNAME;
%LET VDB_GRIDINSTALLLOC=/opt/TKGrid;
options set=GRIDHOST="HOSTNAME";
options set=GRIDINSTALLLOC="/opt/TKGrid";
options validvarname=any validmemname=extend;

/* Register Table Macro */
%macro registertable( REPOSITORY=Foundation, REPOSID=, LIBRARY=, TABLE=, FOLDER=, TABLEID=, PREFIX= );

/* Mask special characters */

%let REPOSITORY=%superq(REPOSITORY);
%let LIBRARY =%superq(LIBRARY);
%let FOLDER =%superq(FOLDER);
%let TABLE =%superq(TABLE);

%let REPOSARG=%str(REPNAME="&REPOSITORY.");
%if ("&REPOSID." ne "") %THEN %LET REPOSARG=%str(REPID="&REPOSID.");

%if ("&TABLEID." ne "") %THEN %LET SELECTOBJ=%str(&TABLEID.);
%else %LET SELECTOBJ=&TABLE.;

%if ("&FOLDER." ne "") %THEN
%PUT INFO: Registering &FOLDER./&SELECTOBJ. to &LIBRARY. library.;
%else
%PUT INFO: Registering &SELECTOBJ. to &LIBRARY. library.;

proc metalib;
omr (
library="&LIBRARY."
%str(&REPOSARG.)
);
%if ("&TABLEID." eq "") %THEN %DO;
%if ("&FOLDER." ne "") %THEN %DO;
folder="&FOLDER.";
%end;
%end;
%if ("&PREFIX." ne "") %THEN %DO;
prefix="&PREFIX.";
%end;
select ("&SELECTOBJ.");
run;
quit;

%mend;

LIBNAME VALIBLA SASIOLA TAG=HPS PORT=10011 HOST="HOSTNAME"

SIGNER="HOSTNAME:PORT/SASLASRAuthorization" ;
option DBIDIRECTEXEC;


/* mention Datasets required for reload */
%vdb_dt(VALIBLA.TARGETLASRTABLE);
data VALIBLA.TARGETLASRTABLE ( );
set libref.SOURCEDATA ( );
run;

nikhil_khanolkar
Calcite | Level 5

Hi Snehasis,

 

Thanks for the Reply. 

 

I am trying to use the Reload at start functionality that comes Out of the Box. Baiscally we want reload the Data in memory from a back up copy of data in Hadoop dynamically every time LASR server re starts.

 

Nikhil   

rgreen33
Pyrite | Level 9

I know that this is an old post, but this is exaclty what I am attempting to do.  Did you every find a resolution to this...other than creating scripts and including a call to those scripts in your startup process?

 

Thanks,

Ricky

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

Tips for filtering data sources in SAS Visual Analytics

See how to use one filter for multiple data sources by mapping your data from SAS’ Alexandria McCall.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 3 replies
  • 2197 views
  • 0 likes
  • 3 in conversation