Architecting, installing and maintaining your SAS environment

How do you setup a LASR table to automatically from Hadoop when the LASR server is restarted?

Accepted Solution Solved
Reply
Contributor
Posts: 73
Accepted Solution

How do you setup a LASR table to automatically from Hadoop when the LASR server is restarted?

Currently, I have jobs setup and scheduled that will load my Oracle data into Hadoop and then into LASR.  Now, I need to set it up so that my LASR table reload automatically (from Hadoop) when my LASR servers are restarted.  What is the best way to accomplish this?

 

By the way, I am new to SAS, so detailed replies are greatly appreciated. :-)

 

Thanks,

Ricky


Accepted Solutions
Solution
‎02-11-2017 10:33 AM
Trusted Advisor
Posts: 1,326

Re: How do you setup a LASR table to automatically from Hadoop when the LASR server is restarted?

You are welcome @rgreen33,

 

let me answeryour questions:

There are GUI options (on the library properties in the SAS Management COnsole) for this for the autoload folders, although I believe none for HDFS. Anyway for what you want to achieve, and to get the latest state of your LASR data, I would script it, yes. 

 

To know when LASR was restarted, you have several ways to know it: your logs, on the VA  Administrator view, with the SAS Environment Manager...  there are even more creative ways, but the main message is that there are many ways to know, fortunately Smiley Happy

 

As I guess you want to automate as much as possible, I understand you also automated the start-up of the LASR servers with a script, or you want to do it. Therefore the best place to callt his script is to be triggered just after you check that HDFS and LASR are up.

 

 

View solution in original post


All Replies
Trusted Advisor
Posts: 1,326

Re: How do you setup a LASR table to automatically from Hadoop when the LASR server is restarted?

[ Edited ]

Hello,

 

I guess your data remains on Hadoop, therefore you could use the same scripts to load the data from HDFS to LASR, a few minutes after the restart, to ensure LASR is up and running. Of course, any intermediate script (to check if LASR is up, etc) could help.

 

Another possible idea, is to save/unload your data from LASR into Hadoop, before stoping them, if you expect the data could have changed, or there might be new tables/queries.

 

Did you already read this paper? https://support.sas.com/resources/papers/proceedings14/SAS033-2014.pdf

Contributor
Posts: 73

Re: How do you setup a LASR table to automatically from Hadoop when the LASR server is restarted?

Posted in reply to JuanS_OCS

JuanS_OCS,

 

Thank you for your reply.  So, it sounds as if this all has to be done via code...no way to do it via the GUI.  So, based on your suggestion above, how do I know when my LASR server has restarted?  Would this be a script that is added to my "start-up" steps, which would manually be kicked off when LASR servers are loaded?  Or, is there a way to automatically trap for this even and fire this script off on re-start?

 

Thanks,

Ricky

Solution
‎02-11-2017 10:33 AM
Trusted Advisor
Posts: 1,326

Re: How do you setup a LASR table to automatically from Hadoop when the LASR server is restarted?

You are welcome @rgreen33,

 

let me answeryour questions:

There are GUI options (on the library properties in the SAS Management COnsole) for this for the autoload folders, although I believe none for HDFS. Anyway for what you want to achieve, and to get the latest state of your LASR data, I would script it, yes. 

 

To know when LASR was restarted, you have several ways to know it: your logs, on the VA  Administrator view, with the SAS Environment Manager...  there are even more creative ways, but the main message is that there are many ways to know, fortunately Smiley Happy

 

As I guess you want to automate as much as possible, I understand you also automated the start-up of the LASR servers with a script, or you want to do it. Therefore the best place to callt his script is to be triggered just after you check that HDFS and LASR are up.

 

 

☑ This topic is solved.

Need further help from the community? Please ask a new question.

Discussion stats
  • 3 replies
  • 158 views
  • 0 likes
  • 2 in conversation