topic Re: Unloading & Reloading Tables in LASR Server Automatically in SAS Visual Analytics

Unloading & Reloading Tables in LASR Server Automatically

aswinrahul_madu — Thu, 19 Nov 2015 13:03:19 GMT

Hi Everyone,

I need some help in automating the process of unloading & reloading of tables in LASR Server.The tables are fetched from Hive (Hadoop) and saved in a Library.Then, tables are registered and loaded into LASR Server for further usage.Whenever the tables are refreshed , we had to unload & reload them manually.I explored the Autoload feature,but unfortunately it doesn't help with our current environment.Is there a way that we can automate this process? Any help on this regard is highly appreciated.Thanks.

OS: Linux

VA Version: 7.2

Deployment: Non distributed

Re: Unloading & Reloading Tables in LASR Server Automatically

dave_alscient — Thu, 19 Nov 2015 13:34:51 GMT

I had a similar challenge with data in a SQL server database. I got round this by creating a connection to the external data using SAS Management Console. It was a bit of a convoluted process where as I need to create a number of items such as:

An authentication domain (I had to do this in order to store the password for the SQL Server user).

Create a database server.

Create a data library.

Finally register the tables.

Once i'd done this I am able to schedule a regular refresh from the source in data preparation or simply reload by right mouse clicking on the tablein the admin screen.

Below is a link to help with ODBC. You may be able to find something similar for Hadoop data stores as I can see there are Hadoop Severs and Hadoop via Hive Libraries in SAS Management console.

http://support.sas.com/documentation/cdl/en/bidsag/61236/HTML/default/viewer.htm#a003098426.htm

Re: Unloading & Reloading Tables in LASR Server Automatically

aswinrahul_madu — Thu, 19 Nov 2015 17:26:57 GMT

Thank you so much for the solution Dave.I appreciate it.I am able to register the tables,But I need to unload & reload existing tables by scheduling process.Any ideas?

Re: Unloading & Reloading Tables in LASR Server Automatically

PeterWijers — Thu, 19 Nov 2015 18:54:13 GMT

Just use the VA data query builder to load the data and schedule this query.

The schedule wil reload the data so you do not need to unload the data.

Greetings

Re: Unloading & Reloading Tables in LASR Server Automatically

aswinrahul_madu — Fri, 20 Nov 2015 10:33:59 GMT

Thank you for the suggestion Peter. We are currently using 20 tables in our dashboard.Do we have to create 20 different queries for scheduling or is it possible to include all tables in a single query?

Thanks

Re: Unloading & Reloading Tables in LASR Server Automatically

PeterWijers — Fri, 20 Nov 2015 11:06:27 GMT

Thats right, you have to set-up this 20 times but its not a lot of work, and you can schedule them differntly is needed.

This also opens an option to reload all tables fast after a reboot or restart of the LASR server.

Greetings