11-19-2015 08:03 AM
I need some help in automating the process of unloading & reloading of tables in LASR Server.The tables are fetched from Hive (Hadoop) and saved in a Library.Then, tables are registered and loaded into LASR Server for further usage.Whenever the tables are refreshed , we had to unload & reload them manually.I explored the Autoload feature,but unfortunately it doesn't help with our current environment.Is there a way that we can automate this process? Any help on this regard is highly appreciated.Thanks.
VA Version: 7.2
Deployment: Non distributed
11-19-2015 08:34 AM
I had a similar challenge with data in a SQL server database. I got round this by creating a connection to the external data using SAS Management Console. It was a bit of a convoluted process where as I need to create a number of items such as:
An authentication domain (I had to do this in order to store the password for the SQL Server user).
Create a database server.
Create a data library.
Finally register the tables.
Once i'd done this I am able to schedule a regular refresh from the source in data preparation or simply reload by right mouse clicking on the tablein the admin screen.
Below is a link to help with ODBC. You may be able to find something similar for Hadoop data stores as I can see there are Hadoop Severs and Hadoop via Hive Libraries in SAS Management console.
11-19-2015 12:26 PM
Thank you so much for the solution Dave.I appreciate it.I am able to register the tables,But I need to unload & reload existing tables by scheduling process.Any ideas?
11-19-2015 01:54 PM
Just use the VA data query builder to load the data and schedule this query.
The schedule wil reload the data so you do not need to unload the data.
11-20-2015 05:33 AM
11-20-2015 06:06 AM
Thats right, you have to set-up this 20 times but its not a lot of work, and you can schedule them differntly is needed.
This also opens an option to reload all tables fast after a reboot or restart of the LASR server.