topic Re: Push tables from LASR to HDFS in SAS Visual Analytics

Push tables from LASR to HDFS

Evgeny_ — Tue, 01 Aug 2017 07:43:44 GMT

Hi all,

I am thinking on the best approach to push loaded LASR tables down to HDFS on a scheduled manner.

I would like to know what is the best approach to do that? Ideally, I was thinking (not sure whether feasible) that once the table is loaded (reloaded) it is automatically copied to HDFS replacing the old one if that exists. I have two LASR libraries and therefore, I would like tables to be pushed to two correspoding HDFS libraries.

If the automatic push is not possible, does that mean I have to write my own script to manually push tables to HDFS and then schedule that script to run let's say daily?

Thank you!

Regards,

Evgeny

Re: Push tables from LASR to HDFS

alexal — Tue, 01 Aug 2017 11:33:47 GMT

@Evgeny_,

Yes, you have to write your own script to manually push tables from the memory to HDFS.

Re: Push tables from LASR to HDFS

Evgeny_ — Wed, 02 Aug 2017 03:33:46 GMT

Hi @alexal,

Thank you for your reply. That turned out to be a small script to loop through the list of LASR tables and use data step to push them to the corresponding HDFS library.

Regards,

Evgeny