08-01-2017 03:43 AM
I am thinking on the best approach to push loaded LASR tables down to HDFS on a scheduled manner.
I would like to know what is the best approach to do that? Ideally, I was thinking (not sure whether feasible) that once the table is loaded (reloaded) it is automatically copied to HDFS replacing the old one if that exists. I have two LASR libraries and therefore, I would like tables to be pushed to two correspoding HDFS libraries.
If the automatic push is not possible, does that mean I have to write my own script to manually push tables to HDFS and then schedule that script to run let's say daily?
08-01-2017 11:33 PM
Thank you for your reply. That turned out to be a small script to loop through the list of LASR tables and use data step to push them to the corresponding HDFS library.
Need further help from the community? Please ask a new question.