Hi all,
I am thinking on the best approach to push loaded LASR tables down to HDFS on a scheduled manner.
I would like to know what is the best approach to do that? Ideally, I was thinking (not sure whether feasible) that once the table is loaded (reloaded) it is automatically copied to HDFS replacing the old one if that exists. I have two LASR libraries and therefore, I would like tables to be pushed to two correspoding HDFS libraries.
If the automatic push is not possible, does that mean I have to write my own script to manually push tables to HDFS and then schedule that script to run let's say daily?
Thank you!
Regards,
Evgeny
Yes, you have to write your own script to manually push tables from the memory to HDFS.
Hi @alexal,
Thank you for your reply. That turned out to be a small script to loop through the list of LASR tables and use data step to push them to the corresponding HDFS library.
Regards,
Evgeny
Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.
If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website.
See how to use one filter for multiple data sources by mapping your data from SAS’ Alexandria McCall.
Find more tutorials on the SAS Users YouTube channel.