09-28-2017 05:09 PM
Thanks for the reply.
I believe it wouldnt impact the data right.
I am looking for inserting new rows and updating existing rows which is same as what merge transformation does. i Have used it to update sas datasets but i have not tried this to update hive tables.. Is there any other way to do an insert and update to a hive table using sas DI studio?
09-29-2017 10:56 AM
data step merge does not update/insert data at rest, it's a type of query that results in a new data set.
So from a data management/ETL perspective I would say this is a no-no.
There are ready made transformations for dealing with target table updates, select the one appropriate to your logic.
Sounds like that you need help from an ETL designer...?
10-03-2017 08:34 AM
Bare in mind that Hive have limited set of methods for update (none until recently). So be sure to align your ETL with Hive capabilities.
10-03-2017 04:25 PM - edited 10-03-2017 04:26 PM
Given that Hadoop is only good at Insert (Append) and Read you might also consider a strategy as outlined here: