BookmarkSubscribeRSS Feed
HeatherNewton
Quartz | Level 8
I move sas data to DB2 wheee we have aded keys in table. Now when i load data into tables, duplicates based on keys were deleted. This makes my uat data having less volume compared to production data. How can I address this gap? Not adding keys to db2 table? Declare to users it is known gap? I dont kniw if there us impact to later calculation yet as we are still at data preparation and it is not possible to decide from reading code.

Anyone have experience around these?
4 REPLIES 4
SASKiwi
Opal | Level 21

Surely you have a business rule for this? Is data with duplicate keys allowed or not allowed (the answer might be different depending on the table)? If it is allowed then your DB2 table definition is incorrect and needs to be corrected. If it is not allowed, then your current Production data is incorrect and your new DB2 data is correct.

HeatherNewton
Quartz | Level 8
Data architect designed that so keys allowed to minimize data unless he is not awared there could be impact which could be the case too. User not known yet and guess they only care about impact to data. Suppose no material sifference before and after migration.
SASKiwi
Opal | Level 21

"Data architect designed that so keys allowed to minimize data" - this isn't a business rule, it's an architectural decsion. I suggest you raise the issue of a lack of a business rule with your project team. Until you decide what this rule is you don't know if your migrated data is correct or not.

Kurt_Bremser
Super User

If only observations (records) were removed where all values (variables,columns) were identical, then no information was lost, and you should ask yourself where the duplicates came from.

If this is not the case, then information WAS lost, and you have to determine if this information is crucial, and how to make sure the correct "duplicate" is kept if information can be discarded. If information is crucial, the key architecture needs to be reviewed.

SAS INNOVATE 2024

Innovate_SAS_Blue.png

Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.

If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website. 

Register now!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

Get the $99 certification deal.jpg

 

 

Back in the Classroom!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 4 replies
  • 171 views
  • 3 likes
  • 3 in conversation