BookmarkSubscribeRSS Feed
HeatherNewton
Quartz | Level 8
I move sas data to DB2 wheee we have aded keys in table. Now when i load data into tables, duplicates based on keys were deleted. This makes my uat data having less volume compared to production data. How can I address this gap? Not adding keys to db2 table? Declare to users it is known gap? I dont kniw if there us impact to later calculation yet as we are still at data preparation and it is not possible to decide from reading code.

Anyone have experience around these?
4 REPLIES 4
SASKiwi
PROC Star

Surely you have a business rule for this? Is data with duplicate keys allowed or not allowed (the answer might be different depending on the table)? If it is allowed then your DB2 table definition is incorrect and needs to be corrected. If it is not allowed, then your current Production data is incorrect and your new DB2 data is correct.

HeatherNewton
Quartz | Level 8
Data architect designed that so keys allowed to minimize data unless he is not awared there could be impact which could be the case too. User not known yet and guess they only care about impact to data. Suppose no material sifference before and after migration.
SASKiwi
PROC Star

"Data architect designed that so keys allowed to minimize data" - this isn't a business rule, it's an architectural decsion. I suggest you raise the issue of a lack of a business rule with your project team. Until you decide what this rule is you don't know if your migrated data is correct or not.

Kurt_Bremser
Super User

If only observations (records) were removed where all values (variables,columns) were identical, then no information was lost, and you should ask yourself where the duplicates came from.

If this is not the case, then information WAS lost, and you have to determine if this information is crucial, and how to make sure the correct "duplicate" is kept if information can be discarded. If information is crucial, the key architecture needs to be reviewed.

hackathon24-white-horiz.png

The 2025 SAS Hackathon Kicks Off on June 11!

Watch the live Hackathon Kickoff to get all the essential information about the SAS Hackathon—including how to join, how to participate, and expert tips for success.

YouTube LinkedIn

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

SAS Training: Just a Click Away

 Ready to level-up your skills? Choose your own adventure.

Browse our catalog!

Discussion stats
  • 4 replies
  • 905 views
  • 3 likes
  • 3 in conversation