topic &quot;Duplicate values not allowed&quot; on my pk_index in DI Studio in SAS Data Management https://communities.sas.com/t5/SAS-Data-Management/quot-Duplicate-values-not-allowed-quot-on-my-pk-index-in-DI/m-p/81308#M727 <HTML><HEAD></HEAD><BODY><P>I've created a job that's using a composite PK which includes eight variables. When I run the job, the final Table Loader generates an error message telling me&nbsp; "Duplicate values not allowed on index pk_index for file MYTABLENAME." The Constraint- and Index Conditions of the Table Loader are both set to "After Load: On (table creation)". What is a good way to resolve this situation? I've never handled something like this before.</P><P></P><P>Thanks for your time.</P></BODY></HTML> Mon, 01 Oct 2012 08:19:49 GMT EinarRoed 2012-10-01T08:19:49Z "Duplicate values not allowed" on my pk_index in DI Studio https://communities.sas.com/t5/SAS-Data-Management/quot-Duplicate-values-not-allowed-quot-on-my-pk-index-in-DI/m-p/81308#M727 <HTML><HEAD></HEAD><BODY><P>I've created a job that's using a composite PK which includes eight variables. When I run the job, the final Table Loader generates an error message telling me&nbsp; "Duplicate values not allowed on index pk_index for file MYTABLENAME." The Constraint- and Index Conditions of the Table Loader are both set to "After Load: On (table creation)". What is a good way to resolve this situation? I've never handled something like this before.</P><P></P><P>Thanks for your time.</P></BODY></HTML> Mon, 01 Oct 2012 08:19:49 GMT https://communities.sas.com/t5/SAS-Data-Management/quot-Duplicate-values-not-allowed-quot-on-my-pk-index-in-DI/m-p/81308#M727 EinarRoed 2012-10-01T08:19:49Z Re: "Duplicate values not allowed" on my pk_index in DI Studio https://communities.sas.com/t5/SAS-Data-Management/quot-Duplicate-values-not-allowed-quot-on-my-pk-index-in-DI/m-p/81309#M728 <HTML><HEAD></HEAD><BODY><P>Obviously, you have duplicate values in your source data.</P><P>How to handle this is a matter of process.</P><P>Perhaps you have the source data i some kind of staging table, which will make it easy to examine and determine the duplicates.</P><P>If duplicates are common, you could add some logic in your flows to find the duplicates prior to the loading step, hand have them stored in a separate table. The Data validation transformation could be used for this.</P><P>About the constraints, what is the requirement to handle data quality? Having constraints on a target like this is like a guarantee that the data is consistent. You pay with a little overhead during load. The trade off is when to restore or in other ways clean up the target table after a load of duplicate values.</P></BODY></HTML> Mon, 01 Oct 2012 09:07:00 GMT https://communities.sas.com/t5/SAS-Data-Management/quot-Duplicate-values-not-allowed-quot-on-my-pk-index-in-DI/m-p/81309#M728 LinusH 2012-10-01T09:07:00Z