SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

SAS DI Studio SCD Type 2 - duplicate records closes and opens new records in target table

Reply
New Contributor
Posts: 3

SAS DI Studio SCD Type 2 - duplicate records closes and opens new records in target table

Hi

 

I am using the SCD Type 2 loader to load data into a target table. However when I run the transformation more than once without changing the data in the source (duplicated data), the target table has closes out some records and adds new records into the table when the expected result should be no change in target. 

 

I have already read and applied the solution from the a similar issue in https://communities.sas.com/t5/SAS-Data-Management/DI-studio-SCD-Type-2-close-out-records/td-p/15015... but I am still getting the same issue where duplicated data in the source is closing and adding new records in the target. 

 

I am using SAS version 4.901

 

Due to the sensitivity of the data I am unable to attach any sample data. 

 

Has anyone encountered this issue?

 

Kind regards

 

Zubair

SAS Employee
Posts: 32

Re: SAS DI Studio SCD Type 2 - duplicate records closes and opens new records in target table

If you can duplicate your issue with some simple and small amount of sample data and if you sent me that data I could try to replicate this.  Perhaps take a few columns from your source table, change the variable names but otherwise use the same variable attributes and create 3 or 4 records with made up data values. Then set up a job like you current job with an SCD type 2 loader. Once you run the job you could send me both the physical source table and the physical target table and I can try and replicate the issue.

Also can you describe the type of source and target data you are using. Are they both SAS datasets? Are either or both tables another data format?

Ask a Question
Discussion stats
  • 1 reply
  • 104 views
  • 0 likes
  • 2 in conversation