topic Re: data cleaning /merge purge problem in SAS Programming

data cleaning /merge purge problem

kossack — Tue, 24 Jan 2017 19:06:52 GMT

I'm dealing with a data cleaning problem. We only have Base SAS but I need to find a systematic way of cleaning a list of names and addresses eliminating duplicates.

The data has been entered over years with no control of how information was entered. For example, company names might be slightly changed and addresses entered any way someone wishes.

At present the data is manually cleaned but each time new data comes in it has to be cleaned again.

I've used so called merge purge programs in the past to clean mailing lists.

Re: data cleaning /merge purge problem

LinusH — Tue, 24 Jan 2017 19:20:45 GMT

So what exactly is your question?

Re: data cleaning /merge purge problem

Reeza — Tue, 24 Jan 2017 20:39:24 GMT

I like the solution from FriedEgg here:

https://communities.sas.com/t5/SAS-Procedures/Name-matching/td-p/82780

Given your situation and the lack of Data Quality software, I would recommend getting either SAS Data Flux, or creating your own custom program. The link above is a starting point. Also, look at Link King, which has the SAS code available.