data cleaning /merge purge problem

Reply
Occasional Learner
Posts: 1

data cleaning /merge purge problem

I'm dealing with a data cleaning problem.  We only have Base SAS but I need to find a systematic way of cleaning a list of names and addresses eliminating duplicates.

 

The data has been entered over years with no control of how information was entered.  For example, company names might be slightly changed and addresses entered any way someone wishes.

 

At present the data is manually cleaned but each time new data comes in it has to be cleaned again.

 

I've used so called merge purge programs in the past to clean mailing lists.

 

 

Esteemed Advisor
Posts: 5,198

Re: data cleaning /merge purge problem

So what exactly is your question?

Data never sleeps
Grand Advisor
Posts: 17,325

Re: data cleaning /merge purge problem

I like the solution from FriedEgg here:

https://communities.sas.com/t5/SAS-Procedures/Name-matching/td-p/82780

 

Given your situation and the lack of Data Quality software, I would recommend getting either SAS Data Flux, or creating your own custom program. The link above is a starting point. Also, look at Link King, which has the SAS code available. 

 

Ask a Question
Discussion stats
  • 2 replies
  • 111 views
  • 0 likes
  • 3 in conversation