BookmarkSubscribeRSS Feed
andrewfau
Fluorite | Level 6

I have property data sets with about 600,000 observations. I have variables for owner address-city-state-zip and variables for physical address-city-zip. I created a variable to indicate whether the owner address variable matches the physical address, but the lack of standardization in the data sets disrupts the accuracy of the matching (e.g. 3rd St. doesn't match with 3rd Street, or 3rd St. doesn't match with Third St.). What is the best way to standardize addresses in SAS? Is that even doable?

1 REPLY 1
kiranv_
Rhodochrosite | Level 12

This often better done in data profiling tools like Dataflux.

 

I have worked on address standardization but mostly through the hand written code. I used to do this on basis of business rules defined by stakeholders(regularly new rules were defined, say once in couple of months), it solved most of our problems but  was not enough ( this is what I strongly believe). 

 

When I was in this project they allow me to use Dataflux, because I was told that running Dataflux on large datasets will take lot of time. I was using datasets close to 200 million records and was using explicit SQL pass through.

 

Below is paper on Dataflux, which you might find interesting

 

http://www2.sas.com/proceedings/sugi30/102-30.pdf

sas-innovate-2024.png

Don't miss out on SAS Innovate - Register now for the FREE Livestream!

Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.

 

Register now!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 1 reply
  • 2049 views
  • 1 like
  • 2 in conversation