topic Re: Correct mispelling of names in Data Management Studio 2.6 in SAS Data Management

Correct mispelling of names in Data Management Studio 2.6

kevind21 — Thu, 25 Jun 2015 14:09:38 GMT

In DM Studio there is a description of the Standardization node that says "Makes similar items the same. Examples of standardization are corrected misspellings (Mary instead of Mmary)..." I've tried using this Mmary example, along with other misspellings, to get the corrected name. However, no definition or scheme in the QKB that I've seen corrects these misspellings. What am I doing wrong? I'm using the CI 24 QKB.

Re: Correct mispelling of names in Data Management Studio 2.6

RonAgresta — Mon, 06 Jul 2015 14:50:58 GMT

Hi,

I believe the documentation is just showing an example to help describe the concept of standardization, rather than giving a specific instance of a standardized value provided by a standardization definition from the Quality Knowledge Base. It is possible to build in these kinds of transformations of course using the Customize component and its associated editors in Data Management Studio. You can also use Customize to see how data is transformed step by step for each data quality algorithm. This would let you see where you could add a standardization scheme to existing standardization definitions to correct common name misspellings (though standardizing people's names can be tricky especially when diminutive names and nicknames are involved).

Ron

Re: Correct mispelling of names in Data Management Studio 2.6

kevind21 — Tue, 07 Jul 2015 20:37:35 GMT

Thank you Ron. I was using the Customize component to see how the data was being transformed, and I saw where one of the nodes transformed a misspelled name properly ( perhaps this was the Vocabulary Editor), but wasn't sure how to incorporate this into a job where it could be used to standardize names. Guess I have some more reading to do. Thanks again.

Re: Correct mispelling of names in Data Management Studio 2.6

DaveR_SAS — Tue, 07 Jul 2015 21:47:47 GMT

This topic from the user guide might help: Using QKB Definitions in Jobs, Profiles, and Explorations

Re: Correct mispelling of names in Data Management Studio 2.6

DaveR_SAS — Tue, 07 Jul 2015 21:56:10 GMT

Also, the default repository (DataFlux Sample) has a number of data jobs that use a QKB to perform data quality operations. See this topic for an intro to data jobs:

Overview of Data Jobs

See this topic for a description of the data quality nodes: Data Job Nodes