Non-printable or 'special' characters affecting Standardization

1 Like

Symptoms

You are passing row data to the SAS Viya Data Quality Standardization transformation which contains 'special' characters.

Diagnosis

Non-printable characters exist in the row-level data that cause Standardization to process incorrectly or fail. Removal or recasting of the non-printable characters should solve this problem.

Solution

You won't find me posting too many programming-related comments, but this is a simple solution that can take care of potentially repetitive faults in Standardization. It's a re-print from an early reply on this subject that is worth showing again.

The solution is:

1) swap out non-printable characters with,

2) a safe character so that,

3) standardization runs properly.

Detail, explanation, and sample code is here: http://support.sas.com/kb/24/716.html

pchegoor · ‎09-04-2018

The SAS sample Note is missing the VERIFY function solution. Perhaps it should be as below :

test=verify(UPCASE(string),' !@#$%^&*,.1234567890ABCDEFGHIJKLMNOPQRSTUVWXYZ');