BookmarkSubscribeRSS Feed

Non-printable or 'special' characters affecting Standardization

Started ‎08-30-2018 by
Modified ‎08-30-2018 by
Views 2,299

Symptoms

You are passing row data to the SAS Viya Data Quality Standardization transformation which contains 'special' characters.

Diagnosis

Non-printable characters exist in the row-level data that cause Standardization to process incorrectly or fail.  Removal or recasting of the non-printable characters should solve this problem. 

Solution

You won't find me posting too many programming-related comments, but this is a simple solution that can take care of potentially repetitive faults in Standardization.  It's a re-print from an early reply on this subject that is worth showing again. 

 

The solution is: 

1) swap out non-printable characters with,

2) a safe character so that,

3) standardization runs properly. 

 

Detail, explanation, and sample code is here:  http://support.sas.com/kb/24/716.html

Comments

The SAS sample Note is missing the VERIFY function solution. Perhaps it should be as below :

 

test=verify(UPCASE(string),' !@#$%^&*,.1234567890ABCDEFGHIJKLMNOPQRSTUVWXYZ');
Version history
Last update:
‎08-30-2018 01:48 PM
Updated by:
Contributors

SAS INNOVATE 2024

Innovate_SAS_Blue.png

Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.

If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website. 

Register now!

Free course: Data Literacy Essentials

Data Literacy is for all, even absolute beginners. Jump on board with this free e-learning  and boost your career prospects.

Get Started

Article Tags