BookmarkSubscribeRSS Feed

Non-printable or 'special' characters affecting Standardization

Started ‎08-30-2018 by
Modified ‎08-30-2018 by
Views 2,966

Symptoms

You are passing row data to the SAS Viya Data Quality Standardization transformation which contains 'special' characters.

Diagnosis

Non-printable characters exist in the row-level data that cause Standardization to process incorrectly or fail.  Removal or recasting of the non-printable characters should solve this problem. 

Solution

You won't find me posting too many programming-related comments, but this is a simple solution that can take care of potentially repetitive faults in Standardization.  It's a re-print from an early reply on this subject that is worth showing again. 

 

The solution is: 

1) swap out non-printable characters with,

2) a safe character so that,

3) standardization runs properly. 

 

Detail, explanation, and sample code is here:  http://support.sas.com/kb/24/716.html

Comments

The SAS sample Note is missing the VERIFY function solution. Perhaps it should be as below :

 

test=verify(UPCASE(string),' !@#$%^&*,.1234567890ABCDEFGHIJKLMNOPQRSTUVWXYZ');
Version history
Last update:
‎08-30-2018 01:48 PM
Updated by:
Contributors

hackathon24-white-horiz.png

The 2025 SAS Hackathon Kicks Off on June 11!

Watch the live Hackathon Kickoff to get all the essential information about the SAS Hackathon—including how to join, how to participate, and expert tips for success.

YouTube LinkedIn

SAS AI and Machine Learning Courses

The rapid growth of AI technologies is driving an AI skills gap and demand for AI talent. Ready to grow your AI literacy? SAS offers free ways to get started for beginners, business leaders, and analytics professionals of all skill levels. Your future self will thank you.

Get started

Article Tags