topic Re: Distorted German Alphabet in SAS Programming

Distorted German Alphabet

seamoh — Wed, 10 Jun 2020 00:59:35 GMT

Hello all of my friend , hope all of you are very well. I have a dataset contained German alphabets in Customer Name column. special German alphabet is distorted in dataset and all the reports and list taken from that.(as you see in the screen shot below). I use sas studio university edition.

I am looking forward your answers..

Thank you and deeply appreciated.

Re: Distorted German Alphabet

smantha — Wed, 10 Jun 2020 02:39:12 GMT

There are two ways to go about this
1. Change Sas encoding option so that it supports non native characters
2. Try using varchar instead of string for column informats and formats

Re: Distorted German Alphabet

ChrisNZ — Wed, 10 Jun 2020 03:14:25 GMT

SAS UE uses UTF-8 encoding.

It looks like your data set uses sometime else.

1. Do you have any messages in the log?

2. Run proc contents and report.

Re: Distorted German Alphabet

Kurt_Bremser — Wed, 10 Jun 2020 04:52:25 GMT

Does the dataset look right when viewed in SAS Studio?

Re: Distorted German Alphabet

seamoh — Wed, 10 Jun 2020 08:37:41 GMT

Hello and thank you very much for your reply. I have just SAS university edition.

Thank you again.

Re: Distorted German Alphabet

Kurt_Bremser — Wed, 10 Jun 2020 08:55:53 GMT

SAS Studio is the user interface used in University Edition.

PS it is the second tab in the screenshot you posted.

Re: Distorted German Alphabet

ChrisNZ — Wed, 10 Jun 2020 08:52:12 GMT

Have you tried my suggestions?

Re: Distorted German Alphabet

DavePrinsloo — Wed, 10 Jun 2020 12:46:01 GMT

This has happened to me, when I got data that had been previously transferred incorrectly between Latin and UTF8.

The following code fixed it for me.


/* adjust the following to add all corrupted German char variables */
%let vars_with_corrupted_chars=name address ;

data corrected;
set has_incorrect_german_chars;
array __array_char_vars $ &vars_with_corrupted_chars.;

   /* following code using explicit special characters is a LOT faster than the 
   equivalent code below using hex values */
   __array_char_vars = prxchange('s/Ãƒâ€ž/Ã„/',-1,__array_char_vars);
   __array_char_vars = prxchange('s/ÃƒÂ¤/Ã¤/',-1,__array_char_vars);
   __array_char_vars = prxchange('s/Ã‚â‚¬Ãƒ/Ã¤/',-1,__array_char_vars);
   __array_char_vars = prxchange('s/Ãƒâ€“/Ã–/',-1,__array_char_vars);
   __array_char_vars = prxchange('s/ÃƒÂ¶/Ã¶/',-1,__array_char_vars);
   __array_char_vars = prxchange('s/ÃƒÂ¼/Ã¼/',-1,__array_char_vars);
   __array_char_vars = prxchange('s/ÃƒÅ“/Ãœ/',-1,__array_char_vars);
   __array_char_vars = prxchange('s/ÃƒÅ’/Ã¼/',-1,__array_char_vars);
   __array_char_vars = prxchange('s/ÃƒÅ¸/ÃŸ/',-1,__array_char_vars);
   __array_char_vars = prxchange('s/ÃƒÂ©/Ã‰/',-1,__array_char_vars);
   __array_char_vars = prxchange('s/Â²/2/',-1,__array_char_vars);
   __array_char_vars = prxchange('s/Â³/3/',-1,__array_char_vars);
   __array_char_vars = prxchange("s/Â´/'/",-1,__array_char_vars);
run;

Re: Distorted German Alphabet

seamoh — Fri, 12 Jun 2020 23:49:38 GMT

Hello and thank you very much for your answer, yes the German alphabets are distorted in SAS studio tab too.

Thank you very much

Re: Distorted German Alphabet

seamoh — Fri, 12 Jun 2020 23:50:40 GMT

Hi and thank you very much for your reply

Where should I insert the codes?

Thank you again

Re: Distorted German Alphabet

ChrisNZ — Sat, 13 Jun 2020 03:33:01 GMT

...

Re: Distorted German Alphabet

DavePrinsloo — Sat, 13 Jun 2020 07:23:54 GMT

Run the conversion program once now, and every time immediately after importing / reading from the source table

Re: Distorted German Alphabet

DavePrinsloo — Sun, 21 Jun 2020 16:41:52 GMT

did this work?