topic Re: Transcoding of texte in SAS Programming

Transcoding of texte

SASdevAnneMarie — Mon, 20 Jul 2020 10:13:49 GMT

Hello,

In my data file csv have a lote of "â€™", I need to replace it just by " ' ".

I import my row data file with infile statement (infile "&Rep_Travail\xxxx.csv" dsd truncover lrecl=32767 encoding=wlatin2) and I get the table donne.sas

When I run the code:

data donnee_bis;
set donne;
var3_correct=tranwrd(var3,"â€™","'");
run;

I get the error that SAS "Failed to transcode data from U_UTF8_CE to LATIN_9_CE......."

I put already the options locale=FR before the infile. Maybe I need to change encoding option in infile statement?

Thank you for your help!

Re: Transcoding of texte

SASdevAnneMarie — Mon, 20 Jul 2020 16:57:48 GMT

The data is attached.

Thank you

Re: Transcoding of texte

PGStats — Mon, 20 Jul 2020 17:52:12 GMT

If your csv file was exported from an Excel workbook, you could correct the problem in Excel at the export step. In the export dialog, choose Tools - Web Options - Encoding -> Unicode (UTF-8)

Re: Transcoding of texte

SASdevAnneMarie — Mon, 20 Jul 2020 18:44:49 GMT

Thank you for your suggestion.
I'm receiving this file, I need to correct it automatically, not manually.

Re: Transcoding of texte

PGStats — Mon, 20 Jul 2020 19:32:27 GMT

Then try adding option encoding=WLATIN1 to your infile statement.

Re: Transcoding of texte

SASdevAnneMarie — Mon, 20 Jul 2020 19:53:28 GMT

It doesn't work 😞

Re: Transcoding of texte

PGStats — Mon, 20 Jul 2020 20:35:56 GMT

Maybe@Tom can help. He understands this encoding stuff.

Re: Transcoding of texte

SASdevAnneMarie — Thu, 23 Jul 2020 16:26:59 GMT

I mean that I import the file with encoding=wlatin1, but I still need to correct the values like :
VAR&i.=tranwrd(VAR&i.,"Ã©","é");
VAR&i.=tranwrd(VAR&i.,"ÃŽ","ô");
VAR&i.=tranwrd(VAR&i.,"ÃªŸ","ê");
VAR&i.=tranwrd(VAR&i.,"Ã§Ÿ","ç");
VAR&i.=tranwrd(VAR&i.,"Ã¢","â");
VAR&i.=tranwrd(VAR&i.,"â€","'");
VAR&i.=tranwrd(VAR&i.,"Ã","à");
Maybe, there is some function as in this example (it doesn't work in my case 😞
data gg; g="Général";
g1=PUT(g,$UTF8x2000.);
g2=INPUT(g1,$UTF8x2000.);
run;
Obs g g1 g2

1 Général GÃ©nÃ©ral Général

I mean that with a step like that I don't need to use a lot of tranwrd functions, but I still can't found a combination of formats for my case...

Thank you very much!