SAS Code in EG get garbled

[ChaseLiu]

Hi Chris,

Thanks for your great solution. It's working!

Just like you said, It's because EG could not detect the encoding in my SAS program by default.

[Kurt_Bremser]

---

@ChaseLiu wrote:

It's because EG could not detect the encoding in my SAS program by default.

---

Which happens because your IDE does not supply the BOM that tells other software that the file is UTF coded. You might look if there's an option for that.

[ChaseLiu]

@Kurt_Bremser You are right. The editor save file in UTF-8 without BOM by default. Thanks for you advice! I think my confuse has been completely addressed.

Spoiler

.

[NMad]

"Use of a BOM is neither required nor recommended for UTF-8, but may be encountered in contexts where UTF-8 data is converted from other encoding forms that use a BOM or where the BOM is used as a UTF-8 signature"

https://www.unicode.org/versions/Unicode6.0.0/ch02.pdf

[DumptyHumpty]

I had a related issue with thousands of *.sas files from external sources in UTF8 that were incorrectly handled by the EG due to the missing Byte Order Mark (BOM) in the files. Opening and saving them manually in EG with the correct encoding information was not an option. 

I added the BOM programmatically which made EG detect the encoding correctly. Due to my personal preferences I coded it in linux bash. Powershell should look similiar.

 echo -ne '\xEF\xBB\xBF' > prog_utf8_BOM.sas && cat prog_utf8.sas >> prog_utf8_BOM.sas &&  mv prog_utf8_BOM.sas prog_utf8.sas