09-14-2017 04:44 AM
I'm running queries across a pretty large dataset, but there seems to be an issue with the processing, so 20-30 rows of the query output come out with all columns as '???'. I've looked back to the source data, and there doesn't seem to be a problem there. Anyone have any ideas?
09-14-2017 05:13 AM
Are those columns numerics formatted, such as dates, datetimes etc. That is where you normally get this where the width of the column is not big enough to show the full formatted value of an underlying numeric data. If you look at the dataset and move the column width it should show.
09-14-2017 05:17 AM
The '???' is across all columns, regardless of data type and length, and the results above and below are displaying normally. As a bit of further information, when I'm scrolling through the data, it seems to pause slightly before getting to the data with the '???'. Not sure if this helps.
09-14-2017 08:07 AM
I'm guessing that this might be an encoding problem. The original data might contain some national characters that don't fit in your SAS session encoding, so the representation of these chars is "?". If you can, try running your SAS session with ENCODING=UTF8 (that might be an admin task to set up).
SAS Enterprise Guide is a full Unicode application, so virtually all character sets can be represented. But the SAS session is often pinned to one codepage or encoding, so information is literally "lost in translation". UTF-8 (a form of Unicode) is the best option for SAS sessions.
09-14-2017 09:48 AM
I'm currently set up for the utf-8 encoding so that shouldn't be an issue. I've managed to isolate the column with the data that appears to be screwing things up. It occaisionally contains cyrillic characters, and seems to be imported in from the source excel files without any issues, but then has issues after querying.
09-14-2017 10:14 AM
Any user-defined formats applied to that column, by chance? Does a small PROC PRINT to HTML produce the same output? Or is this limited to the data grid view?