When I persisted SAS data to hive,there was some dirty data in .sas7bdat file.Due to this error,the execution stopped.How can I deal with these dirty data?
data hivelib.cars (COLUMN_DELIMITER = '|');
set locallib.cars;
run;
Data conversion error on column 'xxx',
Depends on what type of 'dirty' and how they're dirty.
Please provide more details.
@zdk wrote:
When I persisted SAS data to hive,there was some dirty data in .sas7bdat file.Due to this error,the execution stopped.How can I deal with these dirty data?
data hivelib.cars (COLUMN_DELIMITER = '|');
set locallib.cars;
run;
Data conversion error on column 'xxx',
thx
the error :data conversion error on column 'xxx' ,row xxx
note :due to errors above,SAS set option OBS=0,enabling syntax check mode.
This prevents execution of subsequent data modification statements.
dirty data is ....there were scrambled code or invisible characters in the source data...so failed to load...
My solution is to extract dirty data and process them seprately.But we have more than 3000 tables.It costs too much...Do you have any suggestions?
thank u very much!
Join us for SAS Innovate 2025, our biggest and most exciting global event of the year, in Orlando, FL, from May 6-9. Sign up by March 14 for just $795.
Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.
Find more tutorials on the SAS Users YouTube channel.