Help using Base SAS procedures

Greenplum to SAS Bulkload gpfdist error - line too long in file

Reply
Super Contributor
Posts: 326

Greenplum to SAS Bulkload gpfdist error - line too long in file

Hi,
I'm currently doing a bulk load from Greenplum to SAS. Initially there was one field with a backslash "\" at the end of the column causing to throw an error during loading. To resolve it I changed the format from TEXT to CSV and worked fine. But loading more data I encountered this error:
gpfdist error - line too long in file
I've been doing some search but couldn't assess if the cause is due to that the max_length to set when starting the gpfdist service. I also saw that there is a limit for Windows which is 1MB? Greatly appreciate your help.
By the way here are some additional info which might help:
-Greenplum version: 4.2.1.0 build 3
-Gpfdist installed in Windows along with SAS Applications
-Script submitted to Greenplum based on SAS Logs: CREATE EXTERNAL TABLE <tablename> (  ) LOCATION ('gpfdist://:8081/fileout.dat')  FORMAT 'CSV' ( DELIMITER '|' NULL '\N') ENCODING 'LATIN1'
Thanks!
Ask a Question
Discussion stats
  • 0 replies
  • 442 views
  • 0 likes
  • 1 in conversation