Dear Sir, I have a large sas dataset which I want to upload to MySql. I have verified that I can write a small sas dataset to it. However, when I try to write the big dataset to it, it takes forever. So I try to use bulkload but encountered the following error. I have tried a few ways to use bulkload but no success. I have increased my memsize to max. How much more memory do I need? Hope you can help or advice me Tan NOTE: Writing TAGSETS.SASREPORT13(EGSR) Body file: EGSR 22 23 GOPTIONS ACCESSIBLE; 24 proc append data=dp base=mysqllib.dp(bulkload=yes); 25 run; NOTE: Appending WORK.DP to MYSQLLIB.dp. WARNING: Variable barrid has different lengths on BASE and DATA files (BASE 10 DATA 8). MYSQL: Can't create bulkload temporary file: bl_dp_5 ERROR: The SAS System stopped processing this step because of insufficient memory. NOTE: There were 2 observations read from the data set WORK.DP. NOTE: There were 2 observations read from the data set MYSQLLIB.dp. 26 27 data mysqllib.dp5 (BULKLOAD=yes BL_DEFAULT_DIR="c:\temp\"); 28 set dp; 29 run; NOTE: SAS variable labels, formats, and lengths are not written to DBMS tables. MYSQL: Can't create bulkload temporary file: c:/temp//bl_dp5_6 ERROR: The SAS System stopped processing this step because of insufficient memory. NOTE: There were 2 observations read from the data set WORK.DP. WARNING: The data set MYSQLLIB.dp5 may be incomplete. When this step was stopped there were 1 observations and 4 variables. 30 31 data mysqllib.dp6 (BULKLOAD=yes); 32 set dp; 33 run; NOTE: SAS variable labels, formats, and lengths are not written to DBMS tables. MYSQL: Can't create bulkload temporary file: bl_dp6_7 2 The SAS System 18:29 Friday, June 3, 2016 ERROR: The SAS System stopped processing this step because of insufficient memory. NOTE: There were 2 observations read from the data set WORK.DP. WARNING: The data set MYSQLLIB.dp6 may be incomplete. When this step was stopped there were 1 observations and 4 variables. 34 35 proc options group=memory; run; SAS (r) Proprietary Software Release 9.4 TS1M3 Group=MEMORY SORTSIZE=1073741824 Specifies the amount of memory that is available to the SORT procedure. SUMSIZE=0 Specifies a limit on the amount of memory that is available for data summarization procedures when class variables are active. MAXMEMQUERY=0 Specifies the maximum amount of memory that is allocated for procedures. MEMBLKSZ=16777216 Specifies the memory block size for Windows memory-based libraries. MEMMAXSZ=2147483648 Specifies the maximum amount of memory to allocate for using memory-based libraries. LOADMEMSIZE=0 Specifies a suggested amount of memory that is needed for executable programs loaded by SAS. MEMSIZE=9854127360 Specifies the limit on the amount of virtual memory that can be used during a SAS session. REALMEMSIZE=0 Specifies the amount of real memory SAS can expect to allocate. NOTE: PROCEDURE OPTIONS used (Total process time):
... View more