cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Lanei
‎06-12-2020
  • 2 Posts
  • 1 Likes Given
  • 0 Solutions
  • 0 Likes Received

Re: Bulkload from SAS to Vertica

by Calcite | Level 5 in SAS Programming
‎05-19-2020 02:55 AM
‎05-19-2020 02:55 AM
Hi, That INSERTBUFF looks very promising! I think one job which was earlier 4hours takes now only less than 20minutes! I have to check few times before I believe this 😄 Thank you so much! That PROC APPEND problem I don't understand. It has increased also and gives me no WARNING: Variable XX has different lengths on BASE and DATA files (BASE 32767 DATA 40). That's the maximum (I tried few times). And all the chars get same BASE, even the DATA varies (BASE 32767 DATA 16) or (BASE 32767 DATA 32). This job reads SAS table and takes summary and then loads to the Vertica table. Extract before Table Loader changes column length from 20 to 40 (with variable XX). I tried to check the character lengths, but everything seemed ok..? ... View more

Bulkload from SAS to Vertica

by Calcite | Level 5 in SAS Programming
‎05-18-2020 06:03 AM
‎05-18-2020 06:03 AM
Hi,   We have migration on going from Netezza to Vertica. I'm using SAS DIS and we have converted all the Netezza tables to Vertica tables and most of it works fine but I have two problems which I need to figure out. We are using SAS/ACCESS to Vertica.   Some jobs have bigger datasets to upload to database and those had BULKLOAD = YES with Netezza. As I understood, Vertica doesn't support BULKLOAD so I had to remove that. I also changed Table Loader (Load style: Append to Existing) Technique from 'proc append' to 'insert sql' because with append I got errors: WARNING: Variable XX has different lengths on BASE and DATA files (BASE 2560 DATA 40) from all the character columns.   Problem 1 is that when I had to remove BULKLOAD = YES, execution times increased from few minutes to many hours. Is there any 'bulkload' option which works with Vertica?   And problem 2 may be because of problem 1 (?). After job has executed 8 hours, I get error: ERROR: Error attempting to CREATE a DBMS table. ERROR: CLI execute error: ROLLBACK 4213: Object "table_name"  already exists. I can't repeat that error with limited datasets so this occurs only after long runs. I also checked that all the work table names match in log so it's not (shouldn't be) because of table references. Table is not empty before this append and it should not try to create anything. ... View more
Contact Me
Online Status
Offline
Date Last Visited
‎06-12-2020 11:17 AM
Likes given to
View All
Quick links