BookmarkSubscribeRSS Feed
sasmaverick
Obsidian | Level 7

I have an extremely large SAS dataset (15mn rows) that I want to create as a table in Teradata. I do not have SAS/ACCESS Interface to Teradata, hence trying to use the SAS/ACCESS Interface to ODBC. The problem is it takes an extremely long time to create table in Teradata using the ODBC approach. 

 

What is the workaround?

 

 

 

 

4 REPLIES 4
Ksharp
Super User
You could check option of libname like :
readbuff=10000
insertbuff=10000
connection=unique
dbcommit=yes
...........

Also calling expert about this topic : @LinusH @SASKiwi
LinusH
Tourmaline | Level 20

Unfortenately, bulk load (or the different Teradata counterparts) is only available when you have the native SAS/ACCESS to Teradata product.

As @Ksharp already pointed out, INSERTBUFF= is the option you can tweak.

Data never sleeps
Tom
Super User Tom
Super User

@sasmaverick wrote:

I have an extremely large SAS dataset (15mn rows) that I want to create as a table in Teradata. I do not have SAS/ACCESS Interface to Teradata, hence trying to use the SAS/ACCESS Interface to ODBC. The problem is it takes an extremely long time to create table in Teradata using the ODBC approach. 

 

What is the workaround?


If you don't have SAS/Access to Teradata then work with your Teradata database team to show you how to use the Teradata tools for bulk loading data.  Dump the SAS dataset to a text file and load that into Teradata using the tools from Teradata.

SASKiwi
PROC Star

How long is extremely long? In my experience SAS's default database table loading settings such as DBCOMMIT and INSERTBUFF are not optimal. You should experiment with load times using a much smaller sample of rows, say 100,000. Set DBCOMMIT / INSERTBUFF to say 5,000 (default is 1,000) to start with then try increasing it. What SAS code are you using to load the data?

hackathon24-white-horiz.png

The 2025 SAS Hackathon has begun!

It's finally time to hack! Remember to visit the SAS Hacker's Hub regularly for news and updates.

Latest Updates

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

SAS Training: Just a Click Away

 Ready to level-up your skills? Choose your own adventure.

Browse our catalog!

Discussion stats
  • 4 replies
  • 1243 views
  • 2 likes
  • 5 in conversation