topic Re: Joining sas dataset with teradata table in SAS Programming

Joining sas dataset with teradata table

nickspencer — Mon, 02 Nov 2020 01:39:07 GMT

Hello everyone,
I have my source data in oracle table. I am bringing this data to SAS and applying some logic. But some of the reference data is stored in teradata table. I am having hard time deciding how to bring in the teradata reference table to SAS since it is a huge table with about 400 million records.
I was thinking of loading this sas dataset to teradata but we do not have capability to create tables in teradata in production. I found a way to create volatile table in teradata with this sas dataset but since the dataset is also so big that it may not be efficient to create volatile table.
Please suggest me the options to join this sas dataset to this large teradata reference table. Any suggestions will be highly appreciated.

Thanks,
Nick

Re: Joining sas dataset with teradata table

SASKiwi — Mon, 02 Nov 2020 01:48:51 GMT

How many rows are in your SAS table? How many columns are you joining into your SAS table from Teradata? If your SAS table is significantly smaller than the Teradata one it would make sense to load that into Teradata as a volatile table and join to your Teradata table. Where is the result table going?

Re: Joining sas dataset with teradata table

ChrisNZ — Mon, 02 Nov 2020 02:15:51 GMT

So you have a number of key values for which you want to retrieve data in Teradata?

How many values? And how many records do you expect back? One record per key value?

Re: Joining sas dataset with teradata table

nickspencer — Mon, 02 Nov 2020 10:28:11 GMT

@SASKiwi my SAS table has around 100k records. Do you think it might be a good idea to load them to the teradata volatile table ?

Re: Joining sas dataset with teradata table

SASKiwi — Mon, 02 Nov 2020 18:50:55 GMT

@nickspencer - Yes. To me it makes sense to load the smaller table to where the larger one is. Is your result table being used in SAS or somewhere else?