BookmarkSubscribeRSS Feed
ANLYNG
Pyrite | Level 9

Hi ,

 

We have a lot of tables and can choose to load them directly from the different source databases or exportet data to FTPs site. Sometimes it is small dataset but also 6 mio records.

 

What do you recommend to use if possible? pro and cons? eg. in relation to performance and security and other??

 

Thanks in advance.

1 REPLY 1
Kurt_Bremser
Super User

From experience, unloading into a flatfile and reading that poses the least problems and has several advantages:

- the unload can be performed in the database under control of the DB when load is low, making DB admins happy

- no SAS license for ACCESS to RDBMS is needed

- no DB client needs to be installed and maintained on the SAS server

 

For optimum performance, I would do the unload (inlcuding storing the flatfile) on the DB server, and retrieve the file with filename FTP from there; this necessitates only one network transfer, which is usually the bottleneck. Using a third (FTP) host moves the data over the network twice.

 

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 1 reply
  • 609 views
  • 0 likes
  • 2 in conversation