Hi ,
We have a lot of tables and can choose to load them directly from the different source databases or exportet data to FTPs site. Sometimes it is small dataset but also 6 mio records.
What do you recommend to use if possible? pro and cons? eg. in relation to performance and security and other??
Thanks in advance.
From experience, unloading into a flatfile and reading that poses the least problems and has several advantages:
- the unload can be performed in the database under control of the DB when load is low, making DB admins happy
- no SAS license for ACCESS to RDBMS is needed
- no DB client needs to be installed and maintained on the SAS server
For optimum performance, I would do the unload (inlcuding storing the flatfile) on the DB server, and retrieve the file with filename FTP from there; this necessitates only one network transfer, which is usually the bottleneck. Using a third (FTP) host moves the data over the network twice.
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Learn how use the CAT functions in SAS to join values from multiple variables into a single value.
Find more tutorials on the SAS Users YouTube channel.