topic Re: SAS DATA Migration In General in SAS Programming

SAS DATA Migration In General

vijayanand — Wed, 18 Jul 2018 08:06:58 GMT

Hi,

We are working on a plan to migrate SAS Applications from Unix (AIX 7.1 and SAS 9.4) to Linux (RedHat RHEL 7.4 and SAS 9.4). As part of this, the data is also to be migrated. There are many ways to migrate SAS data. We have around 40 TB data to be migrated.

Any idea how long would it take , as a sample , to migrate 5GB of data. I vividly remember that it has taken me around 8 hours for 2GB data from Mainframes to Linux using PROC CPORT and PROC CIMPORT. This I have done 2 years ago.

Any suggestions regarding the data migration would really be helpful. How can the data of this volume can be migrated the best possible way. This data has normal sas datasets , spd datasets , catalogs and program files. Program files should not take much time as they are just like ordinary files, which do not require any additional work with SAS Procedures.

Thanks,

Re: SAS DATA Migration In General [how to improve your question]

Community_Guide — Wed, 18 Jul 2018 08:49:29 GMT

Hello @vijayanand,

Your question requires more details before experts can help. Can you revise your question to include more information?

Review this checklist:

Specify a meaningful subject line for your topic. Avoid generic subjects like "need help," "SAS query," or "urgent."
When appropriate, provide sample data in text or DATA step format. See this article for one method you can use.
If you're encountering an error in SAS, include the SAS log or a screenshot of the error condition. Use the Photos button to include the image in your message.
It also helps to include an example (table or picture) of the result that you're trying to achieve.

To edit your original message, select the "blue gear" icon at the top of the message and select Edit Message. From there you can adjust the title and add more details to the body of the message. Or, simply reply to this message with any additional information you can supply.

SAS experts are eager to help -- help them by providing as much detail as you can.

This prewritten response was triggered for you by fellow SAS Support Communities member @Kurt_Bremser

Re: SAS DATA Migration In General

Kurt_Bremser — Wed, 18 Jul 2018 08:50:48 GMT

Forget the previous message, I must somehow have clicked onto the wrong space while the page was loading.

Re: SAS DATA Migration In General

Kurt_Bremser — Wed, 18 Jul 2018 08:57:41 GMT

Now to the real answer: you will have to do a proc cport/proc cimport because of the different processor architecture.

The main bottleneck IMO will be the physical transfer of the cport files from one server to the other. Unless you can do that via some kind of shared storage volume, this will go over the network and be limited by your ethernet bandwidth.

Make sure that you have several file copies running in parallel; I've found that single sftp transfers do not saturate the available bandwidth, but multiple copies can.

Ideally, you set up a process where you have sufficent file transfers running all the time, and start cimporting in the target as soon as you have a first package available. Have a string of cports running permanently on the source server, as long as you have space available.