SAS DATA Migration In General

Reply
Contributor
Posts: 30

SAS DATA Migration In General

Hi,

 

We are working on a plan to migrate SAS Applications from Unix (AIX 7.1 and SAS 9.4)  to Linux (RedHat RHEL 7.4 and SAS 9.4). As part of this, the data is also to be migrated.  There are many ways to migrate SAS data. We have around 40 TB data to be migrated.

 

Any idea how long would it take , as a sample , to migrate 5GB of data.  I vividly remember that it has taken me around 8 hours for  2GB data from Mainframes to Linux using PROC CPORT  and PROC CIMPORT. This I have done 2 years ago.

 

Any suggestions  regarding the data migration would really be helpful. How can the data of this volume can be migrated the best possible way.   This data has  normal sas datasets , spd datasets , catalogs and program files.    Program files should not take much time as they are just like ordinary files, which do not require  any additional work with SAS Procedures.

 

 

Thanks,

SAS Moderator
Posts: 70

Re: SAS DATA Migration In General [how to improve your question]

Posted in reply to vijayanand

Hello @vijayanand,


Your question requires more details before experts can help. Can you revise your question to include more information? 

 

Review this checklist:

  • Specify a meaningful subject line for your topic.  Avoid generic subjects like "need help," "SAS query," or "urgent."
  • When appropriate, provide sample data in text or DATA step format.  See this article for one method you can use.
  • If you're encountering an error in SAS, include the SAS log or a screenshot of the error condition. Use the Photos button to include the image in your message.
    use_buttons.png
  • It also helps to include an example (table or picture) of the result that you're trying to achieve.

To edit your original message, select the "blue gear" icon at the top of the message and select Edit Message.  From there you can adjust the title and add more details to the body of the message.  Or, simply reply to this message with any additional information you can supply.

 

edit_post.png

SAS experts are eager to help -- help them by providing as much detail as you can.

 

This prewritten response was triggered for you by fellow SAS Support Communities member @KurtBremser

.
Super User
Posts: 10,623

Re: SAS DATA Migration In General

Posted in reply to vijayanand

Forget the previous message, I must somehow have clicked onto the wrong space while the page was loading.

---------------------------------------------------------------------------------------------
Maxims of Maximally Efficient SAS Programmers
How to convert datasets to data steps
How to post code
Super User
Posts: 10,623

Re: SAS DATA Migration In General

Posted in reply to vijayanand

Now to the real answer: you will have to do a proc cport/proc cimport because of the different processor architecture.

The main bottleneck IMO will be the physical transfer of the cport files from one server to the other. Unless you can do that via some kind of shared storage volume, this will go over the network and be limited by your ethernet bandwidth.

Make sure that you have several file copies running in parallel; I've found that single sftp transfers do not saturate the available bandwidth, but multiple copies can.

Ideally, you set up a process where you have sufficent file transfers running all the time, and start cimporting in the target as soon as you have a first package available. Have a string of cports running permanently on the source server, as long as you have space available.

 

 

---------------------------------------------------------------------------------------------
Maxims of Maximally Efficient SAS Programmers
How to convert datasets to data steps
How to post code
Ask a Question
Discussion stats
  • 3 replies
  • 50 views
  • 0 likes
  • 3 in conversation