topic Re: Batch Export and Import SAS DI Jobs for entire Server in Administration and Deployment

Batch Export and Import SAS DI Jobs for entire Server

gra_in_aus — Sun, 10 Jan 2021 21:36:30 GMT

I need to migrate every SAS DI Job from Production (Linux) to our new SAS Grid Environment (Linux) circa 100,000 jobs. The migration will need to include all folders and dependencies. Is there a easier way to complete a mass migration of a whole server? Or an example of using the Batch Export and Import based on a full migration of a SAS DI Jobs from a production server?

Any help would be greatly appreciated.

Thanks

Re: Batch Export and Import SAS DI Jobs for entire Server

AnandVyas — Mon, 11 Jan 2021 01:20:30 GMT

Hi @gra_in_aus

That's a lot of jobs!! I have done export/import of around 1000+ jobs and it can get very tedious if there are failures. Few points from myside:

Suggest to break it into chunks of smaller jobs rather doing it in one shot
Make sure Metadata server is running optimally i.e. no slowness observed or file system issues
Take full cold backup of the system
It could take a long time to process so better to run it in background
Deployment directories created by users can be a lot and at different file system paths. Verify this from source and create it in the destination environment
- If there are a lot of them, better to reach out to TS to help create them automatically using code or if you can do it via code
Take a backup again after deployment to fall back incase of issues later
If you are planning to do it via multiple jobs, intermediate backups can help incase there is a failure in between jobs

Re: Batch Export and Import SAS DI Jobs for entire Server

gra_in_aus — Mon, 11 Jan 2021 22:16:25 GMT

Thanks for the info. Probably will need to raise a tech support due to the volume of jobs and flows involved.