DataOpsWeek - Continuous delivery

[#1]

Introduction

In January 2024, we held a #DataOpsWeek event with the aims of showcasing our work, learning from our colleagues and building the SAS DataOps community. Each day had a theme, based on Alexey Vodilin's 5 pillars for a successful DataOps strategy blog. Our third theme of the week was " Continuous delivery".

Continuous delivery

Alexey says:

"Finally, the speed and quality of content promotion between development and production environments are crucial in accelerating the analytics lifecycle. Implementing an automated continuous integration/continuous delivery (CI/CD) approach (in cooperation with testing automation) reduces the time needed to deliver and embed data pipelines, machine learning models and decisions into production and reduces the probability of errors caused by manual interventions.

Though automation is crucial here it should also be possible to incorporate the functionality of manual approvals and enable additional validation as part of this process. The ability to version continuous delivery pipelines should also be supported."

Top Continuous delivery resources 

Webinar:

• Applying Continuous Delivery to Industrialize Data Pipeline Deployment – Neil Griffin, Kunal Shah, Alexey Vodilin

DevOps:

• Powering disruption: A DevOps journey at SAS - Billy Dickerson, Connie Dunbar

Azure DevOps:

• Configure a SAS Viya Self-Hosted Agent with Azure Pipelines – Bogdan Teleuca
• How to Automate Model Deployment with SAS Viya and Azure DevOps – Bogdan Teleuca
• How to Create a SAS Viya Docker Agent for Azure DevOps – Bogdan Teleuca

Bitbucket:

• DevOps Lifecycle with SAS Viya Studio Git Plug-in and Bitbucket – Achal Patel

SAS Studio:

• How To Get the Code From a SAS Studio Flow and Why It Matters – Bogdan Teleuca
• How to Get the Code From a SAS Studio Flow Using Python – Bogdan Teleuca

SAS Viya CLI:

• The Easiest Way to Run a SAS Studio Flow in Batch – Bogdan Teleuca

SAS Visual Analytics:

• Storing web pages on GitHub for consumption inside the SAS Visual Analytics Data-Driven Content – Xavier Bizoux

ModelOps:

• Get started with ModelOps now – Sophia Rowland

SAS Container Runtime:

• Easily Promote and Use Containerized Model Deployments – Sophia Rowland

Summary

The day brought us many interesting discussions about automation, the reasons why we do it, or why we still choose to apply changes manually (we’d love to hear about your experiences!), and lots of useful content to help you build your own pipelines. But to sum up the day, I’ll borrow Jan Kostrubiec’s advice:

You can find resources from our other DataOpsWeek themes here:

1. Collaboration
2. Orchestration 
3. Continuous delivery (this blog)
4. Testing automation
5. Environmental management