DataOpsWeek - Collaboration

[#1]

Introduction

In January 2024, we held a #DataOpsWeek event with the aims of showcasing our work, learning from our colleagues and building the SAS DataOps community. Each day had a theme, based on Alexey Vodilin' s 5 pillars for a successful DataOps strategy blog. Our first theme of the week was "Collaboration".

Collaboration

Alexey says:

"With the growing demand for faster analytical insights, it's now relatively common for a few team members – whether data engineers or data scientists – to work on the same project or even the same artifact together. But accelerating the development also requires introducing proper and robust means of collaboration. One of the essential requirements when introducing a collaboration framework is the ability to track the history of changes, compare and restore different versions of artifacts, quickly resolve conflicts and develop multiple features in parallel in independent branches.

The collaboration framework should also ensure effortless sharing of assets of several types via a central shared repository so these assets can be reused in other projects and/or as part of other artifacts. It should also provide simple but structured means of communication between team members."

Top collaboration resources 

Webinar

• Improving Collaboration and Increasing Productivity With DataOps - Neil Griffin, Alexey Vodilin & Kunal Shah

SAS Studio

• How to Clone a GitHub Repository in SAS Studio Using SSH - Bogdan Teleuca
• SAS Studio Git integration - Stephen Foerster

SAS Studio Custom Steps

• SAS Studio Custom Steps repo
• Uploading all the Custom Steps
• Git Set N Go : SAS Studio Custom Steps for Git integration - Sundaresh Sankaran

SAS Model Manager

• Why It Is Easier to Publish SAS Models or Decisions to Git - Bogdan Teleuca

SAS ESP

• File-Based Versioning in SAS Event Stream Processing
• Learn SAS® Event Stream Processing Open Source Integration With Git and Grafana on Azure Marketplace - SAS Explore 2023

SAS IML

• How to use Git to share SAS programs - Rick Wicklin

Summary

My takeaway for the day was the success of the SAS Studio Custom Steps repo which promotes re-use of code and increases developer's productivity. The collaboration between members of the community now offers 70 high-quality Custom Steps, with more Steps added and improved every month.

You can find resources from our other DataOpsWeek themes here:

1. Collaboration (this blog)
2. Orchestration
3. Continuous delivery
4. Testing automation
5. Environmental management