DataOpsWeek - Environmental management

[#1]

Introduction

In January 2024, we held a #DataOpsWeek event with the aims of showcasing our work, learning from our colleagues and building the SAS DataOps community.  Each day had a theme, based on Alexey Vodilin' s 5 pillars for a successful DataOps strategy blog.  Our final theme of the week was "environmental management", which examined design and administration of performant compute environments.  Topics included:

• Sizing

• Integration with open source

• Portability

• Deployment automation and autoscaling, and more.

The above considerations are important in today's cloud-native computing paradigm, which focuses on ephemeral resources, modular services and scalability.

Environmental management

Alexey says:"The final pillar in enabling the DataOps strategy is the ability to quickly provision multiple rich development environments in a repeatable and flexible manner.  It allows isolating development work in individual secure sandboxes where engineers can access tools of their choice and necessary permissions for extending their sandbox as needed.  This eliminates dependencies between different versions of multiple tools and technologies that might exist when multiple environments are hosted together and can also save costs, e.g., by turning off a specific environment when needed.

This approach can also be applied to isolated continuous integration and lightweight, secure production environments."

Top environmental management resources

Here's a sampler of topics actively discussed in DataOpsWeek - Environmental Management.

Open-source Integration

Building and updating Python and R

• Using the SAS Configurator for Open Source to Build Python and R - Scott McCauley

• Using the SAS Configurator for Open Source to Add Packages to Python and R - Scott McCauley

Configuring Python & R integration

• Configuring SAS Viya for Python Integration - Scott McCauley

• Configuring SAS Viya for R Integration - Scott McCauley

Open-source interfaces

• Using PROC PYTHON to augment your SAS programs - Nicholas Robert & Beverly Brown

• Experience of an R Programmer Using the R Runner Custom Step in SAS Studio Flows - Shelby Taylor

Portability

Housekeeping SAS Content

• SAS Content Folders : Make a list (something I never do!) - Sundaresh Sankaran

• You CAN take it with you! Saving SAS Viya Content - Gerry Nelson

Move to Viya

• SAS Demo | Using CICD to Automate the Move to SAS Viya from SAS Enterprise Guide (YouTube video) - Lars Arne Skår

• Automating migration from SAS Enterprise Guide to SAS Viya - demo and sample github repository (blog) - Lars Arne Skår

Administration

REST API and SAS Viya CLI documenation

• SAS Developer Portal (REST API documentation)

• SAS Viya Platform: Using the Command-Line Interface

Security

• SAS documentation about pod security standards, as highlighted by Alexander Koller

Observability

• Why Do I Need SAS® Enterprise Session Monitor and Ecosystem Diagnostics? - Steven Sober

 

The full list

Please click on the following link for a full set of stories tagged with:  "DataOpsWeek - Environmental Management".

Summary

As noted in the final wrap up,  content was shared on various aspects of environmental management.  We were exposed to DevOps & CI/CD approaches for smooth Viya deployments, methods to migrate and port content, open-source integration, assessment of existing content, sizing considerations, workload management and REST APIs!  We also had a bit of casual fun experiencing a topic through the joy of a regional accent!

The are many good resources available to help you manage your SAS Viya environment.  In addition to the material shared above, do check out the excellent blogs by David Stern, Stephen Foerster, David Ghan, Uttam Kumar, Mary Kathryn Queen and Nicolas Robert from our Technology Transfer and Governance team.

You can find resources from our other DataOpsWeek themes here:

1. Collaboration
2. Orchestration
3. Continuous delivery
4. Testing automation
5. Environmental management (this blog)