Introduction
In January 2024, we held a #DataOpsWeek event with the aims of showcasing our work, learning from our colleagues and building the SAS DataOps community. Each day had a theme, based on Alexey Vodilin' s 5 pillars for a successful DataOps strategy blog. Our final theme of the week was "environmental management", which examined design and administration of performant compute environments. Topics included:
Sizing
Integration with open source
Portability
Deployment automation and autoscaling, and more.
The above considerations are important in today's cloud-native computing paradigm, which focuses on ephemeral resources, modular services and scalability.
Environmental management
Alexey says:"The final pillar in enabling the DataOps strategy is the ability to quickly provision multiple rich development environments in a repeatable and flexible manner. It allows isolating development work in individual secure sandboxes where engineers can access tools of their choice and necessary permissions for extending their sandbox as needed. This eliminates dependencies between different versions of multiple tools and technologies that might exist when multiple environments are hosted together and can also save costs, e.g., by turning off a specific environment when needed.
This approach can also be applied to isolated continuous integration and lightweight, secure production environments."
Top environmental management resources
Here's a sampler of topics actively discussed in DataOpsWeek - Environmental Management.
Open-source Integration
Building and updating Python and R
Using the SAS Configurator for Open Source to Build Python and R - Scott McCauley
Using the SAS Configurator for Open Source to Add Packages to Python and R - Scott McCauley
Configuring Python & R integration
Configuring SAS Viya for Python Integration - Scott McCauley
Configuring SAS Viya for R Integration - Scott McCauley
Open-source interfaces
Using PROC PYTHON to augment your SAS programs - Nicholas Robert & Beverly Brown
Experience of an R Programmer Using the R Runner Custom Step in SAS Studio Flows - Shelby Taylor
Portability
Housekeeping SAS Content
SAS Content Folders : Make a list (something I never do!) - Sundaresh Sankaran
You CAN take it with you! Saving SAS Viya Content - Gerry Nelson
Move to Viya
SAS Demo | Using CICD to Automate the Move to SAS Viya from SAS Enterprise Guide (YouTube video) - Lars Arne Skår
Automating migration from SAS Enterprise Guide to SAS Viya - demo and sample github repository (blog) - Lars Arne Skår
Administration
REST API and SAS Viya CLI documenation
SAS Developer Portal (REST API documentation)
SAS Viya Platform: Using the Command-Line Interface
Security
SAS documentation about pod security standards, as highlighted by Alexander Koller
Observability
Why Do I Need SAS® Enterprise Session Monitor and Ecosystem Diagnostics? - Steven Sober
The full list
Please click on the following link for a full set of stories tagged with: "DataOpsWeek - Environmental Management".
Summary
As noted in the final wrap up, content was shared on various aspects of environmental management. We were exposed to DevOps & CI/CD approaches for smooth Viya deployments, methods to migrate and port content, open-source integration, assessment of existing content, sizing considerations, workload management and REST APIs! We also had a bit of casual fun experiencing a topic through the joy of a regional accent!
The are many good resources available to help you manage your SAS Viya environment. In addition to the material shared above, do check out the excellent blogs by David Stern, Stephen Foerster, David Ghan, Uttam Kumar, Mary Kathryn Queen and Nicolas Robert from our Technology Transfer and Governance team.
You can find resources from our other DataOpsWeek themes here:
Collaboration
Orchestration
Continuous delivery
Testing automation
Environmental management (this blog)
... View more