What's new in DataOps - March 2024

[#1]

What's new in DataOps 

Each month we round up what's new in the five pillars of DataOps: collaboration, orchestration, continuous delivery, testing automation and environmental management.

Highlights this month include:

• SAS Enterprise Guide v8.4 adds support for SAS Viya 4
• Containerised SAS Viya CLI
• Public documentation for the SAS Studio Development REST API. Given the location of a SAS program or the Studio flow file, this API returns the code that SAS Studio would run. This allows you to implement CI/CD pipelines with SAS Viya and your DevOps platform (GitHub, GitLab, Bitbucket, etc.)

Check out Wilbram Hazejager's SAS Enterprise Guide 8.4 update here:

Resources

SAS Studio

• What's new in SAS Studio 2024.03

REST API

• Reminder that the new developers.sas.com developer portal has launched!
• The following APIs are new / updated in the public documentation this month: 
  • CAS: casManagement
  • Compute and Jobs: compute
  • Data Management: studioDevelopment 🆕, dataQuality
  • Fraud and Compliance: detection 🆕, detectionDefinition 🆕, detectionMessageSchema 🆕
  • Models and Decisions: decisionsRuntimeBuilder 🆕, businessRules
  • Visualization and Reports: thumbnails 🆕, reportTransforms, reports

SAS Viya CLI & Plug-ins

• Command-Line Interface overview and Plug-ins
• Command-Line Interface: Instructions When Running the CLI from a Container documentation
• New and major / minor updates this month:
  • audit v1.21.x (Platform). New commands: list-activities and show-activity-info
  • cas v1.14.x (Platform)
  • dagentsrv v3.5.x (Cloud Data Exchange)
  • job v2.7.x (Platform). New command: job flows trigger available in v2.6.25+

SAS Studio Custom Steps

• SAS Studio Custom Steps repo on GitHub
• New and updated Steps available this month:
  • DQ - Match Code: Create Match Codes based on locale, using SAS QKB and dqMatch function (Lorenzo Toja / Arnold Toporowski)

  • DQ - Standardize: Create standardized values based on locale, using SAS QKB and dqStandardize function (includes support for generating masked values) (Lorenzo Toja / Arnold Toporowski)

  • Loop Deployed Object: Parallel execution of a deployed flow or a SAS program for a given set of parameter values (Remco Gooijer)

  • Loop Flow 🆕: Iteratively execute another Studio Flow, much like Loop/Loop End in SAS Data Integration Studio (Torben Juul Johansson)
  • OCR - Azure AI Document Intelligence: Uses Microsoft Azure's Document Intelligence service to perform different types of OCR for files stored in the SAS Server file system or stored on a URL (Sundaresh Sankaran / Jannic Horst)
    
    

SAS Extension for Visual Studio Code

• Extension on Marketplace and changelog
• 📺 SAS VS Code Extension | Version Update 1.7 & 1.8 on YouTube - David Weik

SAS Communities blogs

• SAS Studio DevOps: Collaborative Development of SAS Studio Flows and Programs Using Git Integration – David Ghan
• “Data-Aware” Scheduling with Airflow or How to Specify Data Dependencies in your DAGs - Nicolas Robert
• SAS Studio, SAS Studio Analyst & SAS Studio Engineer- oh my! - Gemma Robson
  • See also General Feature Comparison among SAS Studio Releases
• Using SAS Enterprise Guide with SAS Viya 4 - Beverly Brown
  
  • 📺 Check out Wilbram Hazejager's update on YouTube
  • And look back through the product's history in  Through the years: SAS Enterprise Guide versions with Chris Hemedinger

SAS Hot Fix announcements

• Git integration updates available for SAS® Studio 5.2 (on SAS Viya 3.5)