BookmarkSubscribeRSS Feed
☑ This topic is solved. Need further help from the community? Please sign in and ask a new question.
Residentx10
Quartz | Level 8

I finally had a chance to start reading the SAS ModelOps Guide but I have these questions:

 

1. Is it true that SAS Viya cannot retrain these model types?This information is from the SAS Model Manager 14.3 User Guide

 

ModelManagement.jpg

 

ModelManagement1.jpg

 

 

2. If this can only retrain SAS/SAS Viya files is this really ModelOPS? I assumed SAS / SAS Viya could deal with all model types. Don't all models need retraining eventually? Could this possibly be a mistake/typo? Also, notice R retraining at top and bottom.

 

3. This is from the SAS Model Manager User Guide 2022.1 - 2022.3 (see below):

 

ModelManagement2.jpg

 

ModelManagement2a.jpg

 

ModelManagement2b.jpg

 

ModelManagement2c.jpg

 

ModelManagement2d.jpg

 

 

 

1 ACCEPTED SOLUTION

Accepted Solutions
SASKiwi
PROC Star

If you don't get Community responses then I'd suggest contacting SAS Tech Support as they have access to SAS's internal subject matter experts.

View solution in original post

6 REPLIES 6
Residentx10
Quartz | Level 8

4. Finally, why can't C, Java, and Matlab be scored and published?

 

ModelManagement3.jpg

 

Residentx10
Quartz | Level 8

No replies? Can SAS modelops give model pre-deployment and post-deployment performance estimates on CPU or GPU?

SASKiwi
PROC Star

If you don't get Community responses then I'd suggest contacting SAS Tech Support as they have access to SAS's internal subject matter experts.

Residentx10
Quartz | Level 8

That's the best suggestion I have heard and that's credible. I have email for support and will contact them.

Residentx10
Quartz | Level 8

Finally, does SAS or SAS Viya have an estimation procedure for pre-sizing roughly a cpu or gpu to run a model before deployment?

SophiaRowland
SAS Super FREQ

Hello @Residentx10! Let me take a stab at addressing your questions. It does look like you are referencing documentation for two different versions of Model Manager: one built on the SAS 9.4 platform and the other on Viya 4. If you would like to learn more about SAS Viya, I suggest starting here. I am not familiar with  Model Manager on SAS 9.4, but I can speak to Model Manager on Viya. First, out-of-the-box, Model Manager on SAS Viya can only automatically retrain models developed in SAS Model Studio (i.e., Visual Data Mining and Machine Learning). This is because Model Manager doesn't automatically retrain the model itself - it requests Model Studio to automatically retrain the model pipeline and register the champion model. This is because model retraining requires the model training code, whereas the code stored within Model Manager is for scoring new transactions using the trained model. Model training and model inferencing/serving/scoring are two different processes. And while the scoring code is enough to use the model, it is not enough to automatically retrain the model. I have seen people leverage another tool, SAS Workflow Manager, which is shipped with Model Manager, to create their own automated retraining process for Python models by providing the required training code and some guardrails for retraining. So while it may not be out-of-the-box, you can add customizations to support automatic retraining. Some organizations prefer automated retraining, but others prefer to retrain manually to retain finer control over the process. I see the later much more often and that route is well supported in Model Manager. 

 

Second, to score models written in specific languages, Model Manager on Viya uses an environment corresponding to that language (i.e. models written in Python run in a Python environment and models written in R run in a R environment). This allows us to work with open source models without requiring users to recode them in another language. If you notice in the documentation image you included for Model Manager on SAS 9.4, you'll see a note about Data Step set next to R. This references R models rewritten to run in SAS Data Step, not purely native R. There hasn't been a lot of requests for C, Java, and Matlab model execution, so we have focused our resources on Python and R. If you are interested in C, Java, or Matlab model execution, I encourage you to submit a feature request to document your need. 

 

I also am not aware of any tools for CPU/GPU sizing or estimation, but compared to model training, model scoring is a not a computationally intensive process. With Model Manager on SAS Viya, we offer containerized model deployments so end-users have finer control over the inferencing architecture and can take advantage of scaling to meet traffic needs. 

 

 

 

 

sas-innovate-2024.png

Available on demand!

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

 

Register now!

How to choose a machine learning algorithm

Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 6 replies
  • 1092 views
  • 1 like
  • 3 in conversation