topic Re: Resource size availability error despite adequate quotas (Azure marketplace install) in SAS Viya (Pay-As-You-Go)

Resource size availability error despite adequate quotas (Azure marketplace install)

SpencerK — Tue, 18 Apr 2023 04:52:41 GMT

My deployment of SAS Viya via the Azure Marketplace is failing due to what appears to be a resource limitation that I have been unable to resolve—I need some help 🙂

The errors I am receiving during deployment involve a series of vitualMachineScaleSets, which are said to be not available in the region East US 2. They look like this:

The requested size for resource '/subscriptions/****REDACTED_SUBSCRIPTION_ID****/resourceGroups/mrg-sas-viya-on-azure-20230417212406/providers/Microsoft.Compute/virtualMachineScaleSets/aks-cas-23465321-vmss' is currently not available in location 'eastus2' zones '1'

This error recurs for the following scale sets

aks-cas-23465321-vmss
aks-compute-23465321-vmss
aks-stateful-23465321-vmss
aks-stateless-23465321-vmss
aks-system-23465321-vmss

(full message here:)

{
    "status": "Failed",
    "error": {
        "code": "ApplicationDeploymentFailed",
        "message": "The operation to create application failed. Please check operations of deployment 'viyaeast2' under resource group '/subscriptions/13eafbee-9f84-4f58-a551-a3c747360d65/resourceGroups/mrg-sas-viya-on-azure-20230417212406'. Error message: 'At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.'",
        "details": [
            {
                "code": "BadRequest",
                "message": "{\r\n  \"error\": {\r\n    \"code\": \"InvalidTemplateDeployment\",\r\n    \"message\": \"The template deployment 'viyaeast2-aks' is not valid according to the validation procedure. The tracking id is '517411a2-dcb7-44ee-879b-b55a99133ecc'. See inner errors for details.\",\r\n    \"details\": [\r\n      {\r\n        \"code\": \"PreconditionFailed\",\r\n        \"message\": \"Provisioning of resource(s) for container service initial-deployment-aks in resource group mrg-sas-viya-on-azure-20230417212406 failed. Message: Provisioning of resource(s) for container service initial-deployment-aks in resource group mrg-sas-viya-on-azure-20230417212406 failed. Message: Multiple error occurred: BadRequest,BadRequest,BadRequest,BadRequest,BadRequest. Please see details.. Details: [{\\\"code\\\":\\\"\\\",\\\"message\\\":\\\"The template deployment failed with error: 'The resource with id: '/subscriptions/****REDACTED_SUBSCRIPTION_ID****/resourceGroups/mrg-sas-viya-on-azure-20230417212406/providers/Microsoft.Compute/virtualMachineScaleSets/aks-cas-23465321-vmss' failed validation with message: 'The requested size for resource '/subscriptions/****REDACTED_SUBSCRIPTION_ID****/resourceGroups/mrg-sas-viya-on-azure-20230417212406/providers/Microsoft.Compute/virtualMachineScaleSets/aks-cas-23465321-vmss' is currently not available in location 'eastus2' zones '1' for subscription '****REDACTED_SUBSCRIPTION_ID****'. Please try another size or deploy to a different location or zones. See https://aka.ms/azureskunotavailable for details.'.'.\\\"},{\\\"code\\\":\\\"\\\",\\\"message\\\":\\\"The template deployment failed with error: 'The resource with id: '/subscriptions/****REDACTED_SUBSCRIPTION_ID****/resourceGroups/mrg-sas-viya-on-azure-20230417212406/providers/Microsoft.Compute/virtualMachineScaleSets/aks-compute-23465321-vmss' failed validation with message: 'The requested size for resource '/subscriptions/****REDACTED_SUBSCRIPTION_ID****/resourceGroups/mrg-sas-viya-on-azure-20230417212406/providers/Microsoft.Compute/virtualMachineScaleSets/aks-compute-23465321-vmss' is currently not available in location 'eastus2' zones '1' for subscription '****REDACTED_SUBSCRIPTION_ID****'. Please try another size or deploy to a different location or zones. See https://aka.ms/azureskunotavailable for details.'.'.\\\"},{\\\"code\\\":\\\"\\\",\\\"message\\\":\\\"The template deployment failed with error: 'The resource with id: '/subscriptions/****REDACTED_SUBSCRIPTION_ID****/resourceGroups/mrg-sas-viya-on-azure-20230417212406/providers/Microsoft.Compute/virtualMachineScaleSets/aks-stateful-23465321-vmss' failed validation with message: 'The requested size for resource '/subscriptions/****REDACTED_SUBSCRIPTION_ID****/resourceGroups/mrg-sas-viya-on-azure-20230417212406/providers/Microsoft.Compute/virtualMachineScaleSets/aks-stateful-23465321-vmss' is currently not available in location 'eastus2' zones '1' for subscription '****REDACTED_SUBSCRIPTION_ID****'. Please try another size or deploy to a different location or zones. See https://aka.ms/azureskunotavailable for details.'.'.\\\"},{\\\"code\\\":\\\"\\\",\\\"message\\\":\\\"The template deployment failed with error: 'The resource with id: '/subscriptions/****REDACTED_SUBSCRIPTION_ID****/resourceGroups/mrg-sas-viya-on-azure-20230417212406/providers/Microsoft.Compute/virtualMachineScaleSets/aks-stateless-23465321-vmss' failed validation with message: 'The requested size for resource '/subscriptions/****REDACTED_SUBSCRIPTION_ID****/resourceGroups/mrg-sas-viya-on-azure-20230417212406/providers/Microsoft.Compute/virtualMachineScaleSets/aks-stateless-23465321-vmss' is currently not available in location 'eastus2' zones '1' for subscription '****REDACTED_SUBSCRIPTION_ID****'. Please try another size or deploy to a different location or zones. See https://aka.ms/azureskunotavailable for details.'.'.\\\"},{\\\"code\\\":\\\"\\\",\\\"message\\\":\\\"The template deployment failed with error: 'The resource with id: '/subscriptions/****REDACTED_SUBSCRIPTION_ID****/resourceGroups/mrg-sas-viya-on-azure-20230417212406/providers/Microsoft.Compute/virtualMachineScaleSets/aks-system-23465321-vmss' failed validation with message: 'The requested size for resource '/subscriptions/****REDACTED_SUBSCRIPTION_ID****/resourceGroups/mrg-sas-viya-on-azure-20230417212406/providers/Microsoft.Compute/virtualMachineScaleSets/aks-system-23465321-vmss' is currently not available in location 'eastus2' zones '1' for subscription '****REDACTED_SUBSCRIPTION_ID****'. Please try another size or deploy to a different location or zones. See https://aka.ms/azureskunotavailable for details.'.'.\\\"}]. Details: \"\r\n      }\r\n    ]\r\n  }\r\n}"
            }
        ]
    }
}

Here's what's confusing about this

The East US 2 region has the necessary resources

East US 2 supports availability zones, as required by Viya
According to the official SAS documentation, the VM types required are DSv4 and EDSv4. Drilling down a little more specifically, this forum post documents the following VM types for a baseline install:

All of those VM types are available in East US 2:

My quotas in the East US 2 region are sufficient

So, the question is, what else could it be? Why would Azure complain that the requested resource sizes are not available, when it appears that the region, and moreover, my quotas, are sufficient? Any thoughts for troubleshooting?

Thanks for the help!

Re: Resource size availability error despite adequate quotas (Azure marketplace install)

akash1234007 — Tue, 18 Apr 2023 18:30:51 GMT

If I am interpreting the error message correctly then it should mean, the particular resource provider is not available in eastus2, zone1 for your subscription.

you can rule it out by checking the output of "az provider list" it is showing as registered then does the json have the region and zone in question listed. (if deployment is coming from Azure Marketplace, probably it should be taken care but nonetheless good to rule out)

In my case for VMSS I can see zones by regions for the VMSS resources type as below

Re: Resource size availability error despite adequate quotas (Azure marketplace install)

maperi — Tue, 18 Apr 2023 20:11:03 GMT

Hi Spencer,

Can you also please check your Subscription > Overview, and tell us your values for "My Role" and "Offer". Also, please check the Usage + Quotas again, but select "Storage" from the drop down and check to make sure you have enough quota for Storage Accounts in East US 2.

Re: Resource size availability error despite adequate quotas (Azure marketplace install)

SpencerK — Wed, 19 Apr 2023 05:33:33 GMT

"az provider list" indicates that virtualMachineScaleSets are available in the region and zone that the template was attempting to deploy in (East US 2, Zone 1).

Re: Resource size availability error despite adequate quotas (Azure marketplace install)

SpencerK — Wed, 19 Apr 2023 05:40:15 GMT

"My role" for the subscription is "Owner". Unfortunately I don't see any field called "Offer". Any idea why I might not have that visible?

My quotas for Storage Accounts in East US 2 are at what appears to be the default of 250, and my usage is only 3 of these.

Re: Resource size availability error despite adequate quotas (Azure marketplace install)

maperi — Thu, 20 Apr 2023 20:11:19 GMT

For subscription related questions, you'll want to contact Microsoft. Was mainly just confirming you weren't using a Free Trial subscription.

Have you tried using different region such as US East?

Re: Resource size availability error despite adequate quotas (Azure marketplace install)

SpencerK — Fri, 21 Apr 2023 06:58:26 GMT

I've tried deploying in West US 3, same behavior.

Re: Resource size availability error despite adequate quotas (Azure marketplace install)

maperi — Thu, 27 Apr 2023 18:17:29 GMT

There may be a policy set on your subscription that is preventing you from creating the resources required. For example, your organization may not allow creating an AKS cluster, regardless of permissions. As a test, you could try to manually create an AKS cluster and / or a Virtual Machine Scale Set. If you are still having trouble, you may want to contact your IT organization.

https://learn.microsoft.com/en-us/azure/aks/learn/quick-kubernetes-deploy-portal?tabs=azure-cli

https://learn.microsoft.com/en-us/azure/virtual-machine-scale-sets/quick-create-portal

Re: Resource size availability error despite adequate quotas (Azure marketplace install)

SpencerK — Fri, 05 May 2023 06:34:11 GMT

In my case, it turned out there was insufficient capacity in "Zone 1" of the regions that I was trying to deploy to in order to accommodate the Virtual Machine Scale Sets. After getting connected with Azure support they added enough capacity so that I could deploy.

I probably could have diagnosed this problem quicker if the Azure Marketplace template included the ability to choose the zone (the same way the terraform module does). Currently it only allows you to select the region.

Re: Resource size availability error despite adequate quotas (Azure marketplace install)

mazam — Fri, 05 May 2023 14:39:42 GMT

@SpencerK We are glad to hear you were able to deploy with the added capacity provided by Azure support. We have shared your feedback with the SAS Viya on Microsoft Azure development team. Thank you for your patience! Let us know if we can be of further assistance.