Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Note
This document refers to the Microsoft Foundry (classic) portal.
🔄 Switch to the Microsoft Foundry (new) documentation if you're using the new portal.
Note
This document refers to the Microsoft Foundry (new) portal.
Tip
An alternate hub-focused quota article is available: Manage and increase quotas for hub resources.
Quota provides the flexibility to actively manage the allocation of rate limits across the deployments within your subscription. This article walks through the process of managing quota for your Microsoft Foundry Models (Foundry projects).
Quota provides the flexibility to actively manage the allocation of rate limits across the deployments within your subscription. This article walks through the process of managing quota for your Foundry Models (Foundry projects).
Azure uses limits and quotas to prevent budget overruns due to fraud and to honor Azure capacity constraints. It's also a good way for admins to control costs. Consider these limits as you scale for production workloads.
In this article, you learn about:
- Viewing your quotas and limits
- Requesting quota and limit increases
Foundry shared quota
Foundry provides a pool of shared quota that different users across various regions can use concurrently. Depending on availability, users can temporarily access quota from the shared pool and use the quota to perform testing for a limited amount of time. The specific time duration depends on the use case. By temporarily using quota from the quota pool, you no longer need to file a support ticket for a short-term quota increase or wait for your quota request to be approved before you can proceed with your workload.
You can use the shared quota pool for testing inferencing for Foundry Models from the model catalog. Use the shared quota only for creating temporary test endpoints, not production endpoints. For endpoints in production, you should request dedicated quota. Billing for shared quota is usage-based.
View and request quotas in Foundry portal
Use quotas to manage model quota allocation between multiple Foundry projects in the same subscription.
Sign in to Microsoft Foundry. Make sure the New Foundry toggle is off. These steps refer to Foundry (classic).
Sign in to Microsoft Foundry. Make sure the New Foundry toggle is on. These steps refer to Foundry (new).
Select Management center from the bottom of the left pane.
Select Quota from the left pane to open the quota view, where you can see the quota for the models in specific Azure regions.
To request quota from the quota view, expand any of the groupings listed in the deployment column until you see the model deployments and their associated information.
- Use the Show all quota toggle to display all quota or only the currently allocated quota.
- Use the Group by dropdown to group the list by Quota type, Region & Model, or Quota type, Model & Region, or None. The None option displays a flat list of model deployments, rather than a nested list.
- On the line entry for a given model deployment, select the pencil icon in the Quota allocation column to edit the quota allocation for the model deployment.
- Select Request quota in the Request quota column to request increases in quota for the standard deployment type.
- Use the charts along the side of the page to view more details about quota usage. The charts are interactive; hovering over a section of the chart displays more information, and selecting the chart filters the list of models. Selecting the chart legend filters the data displayed in the chart.
- Use the Provisioned Throughput link to view information about provisioned models, including a Capacity calculator that you can use to estimate the number of PTUs needed for your workload.
Sign in to Microsoft Foundry. Make sure the New Foundry toggle is off. These steps refer to Foundry (classic).
Sign in to Microsoft Foundry. Make sure the New Foundry toggle is on. These steps refer to Foundry (new).
Projects help organize your work. The project you're working on appears in the upper-left corner. If you want to create a new project, select the project name, then Create new project.
Select Operate from the upper-right navigation.
Select Quota from the left pane to land on the Quota pane. Here, you can view your quota on the Token per minute tab and view provisioned models on the Provisioned throughput unit tab.
Select any of the deployments in the list to open its details pane on the right side.
On the deployment's details pane, go to the Affiliated deployments using shared quota section. Select the pencil icon in the Actions column of the table to edit quota allocation for the deployment and free up unused quota or increase allocation as needed.
Select the Request quota button in the upper-right corner to request increases in quota for the standard deployment type.