Skip to main content

Manage budgets

Use the Budgets screen to set organization defaults and limits for users and groups.

Budget enforcement denies model requests from callers without an applicable budget. Configure an organization default before you connect the gateway to the budgets service. See Budgets and pricing for the API, model pricing, and what callers see when a budget runs out.

Set the organization default​

On the Defaults tab, set the limit and period applied to users without an explicit budget.

Group budgets​

The Group Budgets tab lists each group's Period, Budget, Used, and Utilization. Select Create Group Budget, then choose a group, daily, monthly, or yearly period, and limit. Budget periods align with the calendar.

Use Priority, called precedence in the API, to order applicable group budgets. See Which budget gets charged for the full charge order.

User budgets​

The User Budgets tab lists each user's Budget source, Period, and Limit. Default identifies the organization default, and Custom identifies an explicit user budget. Select Edit Budgets to update multiple users.

Changes take effect on the next request and preserve current-period usage. Raise an exhausted user's limit to restore access before the period resets.

Service account budgets​

The Service Accounts tab lists each service account's own Period, Budget, Used, and Utilization. Select Create Service Account Budget, then choose a service account, period, and limit. Each account has at most one budget of its own.

The organization default never funds a service account. An account spends its own budget first, then the pools of the groups it belongs to, and is refused when none has capacity. The account's Budgets tab under Service Accounts shows its budgets in the order they're charged. A group budget's Service accounts tab shows the accounts that pool funds and what each has spent.

Next steps​