Skip to Content
Anuma SDKClientInternalType AliasesOpenaiChatCompletionServiceTier

OpenaiChatCompletionServiceTier

OpenaiChatCompletionServiceTier = string

Defined in: src/client/types.gen.ts:3564 

Specifies the processing type used for serving the request.

  • If set to ‘auto’, then the request will be processed with the service tier configured in the Project settings. Unless otherwise configured, the Project will use ‘default’.
  • If set to ‘default’, then the request will be processed with the standard pricing and performance for the selected model.
  • If set to ‘flex ’ or ‘priority’, then the request will be processed with the corresponding service tier. Contact sales  to learn more about Priority processing.
  • When not set, the default behavior is ‘auto’.

When the service_tier parameter is set, the response body will include the service_tier value based on the processing mode actually used to serve the request. This response value may be different from the value set in the parameter.

Any of “auto”, “default”, “flex”, “scale”, “priority”.

Last updated on
OpenaiChatCompletionPredictionContentParamOpenaiChatCompletionStreamOptionsParam