CreateResponseRequest.Truncation Property
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
The truncation strategy to use for the model response.
auto: If the context of this response and previous ones exceeds the model's context window size, the model will truncate the response to fit the context window by dropping input items in the middle of the conversation.disabled(default): If a model response will exceed the context window size for a model, the request will fail with a 400 error.
public Azure.AI.AgentServer.Contracts.Generated.Responses.CreateResponseRequestTruncation? Truncation { get; }member this.Truncation : Nullable<Azure.AI.AgentServer.Contracts.Generated.Responses.CreateResponseRequestTruncation>Public ReadOnly Property Truncation As Nullable(Of CreateResponseRequestTruncation)