Chat

chat

Methods

post/chat/stream/v9

chatV9

header Parameters
Grazie-Original-JWT: string
Optional
Response fields
Request example
200Example

Domain types

Represents a regular LLM response chunk in the stream.

ChatStreamingContent = { content, type, choiceIndex }

Represents a regular LLM response chunk in the stream.

ChatStreamingFinishMetadata = { reason, type, choiceIndex }

Finish reason metadata for LLM stream response.

ChatStreamingQuotaMetadata = { spent, type, updated }
ChatStreamingToolCall = { type, id, choiceIndex, 3 more... }

Represents a tool call LLM response chunk in the stream