Vercel AI SDK runtime hooks, chat transports, and message conversion utilities for assistant-ui React applications.
API Reference
AISDKToolkit
AISDKToolkitconstructor?: (options: AISDKToolkitOptions) => AISDKToolkit#toolkit?: Toolkit#mcpClients?: Map<string, Promise<MCPClient>>tools?: (options: AISDKToolkitToolsOptions = {}) => Promise<ToolSet>close?: () => Promise<void>#mcpTools?: () => Promise<ToolSet>#mcpClient?: (name: string, config: McpServerConfig) => Promise<MCPClient>
AssistantChatTransport
AssistantChatTransportconstructor?: (initOptions?: AssistantChatTransportInitOptions<UI_MESSAGE>) => AssistantChatTransportsetRuntime?: (runtime: AssistantRuntime) => voidgetResumableAdapter?: () => AssistantChatResumableOptions__internal_setGetThreadListItem?: (getter: () => InitializableThreadListItem) => void
createResumableSessionStorage
sessionStorage-backed storage for the pending resumable stream id.
createResumableSessionStorageoptions?: { key?: string; }key?: string
frontendTools
const frontendTools: (tools: Record<string, ToolJSONSchema>) => ToolSet;generativeTools
Deprecated. Use AISDKToolkit instead:
new AISDKToolkit({ toolkit }).tools({ frontend }). It is a strict superset
(it also opens MCP server connections), so it replaces generativeTools
everywhere. The frontendTools option is named frontend on .tools(), and
.tools() is async. generativeTools will be removed in a future version.
Builds an AI SDK ToolSet for server-side use with streamText /
generateText from a generative toolkit and the frontend-uploaded tools.
Each toolkit tool's execute runs on the server. Pair this with the
"use generative" compiler: import the toolkit in a server route (where it
resolves to the server build — schema + execute, with render stripped) and
pass it here. Tools without an execute are still exposed to the model but
left for the client to fulfill. frontendTools lets the client contribute
tools that aren't in the static toolkit.
// Define once at module scope so any MCP connections pool across requests.
const aiToolkit = new AISDKToolkit({ toolkit: docsToolkit });
// In your route handler:
const { tools } = await req.json();
streamText({
model,
messages,
tools: await aiToolkit.tools({ frontend: tools }),
});const generativeTools: (options: GenerativeToolsOptions) => ToolSet;getThreadMessageTokenUsage
getThreadMessageTokenUsagemessage: TokenUsageExtractableMessagerole?: stringmetadata?: unknown
injectQuoteContext
Injects quote context into messages as markdown blockquotes.
Use this in your route handler before convertToModelMessages so the LLM
sees the quoted text that the user is referring to.
import { convertToModelMessages, streamText } from "ai";
import { injectQuoteContext } from "@assistant-ui/react-ai-sdk";
export async function POST(req: Request) {
const { messages } = await req.json();
const result = streamText({
model: myModel,
messages: await convertToModelMessages(injectQuoteContext(messages)),
});
return result.toUIMessageStreamResponse();
}injectQuoteContextmessages: UIMessage<unknown, UIDataTypes, UITools>[]
RESUMABLE_STREAM_ID_HEADER
const RESUMABLE_STREAM_ID_HEADER: "x-resumable-stream-id";useAISDKRuntime
useAISDKRuntimechatHelpers: UseChatHelpers<UI_MESSAGE>id: stringThe id of the chat.
setMessages: (messages: UI_MESSAGE[] | ((messages: UI_MESSAGE[]) => UI_MESSAGE[])) => voidUpdate the `messages` state locally. This is useful when you want to edit the messages on the client, and then trigger the `reload` method manually to regenerate the AI response.
error?: Errorname: stringmessage: stringstack?: stringcause?: unknown
status: ChatStatusHook status: - `submitted`: The message has been sent to the API and we're awaiting the start of the response stream. - `streaming`: The response is actively streaming in from the API, receiving chunks of data. - `ready`: The full response has been received and processed; a new user message can be submitted. - `error`: An error occurred during the API request, preventing successful completion.
addToolResultdeprecated: ChatAddToolOutputFunction<UI_MESSAGE>Deprecated: Use addToolOutput
stop: () => Promise<void>Abort the current request immediately, keep the generated tokens if any.
messages: UI_MESSAGE[]sendMessage: (message?: (CreateUIMessage<UI_MESSAGE> & { text?: never; files?: never; messageId?: string; }) | { text: string; files?: FileList | FileUIPart[]; metadata?: InferUIMessageMetadata<UI_MESSAGE>; parts?: never; messageId?: string; } | { files: FileList | FileUIPart[]; metadata?: InferUIMessageMetadata<UI_MESSAGE>; parts?: never; messageId?: string; }, options?: ChatRequestOptions) => Promise<void>Appends or replaces a user message to the chat list. This triggers the API call to fetch the assistant's response. If a messageId is provided, the message will be replaced.
regenerate: ({ messageId, ...options }?: { messageId?: string; } & ChatRequestOptions) => Promise<void>Regenerate the assistant message with the provided message id. If no message id is provided, the last assistant message will be regenerated.
resumeStream: (options?: ChatRequestOptions) => Promise<void>Attempt to resume an ongoing streaming response.
addToolOutput: ChatAddToolOutputFunction<UI_MESSAGE>addToolApprovalResponse: ChatAddToolApproveResponseFunctionclearError: () => voidClear the error state and set the status to ready if the chat is in an error state.
adapter?: AISDKRuntimeAdaptersuggestions?: readonly ThreadSuggestion[]isDisabled?: booleanWhether the entire thread is disabled. When `true`, the composer's input is also disabled (the user cannot type, attach files, or submit). For a narrower gate that keeps the input usable but blocks only sending, use `isSendDisabled`.
isSendDisabled?: booleanWhether sending new messages is currently disabled. When `true`, the thread composer's input remains usable but `send()` becomes a no-op and the thread composer's `canSend` is `false`. Use this to gate sending on external React state (e.g. while tool config is loading) without disabling the input itself the way `isDisabled` does. Edit composers (saving message edits) intentionally ignore this flag.
unstable_capabilitiesunstable?: AISDKRuntimeAdapter["unstable_capabilities"]copy?: boolean
adapters?: (NonNullable<ExternalStoreAdapter["adapters"]> & { history?: ThreadHistoryAdapter | undefined; })attachments?: AttachmentAdapteraccept: stringadd: (state: { file: File; }) => Promise<PendingAttachment> | AsyncGenerator<PendingAttachment, void>remove: (attachment: Attachment) => Promise<void>send: (attachment: PendingAttachment) => Promise<CompleteAttachment>
speech?: SpeechSynthesisAdapterspeak: (text: string) => SpeechSynthesisAdapter.Utterance
dictation?: DictationAdapterlisten: () => DictationAdapter.SessiondisableInputDuringDictation?: boolean
voice?: RealtimeVoiceAdapterconnect: (options: { abortSignal?: AbortSignal; }) => RealtimeVoiceAdapter.Session
feedback?: FeedbackAdaptersubmit: (feedback: FeedbackAdapterFeedback) => void
threadListdeprecated?: ExternalStoreThreadListAdapterDeprecated: This API is still under active development and might change without notice.
threadIddeprecated?: stringDeprecated: This API is still under active development and might change without notice.
isLoading?: booleanthreads?: readonly ExternalStoreThreadData<"regular">[]archivedThreads?: readonly ExternalStoreThreadData<"archived">[]onSwitchToNewThreaddeprecated?: (() => Promise<void> | void)Deprecated: This API is still under active development and might change without notice.
onSwitchToThreaddeprecated?: ((threadId: string) => Promise<void> | void)Deprecated: This API is still under active development and might change without notice.
onRename?: ( threadId: string, newTitle: string, ) => (Promise<void> | void)onUpdateCustom?: (( threadId: string, custom: Record<string, unknown> | undefined, ) => Promise<void> | void)onArchive?: ((threadId: string) => Promise<void> | void)onUnarchive?: ((threadId: string) => Promise<void> | void)onDelete?: ((threadId: string) => Promise<void> | void)
history?: ThreadHistoryAdapterload: () => Promise<ExportedMessageRepository & { unstable_resume?: boolean; }>resume?: (options: ChatModelRunOptions) => AsyncGenerator<ChatModelRunResult, void, unknown>append: (item: ExportedMessageRepositoryItem) => Promise<void>delete?: (items: ExportedMessageRepositoryItem[]) => Promise<void>withFormat?: <TMessage, TStorageFormat extends Record<string, unknown>>(formatAdapter: MessageFormatAdapter<TMessage, TStorageFormat>) => GenericThreadHistoryAdapter<TMessage>Required when used with `useAISDKRuntime` / `useChatRuntime`.
toCreateMessage?: CustomToCreateMessageFunctioncancelPendingToolCallsOnSend: boolean= trueWhether to automatically cancel pending interactive tool calls when the user sends a new message. When enabled (default), the pending tool calls will be marked as failed with an error message indicating the user cancelled the tool call by sending a new message.
onResume?: ExternalStoreAdapter["onResume"]Called when `runtime.thread.resumeRun(config)` is invoked. When omitted, `resumeRun` throws `"Runtime does not support resuming runs."`. Provide this to bridge resume invocations into a custom replay channel (for example, an SSE reconnect endpoint keyed by turn id).
joinStrategy?: JoinStrategyHow consecutive assistant messages are rendered. `"concat-content"` (the default) merges them into a single thread message. `"none"` keeps each assistant message as its own thread message, which is useful when a backend persists proactive or consecutive assistant messages as separate entries.
useChatRuntime
useChatRuntimeoptions?: UseChatRuntimeOptions<UI_MESSAGE>id?: stringA unique identifier for the chat. If not provided, a random one will be generated.
messageMetadataSchema?: FlexibleSchema<InferUIMessageMetadata<UI_MESSAGE>>dataPartSchemas?: UIDataTypesToSchemas<InferUIMessageData<UI_MESSAGE>>messages?: UI_MESSAGE[]generateId?: IdGeneratorA way to provide a function that is going to be used for ids for messages and the chat. If not provided the default AI SDK `generateId` is used.
transport?: ChatTransport<UI_MESSAGE>sendMessages: (options: { /** The type of message submission - either new message or regeneration */ trigger: 'submit-message' | 'regenerate-message'; /** Unique identifier for the chat session */ chatId: string; /** ID of the message to regenerate, or undefined for new messages */ messageId: string | undefined; /** Array of UI messages representing the conversation history */ messages: UI_MESSAGE[]; /** Signal to abort the request if needed */ abortSignal: AbortSignal | undefined; } & ChatRequestOptions) => Promise<ReadableStream<UIMessageChunk>>Sends messages to the chat API endpoint and returns a streaming response. This method handles both new message submission and message regeneration. It supports real-time streaming of responses through UIMessageChunk events.
reconnectToStream: (options: { /** Unique identifier for the chat session to reconnect to */ chatId: string; } & ChatRequestOptions) => Promise<ReadableStream<UIMessageChunk> | null>Reconnects to an existing streaming response for the specified chat session. This method is used to resume streaming when a connection is interrupted or when resuming a chat session. It's particularly useful for maintaining continuity in long-running conversations or recovering from network issues.
onError?: ChatOnErrorCallbackCallback function to be called when an error is encountered.
onToolCall?: ChatOnToolCallCallback<UI_MESSAGE>Optional callback function that is invoked when a tool call is received. Intended for automatic client-side tool execution. You can optionally return a result for the tool call, either synchronously or asynchronously.
onFinish?: ChatOnFinishCallback<UI_MESSAGE>Function that is called when the assistant response has finished streaming.
onData?: ChatOnDataCallback<UI_MESSAGE>Optional callback function that is called when a data part is received.
sendAutomaticallyWhen?: (options: { messages: UI_MESSAGE[]; }) => boolean | PromiseLike<boolean>When provided, this function will be called when the stream is finished or a tool call is added to determine if the current messages should be resubmitted.
suggestions?: readonly ThreadSuggestion[]isDisabled?: booleanWhether the entire thread is disabled. When `true`, the composer's input is also disabled (the user cannot type, attach files, or submit). For a narrower gate that keeps the input usable but blocks only sending, use `isSendDisabled`.
isSendDisabled?: booleanWhether sending new messages is currently disabled. When `true`, the thread composer's input remains usable but `send()` becomes a no-op and the thread composer's `canSend` is `false`. Use this to gate sending on external React state (e.g. while tool config is loading) without disabling the input itself the way `isDisabled` does. Edit composers (saving message edits) intentionally ignore this flag.
unstable_capabilitiesunstable?: UseChatRuntimeOptions["unstable_capabilities"]copy?: boolean
cloud?: AssistantCloudthreads: AssistantCloudThreadscloud: anymessages: AssistantCloudThreadMessageslist: (query?: AssistantCloudThreadsListQuery) => Promise<AssistantCloudThreadsListResponse>get: (threadId: string) => Promise<CloudThread>create: (body: AssistantCloudThreadsCreateBody) => Promise<AssistantCloudThreadsCreateResponse>update: (threadId: string, body: AssistantCloudThreadsUpdateBody) => Promise<void>delete: (threadId: string) => Promise<void>
auth: UseChatRuntimeOptions["cloud"]["auth"]tokens: AssistantCloudAuthTokens
runs: AssistantCloudRunscloud: anystream: (body: AssistantCloudRunsStreamBody) => Promise<AssistantStream>report: (body: AssistantCloudRunReport) => Promise<{ run_id: string; }>
files: AssistantCloudFilescloud: anypdfToImages: (body: PdfToImagesRequestBody) => Promise<PdfToImagesResponse>generatePresignedUploadUrl: (body: GeneratePresignedUploadUrlRequestBody) => Promise<GeneratePresignedUploadUrlResponse>
telemetry: AssistantCloudTelemetryConfigenabled?: booleanbeforeReport?: (report: AssistantCloudRunReport) => AssistantCloudRunReport | nullCalled before each telemetry report is sent. Return a modified report to enrich it (e.g. add `model_id`), or return `null` to skip the report.
adapters?: AISDKRuntimeAdapter["adapters"]attachments?: AttachmentAdapteraccept: stringadd: (state: { file: File; }) => Promise<PendingAttachment> | AsyncGenerator<PendingAttachment, void>remove: (attachment: Attachment) => Promise<void>send: (attachment: PendingAttachment) => Promise<CompleteAttachment>
speech?: SpeechSynthesisAdapterspeak: (text: string) => SpeechSynthesisAdapter.Utterance
dictation?: DictationAdapterlisten: () => DictationAdapter.SessiondisableInputDuringDictation?: boolean
voice?: RealtimeVoiceAdapterconnect: (options: { abortSignal?: AbortSignal; }) => RealtimeVoiceAdapter.Session
feedback?: FeedbackAdaptersubmit: (feedback: FeedbackAdapterFeedback) => void
threadListdeprecated?: ExternalStoreThreadListAdapterDeprecated: This API is still under active development and might change without notice.
threadIddeprecated?: stringDeprecated: This API is still under active development and might change without notice.
isLoading?: booleanthreads?: readonly ExternalStoreThreadData<"regular">[]archivedThreads?: readonly ExternalStoreThreadData<"archived">[]onSwitchToNewThreaddeprecated?: (() => Promise<void> | void)Deprecated: This API is still under active development and might change without notice.
onSwitchToThreaddeprecated?: ((threadId: string) => Promise<void> | void)Deprecated: This API is still under active development and might change without notice.
onRename?: ( threadId: string, newTitle: string, ) => (Promise<void> | void)onUpdateCustom?: (( threadId: string, custom: Record<string, unknown> | undefined, ) => Promise<void> | void)onArchive?: ((threadId: string) => Promise<void> | void)onUnarchive?: ((threadId: string) => Promise<void> | void)onDelete?: ((threadId: string) => Promise<void> | void)
history?: ThreadHistoryAdapterload: () => Promise<ExportedMessageRepository & { unstable_resume?: boolean; }>resume?: (options: ChatModelRunOptions) => AsyncGenerator<ChatModelRunResult, void, unknown>append: (item: ExportedMessageRepositoryItem) => Promise<void>delete?: (items: ExportedMessageRepositoryItem[]) => Promise<void>withFormat?: <TMessage, TStorageFormat extends Record<string, unknown>>(formatAdapter: MessageFormatAdapter<TMessage, TStorageFormat>) => GenericThreadHistoryAdapter<TMessage>Required when used with `useAISDKRuntime` / `useChatRuntime`.
toCreateMessage?: CustomToCreateMessageFunctiononResume?: AISDKRuntimeAdapter["onResume"]joinStrategy?: AISDKRuntimeAdapter["joinStrategy"]
useThreadTokenUsage
function useThreadTokenUsage(): ThreadTokenUsage;