Skip to main content
Everything about which model the AI uses lives in Settings → AI, in the AI replies card. How the AI talks and when it hands over are on the Instructions page instead. Owners and admins can change these settings. Agents can see them.

Turn the AI on

1

Open Settings → AI

The card’s header shows how many replies the AI has sent this month against your cap, for example 120 / 2000 replies this month.
2

Switch on Answer new chats with AI

When it’s on, the AI answers new website chats from your Knowledge, with citations, and hands off to your team when it can’t help.
3

Pick a model provider and save

Workers AI works with no setup. See Providers for the others.
The Get started page’s AI step does the same thing in one screen and turns the AI on when you finish it.

What “off” means

  • A new chat started while the AI is off goes straight to your team, and round robin assigns it if you use it (see Assignment).
  • A chat the AI was already answering is handed to your team on the visitor’s next message. The visitor sees the usual handoff notice, and the reason is “AI replies are turned off.” Reports don’t count this as the AI handing off.
  • The AI chats on the Agent page (editing a task, action or widget by chat) need the AI on. They say “Turn on the AI first” otherwise.

Providers

The provider is workspace-wide: every AI job runs on it.
Workers AI (built in, no key needed) runs on Cloudflare’s own models through the Worker’s AI binding. Nothing to sign up for.The default model is @cf/mistralai/mistral-small-3.1-24b-instruct. It was picked because it’s fast, follows the rules and calls tools well in the project’s own benchmark (scripts/bench-models.ts).
Use the Workers Paid plan for the AI. On the Free plan a Worker gets 10 ms of CPU per request, and reading a model’s streamed answer takes far more, so AI replies and the Agent page’s AI chats fail now and then with Cloudflare’s error 1102. See Costs and limits.
Knowledge search always uses Workers AI, whatever the provider: @cf/baai/bge-m3 embeds your docs and the visitor’s question, and @cf/baai/bge-reranker-base reranks the results. If embedding fails, keyword search still finds answers. See Knowledge.

Choose a model

Model is optional. Leave it empty to use the provider’s default, shown as the placeholder. Type any model id the provider serves to use that one instead (up to 100 letters, digits and . : / @ - _). The Instructions page shows the model that replies to visitors, read-only, with this month’s reply count.

Model per job

Every AI call names its job. Open Advanced: model per task to give a job its own model from the same provider, for example a small fast model for nudges. How a job’s model is picked:
  1. The model you typed for that job, if any.
  2. Else the job’s own default for the provider. Only Agent page editing has one: gpt-6-astra on OpenAI and ChatGPT, because it writes whole files. Its field shows this as the placeholder.
  3. Else the workspace model above.
If the provider rejects a job’s model as unknown (a typo, or a model your account doesn’t serve), that call is retried once on the workspace model, so a typo doesn’t break nudges or briefs.
On ChatGPT sign-in, Suggested for ChatGPT fills in gpt-6-luna for the fast jobs (nudges, topics, briefs and follow-up questions) and leaves the rest on their defaults.

Monthly reply cap

Monthly reply cap limits how many replies the AI sends to visitors in a calendar month (UTC). The default is 2,000. Any whole number from 0 to 1,000,000 works; 0 stops the AI replying at all. Only the AI’s replies in live chats count toward the cap. Briefs, topics, follow-up questions, tests and editing don’t. When the cap is reached:
  • The AI never goes silent. Its next chat is handed to your team, and the visitor sees “Our assistant isn’t available right now, but a teammate will reply right here.”
  • The Agent page’s AI chats stop until next month.
  • Topic labels and suggested-question drafts are skipped, nudges and AI-written page openers fall back to a fixed line, and issue drafts use a template.
The counter resets at the start of each month.

Usage

The card’s header and the Instructions page show this month’s replies against the cap. The desk also adds up input and output tokens per month for visitor replies, topic labels, suggested-question drafts, task test chats and Agent page edits.

Keep it in git

Below the AI replies card, Keep it in git has the commands to pull the agent’s files into a checkout of the repo, run the tests and push them back. See Agent as code and the CLI. Whether the AI is on, the model, the model per job and the monthly cap are also in desk.yaml under ai; the card’s Also in desk.yaml · View code link opens it. The provider, keys and the ChatGPT sign-in stay out of the file. See desk.yaml.

Add your knowledge

Give the AI your docs, files and snippets to answer from.

Write the instructions

Set its tone and when it hands over.

When the AI hands off

Every reason a chat goes to your team.

Secrets

OPENAI_API_KEY, OPENAI_BASE_URL and action keys.