Turn the AI on
1
Open Settings → AI
The card’s header shows how many replies the AI has sent this month against your cap, for example
120 / 2000 replies this month.2
Switch on Answer new chats with AI
When it’s on, the AI answers new website chats from your Knowledge, with citations, and hands off to your team when it can’t help.
3
Pick a model provider and save
Workers AI works with no setup. See Providers for the others.
What “off” means
- A new chat started while the AI is off goes straight to your team, and round robin assigns it if you use it (see Assignment).
- A chat the AI was already answering is handed to your team on the visitor’s next message. The visitor sees the usual handoff notice, and the reason is “AI replies are turned off.” Reports don’t count this as the AI handing off.
- The AI chats on the Agent page (editing a task, action or widget by chat) need the AI on. They say “Turn on the AI first” otherwise.
Providers
The provider is workspace-wide: every AI job runs on it.- Workers AI (default)
- OpenAI API key
- Sign in with ChatGPT
Workers AI (built in, no key needed) runs on Cloudflare’s own models through the Worker’s AI binding. Nothing to sign up for.The default model is
@cf/mistralai/mistral-small-3.1-24b-instruct. It was picked because it’s fast, follows the rules and calls tools well in the project’s own benchmark (scripts/bench-models.ts).Knowledge search always uses Workers AI, whatever the provider:
@cf/baai/bge-m3 embeds your docs and the visitor’s question, and @cf/baai/bge-reranker-base reranks the results. If embedding fails, keyword search still finds answers. See Knowledge.Choose a model
Model is optional. Leave it empty to use the provider’s default, shown as the placeholder. Type any model id the provider serves to use that one instead (up to 100 letters, digits and. : / @ - _).
The Instructions page shows the model that replies to visitors, read-only, with this month’s reply count.
Model per job
Every AI call names its job. Open Advanced: model per task to give a job its own model from the same provider, for example a small fast model for nudges.
How a job’s model is picked:
- The model you typed for that job, if any.
- Else the job’s own default for the provider. Only Agent page editing has one:
gpt-6-astraon OpenAI and ChatGPT, because it writes whole files. Its field shows this as the placeholder. - Else the workspace model above.
Monthly reply cap
Monthly reply cap limits how many replies the AI sends to visitors in a calendar month (UTC). The default is 2,000. Any whole number from 0 to 1,000,000 works; 0 stops the AI replying at all. Only the AI’s replies in live chats count toward the cap. Briefs, topics, follow-up questions, tests and editing don’t. When the cap is reached:- The AI never goes silent. Its next chat is handed to your team, and the visitor sees “Our assistant isn’t available right now, but a teammate will reply right here.”
- The Agent page’s AI chats stop until next month.
- Topic labels and suggested-question drafts are skipped, nudges and AI-written page openers fall back to a fixed line, and issue drafts use a template.
Usage
The card’s header and the Instructions page show this month’s replies against the cap. The desk also adds up input and output tokens per month for visitor replies, topic labels, suggested-question drafts, task test chats and Agent page edits.Keep it in git
Below the AI replies card, Keep it in git has the commands to pull the agent’s files into a checkout of the repo, run the tests and push them back. See Agent as code and the CLI. Whether the AI is on, the model, the model per job and the monthly cap are also indesk.yaml under ai; the card’s Also in desk.yaml · View code link opens it. The provider, keys and the ChatGPT sign-in stay out of the file. See desk.yaml.
Add your knowledge
Give the AI your docs, files and snippets to answer from.
Write the instructions
Set its tone and when it hands over.
When the AI hands off
Every reason a chat goes to your team.
Secrets
OPENAI_API_KEY, OPENAI_BASE_URL and action keys.