What is the cheapest cost per conversation possible?

Around $0.04 to $0.06 with Haiku-class models, no RAG, short turns. Quality typically lower.

Will costs drop further?

Yes. Frontier model token prices have dropped 80% in 24 months. Expect another 40 to 60% drop by 2027.

Blog · Pricing · 11 min read · May 18, 2026

AI Chatbot Cost Per Conversation: 2026 Honest Breakdown

The headline price of an AI chatbot platform tells you almost nothing. The number that matters is cost per conversation — and that depends on length, model choice, RAG depth, and your team's deflection rate. This is the honest 2026 breakdown.

The four cost components

LLM tokens

Input + output tokens × model price. Often the largest variable cost.

Embedding + retrieval

Embeddings, vector store, rerank API.

Infra

Compute, storage, ingress / egress.

Platform margin

Vendor markup that covers product, support, sales.

Realistic per-conversation costs

Component

Typical cost (per conversation)

LLM tokens (mixed model)

$0.018 to $0.06

Embedding + RAG

$0.0008 to $0.003

Tool call APIs (CRM, etc)

$0.0 to $0.01

Vendor margin

$0.04 to $0.10

Total all-in

$0.06 to $0.18

Why the range is so wide

Model choice (GPT-4o vs Haiku-class — 6x difference).
Conversation length (1 turn vs 8 turns).
RAG depth (small KB vs 5,000 doc corpus).
Whether tool calls hit external paid APIs.
Whether cache hits — repeat questions are 90% cheaper.

The deflection ROI math

A human-handled support ticket costs $4 to $9 fully loaded. AI deflects at $0.06 to $0.18. Even at 50% deflection, the ROI is dramatic. The gating factor is rarely cost; it is content quality and integration depth.

How vendors price

Per-conversation. Linear, predictable. Best when volume is consistent.
Per-seat. Flat. Best when conversation volume is high relative to seats.
Per-resolution. Pay for "solved" chats. Best aligned with outcomes, hardest to count fairly.
Per-MAU. Pay per monthly active user. Common in product-led SaaS.

How to predict your bill

Start with monthly chat volume. Multiply by average turns. Apply per-conversation cost from the table. Add vendor seat / minimum fees. The result is your monthly all-in. Get this in writing from any vendor before signing.