What is the cheapest cost per conversation possible?

Around $0.04 to $0.06 with Haiku-class models, no RAG, short turns. Quality typically lower.

Will costs drop further?

Yes. Frontier model token prices have dropped 80% in 24 months. Expect another 40 to 60% drop by 2027.

Blog · Pricing · 11 min read · May 18, 2026

AI Chatbot Cost Per Conversation: 2026 Honest Breakdown

The headline price of an AI chatbot platform tells you almost nothing. The number that matters is cost per conversation, and that depends on length, model choice, RAG depth, and your team's deflection rate. This is the honest 2026 breakdown.

The four cost components

LLM tokens

Input + output tokens × model price. Often the largest variable cost.

Embedding + retrieval

Embeddings, vector store, rerank API.

Infra

Compute, storage, ingress / egress.

Platform margin

Vendor markup that covers product, support, sales.

Realistic per-conversation costs

Component

Typical cost (per conversation)

LLM tokens (mixed model)

$0.018 to $0.06

Embedding + RAG

$0.0008 to $0.003

Tool call APIs (CRM, etc)

$0.0 to $0.01

Vendor margin

$0.04 to $0.10

Total all-in

$0.06 to $0.18

Why the range is so wide

Model choice (GPT-4o vs Haiku-class, 6x difference).
Conversation length (1 turn vs 8 turns).
RAG depth (small KB vs 5,000 doc corpus).
Whether tool calls hit external paid APIs.
Whether cache hits, repeat questions are 90% cheaper.

The deflection ROI math

A human-handled support ticket costs $4 to $9 fully loaded. AI deflects at $0.06 to $0.18. Even at 50% deflection, the ROI is dramatic. The gating factor is rarely cost; it is content quality and integration depth.

How vendors price

Per-conversation. Linear, predictable. Best when volume is consistent.
Per-seat. Flat. Best when conversation volume is high relative to seats.
Per-resolution. Pay for "solved" chats. Best aligned with outcomes, hardest to count fairly.
Per-MAU. Pay per monthly active user. Common in product-led SaaS.

How to predict your bill

Start with monthly chat volume. Multiply by average turns. Apply per-conversation cost from the table. Add vendor seat / minimum fees. The result is your monthly all-in. Get this in writing from any vendor before signing.