All insights

Operations

The economics of LLM cost-per-task

November 4, 2025 · 2 min read

Cost-per-task is the single most important number in any AI deployment. Token cost, retrieval cost, eval cost, human-in-the-loop cost, infrastructure overhead — sum it. Divide by tasks completed. That is your number.

If it is bigger than what a human costs, kill the project. If it is smaller, scale it.

Want to talk through this in your context?

Start a conversation