Introduction
Cohere's Embed models convert text and images into vectors that power semantic search and retrieval for enterprise AI systems. Embed is sold per token through Cohere's API, through cloud marketplaces, and inside private deployments. The finance team flags that paid Embed token volume on the public API fell 18% month over month, while the number of paying accounts was flat. Revenue from Embed fell by a similar amount.
This is a hard root cause question because Embed usage is "lumpy" by nature. Customers embed a large document collection once (a backfill), then embed only new and changed documents afterwards. A drop could be healthy, harmful, or a measurement artefact. I'll work through it step by step.
Clarify, rule out external causes, understand how Embed is used, decompose the metric, prioritise data, form hypotheses, find the root cause, validate, decide, and resolve.
Step 1
Clarifying Questions (3 minutes)
Why it matters: Fewer tokens per request suggests behaviour change (shorter chunks, compression); fewer requests suggests lower activity. Expected answer: Requests fell 6%; tokens fell 18%. Impact on approach: Tokens per request dropped sharply, so we look at how customers call the API, not just whether they call it.
Why it matters: Internal changes are the most common cause. Expected answer: A new Embed model version became the default two months ago; the previous version's deprecation date was announced last month. Pricing was unchanged. Impact on approach: Migration behaviour is a key suspect.
Why it matters: Separates a market shift from a few large customers. Expected answer: The top 20 accounts generate 65% of Embed tokens; we haven't split the drop yet. Impact on approach: Analyse top accounts individually.
Why it matters: Customers may be moving channels rather than leaving. Expected answer: Embed usage via cloud marketplaces rose 9% in the same month. Impact on approach: Channel shift is a candidate.
Practice similar questions
Subscribe to access the full answer