Weekly active users of North fell from 62% to 41% of seats after a telecom customer expanded from 2,000 to 12,000 seats. Why?

Introduction

A large Canadian telecom customer expanded its North deployment from a 2,000-seat pilot in customer care to 12,000 seats across sales, network operations and corporate functions. Three weeks after the expansion, weekly active users (WAU) as a share of licensed seats fell from 62% to 41%, a drop of roughly a third. The customer's CIO has asked Cohere's account team why, and the renewal conversation starts in four months.

This is a classic enterprise root cause analysis question with a twist: a metric that is a ratio can fall because the denominator grew, because the numerator shrank, or both. I'll clarify the situation, rule out external factors, map the user journey, break down the metric, form and test hypotheses, and propose a resolution plan.

Step 1

Clarifying Questions (3 minutes)

• Is the drop in the ratio, the absolute number, or both?

Why it matters: A ratio can fall simply because 10,000 new seats were added and haven't activated yet. Expected answer: Absolute WAU rose from about 1,240 to 4,900, but the ratio fell from 62% to 41%. Within the original 2,000 pilot users, WAU also fell from 62% to 54%. Impact on approach: There are two problems: slow activation of new users, and a real decline among pilot users.

• Did anything change in the product or deployment at the same time?

Why it matters: Expansions often come with configuration changes. Expected answer: The customer added three new data connectors (Salesforce, ServiceNow and a network-operations wiki) and upgraded to a newer North release. Impact on approach: Retrieval quality and permissions become prime suspects.

• How were new users onboarded?

Why it matters: Rollout quality strongly affects activation. Expected answer: An all-staff email with a login link and a 20-minute recorded video. The pilot had in-person training and team champions. Impact on approach: Activation of new cohorts may be the main driver of the ratio drop.

• Is the decline concentrated in a region, department or language?

Why it matters: Narrows the search. Expected answer: Unknown yet; the customer has French and English users. Impact on approach: Segment by department and language early.