How can we explain the sudden 25% drop in daily active users for Built Technologies's project monitoring dashboard over the past two weeks?

Introduction

The sudden 25% drop in daily active users for Built Technologies's project monitoring dashboard over the past two weeks is a critical issue that demands immediate attention. This analysis will systematically identify, validate, and address the root cause while considering both short-term and long-term implications for the product and business.

I'll approach this problem by first clarifying key details, ruling out external factors, and then diving deep into product understanding, metric breakdown, and data analysis. From there, I'll form hypotheses, conduct root cause analysis, and propose validation methods and solutions.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be a recent product change. Has there been any significant update or feature release in the past month?

Why it matters: Recent changes often correlate with sudden metric shifts. Expected answer: Yes, a new UI was rolled out two weeks ago. Impact on approach: If true, I'd focus on UI/UX issues in my analysis.

• Considering user segments, I'm curious about the distribution of the drop. Is the 25% decrease uniform across all user types, or is it more pronounced in certain segments?

Why it matters: Helps identify if the issue is global or segment-specific. Expected answer: The drop is more significant among less frequent users. Impact on approach: I'd investigate factors affecting casual users' engagement.

• Given the nature of project monitoring, I'm wondering about any changes in the construction industry. Have there been any major economic shifts or regulatory changes in the past month?

Why it matters: External factors could explain user behavior changes. Expected answer: No significant industry changes noted. Impact on approach: I'd focus more on internal factors if this is the case.

• Thinking about data integrity, I want to confirm our measurement systems. Has there been any change in how we track or define daily active users recently?

Why it matters: Ensures we're not dealing with a data anomaly. Expected answer: No changes to tracking or definitions. Impact on approach: If changed, I'd scrutinize the new measurement system.