What caused the sudden 30% decrease in daily active users for Khan Academy's mobile app last week?

Introduction

The sudden 30% decrease in daily active users for Khan Academy's mobile app last week is a critical issue that demands immediate attention. As we analyze this product problem, I'll employ a systematic framework to identify, validate, and address the root cause while considering both short-term and long-term implications.

My approach will involve a thorough examination of potential factors, data analysis, and hypothesis generation. We'll explore technical, user behavior, and external elements that could contribute to this significant drop in engagement. Throughout this process, I'll prioritize data-driven decision-making and cross-functional collaboration to ensure a comprehensive understanding of the situation.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking this could be related to a recent app update. Has there been any significant update or change to the app in the past week or two?

Why it matters: Recent changes often correlate with sudden metric shifts. Expected answer: Yes, there was an update two weeks ago. Impact on approach: If confirmed, we'd focus on changes in that update.

• Considering user segments, I'm curious about the distribution of this decrease. Is the 30% drop uniform across all user segments, or are certain groups more affected?

Why it matters: Helps identify if the issue is global or segment-specific. Expected answer: The decrease is more pronounced in the student segment. Impact on approach: We'd prioritize investigating student-specific features or behaviors.

• Given the nature of educational apps, I'm wondering about the academic calendar. Are we in a period of significant academic transitions, like the end of a semester or school year?

Why it matters: Educational app usage often correlates with academic cycles. Expected answer: It's mid-semester for most regions. Impact on approach: If confirmed, we'd look more closely at content relevance and user needs during this period.

• Considering potential technical issues, have there been any reported server outages, slow performance, or sync problems in the past week?

Why it matters: Technical issues can significantly impact user engagement. Expected answer: No major outages, but some users reported slow video loading. Impact on approach: We'd investigate video delivery infrastructure and content delivery networks.