Why has Khan Academy's math course completion rate dropped by 15% over the past month?

Introduction

Khan Academy's math course completion rate dropping by 15% over the past month is a significant issue that requires immediate attention. This decline could have far-reaching implications for student learning outcomes, platform engagement, and overall business metrics. To address this problem, I'll employ a systematic approach to identify, validate, and resolve the root cause while considering both short-term fixes and long-term strategic implications.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be a seasonal factor at play. Has this drop coincided with any major academic calendar events, like the start of summer break?

Why it matters: Seasonal trends can significantly impact educational platform usage. Expected answer: Yes, the drop aligns with the beginning of summer break. Impact on approach: If confirmed, we'd need to compare this drop to historical seasonal patterns.

• Considering user segments, I'm curious about the distribution of this decline. Are we seeing a uniform 15% drop across all user types, or is it more pronounced in specific groups?

Why it matters: Different user segments may require targeted solutions. Expected answer: The drop is more significant among high school students. Impact on approach: We'd focus on understanding and addressing the needs of high school users.

• Regarding recent changes, have there been any significant updates to the math course content or platform features in the past 1-2 months?

Why it matters: Recent changes could directly impact user behavior and completion rates. Expected answer: A new adaptive learning feature was implemented last month. Impact on approach: We'd investigate how this feature might be affecting course completion.

• Thinking about external factors, has there been any change in marketing strategies or partnerships that might have altered the incoming user base?

Why it matters: Changes in user acquisition can affect overall completion rates. Expected answer: No significant changes in marketing or partnerships. Impact on approach: We'd focus more on internal factors and existing user behavior.