Why has the average watch time for Khan Academy's science video lessons declined by 5 minutes per session in the past quarter?

Introduction

The decline in average watch time for Khan Academy's science video lessons by 5 minutes per session in the past quarter is a concerning trend that requires thorough investigation. This analysis will systematically identify potential root causes, validate hypotheses, and propose solutions to address the issue while considering both immediate and long-term implications for Khan Academy's educational platform.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be seasonal factors at play. Has this decline coincided with any particular academic period or holiday season?

Why it matters: Seasonal patterns could explain temporary fluctuations in engagement. Expected answer: The decline doesn't align with typical seasonal patterns. Impact on approach: If seasonal, we'd focus on cyclical engagement strategies; if not, we'd investigate other factors.

• Considering user segments, I'm curious about the distribution of this decline. Is the 5-minute decrease consistent across all user groups, or are certain demographics more affected?

Why it matters: Identifying specific affected groups could pinpoint targeted issues. Expected answer: The decline is more pronounced among high school students. Impact on approach: We'd focus on tailoring content and features for the most affected segments.

• Regarding recent changes, have there been any significant updates to the video player, content structure, or recommendation algorithms in the past quarter?

Why it matters: Recent changes could directly impact user engagement. Expected answer: A new recommendation algorithm was implemented two months ago. Impact on approach: We'd investigate the algorithm's impact on content discovery and relevance.

• Thinking about content, has there been any shift in the types or complexity of science videos being produced or promoted recently?

Why it matters: Changes in content could affect user engagement and comprehension. Expected answer: There's been a push towards more advanced topics in the past quarter. Impact on approach: We'd evaluate the balance between content difficulty and user readiness.