How can we explain the unexpected 20% decline in player retention rates for Skillz's Blackout Bingo app in the last two weeks?

Introduction

The unexpected 20% decline in player retention rates for Skillz's Blackout Bingo app over the last two weeks is a critical issue that demands immediate attention. To address this problem, I'll employ a systematic approach to identify, validate, and resolve the root cause while considering both short-term and long-term implications.

My analysis will follow a structured framework, beginning with clarifying questions to gather essential context. I'll then rule out basic external factors before diving deep into product understanding, metric breakdown, and data-driven hypothesis formation. This will lead to a thorough root cause analysis, validation steps, and a comprehensive resolution plan.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might have been a recent update. Has there been any significant app update or feature release in the past month?

Why it matters: Recent changes could directly impact user experience and retention. Expected answer: Yes, a major update was released three weeks ago. Impact on approach: If confirmed, I'd focus on analyzing the changes in that update.

• Considering the specificity of the decline, I'm curious about the data. Has there been any change in how we measure or define player retention?

Why it matters: Ensures we're comparing apples to apples in our metrics. Expected answer: No changes in measurement or definition. Impact on approach: If there were changes, we'd need to reassess our baseline metrics.

• Given the suddenness of the decline, I'm wondering about external events. Have there been any major competitors' actions or market shifts in the past month?

Why it matters: External factors could be driving users away from our app. Expected answer: No significant competitor actions noted. Impact on approach: If there were, we'd need to analyze our competitive positioning.

• Thinking about user segments, I'm curious if this decline is uniform. Are we seeing this 20% drop across all user segments or is it concentrated in specific groups?

Why it matters: Helps focus our investigation on potentially affected user groups. Expected answer: The decline is more pronounced in casual players. Impact on approach: We'd prioritize investigating factors affecting casual players' engagement.