What caused the sudden 15% drop in new user activations for Superhuman's mobile app last week?

Introduction

The sudden 15% drop in new user activations for Superhuman's mobile app last week is a critical issue that demands immediate attention. As we analyze this product challenge, I'll employ a systematic framework to identify, validate, and address the root cause while considering both short-term fixes and long-term strategic implications.

My approach will involve a thorough examination of potential factors, data analysis, and hypothesis generation. We'll explore technical, user behavior, and external elements that could contribute to this activation decline. Throughout this process, I'll prioritize data-driven decision-making and cross-functional collaboration to ensure a comprehensive understanding of the problem and its solutions.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be a specific event or change that triggered this drop. Has there been any recent product updates or changes to the onboarding flow in the past two weeks?

Why it matters: Identifying recent changes can quickly pinpoint potential causes. Expected answer: Yes, we rolled out a new onboarding flow last week. Impact on approach: If confirmed, we'd focus on analyzing the new flow's impact on user behavior.

• Considering the specificity of the drop, I'm curious about the affected user segments. Are we seeing this 15% drop consistently across all user demographics and acquisition channels?

Why it matters: Understanding if the issue is universal or specific to certain groups can narrow our focus. Expected answer: The drop is more pronounced in users acquired through organic channels. Impact on approach: We'd investigate factors specific to organic acquisition and those users' expectations.

• Given the mobile app focus, I'm wondering about potential technical issues. Have we noticed any increase in app crashes or performance issues coinciding with this activation drop?

Why it matters: Technical problems can significantly impact user experience and activation rates. Expected answer: There's been a slight increase in crash reports for iOS devices. Impact on approach: We'd prioritize investigating iOS-specific issues and their potential impact on activations.

• Considering external factors, I'm curious if there have been any significant competitor actions or market changes in the email productivity space recently?

Why it matters: External market forces can influence user behavior and adoption rates. Expected answer: A major competitor launched a new feature set last week. Impact on approach: We'd analyze the competitor's offering and its potential impact on user perceptions and choices.