Clickthrough rate for notifications are down by 10%. Why?

Introduction

The recent 10% decrease in clickthrough rate for notifications is a concerning trend that requires immediate attention. As we delve into this product issue, we'll employ a systematic framework to identify, validate, and address the root cause while considering both short-term fixes and long-term strategic implications.

Our approach will involve clarifying the context, ruling out external factors, understanding the product and user journey, breaking down the metric, gathering relevant data, forming hypotheses, conducting root cause analysis, and proposing validation methods and solutions.

Step 1

Clarifying Questions (3 minutes)

• What is the time frame for this 10% decrease?

Why it matters: Understanding the timeline helps identify potential correlations with recent changes or events. Hypothetical answer: The decrease occurred over the past month. Impact: A sudden drop might indicate a specific trigger, while a gradual decline could suggest a broader issue.

• Has there been any recent change in how we measure or define clickthrough rate?

Why it matters: Ensures we're comparing apples to apples and not dealing with a measurement issue. Hypothetical answer: No changes in measurement or definition. Impact: Confirms the issue is with actual performance, not data collection.

• Are all user segments equally affected, or is the decrease more pronounced in specific groups?

Why it matters: Helps narrow down potential causes and tailor solutions. Hypothetical answer: The decrease is more significant among Android users. Impact: Directs our focus towards Android-specific issues or recent Android app updates.

• Have there been any recent product updates or changes to the notification system?

Why it matters: Could directly link the issue to a specific change. Hypothetical answer: A new notification categorization feature was rolled out two weeks ago. Impact: Provides a clear starting point for investigation.