Why has Finder's credit card comparison tool seen a 20% drop in user engagement over the past month?

Introduction

The recent 20% drop in user engagement for Finder's credit card comparison tool is a critical issue that demands immediate attention. As we delve into this product execution problem, we'll employ a systematic approach to identify, validate, and address the root cause while considering both short-term fixes and long-term strategic implications.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be a seasonal component. Has this 20% drop been compared to the same period last year?

Why it matters: Seasonal fluctuations could explain the engagement drop without indicating a deeper problem. Expected answer: No significant seasonal pattern observed in previous years. Impact on approach: If seasonal, we'd focus on strategies to mitigate annual dips; if not, we'd investigate recent changes or external factors.

• Considering user segments, I'm curious if this drop is uniform across all user types. Have we seen any particular user segment more affected than others?

Why it matters: Identifying specific affected segments could point to targeted issues or changes impacting certain users. Expected answer: The drop is more pronounced among mobile users. Impact on approach: If segment-specific, we'd focus on that segment's unique journey and recent changes affecting them.

• Thinking about recent changes, I'm wondering if there have been any updates to the tool or surrounding ecosystem in the past month. Have we rolled out any new features or UI changes recently?

Why it matters: Recent changes could directly correlate with the engagement drop. Expected answer: A minor UI update was implemented three weeks ago. Impact on approach: If changes coincide with the drop, we'd scrutinize those specific alterations and their impact on user behavior.

• Considering data integrity, I'm curious about our measurement systems. Has there been any change in how we track or define user engagement in the past month?

Why it matters: Ensures we're comparing apples to apples and not facing a data anomaly. Expected answer: No changes to tracking or metric definitions. Impact on approach: If metric definitions changed, we'd need to recalibrate our analysis based on the new parameters.