How can we explain the unexpected 25% decline in active users for Loblaw Digital's PC Optimum rewards app during the last quarter?

Introduction

The unexpected 25% decline in active users for Loblaw Digital's PC Optimum rewards app during the last quarter is a significant issue that requires thorough investigation. To address this problem, I'll employ a systematic approach to identify, validate, and address the root cause while considering both immediate and long-term implications for the product and business.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be seasonality at play. Has this decline been observed in previous years during the same quarter?

Why it matters: Seasonal patterns could explain the drop and inform our solution approach. Expected answer: No, this decline is unusual for this quarter. Impact on approach: If seasonal, we'd focus on adapting to cyclical trends; if not, we'd investigate other factors.

• Considering user segments, I'm curious about the distribution of the decline. Is the 25% drop uniform across all user groups, or are certain segments more affected?

Why it matters: Identifying disproportionately affected segments could point to specific issues or changes impacting those users. Expected answer: The decline is more pronounced among younger users and new sign-ups. Impact on approach: We'd focus on recent changes affecting new user onboarding and features popular with younger demographics.

• Thinking about recent changes, have there been any significant updates to the app or the rewards program in the past 3-6 months?

Why it matters: Recent changes could directly correlate with the user decline if they negatively impacted user experience. Expected answer: Yes, we implemented a new UI and changed some reward redemption rules. Impact on approach: We'd scrutinize these changes and their potential impact on user engagement and satisfaction.

• Considering data integrity, I'm wondering if there have been any changes to how we measure or define active users recently?

Why it matters: Ensuring consistent measurement is crucial for accurate problem identification. Expected answer: No changes to measurement or definition. Impact on approach: If changed, we'd need to recalibrate our analysis; if not, we can focus on actual user behavior changes.