Why has Kaiser Permanente's prescription refill mobile app experienced a sudden 20% decrease in user retention rates this week?

Introduction

Kaiser Permanente's prescription refill mobile app has experienced a sudden 20% decrease in user retention rates this week. This significant drop in retention is concerning and requires immediate attention. To address this issue, I'll employ a systematic approach to identify, validate, and address the root cause while considering both immediate and long-term implications.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking this could be related to a recent app update. Has there been any significant changes or updates to the app in the past week?

Why it matters: Recent changes often correlate with sudden metric shifts. Expected answer: Yes, there was an update last week. Impact on approach: If confirmed, we'd focus on the update's features and potential bugs.

• Considering user segments, I'm curious if this decrease is uniform across all user groups. Are we seeing any patterns in terms of age, device type, or frequency of use?

Why it matters: Segmentation helps pinpoint if the issue is widespread or specific to certain users. Expected answer: The decrease is more pronounced among older users and on iOS devices. Impact on approach: We'd prioritize investigating iOS-specific issues and usability for older users.

• Given the nature of the app, I'm wondering about any recent changes in prescription policies or healthcare regulations. Have there been any significant policy updates that might affect how users interact with the app?

Why it matters: External factors can significantly impact user behavior. Expected answer: No major policy changes, but there's been media coverage about prescription drug prices. Impact on approach: We'd consider how external narratives might be influencing user perception and behavior.

• Thinking about system performance, has there been any unusual spike in error rates or app crashes reported in the last week?

Why it matters: Technical issues often lead to decreased retention. Expected answer: There's been a slight increase in error rates, but nothing significant. Impact on approach: We'd still investigate the error logs more closely, as even small increases can impact user experience.