Why has user engagement with DataCamp's mobile app declined by 20% since the latest update two weeks ago?

Introduction

DataCamp's mobile app engagement has declined by 20% since the latest update two weeks ago, presenting a critical challenge for user retention and product success. To address this issue, I'll employ a systematic approach to identify, validate, and resolve the root cause while considering both immediate and long-term implications.

Step 1

Clarifying Questions (3 minutes)

• Considering the timing, I'm wondering if the update introduced new features or UI changes. Could you provide an overview of the main changes in the latest update?

Why it matters: Understanding the scope of changes helps pinpoint potential friction points. Expected answer: A list of key features or UI modifications. Impact on approach: Guides focus on specific areas of the app for investigation.

• Given the 20% decline, I'm curious about the distribution across user segments. Has the engagement drop been uniform across all user types, or are certain segments more affected?

Why it matters: Identifies whether the issue is widespread or concentrated in specific user groups. Expected answer: Breakdown of engagement decline by user segments. Impact on approach: Helps prioritize which user groups to focus on for immediate action.

• Thinking about the engagement metric, I'm wondering about its specific components. Could you clarify how engagement is measured for the mobile app?

Why it matters: Ensures we're analyzing the correct data points. Expected answer: Definition of engagement metrics (e.g., daily active users, session length, feature usage). Impact on approach: Allows for more precise analysis of which aspects of engagement are most affected.

• Considering potential technical issues, have there been any reported crashes, bugs, or performance problems since the update?

Why it matters: Rules out or highlights technical factors contributing to the decline. Expected answer: Overview of any significant technical issues reported. Impact on approach: Determines whether to prioritize technical fixes or focus on other aspects of the user experience.

• Looking at external factors, have there been any changes in marketing campaigns or user acquisition strategies in the past two weeks?

Why it matters: Helps distinguish between product-related issues and external influences. Expected answer: Information on recent marketing or user acquisition changes. Impact on approach: Influences whether to consider marketing-related factors in the analysis.