Why has Pendo.io's in-app guide engagement rate dropped by 15% over the past month?

Introduction

The recent 15% drop in Pendo.io's in-app guide engagement rate over the past month is a concerning trend that requires immediate attention. As we delve into this issue, we'll employ a systematic approach to identify, validate, and address the root cause while considering both short-term fixes and long-term strategic implications.

Our analysis will follow a structured framework, covering issue identification, hypothesis generation, validation, and solution development. This approach ensures we leave no stone unturned in our quest to understand and resolve the engagement rate decline.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be a recent product update. Has there been any significant change to the in-app guide feature in the last 1-2 months?

Why it matters: Recent changes could directly impact user engagement. Expected answer: Yes, there was a UI refresh. Impact on approach: If yes, we'd focus on the changes made and user feedback.

• Considering user segments, I'm curious about the distribution of the drop. Is the 15% decrease uniform across all user types, or are certain segments more affected?

Why it matters: Helps identify if the issue is global or specific to certain users. Expected answer: Enterprise users are more affected. Impact on approach: If segmented, we'd analyze the most affected group's characteristics.

• Thinking about external factors, have there been any major changes in the competitive landscape recently?

Why it matters: Competitor actions could influence user behavior. Expected answer: No significant changes noted. Impact on approach: If yes, we'd consider how to differentiate our offering.

• Regarding data integrity, has there been any change in how engagement is measured or in the systems tracking this metric?

Why it matters: Ensures we're comparing apples to apples. Expected answer: No changes in measurement. Impact on approach: If changed, we'd need to reassess the validity of the comparison.