Why has Moveworks's AI chatbot seen a 15% drop in user engagement over the past month?

Introduction

The recent 15% drop in user engagement for Moveworks's AI chatbot is a critical issue that demands immediate attention. As we delve into this product execution problem, we'll employ a systematic approach to identify, validate, and address the root cause while considering both short-term fixes and long-term strategic implications.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be a recent product update. Has there been any significant change to the chatbot's functionality or user interface in the past month?

Why it matters: Recent changes could directly impact user engagement. Expected answer: Yes, there was a UI refresh. Impact on approach: If confirmed, we'd focus on UI/UX-related hypotheses.

• Considering user segments, I'm curious about the engagement drop distribution. Is the 15% decrease uniform across all user groups, or are certain segments more affected?

Why it matters: Helps identify if the issue is global or specific to certain user types. Expected answer: The drop is more pronounced in new users. Impact on approach: We'd prioritize onboarding and first-time user experience in our analysis.

• Thinking about external factors, have there been any changes in the work environment of our primary customers, such as return-to-office policies or major layoffs?

Why it matters: External changes could indirectly affect chatbot usage patterns. Expected answer: Some clients have implemented hybrid work models. Impact on approach: We'd consider how changing work environments might impact chatbot relevance and usage.

• Regarding system performance, has there been any degradation in response time or accuracy of the AI chatbot over the past month?

Why it matters: Technical issues could lead to user frustration and decreased engagement. Expected answer: No significant changes in performance metrics. Impact on approach: If confirmed, we'd focus less on technical performance and more on user perception and needs.