Why has Vanta's automated evidence collection feature seen a 20% drop in usage over the past month?

Introduction

The recent 20% drop in usage of Vanta's automated evidence collection feature is a critical issue that demands immediate attention. As we delve into this problem, we'll employ a systematic approach to identify, validate, and address the root cause while considering both short-term fixes and long-term strategic implications.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be a recent product update. Has there been any significant change to the automated evidence collection feature in the past 1-2 months?

Why it matters: Recent changes could directly impact usage patterns. Expected answer: Yes, there was a UI update or No, no major changes. Impact on approach: If yes, we'd focus on the update's impact; if no, we'd look at other factors.

• Considering user segments, I'm curious about the distribution of this drop. Is the 20% decrease uniform across all user types, or is it more pronounced in specific segments?

Why it matters: Helps identify if the issue is global or segment-specific. Expected answer: It's uniform or It's concentrated in [specific segment]. Impact on approach: Uniform drop suggests a systemic issue; segment-specific would narrow our focus.

• Thinking about the competitive landscape, have there been any notable changes in competitor offerings or market conditions in the past month?

Why it matters: External factors could be influencing user behavior. Expected answer: Yes, [competitor] launched a new feature or No, the market has been stable. Impact on approach: If yes, we'd consider competitive pressures; if no, we'd focus more on internal factors.

• Considering potential technical issues, have there been any reported problems with the feature's reliability or performance in the last month?

Why it matters: Technical issues could directly impact usage. Expected answer: Yes, we've had some outages or No, the system has been stable. Impact on approach: If yes, we'd prioritize technical investigations; if no, we'd look more at user experience factors.