What's causing the sudden spike in negative feedback from clients about Andela's talent matching process?

Introduction

The sudden spike in negative feedback from clients about Andela's talent matching process is a critical issue that demands immediate attention. This analysis will systematically identify, validate, and address the root cause while considering both short-term fixes and long-term strategic implications.

I'll approach this problem by first clarifying the context, then ruling out external factors before diving deep into the product ecosystem, metric breakdown, and data analysis. From there, I'll form and validate hypotheses, conduct a root cause analysis, and propose a comprehensive resolution plan.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might have been a recent change in the matching algorithm. Has there been any significant update to the talent matching system in the past month?

Why it matters: Recent changes often correlate with sudden spikes in feedback. Expected answer: Yes, we updated the algorithm two weeks ago. Impact on approach: If confirmed, I'd focus on the algorithm change as a primary hypothesis.

• Considering user segments, I'm curious about the distribution of negative feedback. Is the spike in negative feedback consistent across all client types, or is it more pronounced in a particular segment?

Why it matters: Helps identify if the issue is universal or segment-specific. Expected answer: The spike is more noticeable among enterprise clients. Impact on approach: I'd prioritize investigating enterprise-specific factors in the matching process.

• Thinking about the feedback itself, I'm wondering about its nature. What specific aspects of the talent matching process are clients most frequently mentioning in their negative feedback?

Why it matters: Pinpoints the exact pain points in the matching process. Expected answer: Clients are reporting mismatches in technical skills and project requirements. Impact on approach: I'd focus on the skill assessment and project requirement gathering stages of the matching process.

• Considering potential data issues, I'm curious about our feedback collection methods. Have there been any recent changes in how we collect or measure client feedback?

Why it matters: Ensures the spike isn't due to changes in measurement methodology. Expected answer: No changes in feedback collection methods. Impact on approach: If confirmed, I'd rule out measurement issues and focus on actual process problems.