Why has customer satisfaction with Nuro's app's delivery tracking feature decreased from 4.5 to 3.8 stars over the last two weeks?

Introduction

The recent decline in customer satisfaction with Nuro's app delivery tracking feature, dropping from 4.5 to 3.8 stars over the last two weeks, is a critical issue that demands immediate attention. This analysis will systematically identify, validate, and address the root cause while considering both short-term fixes and long-term strategic implications.

To tackle this problem, I'll follow a structured approach that covers issue identification, hypothesis generation, validation, and solution development. My goal is to provide a comprehensive analysis that not only resolves the immediate concern but also strengthens our product and processes for the future.

Step 1

Clarifying Questions (3 minutes)

• Looking at the sudden drop, I'm thinking there might have been a recent update or change. Has there been any significant app update or backend change in the last 2-3 weeks?

Why it matters: Recent changes often correlate with sudden metric shifts. Expected answer: Yes, there was an update to the tracking algorithm. Impact on approach: If confirmed, we'd focus on the update's impact and potential rollback.

• Considering user segments, I'm curious about the distribution of the rating drop. Is the decrease uniform across all user segments or more pronounced in specific groups?

Why it matters: Helps identify if the issue is universal or segment-specific. Expected answer: The drop is more significant among frequent users. Impact on approach: We'd prioritize investigating the experience of power users.

• Thinking about external factors, I'm wondering if there have been any changes in delivery partner performance or availability recently?

Why it matters: External factors can significantly impact user satisfaction. Expected answer: No major changes in delivery partner metrics. Impact on approach: We'd focus more on internal factors if external elements are stable.

• Considering the metric itself, has there been any change in how customer satisfaction or star ratings are collected or calculated?

Why it matters: Ensures we're comparing apples to apples in our analysis. Expected answer: No changes to the rating system or calculation method. Impact on approach: Confirms the issue is with user experience, not measurement.