Why has customer engagement with Roofstock's neighborhood rating tool declined by 40% since the latest platform update?

Introduction

The recent 40% decline in customer engagement with Roofstock's neighborhood rating tool following the latest platform update is a critical issue that demands immediate attention. This analysis will systematically identify, validate, and address the root cause while considering both short-term fixes and long-term strategic implications.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking this might be related to the platform update. Can you provide more details about what changes were implemented in this update?

Why it matters: Understanding the specific changes helps pinpoint potential causes. Expected answer: List of feature changes, UI/UX modifications, or backend updates. Impact on approach: Directs focus to specific areas of the platform that may have affected user behavior.

• I'm curious about the user segments affected. Has the decline been uniform across all user types, or are certain segments more impacted?

Why it matters: Identifies whether the issue is widespread or localized to specific user groups. Expected answer: Breakdown of engagement decline across different user segments. Impact on approach: Helps tailor solutions to most affected groups and understand if the problem is universal or segment-specific.

• Considering the significance of the decline, I'm wondering about the timeframe. Over what period did we observe this 40% drop in engagement?

Why it matters: Establishes whether this is a sudden drop or a gradual decline, which informs the urgency and nature of our response. Expected answer: Specific timeframe, e.g., "over the last month" or "since the update two weeks ago." Impact on approach: Shapes the timeline for investigation and response, and helps correlate with other events or changes.

• Given the importance of data accuracy, has there been any change in how we measure or define customer engagement with the neighborhood rating tool?

Why it matters: Ensures we're comparing apples to apples and not dealing with a measurement issue. Expected answer: Confirmation of consistent measurement methods or details of any changes. Impact on approach: If measurement has changed, we may need to recalibrate our analysis or adjust historical data for accurate comparison.