Why has the click-through rate on CarGurus's search results page declined by 8% since the latest site redesign?

Introduction

The recent 8% decline in click-through rate (CTR) on CarGurus's search results page following a site redesign is a critical issue that demands immediate attention. This metric directly impacts user engagement and potential revenue, making it essential to identify and address the root cause promptly. I'll approach this analysis systematically, examining both internal and external factors to pinpoint the source of the decline and develop effective solutions.

Step 1

Clarifying Questions (3 minutes)

• Considering the timing, I'm wondering if the redesign altered the layout significantly. Could you provide details on the specific changes made to the search results page?

Why it matters: Understanding the extent of changes helps identify potential user experience issues. Expected answer: A summary of major layout and functionality changes. Impact on approach: Significant changes might lead us to focus more on UX-related hypotheses.

• Given the nature of CarGurus' business, I'm curious about the seasonality of car buying. Has there been any unusual fluctuation in overall market demand for vehicles recently?

Why it matters: External market factors could influence user behavior independently of site changes. Expected answer: Information on recent market trends or seasonal patterns. Impact on approach: Strong market influences might shift our focus to external factors rather than internal changes.

• I'm thinking about user segments. Has the 8% decline been consistent across all user types, or are certain groups (e.g., mobile users, specific demographics) more affected?

Why it matters: Identifying disproportionately affected segments can narrow down potential causes. Expected answer: Breakdown of CTR changes by user segment. Impact on approach: Significant variations between segments would lead us to investigate segment-specific issues.

• Considering the technical aspects, I'm wondering about the site's performance post-redesign. Have there been any changes in page load times or error rates since the update?

Why it matters: Technical issues could directly impact user experience and CTR. Expected answer: Data on site performance metrics before and after the redesign. Impact on approach: Notable performance degradation would prioritize technical investigations.