Why has Artsy's artwork search functionality seen a 15% drop in user engagement over the past month?

Introduction

Artsy's artwork search functionality has experienced a 15% drop in user engagement over the past month, signaling a critical issue that requires immediate attention. This analysis will systematically identify, validate, and address the root cause while considering both short-term fixes and long-term strategic implications.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be a seasonal trend. Has this 15% drop been compared to the same period last year?

Why it matters: Seasonal fluctuations could explain the engagement drop. Expected answer: No significant seasonal pattern observed. Impact on approach: If seasonal, we'd focus on adapting to cyclical trends; if not, we'd investigate other factors.

• Considering user segments, I'm curious about the distribution of this drop. Is the 15% decrease uniform across all user types, or is it more pronounced in specific segments?

Why it matters: Helps pinpoint whether the issue is global or segment-specific. Expected answer: The drop is more significant among casual browsers than art collectors. Impact on approach: Segment-specific issues would lead to targeted solutions, while a uniform drop suggests a broader problem.

• Thinking about recent changes, have there been any updates to the search algorithm or UI in the past month?

Why it matters: Recent changes could directly impact user engagement. Expected answer: A minor UI update was implemented three weeks ago. Impact on approach: If changes coincide with the drop, we'd focus on reverting or optimizing those specific updates.

• Considering data integrity, has there been any change in how engagement is measured or tracked?

Why it matters: Ensures we're dealing with a real issue, not a measurement anomaly. Expected answer: No changes in measurement methodology. Impact on approach: If measurement changes occurred, we'd need to reassess the data before proceeding with other analyses.