What caused the sudden 30% decrease in new trial signups for Semrush's Site Audit feature last week?

Introduction

The sudden 30% decrease in new trial signups for Semrush's Site Audit feature last week is a critical issue that demands immediate attention. This analysis will systematically identify, validate, and address the root cause while considering both short-term and long-term implications for the product and business.

I'll approach this problem by first clarifying the context, then ruling out external factors before diving deep into the product ecosystem, metric breakdown, and data analysis. From there, I'll form hypotheses, conduct root cause analysis, and propose validation methods and solutions.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking this could be related to a recent product change. Has there been any significant update to the Site Audit feature or related components in the past two weeks?

Why it matters: Recent changes often correlate with sudden metric shifts. Expected answer: Yes, there was a UI update to the Site Audit dashboard. Impact on approach: If yes, we'd focus on the change's impact on user experience and conversion funnel.

• Considering the specificity of the decrease, I'm wondering about our measurement accuracy. Has there been any change in how we track or define new trial signups recently?

Why it matters: Ensures we're addressing a real issue, not a measurement anomaly. Expected answer: No changes to tracking methods. Impact on approach: If yes, we'd need to audit our analytics setup before proceeding.

• Given the magnitude of the decrease, I'm curious about user segments. Are we seeing this 30% drop uniformly across all user types, or is it more pronounced in specific segments?

Why it matters: Helps narrow down potential causes and affected user groups. Expected answer: The decrease is more significant among small business users. Impact on approach: We'd focus our investigation on factors affecting this segment specifically.

• Considering potential external factors, have there been any notable competitor actions or industry changes in the past month that could influence our trial signups?

Why it matters: External factors can significantly impact user acquisition. Expected answer: A major competitor launched a free tool with similar functionality. Impact on approach: We'd need to assess our value proposition and market positioning.