What caused the sudden 30% decrease in new user signups for Calendly's Team plan last week?

Introduction

The sudden 30% decrease in new user signups for Calendly's Team plan last week is a critical issue that demands immediate attention. This analysis will systematically identify, validate, and address the root cause while considering both short-term and long-term implications for Calendly's product strategy.

I'll approach this problem by first clarifying key details, ruling out external factors, and then diving deep into product understanding, metric breakdown, and data analysis. From there, I'll form hypotheses, conduct root cause analysis, and propose validation methods and solutions.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking this could be related to a recent product change. Has there been any significant update to the Team plan or its onboarding process in the past two weeks?

Why it matters: Recent changes often correlate with sudden metric shifts. Expected answer: Yes, there was a UI update to the signup flow. Impact on approach: If yes, I'd focus on analyzing the specific changes and their potential impact on user behavior.

• Considering the specificity of the decrease, I'm curious about the data integrity. Has there been any change in how we track or define new user signups for the Team plan?

Why it matters: Ensures we're dealing with a real issue, not a data anomaly. Expected answer: No changes to tracking or definitions. Impact on approach: If there were changes, we'd need to audit our data collection and reporting processes first.

• Given the magnitude of the decrease, I'm wondering about external factors. Have we seen any similar trends in competitor products or the broader SaaS market recently?

Why it matters: Helps distinguish between Calendly-specific issues and industry-wide trends. Expected answer: No significant market shifts reported. Impact on approach: If yes, we'd need to consider broader market strategies alongside product-specific solutions.

• Thinking about user segments, I'm curious if this decrease is uniform across all types of Team plan users. Do we see any differences in the drop-off rate between new and existing organizations, or between different team sizes?

Why it matters: Helps pinpoint if the issue is general or specific to certain user groups. Expected answer: The decrease is more pronounced in new organizations with smaller team sizes. Impact on approach: This would focus our investigation on the initial team onboarding experience for smaller groups.