Why has the average time to first feature flag creation for new LaunchDarkly users increased from 2 days to 5 days over the past month?

Introduction

The recent increase in average time to first feature flag creation for new LaunchDarkly users from 2 to 5 days is a concerning trend that requires immediate attention. This analysis will systematically investigate potential root causes, validate hypotheses, and propose targeted solutions to address this critical onboarding metric.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might have been a recent product update. Has there been any significant change to the onboarding flow or feature flag creation process in the last month?

Why it matters: Recent changes could directly impact user behavior. Expected answer: Yes, there was a UI update to the feature flag creation wizard. Impact on approach: If confirmed, we'd focus on analyzing the new UI's usability.

• Considering user segments, I'm curious about the distribution. Are we seeing this increase across all user types, or is it more pronounced in certain segments?

Why it matters: Helps identify if the issue is universal or segment-specific. Expected answer: The increase is more significant among non-technical users. Impact on approach: We'd prioritize investigating the onboarding experience for non-technical users.

• Thinking about external factors, has there been any change in the marketing strategy or target audience in the past month?

Why it matters: Changes in user demographics could affect onboarding metrics. Expected answer: We've started targeting more enterprise customers. Impact on approach: We'd analyze if enterprise users have different onboarding needs.

• Considering system performance, have there been any reported issues with the feature flag creation functionality or overall system stability?

Why it matters: Technical issues could directly impact user ability to create flags. Expected answer: No major outages, but there have been intermittent slowdowns. Impact on approach: We'd investigate the impact of system performance on user behavior.