What factors contributed to the sudden 50% increase in course completion rates for Degreed's Compliance Learning pathways last quarter?

Introduction

The sudden 50% increase in course completion rates for Degreed's Compliance Learning pathways last quarter presents an intriguing product execution challenge. To unravel this unexpected surge, we'll employ a systematic approach to identify, validate, and address the root cause while considering both immediate and long-term implications for our product strategy.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might have been a recent product update. Have there been any significant changes to the Compliance Learning pathways in the last 3-6 months?

Why it matters: Product changes often directly impact user behavior and metrics. Expected answer: Yes, there were updates to the user interface and content structure. Impact on approach: If confirmed, we'd focus on analyzing the specific changes and their effects.

• Considering user segments, I'm curious about the distribution of this increase. Was the 50% increase consistent across all user groups, or did certain segments show higher completion rates?

Why it matters: Identifying affected segments helps pinpoint targeted causes. Expected answer: The increase was more pronounced in newer users and certain industries. Impact on approach: We'd investigate factors specific to these user groups and their learning environments.

• Thinking about external factors, I'm wondering if there were any regulatory changes or industry events that might have driven increased compliance focus. Have there been any notable shifts in the compliance landscape for our key industries?

Why it matters: External pressures often drive compliance learning engagement. Expected answer: There were new regulations introduced in the financial sector. Impact on approach: We'd examine how our product adapted to or capitalized on these changes.

• Considering the metric itself, I'm interested in the definition of "completion." Has there been any change in how course completion is measured or tracked in our system?

Why it matters: Changes in metric definition can lead to apparent performance shifts. Expected answer: No changes to the completion definition or tracking system. Impact on approach: We'd focus on actual behavior changes rather than measurement artifacts.