Why has Go1's course completion rate for compliance training modules dropped by 15% over the last quarter?

Introduction

The recent 15% drop in Go1's course completion rate for compliance training modules over the last quarter is a concerning trend that requires immediate attention. As we delve into this issue, we'll employ a systematic approach to identify, validate, and address the root cause while considering both short-term fixes and long-term strategic implications.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be seasonal factors at play. Has this drop coincided with any particular time of year or industry events?

Why it matters: Seasonal patterns could explain the fluctuation and inform our solution approach. Expected answer: No significant seasonal correlation identified. Impact on approach: If seasonal, we'd focus on adapting to cyclical patterns; if not, we'd investigate other factors more deeply.

• Considering user segments, I'm curious about the distribution of this drop. Is the 15% decrease uniform across all user groups, or are certain segments more affected?

Why it matters: Identifying specific affected groups could point to targeted issues or user experience problems. Expected answer: The drop is more pronounced in newer users and smaller companies. Impact on approach: We'd focus on onboarding processes and scalability of the platform for different company sizes.

• Thinking about recent changes, have there been any significant updates to the compliance training modules or the platform itself in the past quarter?

Why it matters: Recent changes could directly impact user behavior and completion rates. Expected answer: A new UI was implemented for the training dashboard. Impact on approach: We'd investigate the UI change's impact on user engagement and navigation.

• Regarding the metric itself, has there been any change in how course completion is defined or measured in the last quarter?

Why it matters: Ensures we're comparing apples to apples and not dealing with a measurement issue. Expected answer: No changes to the metric definition or measurement. Impact on approach: If changed, we'd need to recalibrate our analysis; if not, we can proceed with investigating user behavior and system performance.