Why are completion rates for Island's phishing awareness training modules down 20% compared to the previous month?

Introduction

The recent 20% drop in completion rates for Island's phishing awareness training modules is a concerning trend that requires immediate attention. As we delve into this issue, we'll employ a systematic approach to identify, validate, and address the root cause while considering both short-term fixes and long-term strategic implications.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be a seasonal factor at play. Has this dip coincided with any particular time of year or company-wide events?

Why it matters: Seasonal patterns could explain cyclical changes in engagement. Expected answer: No significant seasonal correlation identified. Impact on approach: If seasonal, we'd need to adjust our baseline expectations.

• Considering user segments, I'm curious about the distribution of the decline. Is the 20% drop uniform across all user groups, or are certain segments more affected?

Why it matters: Identifying specific affected groups could pinpoint targeted issues. Expected answer: The decline is more pronounced in the non-technical departments. Impact on approach: We'd focus on understanding the unique challenges for these groups.

• Thinking about recent changes, have there been any updates to the training modules or the platform itself in the past month?

Why it matters: Recent changes could directly impact user engagement and completion rates. Expected answer: A new module interface was rolled out two weeks ago. Impact on approach: We'd investigate the usability and reception of the new interface.

• Regarding measurement accuracy, has there been any change in how completion rates are tracked or reported?

Why it matters: Ensures we're comparing apples to apples in our metrics. Expected answer: No changes in tracking or reporting methods. Impact on approach: Confirms the issue is with actual completion rates, not measurement discrepancies.