Why has Degreed's Skills Ratings feature seen a 30% drop in user engagement over the past month?

Introduction

Degreed's Skills Ratings feature has experienced a significant 30% drop in user engagement over the past month, raising concerns about its effectiveness and user adoption. This analysis will systematically investigate potential root causes, generate data-driven hypotheses, and propose actionable solutions to address this critical issue.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might have been a recent product update. Has there been any significant change to the Skills Ratings feature in the last 1-2 months?

Why it matters: Recent changes could directly impact user engagement. Expected answer: Yes, there was a UI refresh or No, no major changes. Impact on approach: If yes, we'd focus on the update's impact; if no, we'd look at other factors.

• Considering user segments, I'm curious about the engagement drop distribution. Is the 30% drop uniform across all user types, or are certain segments more affected?

Why it matters: Helps identify if the issue is global or specific to certain users. Expected answer: It's mostly affecting casual users or It's consistent across all segments. Impact on approach: Targeted solutions for specific segments vs. broader changes.

• Thinking about external factors, have there been any significant changes in the competitive landscape or industry trends that might influence Skills Ratings usage?

Why it matters: External factors could be driving the engagement drop. Expected answer: Yes, a competitor launched a similar feature or No, the market has been stable. Impact on approach: If yes, we'd consider competitive positioning; if no, focus on internal factors.

• Regarding data integrity, I'm wondering if there have been any changes to how engagement is measured or tracked for the Skills Ratings feature?

Why it matters: Ensures we're comparing apples to apples in our metrics. Expected answer: No changes in measurement or Yes, we adjusted our tracking method. Impact on approach: If changed, we'd need to re-evaluate the actual impact; if not, proceed with current data.