Why have average session durations on G2's comparison pages decreased by 15% in the last two weeks?

Introduction

The recent 15% decrease in average session durations on G2's comparison pages over the past two weeks is a concerning trend that requires immediate attention. This analysis will systematically investigate potential root causes, validate hypotheses, and propose targeted solutions to address this critical product issue.

Step 1

Clarifying Questions (3 minutes)

• Timing of the change: Given the sudden drop, I'm wondering if there were any recent updates or changes. Have there been any significant product releases or modifications to the comparison pages in the last month?

Why it matters: Identifying recent changes can help pinpoint potential triggers for the decreased session duration. Expected answer: Information about recent updates or lack thereof. Impact on approach: If changes were made, we'd focus on those specific areas; if not, we'd look at broader factors.

• User segment impact: I'm curious about the distribution of this decrease. Is this 15% drop consistent across all user segments, or are certain groups more affected?

Why it matters: Understanding if this is a universal issue or specific to certain users helps narrow down potential causes. Expected answer: Data on how different user segments are affected. Impact on approach: If specific segments are more impacted, we'd tailor our investigation and solutions accordingly.

• Metric definition consistency: To ensure we're working with accurate data, has there been any change in how session duration is measured or calculated in the last month?

Why it matters: Confirms the validity of the observed decrease and rules out measurement errors. Expected answer: Confirmation of consistent measurement methods. Impact on approach: If measurement changes occurred, we'd need to reassess the data before proceeding.

• Concurrent metrics: I'm thinking about related metrics. Have you noticed any significant changes in other key performance indicators, such as bounce rate or page load times, during this same period?

Why it matters: Correlated changes in other metrics can provide insights into the nature of the problem. Expected answer: Information on other metric changes, if any. Impact on approach: Correlated changes would guide us to investigate specific areas of user experience or technical performance.