What caused the sudden 30% decrease in survey completion rates for Evidation Health's heart health study last week?

Introduction

The sudden 30% decrease in survey completion rates for Evidation Health's heart health study last week is a critical issue that demands immediate attention. This significant drop could impact the study's validity, participant engagement, and ultimately, the valuable insights we aim to gather about heart health. I'll approach this problem systematically, focusing on identifying the root cause, validating our hypotheses, and developing both short-term and long-term solutions.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might have been a recent change to the survey. Has there been any update to the survey content or user interface in the past two weeks?

Why it matters: Recent changes could directly impact completion rates. Expected answer: Yes, there was a minor UI update. Impact on approach: If confirmed, we'd focus on UI-related hypotheses.

• Considering user segments, I'm curious about the demographics affected. Are we seeing this decrease across all age groups, or is it more pronounced in specific segments?

Why it matters: Helps identify if the issue is universal or segment-specific. Expected answer: The decrease is more significant in users over 60. Impact on approach: We'd investigate factors that might disproportionately affect older users.

• Thinking about external factors, has there been any change in the incentive structure for completing surveys in the past month?

Why it matters: Changes in rewards could affect motivation to complete surveys. Expected answer: No changes to incentives. Impact on approach: If confirmed, we'd focus more on internal factors rather than motivation.

• Considering technical aspects, have there been any reported issues with the app's performance or server uptime in the last week?

Why it matters: Technical problems could prevent users from completing surveys. Expected answer: No significant technical issues reported. Impact on approach: If confirmed, we'd prioritize non-technical hypotheses.