Why did Facebook Watch video load success rate drop from 98% to 85%?

Introduction

The sudden drop in Facebook Watch video load success rate from 98% to 85% is a critical issue that demands immediate attention. This significant decrease in performance could severely impact user experience, engagement, and ultimately, the platform's success. I'll approach this problem systematically, focusing on identifying the root cause, validating hypotheses, and developing both short-term fixes and long-term solutions.

Step 1

Clarifying Questions (3 minutes)

• Looking at the timing, I'm thinking there might be a recent change. When exactly did this drop occur, and was it sudden or gradual?

Why it matters: Helps pinpoint potential causes and narrow down the investigation timeframe. Expected answer: A sudden drop within the last week. Impact on approach: A sudden drop would suggest a specific event or change, while a gradual decline might indicate a systemic issue.

• Considering user segments, I'm wondering if this affects all users equally. Are there any patterns in terms of device types, regions, or user demographics that are more affected?

Why it matters: Identifies if the issue is universal or specific to certain user groups. Expected answer: The issue is more prevalent on mobile devices and in certain regions. Impact on approach: Would focus on mobile-specific factors and potential regional infrastructure issues.

• Given the nature of video content, I'm curious about content types. Is the drop consistent across all video types (e.g., live, short-form, long-form)?

Why it matters: Helps isolate whether the issue is content-specific or platform-wide. Expected answer: The issue affects all video types but is more pronounced in live videos. Impact on approach: Would investigate live video streaming infrastructure and CDN performance.

• Thinking about recent changes, have there been any significant updates to the video player, CDN, or backend systems in the past month?

Why it matters: Identifies potential technical causes related to recent deployments. Expected answer: A new video compression algorithm was implemented two weeks ago. Impact on approach: Would focus on the impact of the new algorithm on video loading and playback.