The Facebook Ads Manager team is discussing: should we implement automated campaign optimization or give advertisers more manual controls?

Introduction

The Facebook Ads Manager team is facing a critical decision: should we implement automated campaign optimization or provide advertisers with more manual controls? This trade-off involves balancing efficiency and ease of use with granular control and customization for advertisers. I'll analyze this scenario by examining the product context, potential impacts, and key metrics, then design an experiment to inform our decision.

Step 1

Clarifying Questions (3 minutes)

• Based on recent market trends, I'm thinking this decision might be driven by increasing competition in the ad tech space. Could you share more about the competitive landscape and how it's influencing our product strategy?

Why it matters: Helps contextualize the urgency and strategic importance of this decision. Expected answer: Increased competition from Google Ads and emerging platforms. Impact on approach: Would emphasize differentiation and unique value proposition in our solution.

• Considering our revenue model, I assume this directly impacts our core business. Can you confirm the percentage of revenue that comes from Ads Manager, and if there are any specific growth targets we're aiming for?

Why it matters: Aligns the decision with our financial objectives and risk tolerance. Expected answer: Ads Manager contributes significantly (e.g., 70%+) to overall revenue. Impact on approach: Would influence the balance between short-term gains and long-term advertiser satisfaction.

• Thinking about our user base, I'm curious about the distribution of advertisers by size and sophistication. What percentage of our advertisers are large enterprises vs. small businesses or individuals?

Why it matters: Helps tailor the solution to meet the needs of our most valuable or strategic segments. Expected answer: Mix of enterprise (20%), SMBs (50%), and individuals (30%). Impact on approach: Would inform the level of complexity and customization options in the solution.

• From a technical perspective, I'm wondering about our current AI capabilities for campaign optimization. How advanced are our algorithms compared to manual optimization by experienced advertisers?

Why it matters: Determines the feasibility and potential effectiveness of automated solutions. Expected answer: AI performs well but still lags behind top human experts in some scenarios. Impact on approach: Would influence the balance between automated and manual controls.

• Considering resource allocation, I'm curious about our team's capacity to support both automated and manual optimization features. Do we have the engineering and customer support resources to maintain both paths?

Why it matters: Ensures the chosen solution is sustainable and doesn't overburden our teams. Expected answer: Resources are limited, favoring focus on one primary approach. Impact on approach: Would lean towards a more unified strategy rather than trying to fully support both options.