For Bazaarvoice's Sampling service, should we expand the pool of potential reviewers to increase product coverage or maintain a smaller, more targeted group of reviewers for higher-quality feedback?

Introduction

The trade-off we're considering for Bazaarvoice's Sampling service is whether to expand the pool of potential reviewers to increase product coverage or maintain a smaller, more targeted group of reviewers for higher-quality feedback. This decision involves balancing quantity and quality of reviews, which directly impacts the value proposition of Bazaarvoice's service. I'll analyze this trade-off by examining the product context, potential impacts, and proposing an experimental approach to inform our decision.

Step 1

Clarifying Questions (3 minutes)

• Based on our current business model, I'm thinking review volume might be a key revenue driver. Could you confirm how our pricing structure relates to the number of reviews generated?

Why it matters: Helps understand the direct business impact of expanding the reviewer pool. Expected answer: Pricing tied to review volume with quality thresholds. Impact on approach: Would influence the balance between quantity and quality in our solution.

• Considering user behavior, I'm assuming product coverage is currently a pain point for our clients. How significant is the gap in product coverage, and which product categories are most affected?

Why it matters: Identifies the scale of the problem and prioritizes areas for improvement. Expected answer: Significant gaps in niche or new product categories. Impact on approach: Would help target specific product areas for reviewer expansion.

• From a technical perspective, I'm thinking about our current reviewer vetting process. How scalable is our current system for managing and qualifying reviewers?

Why it matters: Determines the feasibility of expanding the reviewer pool. Expected answer: Current system has limitations but can be scaled with investment. Impact on approach: Would influence the timeline and resources needed for expansion.

• Looking at our team capacity, I'm curious about our ability to maintain review quality with a larger pool. Do we have the resources to effectively moderate an increased volume of reviews?

Why it matters: Assesses our operational capability to handle expansion. Expected answer: Current team is at capacity, would need to scale moderation efforts. Impact on approach: Might necessitate a phased approach or additional resource allocation.