Should ClickHouse prioritize improving query performance for complex analytical workloads or focus on enhancing ease of use for new users?

Introduction

The trade-off we're examining today is whether ClickHouse should prioritize improving query performance for complex analytical workloads or focus on enhancing ease of use for new users. This scenario presents a classic product dilemma: balancing technical excellence with user accessibility. I'll analyze this trade-off through multiple lenses, considering business impact, user needs, and technical feasibility.

Step 1

Clarifying Questions (3 minutes)

• Based on our current user base, I'm thinking we might have a mix of power users and newcomers. Could you give me an overview of our user segments and their relative importance to our business?

Why it matters: Helps prioritize which user group to focus on Expected answer: 70% power users, 30% new users, but growing new user segment Impact on approach: Would influence whether to prioritize performance or ease of use

• Considering our revenue model, I assume we charge based on usage or data processed. Is this correct, and how might improving query performance or ease of use impact our revenue?

Why it matters: Aligns product decisions with business goals Expected answer: Usage-based pricing, performance improvements could increase revenue Impact on approach: Might lean towards performance if it directly impacts revenue

• From a technical standpoint, I'm curious about the current bottlenecks in query performance. Are we dealing with issues of scale, complexity, or both?

Why it matters: Determines the feasibility and impact of performance improvements Expected answer: Primarily complexity issues with large, multi-join queries Impact on approach: Would focus on query optimization techniques rather than infrastructure scaling

• Regarding our product roadmap, where does this decision fit in terms of urgency and strategic importance?

Why it matters: Helps prioritize this decision against other initiatives Expected answer: High priority, aiming to address in next quarter Impact on approach: Would justify a more immediate and comprehensive solution

• Looking at our team capacity, do we have the resources to pursue both options simultaneously, or are we constrained to choosing one path?

Why it matters: Determines if we need to make a strict trade-off or can balance both Expected answer: Limited resources, need to focus on one primary direction Impact on approach: Would necessitate a clear prioritization and phased approach