For New Relic's Logs offering, should we focus on increasing data retention periods or enhancing real-time log analysis features to better serve customers?

Introduction

The trade-off we're examining today is whether New Relic's Logs offering should prioritize increasing data retention periods or enhancing real-time log analysis features to better serve our customers. This decision is crucial for our product strategy and will significantly impact our users' experience and our competitive positioning in the observability market.

In my analysis, I'll explore the implications of both options, considering user needs, technical feasibility, business impact, and long-term product strategy. I'll outline a structured approach to evaluate this trade-off and provide a data-driven recommendation.

Step 1

Clarifying Questions (3 minutes)

• Context: I'm assuming this decision is driven by customer feedback or competitive pressure. Could you share more about what's prompting this trade-off consideration now?

Why it matters: Helps understand the urgency and external factors influencing the decision. Expected answer: Mixture of customer requests and competitive offerings. Impact on approach: Would prioritize the option that addresses the most pressing customer needs or competitive gaps.

• Business Context: Based on our current revenue model, I'm thinking log retention might impact our pricing tiers. How does our current pricing structure factor into this decision?

Why it matters: Helps align the solution with our business model and potential revenue impact. Expected answer: Longer retention periods are tied to higher-priced tiers. Impact on approach: Would consider how each option could affect upsell opportunities and customer retention.

• User Impact: I'm assuming different user segments might prioritize retention vs. real-time analysis differently. Can you provide insights into which customer segments are most vocal about each feature?

Why it matters: Ensures we're addressing the needs of our most valuable or strategic customer segments. Expected answer: Enterprise customers want longer retention, while DevOps teams prioritize real-time analysis. Impact on approach: Would tailor the solution to best serve our target customer segment or find a balance for both.

• Technical Feasibility: Considering our current architecture, I'm thinking real-time enhancements might be more complex. What are the main technical challenges for each option?

Why it matters: Helps assess the feasibility and potential timeline for implementation. Expected answer: Retention increase requires more storage, real-time enhancements need processing optimizations. Impact on approach: Would factor in development time and potential technical debt into the decision.

• Resource Allocation: Given our current team structure, I'm curious about our capacity to tackle these enhancements. Do we have dedicated teams for both areas, or would this require resource reallocation?

Why it matters: Ensures we can execute on the chosen strategy effectively. Expected answer: Limited resources, would require prioritization and potential team restructuring. Impact on approach: Would consider the opportunity cost of focusing on one option over the other.