What metrics would you use to evaluate Conviva's Experience Benchmarking feature?

Introduction

Evaluating Conviva's Experience Benchmarking feature requires a comprehensive approach to product success metrics. This powerful tool allows streaming providers to compare their performance against industry standards, making it crucial to select metrics that accurately reflect its value and impact. I'll follow a structured framework covering product context, goals, and a hierarchy of success metrics to provide a thorough analysis.

Step 1

Product Context

Conviva's Experience Benchmarking feature is a data analytics tool designed for streaming media companies. It allows these providers to compare their quality of experience (QoE) metrics against anonymized industry data, helping them identify areas for improvement and competitive advantages.

Key stakeholders include:

1. Streaming service providers (primary users)
2. Content delivery networks (CDNs)
3. Conviva's product and sales teams
4. End consumers of streaming services (indirect beneficiaries)

The user flow typically involves:

1. Data collection: The feature aggregates QoE data from participating streaming services.
2. Analysis: It processes this data to create industry benchmarks across various metrics.
3. Comparison: Users can then compare their own performance against these benchmarks.
4. Insight generation: The tool provides actionable insights based on these comparisons.

This feature aligns with Conviva's broader strategy of providing comprehensive video analytics and intelligence to improve streaming experiences. It differentiates Conviva from competitors by offering unique, industry-wide insights that individual streaming services couldn't access on their own.

In terms of product lifecycle, Experience Benchmarking is likely in the growth stage. It's established enough to have a solid user base but still has room for expansion and feature enhancement.