How to evaluate your product’s existing features?

October 7, 2021

A lot of discussions about product management are focusing on prioritizing the next features to add to the product. However, focusing on what to add next will probably lead to overlooking opportunities with the existing features. Adding more and more features won’t necessarily lead to a better product if we don’t assess the product and features we already have. It is definitely beneficial to answer, from time to time, the following question: “Should we continue to invest in this feature? Or kill it and move on?”. Here is how to assess that:  

1. Be careful with biases

User engagement alone is not enough to evaluate an existing feature. There are multiple biases in this metric. The first bias is due to the fact that user engagement does not mean user satisfaction. If our users don’t have any other alternatives, they will use the feature. Knowing that users are using a feature is not enough to determine whether our users are satisfied or not. The second bias is the fact that we are focusing on users’ standpoint only. There is no measure of the impact of the feature on the product and our business. While users might be happy with the feature, if it does not drive revenue to our business, our strategy is probably not robust enough.  

2. Use quantitative data for the impact on the business

We definitely want to measure the impact of a feature on our business. Since it is a complex topic, it might be hard to determine which feature is driving which amount of revenue. We also want to create a metric that we can measure for every feature, so that we can compare them. Here is a couple of metrics which, when linked together, gives a good overview of the impact of a feature on our business:
  1. Usage – % of intended users who used the feature, at least one time.
  2. Revenue Influence – the revenue ($) driven by the users that are actively using the feature.
 

3. Use qualitative data for the impact on the users

We just saw how to measure the impact of a feature on our business, which is amazing. But, we obviously need to measure the impact of this feature on our users. As we saw previously, usage is coming with a strong bias. The best way to measure user satisfaction is to actually ask our users. There are two metrics we could use to measure the impact on the users:
  1. Perceived Value
  2. Perceived Effort
These two metrics will give a clear picture of how our users are experiencing the feature. Getting the data can be pretty straightforward with two very simple questions we might ask in the product directly:
  1. Perceived Value – On a scale from 1 to 5, how valuable is this feature?
  2. Perceived Effort – On a scale from 1 to 5, how easy was it to use this feature?
 

4. Read the results

The decision tree will depend on our context and our overall strategy. However, there are some conclusions we could get from these metrics.

Usage

Low usage – We might have a problem in the release process or our go-to-market is not good enough. High usage – We don’t have any issue here. 🙂

Revenue Influence

This is an indication of the risk we are taking with this feature. We have a clear number showing what is the revenue linked to this feature.

Perceived Value

Low value – We did not build the right feature, or we are not addressing the right challenge. High value – We built it the right way. 🙂

Perceived Effort

Low effort – We are probably good here. High effort – Our user experience is not good enough  

5. Conclude

Once again, this will depend on our strategy and the risk we are eager to take. However, here is a simple example of a decision we might make, based on the four metrics.  Let’s consider a feature, with the following metrics:
  •       High Usage
  •       Low Revenue Influence
  •       High Perceived Value
  •       High Perceived Effort
Interpretation: Usage & Perceived Value are high, so we reached our audience and delivered a valuable feature. Perceived Effort is high, meaning that User Experience is not that good. Revenue Influence is low, meaning that upgrading the experience won’t impact our business that much. Decision we could make: Do not invest more, for now. We could keep monitoring Revenue Influence. If it goes up, we might have to change our decision.   This article is written by Albin Poignot, co-founder at Linky Product. Source: Travis Kaufman, Agile Insider – httpss://medium.com/agileinsider/how-product-leaders-can-evaluate-features-based-on-business-impact-1146a8878e65

Share

Other articles

Go to Top