CX Mistake #9: Falling In Love With A Metric

In this series of posts, we examine some of the top mistakes companies make in their customer experience management efforts. This post examines mistake #9: Falling In Love With A Metric. Companies often get enamored with a metric like Net Promoter Score (NPS) and lose sight of what’s really important, making improvements.

Customer experience efforts absolutely need metrics and measurements. While there’s value in collecting that data to measure or track customer experience, the true power comes when it provides insight into where and how to make improvements. But some organizations over-emphasize the metric. Companies going down this path can run into problems when they:

  • Rush into compensation. Tying business results to metrics can be a good thing. But tying too much compensation too early to any metric can also cause a lot of problems. If people have a significant part of their pay tied to a metric they don’t understand or don’t know how to affect, then they will either ignore it, get bitter about it, or find ways to “game” the system. Customer experience doesn’t improve if salespeople are calling out to customers and begging them to give higher ratings on a survey.
  • Can’t answer “why.” Reporting on a metric can highlight strengths and weaknesses of a company’s overall customer experience. So it’s understandable that some executive teams push for widespread use of those metrics without caring about the overall set of information collected from customers. But if the company does not understand “why” customers are either happy or unhappy, then they can’t systematically improve customer experience and positively affect the metric.
  • Overuse a metric. Understanding if a customer is happy overall with an organization is quite different than understanding if her needs were met during a specific service call. But some companies blindly use the same metrics for each of those areas. A metric like NPS, for example, may be appropriate for examining relationship strength, but it’s necessarily good for evaluating interactions.
  • Forget their uniqueness. Every business has a unique set of strengths, weaknesses, goals and ambitions. But when it comes to customer experience metrics, companies often want to use the same measures as everyone else. While this may enable benchmarking comparison to other firms, it does not necessarily measure how the company is progressing towards its unique goals.

Here are some tips for avoiding this mistake:

  • Treat relationships and interactions differently. The questions you ask a customer about how they view your company can (and often should) be quite different than those that you ask about an interaction. Think about different questions and methods for five different types of insights: Relationship tracking, interaction monitoring, continuous listening, project infusion, and periodic immersion.
  • Deploy shadow metrics before making large incentive changes. To help leaders in your company understand the impact of customer experience incentives, put in place the metrics you are thinking about for a couple of periods before actually making them “live.” That way people can see how it will affect them before actually does affect them.
  • Establish performance bands, not absolute targets. Customer feedback metrics can be a bit jittery. Sometimes it can be very hard to explain small movements since there’s always some variance due to sampling limitations. Rather than establishing “a number” as the goal, set targets for high and low scores. Success comes from consistently execceding the low band.
  • Measure relevant attitudes and behaviors. Businesses aren’t in the business of getting random people to recommend them. They hope to get that type of loyalty from successfully executing their mission. Develop measurements that test the attitudes and behaviors of target customer segments, making sure they line up with your specific business and brand strategy.
  • Build a robust voice of the customer (VoC) program. Creating isolated metrics will not drive change in an organization; especially when people don’t understand what drives the metric. Companies need to develop a voice of the customer (VoC) program that continuously shares actionable customer insights across the organization.

The bottom line: Use metrics to improve the experience, not just measure it

About Bruce Temkin, CCXP
I am a customer experience transformist, helping large organizations improve business results by changing how they deal with customers. As part of this focus, I examine strategy, culture, interaction design, customer service, branding and leadership practices. I am also a fanatical student of business, so this blog provides an outlet for sharing insights from my ongoing educational journey. Simply put, I am passionate about spotting emerging best practices and helping companies master them. And, as many people know, I love to speak about these topics in almost any forum. My “title” is Managing Partner of the Temkin Group, a customer experience research and consulting firm that helps organizations become more customer-centric. Our goal is simple: accelerate the path to delighting customers. I am also the co-founder and Emeritus Chair of the Customer Experience Professionals Association (CXPA.org), a non-profit organization dedicated to the success of CX professionals.

3 Responses to CX Mistake #9: Falling In Love With A Metric

  1. Rob Peters says:

    Bruce:

    Thank you for sharing your excellent insights and vision.

    We are passionate about quality of relationship metrics online. The Standard of Trust tribe has spent the past 5+ years developing an open industry standard for the capture and measurement of Relationship Capital (RC).

    Relationship Capital (RC) is an accounting of the interactions between “entities”, including people, businesses and products. Interactions include Commitments (actions) and Perceptions (thoughts and feelings). Entities earn RC by keeping Commitments and obtaining positive Perceptions. They receive a Relationship Capital Point (RCP) for each fulfilled Commitment, and an RCP, or a fraction thereof, for each position Perception obtained. RCPs are deposited in an RC Account under the strict control of its owner entity.

    The objectives of RC are to provide a common vocabulary for relationship interactions and to account for the interactions as they occur. Accordingly, RC uses a “standard-in-the-cloud” platform to enable entities to engage in interactions and capture RCPs in near real time. The platform is provided by RNIA, an independent body.

    Would love to connect with you and share our work and get your thoughts.

    Thank you for your thought-leadership.

    -Rob Peters

  2. After working with a number of OEMs, I’ve seen this over and over. In my case, market intelligence teams insisted that capacitive multitouch from Apple was no threat because Gartner and others did not report so. It is about understanding the ‘why’ and making customers the hero.

    We’re using product experience analytics at Argus Insights to help companies understand the ‘why’.

    Hopefully our efforts will result in better experiences!

  3. Charlie Temkin says:

    Is this a problem in businesses such as the NBA and other professional sports where certain analytic metrics are valued too much in determining a player’s value, as well? For instance, the current phenomenon of Monta Ellis actually playing efficient basketball in Dallas after spending the last nine years being the punching bag of basketball analytic circles.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: