JournalArrow left Journal
Measurement myths Hero
Data & Analytics

Three measurement myths, busted

8th July 2020

As we outlined in our previous article about measuring the impact of experience design work, getting measurement to happen on your work often comes down to human behaviour.

If your team doesn’t want to measure their work and treats doing so as a chore rather than an opportunity, it’s unlikely to happen. 

One of the barriers to measuring the impact of experience design work is the prevalence of myths. In this article, we’ll look at the most persistent ones and bust them, one by one.

Myth #1: You can only measure the impact of big design and build projects

The origin of this myth is in the many experience design activities that don’t have a direct impact on business metrics (like an app redesign or website optimisation project would). If you’re creating personas, running a strategy workshop or creating a design system, it’s hard to draw a line between that and KPIs like revenue and profit.

The trick to getting over this is to understand that the success of a project doesn’t have to be measured by an end goal like increased sales, cost reduction and the like. If you’re creating personas, success means that they’re being used, they’re visible and they’re still relevant in more than 6 months’ time.

You can and should measure the effectiveness of your work on every project you do. The more you do it, the more natural it will seem and the better you'll get at it. It's important to make measuring outcomes a habit and making it a default activity is key to that.

On some small projects, it may seem unnecessary to measure outcomes, but these all add up in the long term. Every data point counts.

Myth #2: Measurement takes a lot of time and budget to do

Measurement doesn't have to be a big line item. On many projects, you might spend a couple of hours on it - that's it. If you keep it simple, it doesn’t have to take days of your time.

To keep the time spent on measurement to a minimum, make sure you have:

  • Measurement activities as a standard part of any design process.
  • Templates and example measurement frameworks available for people to use.
  • Any measurement meetings pre-booked at the start of the project.

If you want your team to get into the habit of measuring the impact of their work, you need to make it easy for them. It should be something that they can do even if they have to do it when they’re feeling lazy on a Friday afternoon.

Of course, on the largest projects you’ll need to set aside more time for measurement. In these cases, you shouldn’t have to fight to have measurement included as an activity – if the organisation is spending millions of pounds on a project, there should be an expectation that outcomes will be measured.

Myth #3: Measurement is difficult and complicated

When most practitioners think of ‘measurement’, they imagine unfamiliar analytics tools and endless Excel spreadsheets. The stuff of nightmares for many designers. 

Thankfully, measuring the effectiveness of your work is simpler than most people imagine. We encourage our team to keep it simple and focus on a few important outcomes. It’s easy to become overwhelmed with the number of things that you can track, but just because you can measure it doesn’t mean that you should. 

One of the tools we use is a one-page template for creating a measurement framework. This is designed to deliberately limit the number of outcomes, metrics and data sources that you can list, so that you concentrate on the most important. As with many things, if you can’t write down a summary of it on a single page, it’s probably not thought through well enough.

Measurement isn’t as daunting as you think 

To many experience design practitioners, measuring the effectiveness of their work doesn’t come naturally. But many of the blockers that get in the way of doing it can be overcome. 

Measurement is something that can be incorporated into every project you do. It doesn’t have to take a lot of time or budget to implement, and it doesn’t have to be difficult or complicated. With the right tools and guidance, any practitioner can do it.


Related articles

View All
Big data vs UX measurement
Two illustrated bar charts with particles highlighting the importance of data to design
Data & Analytics

Big data vs UX measurement

By Elsa Plumley

Big Data is being heralded as central to the future success of companies. But is Big Data complementary to UX measurement? Or is it a resource, which supersedes the need for traditional UX measures?

Be clever... measure
Two illustrated bar charts with particles highlighting the importance of data to design
Data & Analytics

Be clever... measure

By Nicky Walker

Nicky Walker measures the impact of individual changes.

Measuring the impact of your work is everyone’s responsibility
Measurement Hero
Data & Analytics

Measuring the impact of your work is everyone’s responsibility

By Charlotte Leedham and Philip Morton

Measuring the effectiveness of your work is a no-brainer. In this article we discuss why it's important and how you can do it.