Everything is Important: Getting the Best Data With MaxDiff

 

As an Analyst, I’m regularly called upon to measure importance in quantitative data. The question of preference is key, whether we’re evaluating product features, satisfaction drivers or positioning statements.

The challenge here lies as much in how we ask questions as how we evaluate the answers. The ideal approach should:

  • be easy to use
  • have strong discrimination
  • offer robust scaling properties
  • limit scale use bias

Traditional techniques, including rating (Likert scale), ranking and constant sum questions, can’t always tick those boxes.

While Likert scales are useful, participants tend to be agreeable when selecting attributes. In other words, they simply tell us everything is important. There’s not much discrimination when all attributes have 4.0 – 4.5 means on a 5-point scale! Ranking and constant sum have inherent bias as well; both are tedious tasks, so participants will often take shortcuts.

That’s where Maximum Difference Scaling (MaxDiff) comes in. The results from this approach typically demonstrate greater discrimination, making it a more refined measurement tool.

With MaxDiff, participants are asked to select most and least preferred items. The technique works best when testing between 15-40 attributes. Displayed attributes are designed so that each item is shown an equal number of times and pairs of items are shown an equal number of times.

The question type is straightforward, so participants of all ages and backgrounds can provide reliable data. And unlike subjective scale ratings, MaxDiff choices are cut and dry. By forcing participants to make discrete choices, there is no opportunity for scale use bias, and the resulting attribute scores are easy to interpret.

MaxDiff is applicable to a wide range of research scenarios, making it a valuable addition to our research toolbox. Consider this technique for:

  • menu development
  • positioning statements
  • promotional offers
  • product features

What's On Our Minds

Leading from the Pack: A Lesson from…

  There’s no shortage of sports metaphors and analogies used to motivate and inspire in business. “You can’t coach someone when he or she is already at the free-throw line.”...
More

Know Our Locations, Know Our Brand

I often step away from my desk in the afternoon and walk around Saratoga Springs. If my puppy is with me, I might take her for a walk through Historic...
More

How to Harness the Power of Positivity

I was thinking recently about how expecting negative outcomes can lead to suboptimal situations and relationships. Put more simply, I was thinking about pessimism and its role in a work...
More