Augment

Usability Testing With Five Users: What You Can and Cannot Learn

Five participants find most of the common problems. They cannot tell you how many users share them. Know the difference.

A team working on laptops around a long table in a workshop
Photo by Campaign Creators on Unsplash, with an Augment halftone treatment
Executive Summary

Key Takeaways

  • For a qualitative test of one user group, five participants reveal most of the major usability problems.
  • The classic recommendation is several small rounds, not one large study.
  • Test again after fixing. The second round catches what the first hid.
  • Small tests find problems. They do not measure how common a problem is.

Where the number comes from

Jakob Nielsen's analysis showed that the first few participants uncover most usability problems, and each new one repeats more of what you have already seen. Five users find about 85 percent of the problems in his curve.

His recommendation was not to stop at five. It was to run small tests repeatedly. NN/g suggests that a budget for fifteen participants is better spent on three rounds of five, fixing issues between rounds, than on one round of fifteen.

What five users can tell you

  • Where people get lost, confused, or stuck.
  • Which words and labels they misread.
  • Which flows take far longer than expected.
  • Which problems are severe enough to fix first.

What they cannot tell you

QuestionWhy five is not enough
How many users hit this problem?Small samples cannot estimate frequency
Is design A faster than design B?Needs quantitative testing and larger samples
Does it work for every segment?Test three to four users per distinct group
What is our success rate?Success rates need larger studies

Run a good session

1

Write tasks

Realistic goals, not instructions. "Find and book a slot for next week."

2

Brief and stay quiet

Ask the person to think aloud. Do not help.

3

Observe

Note where they hesitate, backtrack, or misread.

4

Debrief

Ask what was hardest and what they expected.

Then fix and retest

Rank issues by severity and how many participants hit them. Fix the top ones, and test the new version with a few fresh people. Short cycles beat big reports that arrive too late to matter.

Frequently Asked Questions

For a qualitative test of one user group, yes. They reveal most major problems, and repeated rounds find the rest.

Sources and further reading

  1. Why You Only Need to Test with 5 UsersNielsen Norman Group · Published · Updated · Accessed
  2. Usability (User) Testing 101Nielsen Norman Group · Published · Updated · Accessed

Credits

  • Written by Augment Editorial Team, Product design and engineering, Augment Lab.
  • Cover photo Photo by Campaign Creators on Unsplash, with an Augment halftone treatment, used under the Unsplash License.
  • Research Statistics and standards are cited from the sources above. Always check the original page for the latest version.

Augment Product Design

Ready to make your product clearer?

From first concept to go-live, we turn complex product ideas into clear, useful experiences.

Usability Testing With Five Users: What You Can and Cannot Learn | Augment. Lab