The Wayback Machine - https://web.archive.org/all/20080430065929/http://www.vkistudios.com:80/user-testing.html

User Testing

In user tests, we ask subjects to complete pre-assigned tasks in the presence of a trained moderator. The tasks are realistic, for example:

  • Searching for a product
  • Making a purchase
  • Registering for a course
  • Booking a flight

We conduct the tests in our in-house usability lab, where special equipment records everything that happens: audio and video, plus every mouse movement and keystroke.

Post-test analysis reveals where and why subjects ran into difficulties. Your website can then be improved to eliminate points of confusion.

Why do I need user testing?

There is simply no substitute for testing websites on real users. Expert reviews are fast and efficient, but if you have the time and resources, we highly recommend testing with real users. The advantages include:

Reveal real-world problems

You and your employees may know exactly how your website works. To you , it is obvious. However, there is no substitute for testing with actual users to gain a full understanding of how your customers interact with your web site.

Convincing the Development Team

Resistance to change is universal and includes web development teams. Show your team an expert report, and they may dismiss it as "just an opinion".

In contrast, if developers are shown a video in which users consistently make the same mistake while filling out a form, the discussion is settled: the form must be revised.

When should I do the tests?

Testing can be undertaken at any time, whenever a site redesign is contemplated. Tests can be done on either the existing website, or on prototypes of the redesign.

Testing the existing website

By testing the existing site, you can determine which elements should be retained and which should be modified or eliminated.

Testing redesign prototypes

Making changes to a finished design can be difficult and expensive. By testing early in the design stage, you can make modifications while they are still easy and inexpensive.

The ideal scenario is to run a few quick and informal tests at several stages of development, gradually tweaking your website to perfection.

How many users should I test?

For qualitative, open-ended tests (the majority of our projects), a surprisingly small number of users are needed: Five.

Testing fewer than five users may result in problems going undetected. After testing on four or five users, the law of diminishing returns sets in: the tests become unproductive, merely replicating earlier results.

What do I get from the tests?

After completing the tests, we will analyze all the data and produce an actionable summary of our findings. The exact format of the report will vary, depending on client needs and budget.

In the simplest cases, the "report" may simply be a meeting or conference call. This informal arrangement is the fastest and least expensive option. As it provides almost immediate results, it's the ideal option when testing early prototypes.

Many clients request formal, written reports, especially when testing existing websites.

As an extra option, we can produce highlight videos of the user testing sessions. These are particularly useful where the client anticipates that the web development team may be resist making changes.

Find out more

For more on how your website will benefit from user testing, contact us today.