The Wayback Machine - https://web.archive.org/all/20060318090700/http://www.nngroup.com/reports/confirmation/
Nielsen Norman Group Logo  
NN/g    useit.com    jnd.org    AskTog
Nielsen Norman Group
View shopping cart for report downloads at eSellerate
Strategies to enhance the user experience  
Home People Services Publications Events About NN/g
NN/g Home > Publications > Confirmation Email
                        

Nielsen Norman Group Report:

Usability of Confirmation Email and Transactional Messages
74 Design Guidelines for Automated Messages from Websites to Customers

 
Download Report (PDF file, 110 pages) 110 pages PDF format
Download your copy of the report instantly (from eSellerate)

$119 for a single report, $224 for the report and the right to make copies within your organization. (No shipping/handling fees will be added: it's an immediate download directly from the server.)


Summary

Confirmation email is one of the most important touchpoints for keeping customers appraised of the status of their transactions and for enhancing your reputation for great customer service. Good email usability can save huge amounts of money by reducing the number of telephone calls to your call center. Bad email will often get deleted unread; it'll definitely make customers feel uncertain and poorly treated.

The report contains 74 guidelines for improving the design of confirmation email and other transactional messages that are generated automatically by a computer (the report doesn't cover human-authored customer service email). The report is richly illustrated with 40 screenshots of many different email messages, showing usability problems we found in our testing as well as examples of highly-usable transactional email.

> sample chapter as thumbnail pages
> Jakob Nielsen's Alertbox summarizing the report

This report is based on empirical usability testing and shows what happens when real users interact with real email, starting with the inbox (where many messages get deleted ruthlessly), and continuing with the actual content of the message.

We observed a broad range of test users as they processed 40 transactional email messages. Most were confirmation emails, covering the following categories:

  • Order and service confirmations
  • Shipment notifications
  • Reservation confirmations and e-tickets
  • Available now notices
  • Billing and payment notices
  • Cancellations, returns, refunds, rebates, and bonuses
  • Information request responses
  • Government responses
  • Customer service messages
  • Failure notices
  • Registration and account information

Table of Contents

110-page report.
  1. Executive Summary
    • User Research
    • Surviving Spam-Filled In-Boxes
    • Avoid or Minimize Message Sequences
    • Tell Users What They Want to Know
    • Confirmation Email Builds Trust
  2. Study Overview
  3. How People Use and Manage Email
  4. How Email Affects Trust and Perceptions of Accuracy
    • Incomplete Information
      • Lack of Personal Information
      • Lack of Company Information
      • The Unavailable Company
      • Unanswered Questions
      • What Participants Said They Wanted: Prioritized list of 27 types of information
    • Misunderstandings
    • Questions About Practices or Policies
      • Sales Pitches
      • Hidden Charges
      • Customer Service
      • Privacy and Security
  5. Guidelines List
  6. Email Guidelines and Discussion
    • Email Components
    • From: (Sender Information)
      • Unhelpful From Lines: 8 that didn't work
      • Effective From Lines: 12 that worked well
    • Subject: (Topic)
      • Effective Subjects: 18 words and terms that worked well
      • Ineffective Subjects: 10 words and terms that cause users to delete messages
      • Other Kinds of Subject Problems
    • To: (Recipient Information)
    • The In-Box View
    • Message Body
      • Order
      • Style
      • Mistakes to Avoid
      • Information
      • Format
    • Order Confirmations
    • Shipping Confirmations
    • Cancellations and Refunds
    • Downloads
    • Reservation Confirmations and e-Tickets
    • Message Sequences
  7. Dealing with Important Customer Concerns
    • Giving and Getting Information
      • Personal Information
      • Company Information
      • Answering Questions
      • Being Available
      • Give People What They Want
    • Preventing Misunderstandings
    • Improving Practices and Policies
      • Preaching to the Choir
      • Repeat Key Information
      • Customers Love Service
      • Making People Feel Safer
  8. Anatomy of the Successful Message
    • Measuring Message Success
    • Recommended Features by Type of Message
      • Agreement Change Notices
      • Available Now Notices
      • Billing and Payment Notices, Cancellations, Returns, Refunds, Rebates, and Bonuses
      • Customer Service Messages
      • Failure Notices
      • Government Responses
      • Information Request Responses
      • Order and Service Confirmations
      • Shipment Notifications
      • Registration and Account Information
      • Reservation Confirmations and E-tickets
      • Status Notifications
      • Profile Update Notifications
  9. Methodology
    • How the Study was Conducted
    • Participants
    • Test Tasks
    • Considerations When Planning Your Own Email Studies
      • Email headers
      • Dates
      • Offensive messages
      • Recipient
      • Data capture and note taking
      • What to test in email messages

What You Get

 
  • Checklist of 74 specific design recommendations: review your email design for these 74 items, and you will discover several things that need improvement.
    • The average website typically violates about half of our usability guidelines. You might have the one perfect site in the world that does everything right, but the odds are against you. It is safest to score your design against a checklist of usability guidelines to make sure you don't do anything wrong.
  • Description of how users behave when using a wide variety of email messages, including extensive quotes (often colorful, because they were often annoyed). Learn from the users' comments and reactions to common design mistakes we tested.
  • 40 screenshots of transactional emails with descriptions of why they worked well for users or caused them problems in usability testing.
  • Inbox view of 60 emails with data showing how many users would save or open each message (the 40 transactional messages we tested plus 20 regular emails included for context)
  • $40,000 of user research at 0.3% of the cost.
  • Test methodology description, allowing you to run your own user tests of your own emails.

Who Should Read This Report?

This report has important information for:
  • Anybody who is responsible for the design of automated email messages.
  • Executives in charge of Internet communications strategy or online customer service

Running a similar usability study yourself to collect comparative design lessons from a large number of emails would cost more than $40,000 and several months of an experienced usability professional's time.

Conducting business with enough sites to collect your own sample of message would require at least ten hours full-time work, and the cost of your sample purchases would be much more than the small fee for this report.

Please help us continue publish low-price reports by buying a site license if you have colleagues who will read the report. If you only need it for yourself, then that's obviously what the single-user license is for. If somebody "gives" you a copy, then please buy a download anyway to keep prices down in the future.

Download Report (PDF file, 110 pages) Download Report (from eSellerate)

$119 for the PDF file (110 pages)
$224 for site license to make copies

                        
  

See also Related Reports
Email Newsletters
Design guidelines for subscription, newsletter content, and account maintenance.

E-Commerce User Experience
Usability of websites that sell stuff.
 

Frequently Asked Question: File Format Used
The report is a standard PDF file, formatted to print on both 8.5x11 and A4 paper. Any recent version of the Acrobat Reader will suffice to read or print the file. No special software is needed. The file is not copy-protected: we trust you to buy a site license if you are going to have multiple people read the report.
 

Press Coverage

Line56:
Automated Email Pitfalls and Promises

InternetNews:
Interface Errors Spell Doom for E-mailers

MediaPost:
Researcher Confirms Email Marketing Fear
 


NN/g Contact Information

Copyright © 1998-2006 Nielsen Norman Group.  All Rights Reserved