• Home
  • News
  • Coins2Day 500
  • Tech
  • Finance
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
Features

Surveys can’t account for people who ignore surveys

By
Sam McNerney
Sam McNerney
Down Arrow Button Icon
By
Sam McNerney
Sam McNerney
Down Arrow Button Icon
February 25, 2014, 5:15 PM ET

Coins2Day.com selects the most compelling short essays, anecdotes, and author interviews from “250 Words,” a site developed by Simon & Schuster to explore the best new business books—wherever they may be published.

It’s easy to confuse what you don’t see with what doesn’t exist. In a fascinating new book, The Improbability Principle: Why Coincidences, Miracles, and Rare Events Happen Every Day, published this month by Scientific American/Farrar, Straus and Giroux, David J. Hand imagines a survey company that wants to figure out what percent of magazine readers reply to surveys. The company publishes a poll (“Do you reply to magazine surveys?”) and bases its conclusions on the number of people who answered “Yes.” A better survey would account for the percent of people who don’t take magazine surveys at all. But surveys can’t account for the people who ignore surveys.

tip-cover

Hand’s example illustrates a bias that bedevils how businesses perceive their customers. I’m fed up with my Internet provider because my Internet speeds are slower than the ones I paid for, but navigating their customer service to file a complaint would be a nightmare, so I simply don’t do it. I bet my Internet provider doesn’t receive as many customer complaints as they should because it’s difficult for customer to complain in the first place.

In 1938, the general interest magazine The Literary Digest went out of publication after committing a similar error. The magazine conducted a poll and incorrectly concluded that Governor Alfred Landon of Kansas would win the 1936 presidential election. The Literary Digest only polled its own readers, who tended to have higher than average income and voted Republican. Furthermore, part of the polling was done through telephones, which only high-income voters owned.

It’s tempting to conclude that if one group of people has something in common an entire population does. But if you want to understand your customers better or how people perceive your brand you cannot only pay attention to the people who are talking. You’ve got to listen to the people who aren’t. To paraphrase Hand, a business should never mistake what they see (happy customers) with what is there (many unhappy customers).

More from 250 Words:
• The search for the magic bullet
• How to beat the problem of “more”

About the Author
By Sam McNerney
See full bioRight Arrow Button Icon
Rankings
  • 100 Best Companies
  • Coins2Day 500
  • Global 500
  • Coins2Day 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Leadership
  • Success
  • Tech
  • Asia
  • Europe
  • Environment
  • Coins2Day Crypto
  • Health
  • Retail
  • Lifestyle
  • Politics
  • Newsletters
  • Magazine
  • Features
  • Commentary
  • Mpw
  • CEO Initiative
  • Conferences
  • Personal Finance
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Coins2Day Brand Studio
  • Coins2Day Analytics
  • Coins2Day Conferences
  • Business Development
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Coins2Day
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map

© 2025 Coins2Day Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Coins2Day Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.