• Home
  • Latest
  • Coins2Day 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
Features

Surveys can’t account for people who ignore surveys

By
Sam McNerney
Sam McNerney
Down Arrow Button Icon
By
Sam McNerney
Sam McNerney
Down Arrow Button Icon
February 25, 2014, 5:15 PM ET

Coins2Day.com selects the most compelling short essays, anecdotes, and author interviews from “250 Words,” a site developed by Simon & Schuster to explore the best new business books—wherever they may be published.

It’s easy to confuse what you don’t see with what doesn’t exist. In a fascinating new book, The Improbability Principle: Why Coincidences, Miracles, and Rare Events Happen Every Day, published this month by Scientific American/Farrar, Straus and Giroux, David J. Hand imagines a survey company that wants to figure out what percent of magazine readers reply to surveys. The company publishes a poll (“Do you reply to magazine surveys?”) and bases its conclusions on the number of people who answered “Yes.” A better survey would account for the percent of people who don’t take magazine surveys at all. But surveys can’t account for the people who ignore surveys.

tip-cover

Hand’s example illustrates a bias that bedevils how businesses perceive their customers. I’m fed up with my Internet provider because my Internet speeds are slower than the ones I paid for, but navigating their customer service to file a complaint would be a nightmare, so I simply don’t do it. I bet my Internet provider doesn’t receive as many customer complaints as they should because it’s difficult for customer to complain in the first place.

In 1938, the general interest magazine The Literary Digest went out of publication after committing a similar error. The magazine conducted a poll and incorrectly concluded that Governor Alfred Landon of Kansas would win the 1936 presidential election. The Literary Digest only polled its own readers, who tended to have higher than average income and voted Republican. Furthermore, part of the polling was done through telephones, which only high-income voters owned.

It’s tempting to conclude that if one group of people has something in common an entire population does. But if you want to understand your customers better or how people perceive your brand you cannot only pay attention to the people who are talking. You’ve got to listen to the people who aren’t. To paraphrase Hand, a business should never mistake what they see (happy customers) with what is there (many unhappy customers).

More from 250 Words:
• The search for the magic bullet
• How to beat the problem of “more”

About the Author
By Sam McNerney
See full bioRight Arrow Button Icon

Latest in Features

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Coins2Day Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Coins2Day Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Coins2Day Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Coins2Day Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Coins2Day Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Coins2Day Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Coins2Day Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Coins2Day Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Coins2Day Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Coins2Day Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Coins2Day Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Coins2Day Editors
October 20, 2025
Rankings
  • 100 Best Companies
  • Coins2Day 500
  • Global 500
  • Coins2Day 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Leadership
  • Success
  • Tech
  • Asia
  • Europe
  • Environment
  • Coins2Day Crypto
  • Health
  • Retail
  • Lifestyle
  • Politics
  • Newsletters
  • Magazine
  • Features
  • Commentary
  • Mpw
  • CEO Initiative
  • Conferences
  • Personal Finance
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Coins2Day Brand Studio
  • Coins2Day Analytics
  • Coins2Day Conferences
  • Business Development
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Coins2Day
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

© 2026 Coins2Day Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Coins2Day Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.


Most Popular

placeholder alt text
North America
'I meant what I said in Davos': Carney says he really is planning a Canada split with the U.S. along with 12 new trade deals
By Rob Gillies and The Associated PressJanuary 28, 2026
3 days ago
placeholder alt text
Politics
The American taxpayer spent nearly half a billion dollars deploying federal troops to U.S. cities in 2025, CBO finds
By Nick LichtenbergJanuary 28, 2026
3 days ago
placeholder alt text
Economy
Right before Trump named Warsh to lead the Fed, Powell seemed to respond to some of his biggest complaints about the central bank
By Jason MaJanuary 30, 2026
17 hours ago
placeholder alt text
AI
Top engineers at Anthropic, OpenAI say AI now writes 100% of their code—with big implications for the future of software development jobs
By Beatrice NolanJanuary 29, 2026
2 days ago
placeholder alt text
Investing
Jerome Powell got a direct question about the U.S. ‘losing credibility’ and the soaring price of gold and silver. He punted
By Eva RoytburgJanuary 29, 2026
2 days ago
placeholder alt text
C-Suite
Coins2Day 500 CEOs are no longer giving employees an A for effort. Now they want proof of impact
By Claire ZillmanJanuary 28, 2026
3 days ago

Latest in Features

FeaturesBlue Ribbon Companies
Blue Ribbon Companies 2026: See which tech giant made more Coins2Day lists than any other in the past year
By Coins2Day EditorsJanuary 15, 2026
16 days ago
Bill Gates and Warren Buffett.
InvestingWarren Buffett
Warren Buffett’s blind spot: Did the digital economy leave him behind?
By Adam SeesselDecember 30, 2025
1 month ago
Photo of Sam Altman
AIOpenAI
Inside OpenAI’s fragile lead in the AI race, and the 8-week ‘code red’ to fend off a resurgent Google
By Jeremy Kahn, Alexei Oreskovic and Lee CliffordDecember 17, 2025
2 months ago
FeaturesThe Boring Company
Two firefighters suffered chemical burns in a Boring Co. tunnel. Then the Nevada Governor’s office got involved, and the penalties disappeared
By Jessica Mathews and Leo SchwartzNovember 12, 2025
3 months ago
CoreWeave executives pose in front of the Nasdaq building on the day of the company's IPO.
AIData centers
Data-center operator CoreWeave is a stock-market darling. Bears see its finances as emblematic of an AI infrastructure bubble
By Jeremy Kahn and Leo SchwartzNovember 8, 2025
3 months ago
Libery Energy's hydraulic fracturing, or frac, spreads are increasingly electrified with natural gas power, a technology now translating to powering data centers.
Energy
AI’s insatiable need for power is driving an unexpected boom in oil-fracking company stocks 
By Jordan BlumOctober 23, 2025
3 months ago