Industry

Reminded Anew: ‘A Lot of Room for Humility in Polling’

November 9, 2020 1319
sad face selected in checklist

Election polling is facing yet another reckoning following its uneven-at-best performance in this year’s voting.

Although the outcome in the 2020 presidential race remained uncertain the next day, it was evident that polls faltered, overall, in providing Americans with clear indications as to how the election would turn out.

And that misstep promises to resonate through the field of survey research, which was battered four years ago when Donald Trump carried states such as Wisconsin, Michigan and Pennsylvania, where polls indicated he had almost no chance of winning. Prominent, poll-based statistical forecasts also went off-target in 2016.

The Conversation logo
This article by W. Joseph Campbell originally appeared on The Conversation, a Social Science Space partner site, under the title “An embarrassing failure for election pollsters”

Those failings deepened the embarrassment for a field that has suffered through – but has survived – a variety of lapses and surprises since the mid-1930s. Many of those flubs and failings are described in my latest book, “Lost in a Gallup: Polling Failure in U.S. Presidential Elections.”

Criticism was intense in some quarters Wednesday. Politico’s widely followed “Playbook” newsletter was notably scathing. “The polling industry is a wreck,” it declared, “and should be blown up.”

Many surprises

While that assessment seems extreme, especially given polling’s resiliency over the decades, the poll-driven expectation that former Vice President Joe Biden would lead Democrats in a sweeping “blue wave” went unfulfilled. Biden may still win the presidency, but it will not be in a landslide.

Biden’s overall polling lead, as compiled by RealClearPolitics.com, stood at 7.2 percentage points on the morning of Election Day. A little more than 24 hours later, his lead in the national popular vote was almost 3 percentage points.

A screenshot of pre-election presidential polling. These polls show Biden with a clear lead over Trump.
CNN posted national polls on the presidential race, taken between 10/16/20 and 11/1/20. (Screenshot, CNN, CC BY)

Pollsters often seek comfort, and protection, from critics in asserting that pre-election surveys are not predictions. But the nearer they are to the election, the more reliable polls ought to be. And a number of individual pre-election polls were embarrassingly wide of the mark.

A notable example was the final Washington Post/ABC News poll in Wisconsin, released last week, which gave Biden a stunning 17-point lead. The outcome there was still undecided Wednesday morning, but the margin surely will not be close to 17 points.

Indeed, the polling surprises were many and included Senate races such as those in Maine, where Republican Susan Collins appears to have fended off a well-financed challenger to win a fifth term, and South Carolina, where Republican Lindsey Graham rather easily won reelection despite polls that indicated a much closer race. Graham declared after his victory became clear, “To all the pollsters out there, you have no idea what you’re doing.”

It appears that Republicans will keep control of the U.S. Senate despite expectations, fueled by polls, that control of the upper house was likely to flip to the Democrats.

Polling problems not new

The 2020 election may represent another chapter in the controversies that have periodically surrounded election polls since George Gallup, Elmo Roper and Archibald Crossley initiated their sample surveys during the 1936 presidential campaign. The most dramatic polling failure in U.S. presidential elections came in 1948, when President Harry S. Truman defied the pollsters, the pundits and the press to win reelection over the heavily favored Republican nominee, Thomas E. Dewey.

The surprise this year is not remotely akin to the epic polling failure of 1948. But it is striking how polling missteps are so varied, and almost never the same – much as Leo Tolstoy said of unhappy families: each “is unhappy in its own way.”

Factors that gave rise to this year’s embarrassment may not be clear for weeks or months, but it is no secret that election polling has been confronted with several challenges difficult to resolve. Among them is the declining response rates to telephone surveys conducted by operators using random dialing techniques.

That technique used to be considered the gold standard of survey research. But response rates to telephone-based polls have been in decline for years, forcing polling organizations to look to, and experiment with, other sampling methods, including internet-based techniques. But none of them has emerged as polling’s new gold standard.

One of polling’s most notable innovators was Warren Mitofsky, who years ago reminded his counterparts that there’s “a lot of room for humility in polling. Every time you get cocky, you lose.”

Mitofsky died in 2006. His counsel rings true today.

W. Joseph Campbell is a tenured full professor in the American University School of Communication's Communication Studies program. He joined the AU faculty in 1997, after some 20 years as a professional journalist. Assignments in his award-winning journalism career took him across North America to Europe, West Africa, and parts of Asia. Campbell is the author of seven books, including most recently Lost in a Gallup: Polling Failure in U.S. Presidential Elections.

View all posts by W. Joseph Campbell

Related Articles

‘Settler Colonialism’ and the Promised Land
International Debate
September 27, 2024

‘Settler Colonialism’ and the Promised Land

Read Now
Webinar: Banned Books Week 2024
Event
September 24, 2024

Webinar: Banned Books Week 2024

Read Now
Research Assessment, Scientometrics, and Qualitative v. Quantitative Measures
Impact
September 23, 2024

Research Assessment, Scientometrics, and Qualitative v. Quantitative Measures

Read Now
Revisiting the ‘Research Parasite’ Debate in the Age of AI
International Debate
September 11, 2024

Revisiting the ‘Research Parasite’ Debate in the Age of AI

Read Now
This Anthropology Course Looks at Built Environment From Animal Perspective

This Anthropology Course Looks at Built Environment From Animal Perspective

Title of course: Space/Power/Species What prompted the idea for the course? A few years ago, I came across the architect Joyce Hwang’s […]

Read Now
Trippin’ Forward: Management Research and the Development of Psychedelics

Trippin’ Forward: Management Research and the Development of Psychedelics

Charlie Smith reflects on his interest in psychedelic research, the topic of his research article, “Psychedelics, Psychedelic-Assisted Therapy and Employees’ Wellbeing,” published in Journal of Management Inquiry.

Read Now
Crafting the Best DEI Policies: Include Everyone and Include Evidence

Crafting the Best DEI Policies: Include Everyone and Include Evidence

Organizations shouldn’t back away from workplace DEI efforts. Rather, the research suggests, they should double down, using a more inclusive approach that emphasizes civility and dialogue – one aimed at finding common ground.

Read Now
0 0 votes
Article Rating
Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

0 Comments
Newest
Oldest Most Voted
Inline Feedbacks
View all comments