Survey Experts Still Scratching Heads Over Trump-Biden Polling Fails

May 28, 2021 1237

More than six months after the astonishing polling embarrassment in the 2020 U.S. elections, survey experts examining what went wrong are uncertain about what led to the sharpest discrepancy between the polls and popular vote outcome since Ronald Reagan defeated Jimmy Carter in a near-landslide in 1980.

Lingering questions about the misfire in 2020, in which voter support for then-President Donald Trump was understated in final pre-election polls, suggest that troubles in accurately surveying presidential elections could be deeper and more profound than previously recognized. If the source of the polling miscall isn’t clear, then addressing and correcting it obviously becomes quite challenging.

Moreover, as I discussed in my 2020 book Lost in a Gallup, polling failures in presidential elections since 1936 rarely have been repetitive. Just as no two elections are alike, no two polling failures are quite the same.

Over the years, pollsters have anticipated tight presidential elections when landslides have occurred. They have signaled the wrong winner in closer elections. The estimates of venerable pollsters have been singularly in error. Wayward exit polls have thrown Election Day into confusion by identifying the losing candidate as the likely winner. Off-target state polls have confounded expected national outcomes, which essentially was the story in 2016.

The Conversation logo
This article by W. Joseph Campbell originally appeared on The Conversation, a Social Science Space partner site, under the title “Survey experts have yet to figure out what caused the most significant polling error in 40 years in Trump-Biden race”

Support that wasn’t there

In 2020, overall, election polls pointed to Democrat Joe Biden’s winning the presidency. But the polls overstated support for Biden and underestimated backing for Trump no matter how close to the election the poll was conducted and regardless of the methods pollsters chose. Surveys in races for U.S. senator and governor were beset by similar shortcomings.

Those were among the key findings described recently at the annual conference of the American Association for Public Opinion Research, which was convened online. The organization had recruited a task force of 19 experts in survey research who examined the 2020 election polls in detail and reported being unable, so far, to pinpoint specific causes of polling errors.

Their findings did make clear, however, that the 2020 miscall was the most significant in 40 years.

Polls in the presidential race in 2020 collectively overstated Biden’s lead by 3.9 percentage points, the task force chair, Joshua Clinton of Vanderbilt University, said in a presentation at the conference.

This marked the fourth presidential election in the past five in which the national polls, at least to some extent, overstated support for Democratic candidates.

Masking dramatic miscalls

Averaging the polling errors, as the task force did in conducting its analysis, is broadly revealing about the extent of those errors. But it has the effect of masking several dramatic miscalls in late-campaign polls conducted in 2020 by, or for, leading news organizations. The final CNN poll had Biden ahead by 12 points. Surveys for The Wall Street Journal-NBC News and by the Economist-YouGov had Biden winning by 10 percentage points as the campaign wound down. A few polls, such as Emerson College’s survey, came close in estimating the outcome.

Biden won the popular vote by 4.5 percentage points.

Clinton, the Vanderbilt professor, said the task force eliminated several prospective causes of polling error in 2020, including those that likely distorted survey results in key states in 2016 when Trump unexpectedly won an Electoral College victory. Those factors included undecided voters swinging to Trump late in the campaign and a failure by some pollsters to adjust survey results to account for varying levels of education.

White voters without college degrees were understood to have voted heavily for Trump in 2016, but those voters were underrepresented in some polls in key states such as Pennsylvania and Wisconsin, where Trump won narrowly and surprisingly.

A source of the miscalls in 2020, Clinton said, may have been that Republicans were less inclined than Democrats to agree to be interviewed by pollsters.

If that’s so, it’s not entirely clear why that happened. And that prospect troubles pollsters and survey research experts.

Courtney Kennedy, director of survey research at Pew Research Center, said while moderating a panel discussion at the conference that “what keeps me from getting a good night’s sleep these days is the prospect … Republicans, or maybe certain types of Republicans, seem like they’re less inclined to participate in polls these days than Democrats.”

This may be a tough problem for pollsters to overcome, she said, adding, “It would be a real challenge” to calibrate poll-taking to capture such nuanced distinctions.

Likewise, it is unclear whether Trump’s sharp criticism of pre-election polls in 2020 dissuaded his supporters from participating in surveys.

“So it’s possible that these may be short-term phenomena that will abate when Trump is not on the ballot,” Daniel Merkle, president of the American Association for Public Opinion Research, said in a speech recorded for conference-goers.

“On the other hand, it could be a broader issue of conservatives becoming less likely to respond to polls in general because of a decline in social trust, or for some other reasons. It will take further evaluation to understand this nonresponse issue and to adjust for it. This may not be an easy task,” Merkle said.

News headline shows 10 point lead
Screenshot of a Wall Street Journal story about its poll with NBC News, showing Biden with a 10-point lead over Trump in the waning days of the 2020 campaign.

Overblown characterizations

In the immediate aftermath of the 2020 election, several media critics asserted that polling seemed “irrevocably broken” and faced “serious existential questions.”

Such alarming characterizations appear overblown; polls are not going to melt away. After all, election polling represents a slice of a multibillion-dollar industry that includes consumer and product surveys of all types.

And if election polling survived the debacle of 1948 – when President Harry S Truman defied predictions of pollsters and pundits to win reelection – then it surely will live on after the embarrassment of 2020.

W. Joseph Campbell is a tenured full professor in the American University School of Communication's Communication Studies program. He joined the AU faculty in 1997, after some 20 years as a professional journalist. Assignments in his award-winning journalism career took him across North America to Europe, West Africa, and parts of Asia. Campbell is the author of seven books, including most recently Lost in a Gallup: Polling Failure in U.S. Presidential Elections.

View all posts by W. Joseph Campbell

Related Articles

Why Social Science? Because It Makes an Outsized Impact on Policy
March 4, 2024

Why Social Science? Because It Makes an Outsized Impact on Policy

Read Now
The Importance of Using Proper Research Citations to Encourage Trustworthy News Reporting
February 26, 2024

The Importance of Using Proper Research Citations to Encourage Trustworthy News Reporting

Read Now
A Behavioral Scientist’s Take on the Dangers of Self-Censorship in Science
February 14, 2024

A Behavioral Scientist’s Take on the Dangers of Self-Censorship in Science

Read Now
SSRC Links with U.S. Treasury on Evaluation Projects
February 1, 2024

SSRC Links with U.S. Treasury on Evaluation Projects

Read Now
New Report Finds Social Science Key Ingredient in Innovation Recipe

New Report Finds Social Science Key Ingredient in Innovation Recipe

A new report from Britain’s Academy of Social Sciences argues that the key to success for physical science and technology research is a healthy helping of relevant social science.

Read Now
Your Data Likely Isn’t Best Served in a Pie Chart

Your Data Likely Isn’t Best Served in a Pie Chart

Overall, it is best to use pie charts sparingly, especially when there is a more “digestible” alternative – the bar chart.

Read Now
Research Integrity Should Not Mean Its Weaponization

Research Integrity Should Not Mean Its Weaponization

Commenting on the trend for the politically motivated forensic scrutiny of the research records of academics, Till Bruckner argues that singling out individuals in this way has a chilling effect on academic freedom and distracts from efforts to address more important systemic issues in research integrity.

Read Now
0 0 votes
Article Rating
Notify of

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Inline Feedbacks
View all comments