女生小视频

Insight and Humans

A new world order is defying the science of polling - what now?

By Timothy Revell

9 November 2016

New 女生小视频. Science news and long reads from expert journalists, covering developments in science, technology, health and the environment on the website and the magazine.

Poll predictions again missed the mark

Mark Wilson/Getty

Some serious wounds need licking in the world of predicting elections. Only yesterday, the majority of pollsters were predicting a Hillary Clinton presidency with a probability ranging from around all the way to . Now, Donald Trump has emerged victorious.

鈥淭his failure of polling was the largest in a presidential election year in decades. It’s going to take some time to sort out what went wrong,鈥 says , whose poll analysis blog gave Trump only a 1 per cent chance of success.

So why didn鈥檛 anyone see it coming?

In recent years, websites such as 鈥檚 blog have become synonymous with US elections. Silver and others take hundreds of different polls from across the country and use them to run thousands of simulations, with the results informing their predictions. In 2012, this method famously led Silver to correctly call the result in all 50 states.

The wisdom behind this type of analysis is that individual opinions polls can contain many different biases. Polling companies can鈥檛 ask the whole population what they think, so must instead take a small sample and then try to readjust the outcomes to reflect the nation鈥檚 demographics. By aggregating the different polls and weighting them based on historical accuracy, the hope is that the biases will cancel each other out. But this time it clearly hasn鈥檛 worked.

鈥淒onald Trump exceeded his polls against Hillary Clinton by about 4 percentage points. That may not sound like a lot, but with such a close race, it was enough to reverse his fortunes,鈥 says Wang.

It is hard to conclusively say that predictions such as Silver鈥檚 70 per cent chance for Clinton were wrong per se, because his model still left a 30 per cent chance of victory for Trump. If we could run the election twice more and see Clinton win both, the statistical model would prove true 鈥 but of course, the real world doesn鈥檛 work like that.

Better predictions

So what could the political numerati have done to improve their guesses? The conclusive exit poll from the US census board has yet to be published, but provides some clues as to possible mistakes. It seems that perhaps the biggest influence came from the sheer number of white voters of all genders, age ranges and education levels who turned out in support of Trump. Additionally, Clinton did not do as well with non-white voters as anticipated.

A big shift in the political landscape often involves success in appealing to a group that previously hasn鈥檛 closely engaged in politics. These are the people that are undercounted by polls.

鈥淐hange is always hard to poll. Trump has broken the political mould, which has made it hard to predict how people would react to him,鈥 says Anthony Wells of UK polling firm YouGov. 鈥淭he people that answer opinion polls are unusual. There鈥檚 only ever a very low response rate, so the people that we hear from are often highly engaged in politics in a way that doesn鈥檛 reflect the general population.鈥

The result of the US presidential election echoes that of the UK general election in 2015, which pollsters also got wrong by predicting a hung parliament instead of a Conservative majority, and the UK vote on Brexit, which was expected to be in favour of remaining in the European Union.

In both cases, the mistake was put down to underestimating the role of people that were missed in the polls, and the same could be true for the US presidential election. It seems that the direction of politics on both sides of the Atlantic is being dictated by a new voice 鈥 and it鈥檚 time the pollsters start listening.

Topics:

Sign up to our weekly newsletter

Receive a weekly dose of discovery in your inbox. We'll also keep you up to date with New 女生小视频 events and special offers.

Sign up
Piano Exit Overlay Banner Mobile Piano Exit Overlay Banner Desktop