Time Out

Understanding from the inside out.

Prediction is difficult, especially about the future

Prediction is difficult, especially about the future

Today is Election Day, and soon the professional prognosticators - those pundits and pollsters, social scientists and former politicians who opine and explain on 24/7 T.V., in newspapers and online - soon they will quiet down. They'll take a breath while the actual votes are counted, and then they'll be back in their seats, regardless of outcome, and begin explaining to us why the vote turned out the way it did.

Do these folks know what they're talking about?

Philip Tetlock, a psychologist and the University of California, Berkeley, tried to find out.

He noticed that foreign policy experts, just like the experts on voting behavior, often predicted diametrically opposite outcomes. When he tracked their predictions re Ronald Reagan's foreign policy toward the Soviet Union back in 1984 he found that all the pundits and experts had been wrong! Neither hawks nor doves anticipated the rise of Mikhail Gorbachev and glasnost.

Tetlock then took on the prediction industry by selecting 284 people who made their living giving advice or commenting on political and economic issues. They included journalists, economists, foreign policy experts and intelligence analysts. Over the next 20 years he asked them to make predictions (e.g., would Quebec secede from Canada? Would the dot-com bubble burst?), rating the probability of several possible outcomes.

What was the result of the experts' performance? Worse than chance. Neither political affiliation nor years of education made a difference. Conservatives, moderates and liberals, Master's and Ph.D.s were all lousy when it came to forecasting.

In most of our occupations, failure tends to have an adverse effect on our professional credibility. Not so in the gabby world of punditry! Talking heads continue to talk for pay, and their words and opinions continue to drive our public discourse with wrongheaded notions and inaccurate reasoning.

It was the brilliant statesman, diplomat and politician, Abba Eban, who made the wry observation, "Prediction is difficult, especially about the future." Although we must plan and prepare for the future, tomorrow can - and probably will - continue to surprise us.

It is a humble truth that media "experts" would do well to keep in mind.

 



Subscribe to Time Out

Renee Garfinkel, Ph.D., is affiliated with the Institute for Crisis, Disaster and Risk Management at the George Washington University.

more...