Sacred Cows Make the Best Burgers
That’s the title of a recent book…
WeatherBrains is the weekly netcast that’s all about weather. Each week, the show features some of the best minds in weather. Recent guests have included legendary radar expert Les Lemon, BBC Weather Presenter Hannah Bayman, famed Oklahoma City television meteorologist Gary England, severe weather expert Chuck Doswell and the Long Ranger from Accu-Weather, the incomparable Joe Bastardi.
This Monday night, one of the top television meteorologists in the country, Dave Freeman from KSN in Wichita, will be the Guest WeatherBrain. Dave is a leader in leveraging social science to improve the impact of weather forecasting. He will talk about killing sacred cows in weather forecasting.
One of his sacred cows is probability of precipitation (PoP). Most people want to have them in their forecasts, but few people really understand them. Heck, even us weather people don’t really understand them. In fact, you can ask most weather people and they can’t give you the real definition.
We have been running a poll on the blog for the past few weeks about the meaning of PoPs. The question asked: “There is a 60% chance of rain tomorrow. Which option best describes what the forecast means?” The answers were: (A) It will rain tomorrow in 60% of the area; (B) It will rain tomorrow for 60% of the time; (C) It will rain on 60% of the days like tomorrow and (D) 60% of weather forecasters believe it will rain tomorrow. There were 1,849 votes through Friday night.
The most chosen answer was A (44%). Dave did an identical poll on his website and got the same result. Most people interpret a 60% PoP to say it will rain over 60% of the area. That is not the technically correct answer, although the official NWS definition does define PoPs as the areal coverage multiplied by the forecaster’s confidence. So, if the forecaster believes there is a 100% chance there will be measurable rain in the forecast area, but believes there is going to only be 20% coverage, it would result in a PoP of 20%. This is a subjective way for forecasters to arrive at a number. The PoP number in a forecast is indeed a subjective thing.
Answer B was chosen 15% of the time. That answer is incorrect. PoPs have nothing to do with duration.
Answer D was chosen 9% of the time. While that answer is not correct, there is one interpretation of probability in meteorology that does relate to this concept. Powerful computers allow us to execute multiple runs of numerical weather prediction models using slightly different initial conditions. This results in a range of output. We call it ensemble forecasts. The relative number of times that one result occurs can be used to approximate the probability that that result will happen.
Answer C is the correct answer. It is also the least correct sounding one, so it was chosen 24% of the time. That means that the incorrect answer was chosen 76% of the time. A 60% probability means there is a 60% chance that there will be measurable rain. The convoluted answer makes sense when you consider flipping a coin. There is a 50% probability it will come up heads, and a 50% probability that it will be tails. Flip it twice, and it could be 50/50 or 0/100. Flip it ten times and a myriad of results could occur. Flip it one million times and the results will trend to 50/50.
One other way of interpreting probability is that it is the result of a function as the number of samples gets sufficiently large. Of all the times that all of the atmospheric conditions were like tomorrow, it rained 60% of the time. If we had an unlimited number of samples, we would not need a computer program, we would know the answer. The problem is, we can’t accurately know the initial state of the atmosphere enough, nor is our understanding of the physics of the atmosphere good enough for us to accurately predict the weather 100%. All weather forecasts have an element of uncertainty in them.
How do you use PoPs? Share your thoughts on the subject…
Follow my daily weather history tweets on Twitter @wxhistorian.
February 6th, 2010 at 7:46 am
“How do you use PoPs? Share your thoughts on the subject… ”
Between 10% and 30% I will not get wet.
Between 40% and 60% there is a great chance I will get wet
70% to 100% I will get wet.
Now the above is for rain.
70% to 100 % forecast for snow, I may see a few flakes!
February 6th, 2010 at 10:27 am
60% chance of rain in the forecast means carry the umbrella. 20% chance of rain in the forecast means carry the umbrella. Living in the southeast, I quit listening to rain probabilities a LONG time ago.
February 6th, 2010 at 2:59 pm
being in the meteorology field, I of course knew the answer. However, I was shocked how many misunderstood what the percentages meant! I see now why I get the ” weatherman are the only people who can be wrong 80% of the time and keep their jobs” this is absolutely a fallacy. Even a 90% chance of rain isnt a busted forecast if it doesnt rain =/ These 100% forecasts are another story entirely (I honestly don’t think we should use 100%, ever.)But generally the “weatherman said it would rain and it didnt” crowd have aggravated me to no end. Great poll guys, very enlightening. I’ll try not to be so angry next time, realizing it is just a misunderstanding, not an insult.
February 6th, 2010 at 3:27 pm
thank you logan. my sentiments exactly. we tried to tell them, but this IS a tricky little concept to wrap your mind around. like you said, it was a great poll.
February 8th, 2010 at 9:22 am
[...] fuel for the discussion on tonight’s WeatherBrains. Here are links to the other two posts: Sacred Cows Make the Best Burgers Your Thoughts [...]