Archive for the ‘Scientific Assessments’ Category

Does the IPCC’s Main Conclusion Need to be Revisited?

May 29th, 2008

Posted by: Roger Pielke, Jr.

Yesterday Nature published a paper by Thompson et al. which argues that a change in the observational techniques for taking the temperatures of the oceans led to a cold bias in temperatures beginning in the 1940s. The need for the adjustment raises an interesting, and certainly sensitive, question related to the sociology and politics of science: Does the IPCC’s main conclusion need to be revisited?

(more…)

Homework Assignment: Solve if you Dare

May 23rd, 2008

Posted by: Roger Pielke, Jr.

homework.png

The graph above shows three trend lines.

BLUE: Temperature Trend prediction from the 1990 IPCC report
RED: Temperature Trend prediction from the 2007 IPCC report
GREEN: Observed Trend for 2001-2007 (from average of four obs datasets)

All data is as described in this correspodence (PDF).

Your assignment:

Which IPCC prediction is the trend observed 2001-2007 more consistent with and why? Show your work!

You are free to bring in whatever information and use whatever analysis that you want.

Nature Letters on PWG

May 22nd, 2008

Posted by: Roger Pielke, Jr.

The 8 May 2008 issue of Nature published 4 letters in response to the Pielke, Wigley, and Green commentary on IPCC scenarios (PDF). This provides a few excerpts from and reactions to these letters.

(more…)

World Bank and UK Government on Climate Change Implications of Development

May 22nd, 2008

Posted by: Roger Pielke, Jr.

growthreport.jpg

The World Bank and UK government issued a report today titled, “Strategies For Sustained Growth And Inclusive Development.” Here is what the report says about the implications for climate change of development in the developing world (p. 86), something that the report calls absolutely necessary:

(more…)

An *Inconsistent With* Spotted, and Defended

May 21st, 2008

Posted by: Roger Pielke, Jr.

Readers following recent threads know that I’ve been looking for instances where scientists make claims that some observations are “inconsistent with” the results from climate models. The reason for such a search is that it is all too easy for modelers to claim that anything and everything under the sun is “consistent with” their predictions, sometimes to avoid the perception of a loss of credibility in the political battle over climate change.

I am happy to report that claims of “inconsistent with” do exist. Here is an example from a paper just out by Knutson et al. in Nature Geoscience:

(more…)

Do IPCC Temperature Forecasts Have Skill?

May 19th, 2008

Posted by: Roger Pielke, Jr.

[UPDATE] Roger Pielke, Sr. tells us that we are barking up the wrong tree looking at surface temperatures anyway. He says that the real action is in looking at oceanic heat content, for which predictions have far less variability over short terms than do surface temperatures. And he says that observations of accumulated heat content over the past 4 years “are not even close” to the model predictions. For the details, please see for your self at his site.]

“Skill” is a technical term in the forecast verification literature that means the ability to beat a naïve baseline when making forecasts. If your forecasting methodology can’t beat some simple heuristic, then it will likely be of little use.

What are examples of such naïve baselines? In weather forecasting historical climatology is often used. So if the average temperature in Boulder for May 20 is 75 degrees, and my prediction is for 85 degree, then any observed temperature below 80 degrees will mean that my forecast had no skill. In the mutual fund industry stock indexes are examples of naive baselines used to evaluate performance of fund managers. Of course, no forecasting method can always show skill in every forecast, so the appropriate metric is the degree of skill present in your forecasts. Like many other aspects of forecast verification, skill is a matter of degree, and is not black or white.

Skill is preferred to “consistency” if only because the addition of bad forecasts to a forecasting ensemble does not improve skill unless it improves forecast accuracy, which is not the case with certain measures of “consistency,” as we have seen. Skill also provides a clear metric of success for forecasts, once a naïve baseline is agreed upon. As time goes on, forecasts such as those issued by the IPCC should tend toward increasing skill, as the gap between a naive forecast and a prediction grows. If a forecasting methodology shows no skill then it would be appropriate to question the usefulness and/or accuracy of the forecasting methodology.

In this post I use the IPCC forecasts of 1990, 2001, and 2007 to illustrate the concept of skill, and to explain why it is a much better metric that “consistency” to evaluate forecasts of the IPCC.

(more…)

Old Wine in New Bottles

May 19th, 2008

Posted by: Roger Pielke, Jr.

The IPCC will be using new scenarios for its future work, updating those produced in 2000, the so-called SRES scenarios. This would be good news, since, as we argued in Nature last month, the IPCC scenarios contain some dubious assumptions (PDF). But from the looks of it, it does not appear that much has changed, excpet the jargon. The figure below compares the new scenarios as presented in a report from a meeting of the IPCC held last month (source: PDF) with those from the 2000 IPCC SRES report. I have presented the two sets of scenarios on the same scale to facilitate comparison. Do they look much different to you?

ScenariosIPCC1.png

The Politicization of Climate Science

May 16th, 2008

Posted by: Roger Pielke, Jr.

[Update: The ever helpful David Roberts of Grist Magazine points out that an op-ed in the Washington Times yesterday makes the same logical error that I point out in this post below made by Patrick Michaels -- namely that short-term predictive failures obviate the need for action. The op-ed quotes me and says that I am "not previously a global warming skeptic," which is correct, but implies that somehow I am now . . . sorry, wrong. It also quotes my conclusion that climate models are "useless" without the important qualifiers **for decision making in the short term when specific decisions must be made**. Such models are great exploratory scientific tools, and were helpful in bringing the issue of greenhouse gases to the attention of decision makers. I've emailed the author making these points, asking him to correct his piece.]

Here I’d like to explain why one group of people, which we might call politically active climate scientists and their allies, seek to shut down a useful discussion with intimidation, bluster, and name-calling. It is, as you might expect, a function of the destructive politics of science in the global warming debate.

(more…)

Comparing Distrubutions of Observations and Predictions: A Response to James Annan

May 15th, 2008

Posted by: Roger Pielke, Jr.

James Annan, a climate modeler, has written a post at his blog trying to explain why it is inconceivable that recent observations of global average temperature trends can be considered to be inconsistent with predictions from the models of the IPCC. James has an increasing snarky, angry tone to his comments which I will ignore in favor of the math (and I’d ask those offering comments on our blog to also be respectful, even if that respect is not returned), and in this post I will explain that even using his approach, there remains a quantitative justification for arguing that recent trends are inconsistent with IPCC projections.

(more…)

Lucia Liljegren on Real Climate’s Approach to Falsification of IPCC Predictions

May 14th, 2008

Posted by: Roger Pielke, Jr.

are-swedes-tall.jpg

Lucia Liljegren has wonderfully clear post up which explains issues of consistency and inconsistency between models and observations using a simple analogy based on predicting the heights of Swedes.

She writes;

I think a simple example using heights is helps me explain the answer to these questions:

1. Is the mean trend in surface temperature over time predicted by the IPCC consistent with the temperature trends we have been experiencing? (That is: is 2C/century consistent with the trend we’ve seen? )
2. Is the lowest uncertainty bound the IPCC shows the public consistent with the trend in GMST (global mean surface temperature) we have seen since 2001?

I think these questions are important to the public and policy makers. They are the questions people at many climate blogs are asking and they are the questions many voters and likely policy makers would like answered.

I think the answer to both questions is “No, the IPCC predictions are inconsistent with recent data.”

Please go to her site and read the entire post.

She concludes her discussion as follows:

The IPCC projections remain falsified. Comparison to data suggest they are biased. The statistical tests accounts for the actual weather noise in data on earth.

The argument that this falsification is somehow inapplicable because the earth data falls inside the full range of possibilities for models is flawed. We know why the full range of climate models is huge: It contains a large amount of “climate model noise” due to models that are individually biased relative to the system of interest: the earth.

It will continue to admit what I have always admitted: When applying hypothesis tests to a confidence limit of 5%, one does expect to be wrong 5% of the time. It is entirely possible that the current falsification fall in the category of 5% incorrect falsifications. If this is so, the “falsified” diagnosis will reverse, and not we won’t see another one anytime soon.

However, for now, the IPCC projections remain falsified, and will do so until the temperatures pick up. Given the current statistical state ( a period when large “type 2″ error is expected) it is quite likely we will soon see “fail to falsify” even if the current falsification is a true one. But if the falsification is a “true” falsification, as is most likely, we will see “falsifications” resume. In that case, the falsification will ultimately stick.

For now, all we can do is watch the temperature trends of the real earth.