Fun With Cherry Picking

May 4th, 2005

Posted by: Roger Pielke, Jr.

Two blog posts from recent days highlight the cherry picking of information to put a favorable spin on information.

Chris Mooney does a nice job showing differences between a press release on a recent paper by Hansen et al. issued by Columbia University and a version of the same press release issued by NASA. Mooney argues that the differences show that, “The tenor of these edits is all in one direction: Make the findings seem less alarming–i.e., less demanding of political action, and also less newsworthy.” Of course, the authors of the Columbia press release also had decisions to make about how to portray the Hansen paper.

At Climate Audit, a recent post makes the case that the IPCC selectively ignored inconvenient data when creating a graphed showing paleoclimate temperature reconstructions. Climate Audit then presents its recreation of the graph in question with the previously not-included data added and suggests that the IPCC did not include the data because it complicated its conclusions.

Both of these instances are great examples of the “cherry pick — the careful selection of information to buttress a particular predetermined perspective while ignoring other information that does not. In other words, take the best and leave the rest.” NASA is allegedly trying to present the Hansen paper in a way that puts the current Administration’s climate policies in the best light, and the IPCC is allegedly trying to present data that best support its conclusions. If we get a bit reflexive about this, in a similar manner, Chris Mooney is selectively focusing on data and anecdotes that make the Bush Administration look bad (e.g., he has not vetted every agency press release), and Climate Audit is focused on holding the paleo-climate science community accountable (and similarly has not audited every IPCC graph). Here at Prometheus we selectively focus on examples and cases at the messy interface of climate politics and science (and we tend to focus on problematic aspects of that interface). But of course we should not expect to receive information that is not selective; it would be of little use. Weblogs are useful because they are selective in their presentation of information.

All of this is to say – to quote Dan Sarewitz — all uses of facts and information are selective. Every single one. There is no alternative. Every time anyone makes an argument and invokes facts or information they have some agenda for doing so (except Michael Crichton, that is). That NASA or the IPCC (or Chris Mooney or Climate Audit or Prometheus) have agendas in not surprising. In neither case do Chris Mooney or Climate Audit allege (I think this is correct) that either NASA or the IPCC has engaged in scientific misconduct. What they are saying is that each organization has acted in ways to present information in a manner that further its own interest , perhaps revealing an underlying agenda, probably political.

Good for Chris Mooney and good for Climate Audit. Such close attention can help both the IPCC and NASA realize that people are paying attention to their use of information and facts. Knowing that people are paying attention will mean that NASA and IPCC may be less likely to go beyond cherry picking to providing information that is mistaken or mischaracterized. NASA and IPCC (and bloggers as well) should care because if people come to learn that their information providers are playing fast and loose with facts and information, then with some audiences their institutional legitimacy and authority may be placed at risk.

Anytime someone uses facts or information to make an argument, that use is selective. Cherry picking is inevitable. But it is important to recognize that how one uses information can either foster or damage legitimacy and authority (on this, see recent reports on use of intelligence leading to the war in Iraq).

2 Responses to “Fun With Cherry Picking”

    1
  1. MK Says:

    Cherry picking is one thing. And yes everyone does it to one degree or another. But Mooney’s last paragraph in the original post also talks about the change of wording to tone things down, make it seem less alarming. Maybe you can argue that’s simply editor’s prerogative, but taken all together I think it looks pretty bad.

  2. 2
  3. The Post-Normal Times - Perspectives on Environmental Science and Policy Decisions Says:

    Rules of the science & policy game

    A few weeks ago, Prometheus (aka, Roger Pielke) raised some good questions that beg for more discussion. In a nutshell, and in my own words, given that there is a vast peer-reviewed literature of Science & Technology Studies (STS) that…