7

It is claimed by Rickova and Irsova, in a paper titled "Publication Bias in Measuring Climate Sensitivity" [A], that:

We present a meta-regression analysis of the relation between the concentration of carbon dioxide in the atmosphere and changes in global temperature. The relation is captured by “climate sensitivity”, which measures the response to a doubling of carbon dioxide concentrations compared to pre-industrial levels. Estimates of climate sensitivity play a crucial role in evaluating the impacts of climate change and constitute one of the most important inputs into the computation of the social cost of carbon, which reflects the socially optimal value of a carbon tax. Climate sensitivity has been estimated by many researchers, but their results vary significantly. We collect 48 estimates from 16 studies and analyze the literature quantitatively. We find evidence for publication selection bias: researchers tend to report preferentially large estimates of climate sensitivity. Corrected for publication bias, the bulk of the literature is consistent with climate sensitivity lying between 1.4 and 2.3C.

Is this true? A paper titled "No evidence of publication bias in climate change science", written by Christian Harlos, Tim C. Edgell & Johan Hollander [B], appears opposed, but finds that while

Our meta-analysis did not find evidence of small, statistically non-significant results being under-reported in our sample of climate change articles

it did find the following:

However, our meta-analysis did find multiple lines of evidence of biases within our sample of articles, which were perpetuated in journals of all impact factors and related largely to how science is communicated: The large, statistically significant effects were typically showcased in abstracts and summary paragraphs, whereas the lesser effects, especially those that were not statistically significant, were often buried in the main body of reports. Although the tendency to isolate large, significant results in abstracts has been noted elsewhere (Fanelli 2012), here we provide the first empirical evidence of such a trend across a large sample of literature.

We also discovered a temporal pattern to reporting biases, which appeared to be related to seminal events in the climate change community and may reflect a socio-economic driver in the publication record. First, there was a conspicuous rise in the number of climate change publications in the 2 years following IPCC 2007, which likely reflects the rise in popularity (among public and funding agencies) for this field of research and the increased appetite among journal editors to publish these articles. Concurrent with increased publication rates was an increase in reported effect sizes in abstracts.

Similar stylistic biases were found when comparing articles from journals with high impact factors to those with low impact factors. High impact factors were associated with significantly larger reported effect sizes (and lower sample sizes; see Fig. 4); these articles also had a significantly larger difference between effects reported in abstracts versus the main body of their reports (Fig. 3). This trend appears to be driven by a small number of journals with large impact factors; however, the result is consistent with those of supplementary studies.

and also shows in Figure 3: Figure displaying Climate Sensitivity estimates, grouped by Journal Impact Factor and Sample Size that when their sample includes all journals (which is required per their above finding that journals with a high impact factor selectively publish larger results), the Climate Sensitivity is estimated at 1.6C per doubling of atmospheric C02.

[A] https://ideas.repec.org/p/fau/wpaper/wp2015_14.html (2015)

[B] https://link.springer.com/article/10.1007/s10584-016-1880-1 (2016)

PS: I found this blog to give a better overview of the claim than I can: http://grokinfullness.blogspot.com/2017/04/publication-bias-in-climate-science.html

  • The second paper is looking at a different sample of papers to the first, and the 'cumulative effect size' column is not a measure of climate sensitivities found from a paper. – James Picone Oct 15 at 2:03
  • 1
    The first paper is a working paper with no citations. It was later published in Energy and Environment (Reckova, Dominika, and Zuzana Irsova. "Publication bias in measuring anthropogenic climate change." Energy & Environment 26.5 (2015): 853-862.) E&E is a biased publication. – David Hammen Oct 15 at 13:38
  • 1
    How is E&E biased? – Charlie Crown Oct 18 at 9:09
  • 1
    @CharlieCrown The journal is well-known for publishing shoddy papers that take a contrarian position on climate change. For example, a paper by Ernst-Georg Beck claiming that CO2 was ~400ppm in the 1800s, and a paper by Oliver Manuel claiming that the sun is made of iron. While I think the purpose of Skeptics is to look at individual claims on their merits, it is worth knowing that being published in E&E isn't much better than being published on a random blog. – James Picone yesterday
  • 1
    @JamesPicone Oh, I don't actually know E&E... I was thinking of Energy and Environmental Science. That would be a different journal. Most journals (all journals) have retractions because garbage makes it in though. I wouldn't hold 2 papers against a journal. – Charlie Crown yesterday

You must log in to answer this question.

Browse other questions tagged .