35

A widely-commented upon post on reddit claims that pneumonia deaths in the US have "fallen off a cliff this year":

Graph comparing pneumonia deaths per year

In the conversation I saw several links to CDC data, but they are unclear overviews. The diagram includes a link to the raw data [csv] from the CDC's weekly FluView.

  • 52
    Dear HNQ visitors, welcome to Skeptics! Please note that this is not reddit's r/conspiracy. We don't want to hear your personal speculations (in answers or comments). We expect all answers to be referenced, and empirical, not theoretical. – Oddthinking Apr 8 at 3:18
  • Let us continue this discussion in chat. – Oddthinking Apr 8 at 11:34
  • 8
    Yet another COVID-19 question that should have been immediately closed as "current event". What's happening here? – pipe Apr 8 at 14:03
  • 2
    Definitely agree with the other answers about the dataset being incomplete. I've been pushing a similar situation for UK covid deaths where people are transfixed on the daily death number without understanding it's deaths "reported" nor "occured" in last 24 hours. The media are even drawing trend curves from the data not appreciating they're tracking the reporting system and not the deaths. However I think the simple answer to the question of "no" is logically incorrect and should say "we don't know yet". – user55199 Apr 9 at 22:52
  • There is an official statement from the CDC that there is an increase in pneumonia deaths, not a decrease: "While the percent of all deaths due to P&I has increased during weeks 9-12 (7.4-8.2%), the percent of all deaths with Influenza listed as a cause have decreased (from 1.0% to 0.8%) over this same time period. The increase in pneumonia deaths during this time period are likely associated with COVID-19 rather than influenza." cdc.gov/flu/weekly/index.htm So it's a clear "no", but we'll get another week of data tomorrow. – DavePhD Apr 9 at 23:47
42

CDC's own disclaimer on their combined Covid-19+Pneumonia dataset, which is frankly more relevant than merely the pneumonia one:

Data during this period are incomplete because of the lag in time between when the death occurred and when the death certificate is completed, submitted to NCHS and processed for reporting purposes. This delay can range from 1 week to 8 weeks or more, depending on the jurisdiction, age, and cause of death. [...]

COVID-19 death counts shown here may differ from other published sources, as data currently are lagged by an average of 1–2 weeks. [...]

estimates of completeness for pneumonia deaths may provide context for understanding the lag in reporting for COVID-19 deaths, as it is anticipated that these causes would have similar delays in reporting, processing, and coding. However, it is possible that reporting of COVID-19 mortality may be slower or faster than for other causes of death, and that the delay may change over time. Analyses to better understand and quantify reporting delays for COVID-19 deaths and related causes are underway.

And yeah, there are only 2,214 Covid-19 deaths reported by that CDC dataset

enter image description here

Whereas on Apr 06, 2020:

the United States as a whole had reached a death toll of more than 10,000, according to the coronavirus resource centre at Johns Hopkins University in Maryland. The U.S. has seen 10,335 die from COVID-19 causes, according to the [JHU] tally.

So why would you expect the CDC pneumonia stats to be more up-to-date... especially since... the CDC guidance for how to record the cause of death has also evolved:

To try and get a more accurate picture of the crisis, the CDC last week issued updated guidance for certifying deaths due to COVID-19 – protocols similar to those in place for pneumonia and influenza. According to the new directions, if a patient has died from pneumonia, for example, but was also tested positive for COVID-19, someone is required to specify whether COVID-19 played a role in the death and whether it was actually the underlying, primary cause of death.

Cécile Viboud, a staff scientist at the National Institutes of Health (NIH) who specializes in the mortality associated with infectious diseases, said it will likely take years to know the actual death toll of the contagion that has nearly paralyzed much of the nation.

In previous research on the 2009 H1N1 pandemic, Viboud said she concluded that only 15% of the deaths attributed to the disease were identified in laboratory testing.

Instead of trying to suss under which heading the extras deaths might have been recorded, a simpler heuristic [for now] would be to look at the total causes of death and look for a spike; see related/similar question here on Europe and their EuroMOMO metric, where a spike did show up after some weeks, precisely in the regions hit most by Covid-19, debunking similar conspiracy theories that there were no extra deaths in Europe due to Covid-19.

I have qualms about the mod leaving this question open, while it's clearly an "unresolved current event" to a good extent, but there you have the official disclaimer(s) for the [CDC] data.

Excuse my squiggles below, but besides the fact that incomplete data precludes a serious analysis, what exactly is the claim "fallen off a cliff" in the Reddit image referring to here? That:

  • 2019-20 is below the other years on one or both of the big oval areas? (More "suspicious" in the 2nd black one?)
  • 2019-20 has a different post-peak downward slope than the other years? (Pink arrow)
  • 2019-20 has a substantially different slope just for the last segment/data point (green circle)?

enter image description here

Assuming we had the final data in, which of these claim are we supposed to address?

If the claim is (per discussion on chat) "the graph looks suspicious", then probably the best rebuttal is applying the exact same (faulty) graphic method to previous years' (incomplete) data, truncated up to March, as was reported back then.

This was done by a Twitter user, but he links to the CDC data sources, so hopefully/presumably it's verifiable by others (there aren't any calculations/statics involved, just plotting):

enter image description here

Credit should go to @CL for finding this.

| improve this answer | |
  • 7
    "I have qualms about the mod leaving this question open," - I don't think the answer is really the right place to include meta-commentary about your opinions on moderator action taken (or not taken) on the question. If you want to talk about that, it should probably be done in replies to the mod's comments (where relevant) or more likely on meta. – V2Blast Apr 8 at 5:44
  • Why does the CDC say there have been 12,064 COVID-19 deaths in the US? How is COVID-19+Pneumonia almost 10,000 fewer? From cdc.gov/coronavirus/2019-ncov/cases-updates/cases-in-us.html – BurnsBA Apr 8 at 13:05
  • @BurnsBA: on 2nd thought, the 12K channel probably uses this direct reporting system: cdc.gov/coronavirus/2019-ncov/php/reporting-pui.html The latter page is "owned" by NCIRD rather than NVSS/NCHS. (Different division.) – Fizz Apr 8 at 13:32
  • Of some potential interest; it seems to me the WH has shown exactly this kind of graph in their argument for "Opening Up America Again" medicalsciences.stackexchange.com/questions/23275/… – Fizz Apr 17 at 2:25
42

To further illustrate DavePHD's answer regarding incomplete data, please take a look at this screen shot of me comparing the numbers of Pneumonia deaths in the US in 2020, comparing the numbers of deaths Weeks 1-11, released on Week 11, Week 12, and Week 13

Excel Spreadsheet Screenshot comparing numbers

First column is 2020 week number, columns 2-4 are the numbers released by the CDC in Weeks 11, 12, and 13 respectively.

Obviously, the numbers for Week 11 had not come out yet in the Week 11 spreadsheet, but in all three spreadsheets you can see the tailing off at the end noted by OP in the Reddit post. However, as the weeks go on, the numbers get revised upwards as new data comes in. This is especially noticeable in weeks 9 and 10 on the chart below.


However, for the sake of argument, let's assume that the OP is right, and Pneumonia deaths are down in 2020 because Pneumonia deaths are not being marked as Pneumonia deaths and are instead being blamed on COVID-19. As quoted from one of the highest upvoted comments on the post

Hmmm, it looks like they're down by about exactly the number of Covid-19 deaths to date. What a coincidence!

Here's another chart comparing 2019 and 2020 Pneumonia deaths, using the exact same data that the Reddit OP posted.

2019 vs 2020 Pneumonia Deaths

According to the John Hopkins Coronavirus Tracker, as of 4:58 PM on 7 April 2020, there have been 12,285 deaths in the United States due to COVID-19. This is more than double what the users claim is the difference between 2019 and 2020, in spite of the fact that the 2020 data used has been adjusted upwards, and will continuously be adjusted upwards, for months.

For reference, Week 1 of this year has been adjusted upwards in each of the last three releases by the CDC, from 3,930, to 3,972, to 3,993.

In fact, while preparing this section, I used the Week 13 data instead of the Week 12 data, and the difference between 2020 and 2019 Weeks 1-11 when using the most recent data was less than 3000 deaths.


EDIT : @Avery pointed out the following GIF that was posted on Twitter by @TylerMorganMe illustrating further the point that these numbers are preliminary.

In this GIF, you can see the numbers of Pneumonia deaths each year as the numbers get revised upwards. Each frame of the GIF is a new week of data. The years 2009-2014 start of initally plotted, and then the years 2015-2020 are filled in, with each frame adding the updated data. In every data set, there is a tail on the most recent end of the data, that eventually rises up and fits the norm.

| improve this answer | |
  • 42
    Out of curiosity, would it be reasonable to expect a drop in pneumonia cases due to the effects of the shelter in place orders? While the primary goal is to slow the spread of COVID-19, wouldn't it also have similar impacts on other communicable diseases? – cpcodes Apr 7 at 23:32
  • 4
    FYI, the CDC has only recorded 2200 Covid-19 deaths at this time. It doesn't help to directly data sets with different reporting lags! – Fizz Apr 8 at 4:07
  • 11
    cpcodes - this is much more interesting as a question than the conspiracy theory. My guess is that you'd see a drop in deaths from pneumonia from lockdown, and also a drop in deaths attributed to pneumonia, but that were actually caused by it. Medical coroners are likely to have a very high backlog of cases from COVID-19, and so things won't be logged and attributed to a cause as fast as they'd normally be. We've been seeing this in the UK at the moment, where official death statistics are currently reporting for 8 days ago. The number is likely to go up. – lupe Apr 8 at 8:40
  • 7
    Further illustrated with a very insightful graph: twitter.com/IgCoder/status/1246860025668173827 – CL. Apr 8 at 8:54
  • 1
    @CL that's actually a much better answer. I strongly suggest you write that as a separate answer. – Fizz Apr 8 at 12:38
12

No.

Firstly, the most recent data is Week 13, 2020 which is one week later.

Secondly, and most importantly, the data for the most recent weeks are always incomplete.

Comparing the data released on Week 12 and Week 13 data, not only have they upped recent counts by many hundred (e.g. Week 11 increased from 2431 to 3203 deaths), but they have upped counts many weeks in the past by small amounts (e.g. Week 43, 2019 was increased from 2984 to 2985 deaths). See also the column for total deaths.

In column C, for the most recent week (12th week of 2020), the percentage P&I deaths, increased to 8.15%. So already a slight increase is noticed, but not to the levels of bad years like 2014 or 2018.

enter image description here

Looking purely at percent pneumonia deaths:

week 10: 3404/51978 = 6.55%

week 11: 3203/47655 = 6.72%

week 12: 2930/40002 = 7.32%

So there is an increasing trend, not falling off a cliff.


Update: 10 April 2020

and now with another week of data, quite a tragic increase is seen due to COVID-19 pneumonia:

enter image description here

Looking purely at percent pneumonia deaths:

week 10: 3530/53463 = 6.60%

week 11: 3445/50785 = 6.78%

week 12: 3697/48488 = 7.62%

week 13: 4135/44402 = 9.31%

| improve this answer | |
  • 3
    "No" what? Your last para contradict the rest. And the fact that covid-19 pneumonia deaths may need to be coded separately may well change the way these stats are done. – Fizz Apr 8 at 3:38
  • @Fizz it's not contradictory. See if the explanation is more clear now. – DavePhD Apr 8 at 12:33
  • I see you're computing them (pneumonia deaths) as percentages of total deaths. I don't think that's what the claim is about (since it only graphs the raw figures, not percentages), but of course, since the mod allowed such a vague claim... any answer goes. – Fizz Apr 8 at 12:42
  • 4
    @Fizz the main misunderstanding of the claim is believing that the data are complete. This incompleteness creates the cliff drop effect. The only way to correct for incompleteness is to use percent of total reported deaths (or to wait for more data). – DavePhD Apr 8 at 12:46
  • 1
    @ChrisH the source focuses on the current season. cdc.gov/flu/weekly/index.htm But yes that was a really bad season, maybe the worst since 1957 – DavePhD Apr 8 at 13:16
10

The drop off is due to an always-present lag in reporting: see this live reporting of previous years.

enter image description here

| improve this answer | |
  • 2
    Nice find. Possibly the briefest on-topic answer that I've seen this year (but check-back for confirmation). – Bitter dreggs. Apr 10 at 21:40
  • Do you know by any chance who made that gif? – Fizz Apr 27 at 22:37

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .