90

There is this new study that came out, alleging, that COVID-19 vaccines cause two deaths for every three deaths they prevent, which sounds pretty bad. I was wondering how valid this analysis is and what other view points exist on the topic.

Quote:

Abstract: Background: COVID-19 vaccines have had expedited reviews without sufficient safety data. We wanted to compare risks and benefits. Method: We calculated the number needed to vaccinate (NNTV) from a large Israeli field study to prevent one death. We accessed the Adverse Drug Reactions (ADR) database of the European Medicines Agency and of the Dutch National Register (lareb.nl) to extract the number of cases reporting severe side effects and the number of cases with fatal side effects. Result: The NNTV is between 200–700 to prevent one case of COVID-19 for the mRNA vaccine marketed by Pfizer, while the NNTV to prevent one death is between 9000 and 50,000 (95% confidence interval), with 16,000 as a point estimate. The number of cases experiencing adverse reactions has been reported to be 700 per 100,000 vaccinations. Currently, we see 16 serious side effects per 100,000 vaccinations, and the number of fatal side effects is at 4.11/100,000 vaccinations. For three deaths prevented by vaccination we have to accept two inflicted by vaccination. Conclusions: This lack of clear benefit should cause governments to rethink their vaccination policy.

Source:https://www.mdpi.com/2076-393X/9/7/693/htm

Now obviously this all hinges on the deaths reported in the adverse reaction data base to be causal, but even if they aren't, doesn't this put these vaccines in comparison to other vaccines in a bad light, or is this completely normal for most vaccines?

4

4 Answers 4

191

A series of comments on the article's PubPeer appears to entirely invalidate the paper's conclusion; the paper commits several classic errors which have been previously discussed on skeptics.se.

First is misuse of adverse event databases, exactly as discussed here. These sorts of adverse event databases do not establish causality; it is simply a list of all the times people have reported to have been affected shortly after getting a vaccine. The database used by the authors specifically states that it cannot be used this way.

Second, a risk-reward comparison for vaccination invariably suffers from its own success.

As an absurd example, before SARS-CoV-2 had been transmitted to the U.S., the US had a 0% mortality rate from SARS-CoV-2. If the entire U.S. was then vaccinated at a 0.01% rate of serious adverse events, some 32,800 people would die and practically none from the virus, for a risk-reward ratio of infinity. This ignores the 619,000 people who would otherwise have died.

(Note that it is possible to produce a risk-reward for a certain snapshot in time. Here's one example.)

10
  • 1
    This is a lousy answer, but it's what I've got for now. I recall seeing a much better example of a correctly produced risk-reward analysis somewhere regarding blood clots and age groups, but I cannot find it offhand. Other possible improvements might include the types of statistical mining that are done to establish causality, maybe an example of the number of deaths expected after a certain time period based on chance (Poisson process?), a better rebuke of the 95% underreporting figure.
    – 0xDBFB7
    Commented Jun 27, 2021 at 23:03
  • 3
    We have the same uncertainty with COVID deaths (at least in Germany), the statistics state they died "from or with" COVID. Some people just happen to test positive, even when they died from cancer or road accident.
    – user24582
    Commented Jun 28, 2021 at 7:25
  • 2
    @user24582 That's correct but the base rates are vastly different, making these measures not at all comparable. This may be surprising but it's really a result of basic statistics, and well known in epidemiology. Commented Jun 28, 2021 at 13:15
  • 17
    @CJR minor correction: Both the mRNA vaccines and the adenoviral vector vaccines have been linked to a VERY rare but also very serious form of blood clotting that has in some rare cases caused the death of a vaccinated person. However, we're talking about a VERY low death rate here: in the entirety of the USA, after 300M doses, there have been 3 deaths from J&J due to these clots, and 11 cases of thrombocytopenia (including deaths). For comparison: in the entirety of 2020, the same amount of people have been killed by shark attacks in the USA.
    – Nzall
    Commented Jun 28, 2021 at 13:23
  • 4
    @Nzall That's an excellent point; the viral vector vaccines have been linked to deaths. No equivalent events have occurred for the mRNA vaccines, although there is likely a very low risk of myocarditis/pericarditis in some people that hasn't resulted in any deaths as of yet (to the best of my knowledge).
    – CJR
    Commented Jun 28, 2021 at 13:31
135

Update (7/9/21): The paper was retracted on July 2, 2021. The retraction cited the same concern that not all deaths reported to national government systems are necessarily caused by the vaccine, while the paper incorrectly assumed that all such reported deaths were caused by the vaccine.


Do COVID-19 vaccines cause 2 deaths for every 3 deaths they prevent?

No. The paper is flawed and is contradicted by other reports.


Is the paper scientifically rigorous?

The paper quoted in the question is flawed. The paper searched the European equivalent of VAERS, a vaccine adverse event reporting database, compared the numbers among various countries, and then used the Dutch numbers in their analysis because the Netherlands had the most reports per vaccination. (Because of this, the authors' analysis cannot be generalized to countries beyond the Netherlands. i.e. death rates from COVID-19 may be, and in some instances are, much higher in other countries.) Additionally, the paper only tracked the number of deaths prevented for "three to four weeks" after vaccination. It's likely the vaccine will avert even more deaths from COVID-19 beyond that "three to four week" period. Therefore, the analysis in this paper is flawed. This is in addition to the fact, also noted in the other answer, that reports to these systems do not necessarily represent an event caused by the vaccine.

VAERS accepts and analyzes reports of possible health problems—also called “adverse events”—after vaccination. As an early warning system, VAERS cannot prove that a vaccine caused a problem. Specifically, a report to VAERS does not mean that a vaccine caused an adverse event. (emphasis from the original CDC source)


What do other studies say?

Britain

Luckily for us, this topic has interested the UK government. The UK government has studied the exact question of how many deaths COVID-19 vaccines have prevented. On March 25, 2021, Public Health England released a report on the benefits of COVID-19 vaccination.

Public Health England (PHE) analysis indicates that the COVID-19 vaccination programme prevented 6,100 deaths in those aged 70 and older in England up to the end of February. (Press release on Gov.UK)

As of March 14, 2021, the UK government reported 594 events with a fatal outcome after receiving a COVID-19 vaccine. (Again, reports do not indicate an event was caused by a vaccine.)

The MHRA has received 259 UK reports of suspected ADRs to the Pfizer/BioNTech vaccine in which the patient died shortly after vaccination, 326 reports for the Oxford University/AstraZeneca vaccine and 9 where the brand of vaccine was unspecified. The majority of these reports were in elderly people or people with underlying illness. Usage of the AstraZeneca has increased rapidly and as such, so has reporting of fatal events with a temporal association with vaccination however, this does not indicate a link between vaccination and the fatalities reported. Review of individual reports and patterns of reporting does not suggest the vaccine played a role in the death.

Needless to say, 6,100 deaths averted outnumbers 600 deaths reported to the UK-equivalent of VAERS by slightly over 10 times, again refuting the paper's conclusion.

Those figures have held up even to today. More recently, on May 14, Public Health England concluded the COVID-19 vaccines together prevented 14,000 deaths.

PHE estimates that 14,000 deaths have now been prevented in people aged 60 years or older in England up to 30 May 2021 (11,800 deaths in individuals aged 80 years and older, 1,800 in individuals aged 70 to 79 and 400 in individuals aged 60 to 69 years).

Estimates also indicate that the vaccination programme has prevented around 42,000 hospitalisations in those aged 65 years and over in England (approximately 5,400 admissions in those aged 65 to 74, 16,300 in those aged 75 to 84 and 20,300 in those aged 85 and over).

As of June 16, the most recent date with data available, 1,356 deaths after vaccination have been reported to the UK government. Again, deaths averted exceed deaths reported to the government by over 10 times. And the numbers above only include deaths prevented in older people.


Other studies:

US

The CDC has not yet released numbers on how many lives COVID-19 vaccines have saved. A May 6 study from The Journal of Infectious Diseases predicted that each 1% increase in coverage from 40% to 50% prevents 6,660 deaths. As of May 22, the US adult vaccine coverage is 57% (CDC source). This also questions the paper in the question as exactly 4,001 deaths have so far been reported to VAERS (see VAERS database). (Again, reports do not indicate an event was caused by a vaccine.)

Israel

Israel is a well-known case study in vaccine efficacy due to their vaccine rollout so far. Though I have not found studies of how many deaths were prevented, the number of COVID-19 cases (and, presumably, deaths) has steadily dropped with increased vaccinations (e.g. paper published by the Israel Ministry of Health in The Lancet).

Two doses of [the Pfizer vaccine] are highly effective across all age groups (≥16 years, including older adults aged ≥85 years) in preventing symptomatic and asymptomatic SARS-CoV-2 infections and COVID-19-related hospitalisations, severe disease, and death, including those caused by the B.1.1.7 SARS-CoV-2 variant. There were marked and sustained declines in SARS-CoV-2 incidence corresponding to increasing vaccine coverage. These findings suggest that COVID-19 vaccination can help to control the pandemic.

18
  • 22
    "In any case, 260,000 deaths averted >> 4,001 deaths reported to VAERS" - I think you could also add that we have no idea how many of those 4,001 deaths were due to the vaccine as opposed to some other cause. (and in the similar argument later). Your point of course is that even if all the deaths reported to VAERS were due to the vaccine (which is highly unlikely), it still would be better to vaccinate than not.
    – abligh
    Commented Jun 28, 2021 at 6:06
  • 3
    @abligh You mean the right thing but just to be clear: it's incorrect to say that “we have no idea”. On the contrary, based on other data and prior knowledge we have a pretty good idea that few if any of these deaths are caused by the vaccines (probably >0, but even that is actually not yet firmly established). Commented Jun 28, 2021 at 13:19
  • 5
    600 deaths for 6000 saved, thats pretty bad actually. I don't think any other vaccine has had such a horrible track record. Id love to see a comparison to say the flu vaccine which is targeted to similar demographics and is said to have lots of side effects. Commented Jun 28, 2021 at 22:35
  • 8
    @user1721135 Quoting the report with those 594 adverse reactions: "The majority of these reports were in elderly people or people with underlying illness. Usage of the AstraZeneca has increased rapidly and as such, so has reporting of fatal events with a temporal association with vaccination however, this does not indicate a link between vaccination and the fatalities reported. Review of individual reports and patterns of reporting does not suggest the vaccine played a role in the death."
    – MT0
    Commented Jun 28, 2021 at 23:21
  • 5
    @user1721135, "600 deaths for 6000 saved" is only something it's reasonable to say if those deaths were caused by the vaccine, but the reporting explicitly does not track causality (and with the first people to be vaccinated being those most at risk, whether from old age or other health problems that had potential to be fatal in combination with a case of COVID, that rate is not something to discard). Commented Jun 29, 2021 at 15:40
6

For three deaths prevented by vaccination we have to accept two inflicted by vaccination.

This statement seems to imply that vaccines have a 2/3 mortality rate of Covid cases. If that is what it is asserting, then that can be easily refuted with a simple rough order of magnitude estimate using stats from the US. (all numbers are rough).

In order to gauge a ROM of "preventable deaths" we can take the 3 month period before the vaccines, Oct-Dec 2020, there were roughly 14M Covid cases resulting in 175K deaths. Excess mortality rates seem to confirm the 175K deaths from Covid.

In a 3 month period, March-May of 2021, about 100M people were fully vaccinated. That is 7 times (100M/14M) the number of Covid cases above.

With a 2/3 mortality rate, that would predict 4.7 times the number of deaths from vaccines in March-May of 2021 as compared Covid deaths Oct-Dec 2020.

4.7 x 175K = 833K deaths from vaccines.

I think if 833K had died from vaccines in US the past 3 months (over double the expected death rate), I think we would know about it. At least for March 2021, there has been no excess deaths over usual.

13
  • 7
    Welcome to Skeptics! It is so tempting to think "Oh, I have a figure from this source, and a figure from that source, I can just divide them or multiply them to get the figure I need", but that calculation itself needs a reference to justify it. In this case, you seem to be jumping between CFR and IFR, and misnaming it "mortality". Find someone who has been peer-reviewed or is at least a recognised expert who has made the calculations rather than asking us to trust you.
    – Oddthinking
    Commented Jun 30, 2021 at 13:16
  • 1
    I don't think I need to be an expert to do simple math. The title of the question is "Do covid vaccines cause 2 deaths for every 3 deaths they prevent?". I was doing some simple back of the envelope calculations based on that premise. Specifically what numbers do you have a problem with? If you have better sources please provide. If my logic is flawed, please elaborate. Commented Jun 30, 2021 at 13:28
  • 2
    You don't need to be an expert to do simple math, but you need to be an expert to understand why your math does not make much sense. You are for example using the US death rates compared to vaccine death rates in the article. Also, that very article predicts around 4110 vaccine deaths for 100 million vaccinated, not 883000 wherever that came from. This is simply just a random person on the internet trying to juggle numbers and won't convince anyone.
    – pipe
    Commented Jun 30, 2021 at 13:47
  • 3
    This answer isn't amazing and uses back-of-the-envelope math that I wouldn't use (in the US, we measured how many people have died from the vaccine, and we measured how many people have died of COVID - just compare two numbers you've measured, not two numbers you speculate about). That said it looks brilliant compared to some of these comments (the piles of bodies would be unnoticeable without PCR???) so I guess good job.
    – CJR
    Commented Jun 30, 2021 at 14:42
  • 3
    This is a positive example of critical thinking, a relatively inexpensive and rapid check for plausibility of a claim, without spending the time and resources required for an in-depth investigation and analysis. It does not replace in-depth work, however it can be very useful when attempting to deal with on-the-fly discussions or many issues in a limited time. Commented Sep 30, 2021 at 18:09
1

The rate of COVID mentioned above is inconsistent with other sources.

For example the article below I found from a quick search and it gives a mortality rate of 8.2 per million. This is much lower than the one mentioned above. Without doing a whole review paper of the published statistics, other sources are often lower than this value.

pubmed.ncbi.nlm.nih.gov/34055843 Front Med (Lausanne) . 2021 May 14;8:670370. doi: 10.3389/fmed.2021.670370. eCollection 2021. Mortality Rate and Characteristics of Deaths Following COVID-19 Vaccination Gang Lv 1 , Jing Yuan 2 , Xiaomo Xiong 3 , Minghui Li 4

1

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .