6

A December 2022 paper, Effectiveness of the Coronavirus Disease 2019 (COVID-19) Bivalent Vaccine is being passed around social media, by people who argue against the COVID vaccines.

They're focused on this graph:

The risk of COVID-19 also varied by the number of COVID-19 vaccine doses previously received. The higher the number of vaccines previously received, the higher the risk of contracting COVID-19 (Figure 2). Graph showing higher incidence of COVID-19 infections with greater vaccine doses

That seems to suggest that taking vaccines increases your risk of COVID infection.

But the paper also says this in its "Results" and "Conclusions" sections:

In multivariable analysis, the bivalent vaccinated state was independently associated with lower risk of COVID-19 [...] The bivalent COVID-19 vaccine given to working-aged adults afforded modest protection overall against COVID-19 [...]

Can someone give a explanation for why the graph appears to suggest that taking the vaccines increases your risk of COVID, and yet the paper then declares the opposite?

6
  • I followed the reference [7] which the authors said showed a similar result, and Figure 4 in that article shows people with 2 doses having more COVID than 0 doses, but people with 3 doses having less, and 1 dose even less than that. Neither article explains what this data is supposed to mean, which makes me think there must be confounders involved.
    – Avery
    Commented Jan 2, 2023 at 15:58
  • 11
    100% of people who die in skydiving accidents have parachutes. That doesn't mean parachutes are a bad idea when you're skydiving. The quote you have from the paper explains that other variables are causing this apparent trend, as in Simpson's paradox. I'm not sure this is a good question as the answer is in the claim itself. Perhaps ask in stats?
    – CJR
    Commented Jan 2, 2023 at 16:21
  • @CJR: while Simpson's paradox is always fun, IMHO the explanation here is much easier. The claim of moderate efficiency refers to vaccine that includes vaccine developed against BA.4/BA.5 variants, the diagram considers only vaccines developed against the original Wuhan variant.
    – cbeleites
    Commented Jan 2, 2023 at 18:56
  • "This article is a preprint and has not been peer-reviewed. It reports new medical research that has yet to be evaluated and so should not be used to guide clinical practice."
    – Schwern
    Commented Jan 2, 2023 at 18:57
  • 1
    "Correlation" and "Causation" are not synonyms. Commented Jan 3, 2023 at 15:27

1 Answer 1

3

(This does not qualify as answer, since I hardly use any references beside the paper linked by OP)

No contradiction between claim about efficieny of bivalent vaccine and diagram

Note that the claim about vaccine efficiency refers to the new bivalent vaccine, whereas the diagram refers to previous vaccinations.

The bivalent vaccine they study contains the original vaccine (against the Wuhan variant) as well as vaccine against omicron BA.4/BA.5. All previous vaccines were developed against the original Wuhan variant only.

These are also the variants dominant throughout the duration of the study.

Note also that the claim in the paper is actually narrower than what the part quoted in the question suggests:

 The bivalent COVID-19 vaccine given to working-aged adults afforded modest protection overall against COVID-19, while the virus strains dominant in the community were those represented in the vaccine.
[...]
It is not known if the vaccine will be equally effective when the strains circulating in the community are not those represented in the vaccine.

(my emphasis)

Finding (moderate) vaccine efficiency against (symptomatic) covid with a vaccine adapted to the actually circulating variant does not contradict waning efficiency of vaccines that were developed against variants that are not in circulation any more

(Unfortunately, they don't compare people recently vaccinated with the original vaccine vs. the bivalent vaccine. Table 3 lumps together infections with vaccination. This does make sense biologically, but prevents us from seeing whether the bivalent vaccine is more efficient than the original one.)

Increased incidence and number of vaccinations and possible confounders

Summary: Here it is most important to keep in mind that correlation alone doesn't tell us about causation, and in particular not about the direction of causal effects. After all, people may get vaccinated in order to not need to fear (severe) covid when infected, i.e. to to replace more stressful measures to mitigate their personal risk of severe illness such as avoiding contacts/exposure.

Detailed thoughts:

First of all, the paper reports that similar findings have been published before.

The study (like many others) actually evaluates a surrogate for vaccine efficacy, which is called effectiveness based on observed case rates. Since it is observational, any confounder that changes exposure risk and correlates with vaccine uptake can mess up the conclusions. Thus, we can correctly say that they observe a correlation, but we cannot conclude too much about vaccine efficacy (which is basically vaccine efficiency in its everyday sense).


A bit puzzling to me is that the authors state

Those who chose to get the bivalent vaccine were also more likely to have lower risk-taking behavior with respect to COVID-19 [than those who did not take the bivalent vaccine]

since there is no indication in the methods section that they recorded any indicators of risk-taking behavior.


I'd like to dig a bit deeper into the discussion they give in the paper:

A simplistic explanation might be that those who received more doses were more likely to be individuals at higher risk of COVID-19.

"risk of covid" refers to two distinct types of risk or rather, likelihoods/probabilities.

In particular some people have higher risk of exposure than others (E.g., in the study population the subgroup "clinical" occupation may have a further relevant subgroup of people working in covid wards)

In addition, "risk of covid" is used to refer to the probability of severe illness when exposed.

 A small proportion of individuals may have fit this description. However, the majority of subjects in this study were generally young individuals and all were eligible to have received at least 3 doses of vaccine by the study start date, and which they had every opportunity to do.

Since age has a very strong relation to severity of covid, but no obvious relation to SARS-CoV2 exposure in health care working places, this refers to the 2nd meaning.

But the study does not measure and model severe covid but something close to "sufficient symptoms to think about getting sick days"

Therefore, those who received fewer than 3 doses (>45% of individuals in the study) were not those ineligible to receive the vaccine, but those who chose not to follow the CDC’s recommendations on remaining updated with COVID-19 vaccination, and one could reasonably expect these individuals to have been more likely to have exhibited higher risk- taking behavior. Despite this, their risk of acquiring COVID-19 was lower than those who received a larger number of prior vaccine doses

My take on the confounder situation is that there are a number of plausible potential factors (and interactions) which would be expected to act into opposite directions. Some of which one may be able to address from the raw study data, but the aggregated information they report does not allow us to conclude much here.

  • E.g. people with high-exposure (workplace or other) may be more likely to have taken more vaccines.
    This is the simplistic explanation the study authors refer to, which they dismiss as small proportion without giving or citing evidence.

  • Here in Germany, the official vaccination recommendations roughly boil down to saying that for each infection, skip one dose. Recommendation is also to wait 6 months ("in exceptional individual cases, 4 months is acceptable") after an infection with the next vaccination dose.
    From that perspective, skipping (some) vaccination doses according to the infections one had does not imply particularly high risk-taking behaviour.

  • And an interaction with high-exposure settings correlating to lower total number of vaccinations (because of infections; note that the study population selects towards people who have recovered from their previous infections)
    The raw data of the study should allow to check at least for such a correlation, and a plot similar to figures 1 and 2 but grouping by total number of relevant exposure (i.e. vaccinations plus infections)

2
  • Remove your answer if you state yourself that this is not an answer. This is not a discussion forum site.
    – Grasper
    Commented Jan 3, 2023 at 15:56
  • 2
    Using the original references is fine (as long as you are extracting more from it than the original claim, and not just repeating the claim).
    – Oddthinking
    Commented Jan 4, 2023 at 2:27

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .