Talk:Face masks during the COVID-19 pandemic

Removal of RCT mask studies in progress

In the past, many have put a great deal of emphasis on randomized control trials for masks. This has been a thing since the H1N1 outbreak.[1]

A 2024 review, as well as any quick study on the history of respirators (see N95 respirator and Respirator#Disadvantages) reiterates why this approach is a problem; namely, the issue of noncompliance.

It's been such a pervasive problem, that, even before COVID, even before the 2000s, OSHA 29 CFR 1910.134 requires fit testing for all respirator users, and pre-dates the passage of 42 CFR 84 (the N95, P100 rating, etc.) on July 10, 1995. Not to mention the Hierarchy of hazard controls placing PPE last, mostly due to potential worker error.

Unless the RCT study emphasizes worker training (required under 29 CFR 1910.134), it should probably be removed. Currently, I'm in the process of removing these RCT studies, but getting it right might take a while.⸺(Random)staplers 03:34, 11 September 2024 (UTC)

---

There also appears to be a problem with point-counterpoint statements. I found another review in this article also pointing out the "confounding factor" problem, buried in point-counterpoints with RCT findings. I think this quote from the review sums it up best:

Overall effectiveness of these interventions was affected by clinical heterogeneity and methodological limitations, such as confounding and measurement bias. It was not possible to evaluate the impact of type of face maks (eg, surgical, fabric, N95 respirators) and compliance and frequency of wearing masks owing to a lack of data.

⸺(Random)staplers 03:59, 11 September 2024 (UTC)

• Another note to the point-counterpoint problem: avoid mentioning RCTs, even if it's a rebuttal. The mere mention may give RCTs more undue weight than necessary.

Also, this article is like 200k in size, five paragraphs dedicated to Efficacy - Overall, and one large paragraph (the second one) just talking about RCTs. Understandable if one isn't aware of the Tuberculosis studies in the 1990s...

...but now that the 1992 NIOSH TB Guide is online on Wikisource (references), I think this can be condensed a little.⸺(Random)staplers 04:17, 11 September 2024 (UTC)

* (For those wondering after reading the TB guide: Yes, the N95 standard was designed so that hospitals wouldn't have to buy Powered air-purifying respirators for mitigating HIV-induced TB... okay, maybe just masks with HEPA/Dust-fume-mist-radionuclides-asbestos filters, but still, reduction of expense was one of the goals stated in this Federal Register document.)⸺(Random)staplers 04:30, 11 September 2024 (UTC)

• RCTs are not WP:MEDRS. However your edits removed not these, but reviews and systematic reviews. You also introduced irrelevant material into the lede (which should mirror the body). Hence, reverted. Bon courage (talk) 06:11, 11 September 2024 (UTC)

  • @Bon courage Could you highlight the diff or refs you think are most important or problematic?

  Part of the reason why an excessive amount of material might have been removed is the prose is 200K, hard to verify.

  Named references were re-added to other sections.——Randomstapler's alt 08:00, 11 September 2024 (UTC)

  For example removing a Cochrane systematic review and calling it a RCT.[2] Also adding pre-pandemic sources to this topic, which can never be relevant except through WP:OR/WP:SYNTH (or, if they are cited by relevant reliable source in which case use those). Bon courage (talk) 11:20, 11 September 2024 (UTC)

  @Bon courage If you look on page 15-22 on this updated Coltrane review, you'll notice that the author's seem more concerned about randomization than, say, the length of time during which interventions were used. The other review on the other, is a "rapid systematic review."

  I... don't know why you felt the need to restore these, given that one, it adds to the prose, and two, the fact that another, better review is already included in the article, long before I was here. I'm of the opinion that mining a source is more helpful for readers than including multiple RCT reviews.——Randomstapler's alt 16:20, 11 September 2024 (UTC)

  Cochrane reviews are among the WP:BESTSOURCES and this one was very impactful. Bon courage (talk) 16:22, 11 September 2024 (UTC)

  @Bon courage Textual citation? Did you read the review? I could just as easily claim that the BMJ is among the best.——Randomstapler's alt 16:24, 11 September 2024 (UTC)

  Of course I bloody read it; what kind of question is that? BMJ is also reputable, but that doesn't mean you get to remove a Cochrane review with a misleading edit summary. There was already much discussion about how to include this source.[3] Bon courage (talk) 16:27, 11 September 2024 (UTC)

  @Bon courage Okay, calm down. That is helpful.——Randomstapler's alt 16:30, 11 September 2024 (UTC)

  @Bon courage Hey, edit summaries may be mistyped and they might not be everything. That's why there's a talk page, and that's why I put more context in there.

  As for that discussion you linked, I think one has to loop back around to the top to see a noted omission in the discussions: compliance. As I said, you can have discussions all day without realizing the work already done (NIOSH TB Guide).

  Little un-rigorous note: And if there's that much discussion on a single source, doesn't that indicate it might be a little problematic to include? IMO, better to focus on one source, and mine it to make sure it stands up to scrutiny. Picking poison apples being less likely if you only pick one, even if potentially more of the apple could be learned if more were picked.——Randomstapler's alt 16:46, 11 September 2024 (UTC)

  I agree with Bon courage. I'll add that while sources seem to be divided on how ideal RCTs are for this topic, it isn't WP:NPOV to exclude reviews that focus more on RCT evidence on the basis of being sympathetic to other reviews that argue that focusing on RCTs is flawed for whatever reason. As a more general comment, I don't see why compliance is necessarily fatal to RCTs. Whether people comply or not is a very important part of whether an intervention to promote masking can be effective. The subject is about more than mere physics of aerosols and suchlike, it's about realistic human behavior too. Crossroads ^-talk- 00:23, 12 September 2024 (UTC)

  @Crossroads Hmm... perhaps it could be worded a bit better then. What are you proposing?

  I pointed out one of the reviews made clear it wasn't rigorous. So I think at least that can be omitted, just on prose. ——Randomstapler's alt 00:33, 12 September 2024 (UTC)

  I think it's worded fine as it is. I'm good with the changes that were not reverted, and the status quo for the rest. If you want to propose more changes, up to you. I'm not clear on which review "made clear it wasn't rigorous"; it seems pretty unlikely that a review would negate itself like that. If the 'not rigorous' bit is a Wikipedia editor's judgment of its methodology, that's not relevant at all and should not be used as a basis for changing the article. Crossroads ^-talk- 00:40, 12 September 2024 (UTC)

  @Crossroads "rapid systematic review" in the above comment. Quoting directly from that review.

  As for the other reviews, "judgement on methodology not changing the article"... is cutting it a little close IMO, given that prose is a concern and mining a source is a policy. We have to make judgements all the time-- that's the difficulty of consensus.

  Also the addition of new information and due and undue weight on older information... did you notice the new 2024 review that was added in my edits? ——Randomstapler's alt 00:53, 12 September 2024 (UTC)

Second bold edit

• @Bon courage @Crossroads So, I'm not receiving much substantive feedback concerning this diff. I mean, it could be worded better, maybe certain phrases could be refined, additional citations and words could be added (see WP:Bold-refine), but in light of this review released in 2024, this huge discussion not turning out much in terms of substance kind of feels like WP:stonewalling.

• Actually, I caught a mistake in the lead citation, made by me, that was not said during the discussion. Specificity next time would have reduced the temperature, and got me to realize my mistakes in a shorter period of time. With that said:

Based on Special:Diff/1245134053/1245122934, here's a summary of what's been (and what is going to be) changed:

• Named references that were broken were re-added by the last diff, so that's not going to be issue.

Lead:

• Various case-control and population-based studies have also shown that increased levels of masking in a community reduces the spread of SARS-CoV-2, though there is a paucity of evidence from randomized controlled trials (RCTs). to Masks vary in how well they work. Fitted N95s outperform surgical masks, while cloth masks provide marginal protection. Ref changed from [4] and [5] to [6], based on contributions to Source control (respiratory disease). My main problem, initially, was the fact that mentioning this in the lead kinda gives undue weight to RCTs? I mean, the general public is going to read this, and this doesn't give any impression that updates to the scientific consensus have occurred (see the 2024 review, again). M

Overall:

• There are two types of evidence for the efficacy of masks: observational studies, and randomised controlled trials (RCTs). While RCTs are more robust, they are too impractical for many public health interventions, yielding insufficient statistical power and validity. Most of the evidence for the efficacy of masks against COVID comes from observational studies. Due to the paucity of evidence from RCTs, some systematic reviews have included the observational studies along with the RCTs. As of August 2023, RCTs played a relatively small role in the evaluation of non-pharmaceutical interventions during the pandemic was removed. This could be re-added, and I'll do it for now, but it adds to the prose.
• A 2023 systematic review from the Cochrane Collaboration said the evidence from randomized controlled trials was still inconclusive over whether masking prevented the spread of influenza/COVID‐like illness through a population, noting that the answer could be different for different viruses. This Cochrane review was criticized for combining studies about influenza and about COVID, which could "yield invalid conclusions". Another 2023 systematic review, by the Royal Society, found the evidence from RCTs was that masks reduced risk by 12% to 18%. This was removed for prose, and in light of the 2024 review, (again), I have to agree with myself again; not only does it add to the prose, it adds undue weight, especially after the phrasing While RCTs are more robust, plus the problems mentioned above with this review in particular.
• Masks are not of equal efficacy. While N95 masks outperform surgical masks in filtration, healthcare worker population studies have not shown a significant difference between the two, as of June 2021. Then I added: A later study performed in 2024, however, criticized the methodology of such studies due to substantial healthcare worker compliance problems. Citations: [7] with [8] added. See what I mean about the point-counterpoint issue? That's a longer-term issue that will have to be dealt with via this talk page.
• Cloth masks are insufficient for healthcare workers and not recommended, according to two randomized controlled trials. This is completely unnecessary, and adds to prose and undue weight. (The cited paper is still included in the following sentence.)
• Clinical studies had not evaluated the efficacy of cloth masks in COVID-19 transmission by the end of 2021. This could be replaced with the citation I added in the lead. I'll go ahead and do that.

Okay, that concludes all the changes that will occur following this discussion.

• If anyone has anything else to add, I strongly encourage WP:Bold-refine, a more productive alternative, given the presence of updated information and citations. In my opinion, reversions can only lead to a worse article, and more prose than necessary. So refining is more of a priority, rather than reverting.——Randomstapler's alt 04:01, 12 September 2024 (UTC)