How reliable are the claims made by naturopathic influencers?

Social media platforms are frequently used by the general public to access health information, including information relating to complementary and alternative medicine (CAM). The aim of this study was to measure how often naturopathic influencers make evidence-informed recommendations on Instagram, and to examine associations between the level of evidence available or presented, and user engagement.

A retrospective observational study using quantitative content analysis on health-related claims made by naturopathic influencers with 30 000 or more followers on Instagram was conducted. Linear regression was used to measure the association between health-related posts and the number of Likes, and Comments.

A total of 494 health claims were extracted from eight Instagram accounts, of which 242 (49.0%) were supported by evidence and 34 (6.9%) included a link to evidence supporting the claim. Three naturopathic influencers did not provide any evidence to support the health claims they made on Instagram. Posts with links to evidence had fewer Likes (B=-1343.9, 95% CI=-2424.4 to -263.4, X=-0.1, P=0.02) and fewer Comments (B=-82.0, 95% CI=-145.9 to -18.2, X=-0.2, P=0.01), compared to posts without links to evidence. The most common areas of health were claims relating to ‘women’s health’ (n=94; 19.0%), and ‘hair, nail, and skin’ (n=74; 15.0%).

The authors concluded that this study is one of the first to look at the evidence available to support health-related claims by naturopathic influencers on Instagram. Our findings indicate that around half of Instagram posts from popular naturopathic influencers with health claims are supported by high-quality evidence.

At first sight, these findings amazed me; I would have thought that the percentage of supported claims was lower. As it turned out, I was not far off: in the paper, the authors differentiate the results into more categories and state that ” of those with evidence clearly available, approximately 10% of health claims were underpinned by high-quality evidence such as systematic reviews of randomised controlled trials.”

Even though interesting, the study has significant limitations. The authors are well aware of them and explain:

A key limitation was relying on the 10 most relevant retrieved articles in PubMed, rather than conducting an extensive search for evidence, when not provided alongside the claim. It is possible we did not identify existing evidence to support some of the claims; however, it would not have been feasible to construct a comprehensive search strategy and screen articles for every health claim made. Our search strategy served as a proxy measure for the evidence to support the claim and it is unlikely that the 10 most relevant articles on PubMed would systematically fail to identify existing supporting evidence.

The risk of subjectivity in the extraction of interventional health claims from Instagram posts and conversion into a PICO is another limitation. The subjectivity of data extraction was minimised using standards which included extracting specific terms used by the naturopathic influencer to perform database searches on PubMed. If not explicitly stated, the intended target audience of the health claims were made using educated guesses based on the intervention and outcome promoted in the claim. For the claim to be considered supported by evidence, study participants must match the intended audience of the health claim on Instagram(e.g., postmenopausal women, athletes). When the study with the highest level of evidence were inconclusive due to reasons such as inadequate cohort size, conflicting results for different cohort (e.g., male vs. females), heterogeneity between studies and poor quality of studies, it was concluded that the evidence did not support the health claim. When there was considerable uncertainty related to the health intervention or outcome, it was excluded from the study.

So, in the end, I guess, it boils down to whether you are an optimist or a pessimist:

About half of the claims made by prominent naturopaths are supported by at least a bit of evidence.

About half of the claims made by prominent naturopaths are not supported by evidence.