Acupuncture for male infertility (MI): a story of sloppy research endangering public health

I have often called out unreliable or fraudulent research in the realm of Traditional Chinese Medicine (TCM). I think it is important to do so because the abundance of scientific misconduct is such that it has become a danger to public health. Today, I present yet another example:

This recent review claimed to summarize the evidence on TCM in treating MI, the clinical evaluations of TCM in treating male infertility (MI), and the molecular mechanisms of TCM effects. I was alerted to the fact that the authors cite a paper on acupuncture that I had co-authored. Here is the section in question from the review:

Acupuncture is one of the therapeutic techniques that are part of TCM. Acupuncture is a non-invasive technique and is regarded as free of risk if performed by trained personnel [35]. One of the advantages of acupuncture was that the incidence of adverse effects was substantially lower than that of many drugs or other accepted [35]. Acupuncture has been used in the treatment of male and female infertility and in assisted reproductive technology treatments for many years. A total of 100 patients with MI who met the diagnostic criteria were randomly divided into two groups [7]. Half of the patients received acupuncture treatment, and the other half received placebo acupuncture. After 10 weeks treatment, acupuncture successfully improved the indicators of the semen, including the spermatozoa survival rate, b-level activity rate, sperm density, sperm activity rate. A total of 28 infertile patients with severe oligoasthenozoospermia received acupuncture according to the principles of acupuncture and 29 infertile patients received placebo acupuncture. A significantly higher percentage of motile sperm (World Health Organization categories A-C), but no effect on sperm concentration, was found after acupuncture compared with placebo acupuncture [36]. Of the 279 cases of male sterility treated by the combination of acupuncture, pilose antler essence injection to acupoints and oral administration of Chinese materia medica, 142 cases (47.8%) were cured, 81 cases (27.3%) markedly effective, 53 cases (17.8%) effective and 21 cases (7.1%) ineffective [37]. The therapeutic effect of the combination of these three treatments was satisfactory.

Ref 7

Emerging evidence has shown that cell-cell interactions between testicular cells, in particular at the Sertoli cell-cell and Sertoli-germ cell interface, are crucial to support spermatogenesis. The unique ultrastructures that support cell-cell interactions in the testis are the basal ES (ectoplasmic specialization) and the apical ES. The basal ES is found between adjacent Sertoli cells near the basement membrane that also constitute the blood-testis barrier (BTB). The apical ES is restrictively expressed at the Sertoli-spermatid contact site in the apical (adluminal) compartment of the seminiferous epithelium. These ultrastructures are present in both rodent and human testes, but the majority of studies found in the literature were done in rodent testes. As such, our discussion herein, unless otherwise specified, is focused on studies in testes of adult rats. Studies have shown that the testicular cell-cell interactions crucial to support spermatogenesis are mediated through distinctive signaling proteins and pathways, most notably involving FAK, Akt1/2 and Cdc42 GTPase. Thus, manipulation of some of these signaling proteins, such as FAK, through the use of phosphomimetic mutants for overexpression in Sertoli cell epithelium in vitro or in the testis in vivo, making FAK either constitutively active or inactive, we can modify the outcome of spermatogenesis. For instance, using the toxicant-induced Sertoli cell or testis injury in rats as study models, we can either block or rescue toxicant-induced infertility through overexpression of p-FAK-Y397 or p-FAK-Y407 (and their mutants), including the use of specific activator(s) of the involved signaling proteins against pAkt1/2. These findings thus illustrate that a potential therapeutic approach can be developed to manage toxicant-induced male reproductive dysfunction. In this review, we critically evaluate these recent findings, highlighting the direction for future investigations by bringing the laboratory-based research through a translation path to clinical investigations.

This paper does not relate to the statement it is meant to support by the review authors.

Ref 35

The review by Qin et al (1) includes 5 trials none of which should have been included in a quality metaanalysis as the methodology was unconvincing: In the trial by Alraek et al., patients were randomised to receive either acupuncture or no treatment. This means that no attempt was made to control for the effects of placebo or extra attention. Therefore, this study does not demonstrate an effect of acupuncture as the outcome could be due to non-specific effects unrelated with this therapy. By contrast, the trial by Aune et al. did attempt to control for placebo effects by using a sham control group. Sham acupuncture was given using six needles superficially inserted in the calves, thighs or abdomen outside known acupuncture points or meridians. Needles were not manipulated in the sham group. Sham or placebo controls have the purpose of rendering patients unaware of whether they receive the real or the sham treatment. The method used here cannot achieve this aim; patients would be easily able to tell which intervention they received. In other words, this study also did not adequately control for placebo effects. The remaining three trials are all not Medline-listed, authored by Chinese investigators and published in inaccessible journals. This should disqualify them from inclusion as they were unverifiable by the peer review process. According to the published table, they were equivalence trials of acupuncture versus antibiotics with a sample size around 30. This means they are grossly underpowered and thus unable to generate reliable results. Unless BJOG peer reviewers could see the primary articles, or be provided with translations from Chinese, the systematic review should not have been accepted. The “many eyes of science” requires transparency, testing, challenge and verification. Although in the past, inconclusive results of acupuncture have not been thought to be due to Chinese influence (2), it has been noted that virtually all recent published acupuncture trials are “positive” (3), raising questions of publication and other biases. Our colleagues are under tremendous pressure to publish, but we do them no favours by effectively lowering the standard of scientific peer review. Elite journals too have an obligation to train and reiterate about publication ethics and sound scientific writing (4). As none of the primary studies convincingly demonstrated that acupuncture is an effective therapy for recurrent urinary tract infections, no positive conclusion was warranted. Although Qin et al. did state that the risk of bias of the included trials was generally high or unclear (1), the BJOG nevertheless allowed them to turn massive uncertainty into relatively firm, positive conclusions in the abstract (“Acupuncture appeared to be beneficial for treatment and prophylaxis of rUTIs”) and tweetable abstract (“This review found that acupuncture may improve treatment and prevent recurrence of urinary tract infection in women”), thus leading to excited media headlines that inevitably mislead the public. ‘May’ is a weasel word which should be avoided as it is unfalsifiable (for example, pigs do not fly but they ‘may’ fly in the future). The definite, straightforward conclusion must be “There is no good evidence to support the use of acupuncture for the treatment and prophylaxis of recurrent UTIs”. It is not acceptable to give international credibility to an implausible modality that no objective, independent high-quality review has found effective beyond placebo (5). The dampening accompanying mini-commentary (6) does not undo the damage.
The review should be withdrawn while the primary papers are translated for peer reviewers to examine, the above limitations discussed in the text, and the positive ‘spin’ in conclusions corrected. These improvements would consolidate the researchers’ probity and justify the accolade of BJOG publication.

Our letter to the editor does not bear any relation to the statement it is meant to support by the review authors.

Ref 36

In this first prospective, randomized, single-blind, placebo-controlled study, 28 infertile patients with severe oligoasthenozoospermia received acupuncture according to the principles of traditional Chinese medicine (TCM) and 29 infertile patients received placebo acupuncture. A significantly higher percentage of motile sperm (World Health Organization categories A–C), but no effect on sperm concentration, was found after acupuncture compared with placebo acupuncture.

This small study is far from convincing and does not lend itself to far-reaching conclusions

Ref 37

Of the 279 cases of male sterility treated by the combination of acupuncture, pilose antler
essence injection to acupoints and oral administration of Chinese materia medica, 142
cases (47.8%) were cured, 81 cases (27.3%) markedly effective, 53 cases (17.8%) effective
and 21 cases (7.1%) ineffective. The therapeutic effect of the combination of these three
treatments was satisfactory.

This study had no control group and used two different therapies. Therefore, it does not allow any conclusion about the effectiveness of acupuncture.

____________________

Perhaps you feel that these errors are trivial. But I would disagree. The review authors’ praise of acupuncture for MI is misplaced and will mislead the public. There are plenty of reviews on the subject, and those that are not overtly biased arrive at conclusions like these:

• The current evidence on acupuncture for oligoasthenozoospermia is inadequate to draw a solid conclusion due to the poor methodological quality. Rigorous full-scale RCTs are needed to validate the therapeutic efficacy and safety of acupuncture in treating oligoasthenozoospermia.
• The current evidence showing that acupuncture might improve poor semen quality is insufficient because of the small number of studies, inadequacy of procedures and/or insufficient information for semen analysis, high levels of heterogeneity, high risk of bias, and poor quality of reporting. Further large, well-designed RCTs are required.

So, how did this sloppy review come about?

Its authors are affiliated to the TCM Regulating Metabolic Diseases Key Laboratory of Sichuan Province, Hospital of Chengdu University of Traditional Chinese Medicine, Chengdu 610072, China, and the Tea Research Institute, Sichuan Academy of Agricultural Sciences, Chengdu 610066, China. A footnote tells us that their review was supported by the National Natural Science Foundation of China [No. 81973647] and the Xinglin scholar discipline promotion talent program of Chengdu University of traditional Chinese medicine [No. BSH2021018]. This sounds respectable enough.

The journal that published the review is ‘Pharmacological Research – Modern Chinese Medicine‘. Its stated aims are as follows: The journal publishes articles reporting on advances in our comprehension of mechanism and safety in experimental pharmacology and clinical efficacy and safety of pharmacologically active substances, including compound prescriptions, utilized in Traditional Chinese Medicine applying modern scientific research methods. Studies reporting also on the mechanisms of actions of the active substance(s) investigated are encouraged.