In 2009, we published a systematic review of studies testing acupuncture as a treatment of menopausal hot flushes. We searched the literature using 17 databases from inception to October 10, 2008, without language restrictions. We only included randomized clinical trials (RCTs) of acupuncture versus sham acupuncture. Their methodological quality was assessed using the modified Jadad score. In total, six RCTs could be included. Four RCTs compared the effects of acupuncture with penetrating sham acupuncture on non-acupuncture points. All of these trials failed to show specific effects on menopausal hot flush frequency, severity or index. One RCT found no effects of acupuncture on hot flush frequency and severity compared with penetrating sham acupuncture on acupuncture points that are not relevant for the treatment of hot flushes. The remaining RCT tested acupuncture against non-penetrating acupuncture on non-acupuncture points. Its results suggested favourable effects of acupuncture on menopausal hot flush severity. However, this study was too small to generate reliable findings. At the time, we concluded that sham-controlled RCTs fail to show specific effects of acupuncture for control of menopausal hot flushes. We also argued that more rigorous research is warranted.
It seems that such research has just become available.
The aim of a brand-new study – a stratified, blind (participants, outcome assessors, and investigators, but not treating acupuncturists were blinded to treatment allocation), parallel, randomized, sham-controlled trial with equal allocation – was to assess the efficacy of Chinese medicine acupuncture against sham acupuncture for menopausal hot flushes (HFs). It was funded by the Australian National Health and Medical Research Council.
Women older than 40 years were recruited; they had to be in the late menopausal transition or postmenopause with at least 7 moderate HFs daily, meeting criteria for Chinese medicine diagnosis of kidney yin deficiency. These patients received 10 treatments over 8 weeks of either standardized Chinese medicine needle acupuncture designed to treat ‘kidney yin deficiency’ or they got the same amount of non-insertive sham acupuncture. The primary outcome was HF score at the end of treatment. Secondary outcomes included quality of life, anxiety, depression, and adverse events. Participants were assessed at 4 weeks, the end of treatment, and then 3 and 6 months after the end of treatment. Intention-to-treat analysis was conducted with linear mixed-effects models.
In total, 327 women were randomly assigned to acupuncture (n = 163) or sham acupuncture (n = 164). At the end of treatment, 16% of participants in the acupuncture group and 13% in the sham group were lost to follow-up. Mean HF scores at the end of treatment period were 15.36 in the acupuncture group and 15.04 in the sham group. No serious adverse events were reported.
The authors concluded that Chinese medicine acupuncture was not superior to non-insertive sham acupuncture for women with moderately severe menopausal HFs.
The trial has several strengths: it includes a large sample size and the patients were adequately blinded to eliminate the effects of expectations. It was published in a top journal, and we can therefore assume that it was properly peer-reviewed. Combined with the evidence from our previous systematic review, this indicates that acupuncture has no effect beyond placebo.
In other words: ACUPUNCTURE IS NOTHING BUT A THEATRICAL PLACEBO.
One does not need to be a clairvoyant to predict that acupuncturists will now find what they perceive as a flaw in the new study and claim that its results were false-negative. Subsequently they will probably conduct their own trial which, because it is wide open to bias, will generate the finding they were hoping for.
This sequence of poor quality positive and high quality negative studies could go on ad infinitum.
This begs the question: how can such wasteful pseudo-research be stopped?
In theory, applications to ethics committees for research that is not aimed at answering open and important questions should get rejected. In practice, however, this is unlikely to happen. In my experience, the main reason preventing such actions is that, when it comes to alternative medicine, ethics committees tend to be too lenient (attempting to be ‘politically correct’), too uninterested (thinking that alternative medicine is not really a serious area of research) and too uninformed (failing to insist on a rigorous assessment of the already available evidence).