Blinding patients in clinical trials is a key methodological procedure for minimizing bias and thus making sure that the results are reliable. In alternative medicine, blinding is not always straight forward, and many studies are therefore not patient-blinded. We all know that this can introduce bias into a trial, but how large is its effect on study outcomes?
This was the research question addressed by a recent systematic review of randomized clinical trials with one sub-study (i.e. experimental vs control) involving blinded patients and another, otherwise identical, sub-study involving non-blinded patients. Within each trial, the researchers compared the difference in effect sizes (i.e. standardized mean differences) between the two sub-studies. A difference <0 indicates that non-blinded patients generated a more optimistic effect estimate. The researchers then pooled the differences with random-effects inverse variance meta-analysis, and explored reasons for heterogeneity.
The main analysis included 12 trials with a total of 3869 patients. Ten of these RCTs were studies of acupuncture. The average difference in effect size for patient-reported outcomes was -0.56 (95% confidence interval -0.71 to -0.41), (I(2 )= 60%, P = 0.004), indicating that non-blinded patients exaggerated the effect size by an average of 0.56 standard deviation, but with considerable variation. Two of the 12 trials also used observer-reported outcomes, showing no indication of exaggerated effects due lack of patient blinding.
There was an even larger effect size difference in the 10 acupuncture trials [-0.63 (-0.77 to -0.49)], than in the two non-acupuncture trials [-0.17 (-0.41 to 0.07)]. Lack of patient blinding was also associated with increased attrition rates and the use of co-interventions: ratio of control group attrition risk 1.79 (1.18 to 2.70), and ratio of control group co-intervention risk 1.55 (0.99 to 2.43).
The authors conclude that this study provides empirical evidence of pronounced bias due to lack of patient blinding in complementary/alternative randomized clinical trials with patient-reported outcomes.
This is a timely, rigorous and important analysis. In alternative medicine, we currently see a proliferation of trials that are not patient-blinded. We always suspected that they are at a high risk of generating false-positive results – now we know that this is, in fact, the case.
What should we do with this insight? In my view, the following steps would be wise:
- Take the findings from the existing trials that are devoid of patient-blinding with more than just a pinch of salt.
- Discourage the funding of future studies that fail to include patient-blinding.
- If patient-blinding is truly and demonstrably impossible – which is not often the case – make sure that the trialists at least include blinding of the assessors of the primary outcome measures.
If you are pregnant, a ‘breech presentation’ is not good news. It occurs when the fetus presents ‘bottom-down’ in the uterus. There are three types:
- Breech with extended legs (frank) – 85% of cases
- Breech with fully flexed legs (complete)
- Footling (incomplete) with one or both thighs extended
The significance of breech presentation is its association with higher perinatal mortality and morbidity when compared to cephalic presentations. This is due both to pre-existing congenital malformation, increased incidence of breech in premature deliveries and increased risk of intrapartum trauma or asphyxia. Caesarean section has been adopted as the ‘normal’ mode of delivery for term breech presentations in Europe and the USA, as the consensus is that this reduces the risk of birth-related complications.
But Caesarian section is also not a desirable procedure. Something far less invasive would be much more preferable, of course. This is where the TCM-practitioners come in. They claim they have the solution: moxibustion, i.e. the stimulation of acupuncture points by heat. But does it really work? Can it turn the fetus into the correct position?
This new study aimed to assess the efficacy of moxibustion (heating of the acupuncture needle with an igniting charcoal moxa stick) with acupuncture for version of breech presentations to reduce their rate at 37 weeks of gestation and at delivery. It was a randomized, placebo-controlled, single-blind trial including 328 pregnant women recruited in a university hospital center between 33 4/7 and 35 4/7 weeks of gestation. Moxibustion with acupuncture or inactivated laser (placebo) treatment was applied to point BL 67 for 6 sessions. The principal endpoint was the percentage of fetuses in breech presentation at 37 2/7 weeks of gestation.
The results show that the percentage of fetuses in breech presentation at 37 2/7 weeks of gestation was not significantly different in both groups (72.0 in the moxibustion with acupuncture group compared with 63.4% in the placebo group).
The authors concluded that treatment by moxibustion with acupuncture was not effective in correcting breech presentation in the third trimester of pregnancy.
You might well ask why on earth anyone expected that stimulating an acupuncture point would turn a fetus in the mother’s uterus into the optimal position that carries the least risk during the process of giving birth. This is what proponents of this technique say about this approach:
During a TCM consultation to turn a breech baby the practitioner will take a comprehensive case history, make a diagnosis and apply the appropriate acupuncture treatment. They will assess if moxibustion might be helpful. Practitioners will then instruct women on how to locate the appropriate acupuncture points and demonstrate how to safely apply moxa at home. The acupuncture point UB 67 is the primary point selected for use because it is the most dynamic point to activate the uterus. Its forte is in turning malpositioned babies. It is located on the outer, lower edge of both little toenails. According to TCM theory, moxa has a tonifying and warming effect which promotes movement and activity. The nature of heat is also rising. This warming and raising effect is utilised to encourage the baby to become more active and lift its bottom up in order to gain adequate momentum to summersault into the head down position. This technique can also be used to reposition transverse presentation, a situation where the baby’s has its shoulder or back pointing down, or is lying sideways across the abdomen.
Not convinced? I can’t say I blame you!
Clearly, we need to know what the totality of the most reliable evidence shows; and what better than a Cochrane review to inform us about it? Here is what it tells us:
Moxibustion was not found to reduce the number of non-cephalic presentations at birth compared with no treatment (P = 0.45). Moxibustion resulted in decreased use of oxytocin before or during labour for women who had vaginal deliveries compared with no treatment (risk ratio (RR) 0.28, 95% confidence interval (CI) 0.13 to 0.60). Moxibustion was found to result in fewer non-cephalic presentations at birth compared with acupuncture (RR 0.25, 95% CI 0.09 to 0.72). When combined with acupuncture, moxibustion resulted in fewer non-cephalic presentations at birth (RR 0.73, 95% CI 0.57 to 0.94), and fewer births by caesarean section (RR 0.79, 95% CI 0.64 to 0.98) compared with no treatment. When combined with a postural technique, moxibustion was found to result in fewer non-cephalic presentations at birth compared with the postural technique alone (RR 0.26, 95% CI 0.12 to 0.56).
In other words, there is indeed some encouraging albeit not convincing evidence! How can this be? There is no plausible explanation why this treatment should work!
But there is a highly plausible explanation why the results of many of the relevant trials are false-positive thus rendering a meta-analysis false-positive as well. I have repeatedly pointed out on this blog that practically all Chinese TCM-studies report (false) positive results; and many of the studies included in this review were done in China. The Cochrane review provides a strong hint about the lack of rigor in its ‘plain language summary':
The included trials were of moderate methodological quality, sample sizes in some of the studies were small, how the treatment was applied differed and reporting was limited. While the results were combined they should be interpreted with caution due to the differences in the included studies. More evidence is needed concerning the benefits and safety of moxibustion.
So, would I recommend moxibustion for breech conversion? I don’t think so!
The question whether infant colic can be effectively treated with manipulative therapies might seem rather trivial – after all, this is a benign condition which the infant quickly grows out of. However, the issue becomes a little more tricky, if we consider that it was one of the 6 paediatric illnesses which were at the centre of the famous libel case of the BCA against my friend and co-author Simon Singh. At the time, Simon had claimed that there was ‘not a jot of evidence’ for claiming that chiropractic was an effective treatment of infant colic, and my systematic review of the evidence strongly supported his statement. The BCA eventually lost their libel case and with it the reputation of chiropractic. Now a new article on this intriguing topic has become available; do we have to reverse our judgements?
The aim of this new systematic review was to evaluate the efficacy or effectiveness of manipulative therapies for infantile colic. Six RCTs of chiropractic, osteopathy or cranial osteopathy alone or in conjunction with other interventions were included with a total of 325 infants. Of the 6 included studies, 5 were “suggestive of a beneficial effect” and one found no evidence of benefit. Combining all the RCTs suggested that manipulative therapies had a significant effect. The average crying time was reduced by an average of 72 minutes per day. This effect was sustained for studies with a low risk of selection bias and attrition bias. When analysing only those studies with a low risk of performance bias (i.e. parental blinding) the improvement in daily crying hours was no longer statistically significant.
The quality of the studies was variable. There was a generally low risk of selection bias but a high risk of performance bias. Only one of the studies recorded adverse events and none were encountered.
From these data, the authors drew the following conclusion: Parents of infants receiving manipulative therapies reported fewer hours crying per day than parents whose infants did not and this difference was statistically significant. Most studies had a high risk of performance bias due to the fact that the assessors (parents) were not blind to who had received the intervention. When combining only those trials with a low risk of such performance bias the results did not reach statistical significance.
Does that mean that chiropractic does work for infant colic? No, it does not!
The first thing to point out is that the new systematic review included not just RCTs of chiropractic but also osteopathy and cranio-sacral therapy.
The second important issue is that the effects disappear, once performance bias is being accounted for which clearly shows that the result is false positive.
The third relevant fact is that the majority of the RCTs were of poor quality. The methodologically best studies were negative.
And the fourth thing to note is that only one study mentioned adverse effects, which means that the other 5 trials were in breach of one of rather elementary research ethics.
What makes all of this even more fascinating is the fact that the senior author of the new publication, George Lewith, is the very expert who advised the BCA in their libel case against Simon Singh. He seems so fond of his work that he even decided to re-publish it using even more misleading language than before. It is, of course, far from me to suggest that his review was an attempt to white-wash the issue of chiropractic ‘bogus’ claims. However, based on the available evidence, I would have formulated conclusions which are more than just a little different from his; something like this perhaps:
The current best evidence suggests that the small effects that emerge when we pool the data from mostly unreliable studies are due to bias and therefore not real. This systematic review therefore fails to show that manipulative therapies are effective. It furthermore points to a serious breach of research ethics by the majority of researchers in this field.
A recent meta-analysis evaluated the efficacy of acupuncture for treatment of irritable bowel syndrome (IBS) and arrived at bizarrely positive conclusions.
The authors state that they searched 4 electronic databases for double-blind, placebo-controlled trials investigating the efficacy of acupuncture in the management of IBS. Studies were screened for inclusion based on randomization, controls, and measurable outcomes reported.
Six RCTs were included in the meta-analysis, and 5 articles were of high quality. The pooled relative risk for clinical improvement with acupuncture was 1.75 (95%CI: 1.24-2.46, P = 0.001). Using two different statistical approaches, the authors confirmed the efficacy of acupuncture for treating IBS and concluded that acupuncture exhibits clinically and statistically significant control of IBS symptoms.
As IBS is a common and often difficult to treat condition, this would be great news! But is it true? We do not need to look far to find the embarrassing mistakes and – dare I say it? – lies on which this result was constructed.
The largest RCT included in this meta-analysis was neither placebo-controlled nor double blind; it was a pragmatic trial with the infamous ‘A+B versus B’ design. Here is the key part of its methods section: 116 patients were offered 10 weekly individualised acupuncture sessions plus usual care, 117 patients continued with usual care alone. Intriguingly, this was the ONLY one of the 6 RCTs with a significantly positive result!
The second largest study (as well as all the other trials) showed that acupuncture was no better than sham treatments. Here is the key quote from this trial: there was no statistically significant difference between acupuncture and sham acupuncture.
So, let me re-write the conclusions of this meta-analysis without spin, lies or hype: These results of this meta-analysis seem to indicate that:
- currently there are several RCTs testing whether acupuncture is an effective therapy for IBS,
- all the RCTs that adequately control for placebo-effects show no effectiveness of acupuncture,
- the only RCT that yields a positive result does not make any attempt to control for placebo-effects,
- this suggests that acupuncture is a placebo,
- it also demonstrates how misleading studies with the infamous ‘A+B versus B’ design can be,
- finally, this meta-analysis seems to be a prime example of scientific misconduct with the aim of creating a positive result out of data which are, in fact, negative.
Many dietary supplements are heavily promoted for the prevention of chronic diseases, including cardiovascular disease (CVD) and cancer. But do they actually work or are they just raising false hopes? The evidence on this subject is confusing and proponents of both camps produce data which seemingly support their claims. In this situation, we need an independent analysis of the totality of the evidence to guide us. And one such review has just become available
The purpose of this article was to systematically review evidence for the use of multivitamins or single nutrients and functionally related nutrient pairs for the primary prevention of CVD and cancer in the general population.
The authors searched 5 databases to identify literature that was published between 2005 and January 29, 2013. They also examined the references from the previous reviews and other relevant articles to identify additional studies. In addition, they searched Web sites of government agencies and other organizations for grey literature. Two investigators independently reviewed identified abstracts and full-text articles against a set of a priori inclusion and quality criteria. One investigator abstracted data into an evidence table and a second investigator checked these data. The researchers then qualitatively and quantitatively synthesized the results for 4 key questions and grouped the included studies by study supplement. Finally, they conducted meta-analyses using Mantel-Haenzel fixed effects models for overall cancer incidence, CVD incidence, and all-cause mortality.
103 articles representing 26 unique studies met the inclusion criteria. Very few studies examined the use of multivitamin supplements. Two trials showed a protective effect against cancer in men; only one of these trials included women and found no effect. No effects of treatment were seen on CVD or all-cause mortality.
Beta-carotene showed a negative effect on lung cancer incidence and mortality among individuals at high risk for lung cancer at baseline (i.e., smokers and asbestos-exposed workers); this effect was persistent even when combined with vitamin A or E. Trials of vitamin E supplementation showed mixed results and altogether had no overall effect on cancer, CVD, or all-cause mortality. Only one of two studies included selenium trials showed a beneficial effect for colorectal and prostate cancer; however, this trial had a small sample size. The few studies addressing folic acid, vitamin C, and vitamin A showed no effect on CVD, cancer, and mortality. Vitamin D and/or calcium supplementation also showed no overall effect on CVD, cancer, and mortality. Harms were infrequently reported and aside from limited paradoxical effects for some supplements, were not considered serious.
The authors’ conclusion are less than encouraging: there are a limited number of trials examining the effects of dietary supplements on the primary prevention of CVD and cancer; the majority showed no effect in healthy populations. Clinical heterogeneity of included studies limits generalizability of results to the general primary care population. Results from trials in at-risk populations discourage additional studies for particular supplements (e.g., beta-carotene); however, future research in general primary care populations and on other supplements is required to address research gaps.
A brand-new RCT provides further information, specifically on the question whether oral multivitamins are effective for the secondary prevention of cardiovascular events. In total, 1708 patients aged 50 years or older who had myocardial infarction (MI) at least 6 weeks earlier with elevated serum creatinine levels were randomly assigned to an oral, 28-component, high-dose multivitamin and multi-mineral mixture or placebo. The primary end point was time to death, recurrent MI, stroke, coronary revascularization, or hospitalization for angina. Median follow-up was 55 months. Patients received treatments for a median of 31 months in the vitamin group and 35 months in the placebo group. 76% and 76% patients in the vitamin and placebo groups completed at least 1 year of oral therapy, and 47% and 50% patients completed at least 3 years. Totals of 46% and 46% patients in both groups discontinued the vitamin regimen, and 17% of patients withdrew from the study.
The primary end point occurred in 27% patients in the vitamin group and 30% in the placebo group. No evidence suggested harm from vitamin therapy in any category of adverse events. The authors of this RCT concluded that high-dose oral multivitamins and multiminerals did not statistically significantly reduce cardiovascular events in patients after MI who received standard medications. However, this conclusion is tempered by the nonadherence rate.
These findings are sobering and in stark contrast to what the multi-billion dollar supplement industry promotes. The misinformation in this area is monumental. Here is what one site advertises for heart disease:
Vitamin C could be helpful, limit dosage to 100 to 500 mg a day.
Vitamin E works better with CoQ10 to reduce inflammation in heart disease. Limit vitamin E to maximum 30 to 200 units a few times a week. Use a natural vitamin E complex rather than synthetic products.
CoQ10 may be helpful in heart disease, especially in combination with vitamin E. I would recommend limiting the dosage of Coenzyme Q10 to 30 mg daily or 50 mg three or four times a week.
Curcumin protects rat heart tissue against damage from low oxygen supply, and the protective effect could be attributed to its antioxidant properties. Curcumin is derived from turmeric, which is often used in curries.
Garlic could be an effective treatment for lowering cholesterol and triglyceride levels for patients with a history or risk of cardiovascular disease, especially as a long term strategy.
Terminalia arjuna, an Indian medicinal plant, has been reported to have beneficial effects in patients with ischemic heart disease in a number of small studies. Arjuna has been tested in angina and could help reduce chest pain.
Magnesium is a mineral that could help some individuals. It is reasonable to encourage diets high in magnesium as a potential means to lower the risk of coronary heart disease.
Danshen used in China for heart conditions.
And in the area of cancer, the choice is even more wide and audacious as this web-site for example demonstrates.
So, the picture that emerges from all this seems fairly clear. Despite thousands of claims to the contrary, dietary supplements are useless in preventing cardiovascular diseases or cancer. All they do produce, I am afraid, is rather expensive urine.
There are numerous types and styles of acupuncture, and the discussion whether one is better than the other has been long, tedious and frustrating. Traditional acupuncturists, for instance, individualise their approach according to their findings of pulse and tongue diagnoses as well as other non-validated diagnostic criteria. Western acupuncturists, by contrast, tend to use formula or standardised treatments according to conventional diagnoses.
This study aimed to compare the effectiveness of standardized and individualized acupuncture treatment in patients with chronic low back pain. A single-center randomized controlled single-blind trial was performed in a general medical practice of a Chinese-born medical doctor trained in both western and Chinese medicine. One hundred and fifty outpatients with chronic low back pain were randomly allocated to two groups who received either standardized acupuncture or individualized acupuncture. 10 to 15 treatments based on individual symptoms were given with two treatments per week.
The main outcome measure was the area under the curve (AUC) summarizing eight weeks of daily rated pain severity measured with a visual analogue scale. No significant differences between groups were observed for the AUC (individualized acupuncture mean: 1768.7; standardized acupuncture 1482.9; group difference, 285.8).
The authors concluded that individualized acupuncture was not superior to standardized acupuncture for patients suffering from chronic pain.
But perhaps it matters whether the acupuncturist is thoroughly trained or has just picked up his/her skills during a weekend course? I am afraid not: this analysis of a total of 4,084 patients with chronic headache, lower back pain or arthritic pain treated by 1,838 acupuncturists suggested otherwise. There were no differences in success for patients treated by physicians passing through shorter (A diploma) or longer (B diploma) training courses in acupuncture.
But these are just one single trial and one post-hoc analysis of another study which, by definition, cannot be fully definitive. Fortunately, we have more evidence based on much larger numbers. This brand-new meta-analysis aimed to evaluate whether there are characteristics of acupuncture or acupuncturists that are associated with better or worse outcomes.
An existing dataset, developed by the Acupuncture Trialists’ Collaboration, included 29 trials of acupuncture for chronic pain with individual data involving 17,922 patients. The available data on characteristics of acupuncture included style of acupuncture, point prescription, location of needles, use of electrical stimulation and moxibustion, number, frequency and duration of sessions, number of needles used and acupuncturist experience. Random-effects meta-regression was used to test the effect of each characteristic on the main effect estimate of pain. Where sufficient patient-level data were available, patient-level analyses were conducted.
When comparing acupuncture to sham controls, there was little evidence that the effects of acupuncture on pain were modified by any of the acupuncture characteristics evaluated, including style of acupuncture, the number or placement of needles, the number, frequency or duration of sessions, patient-practitioner interactions and the experience of the acupuncturist. When comparing acupuncture to non-acupuncture controls, there was little evidence that these characteristics modified the effect of acupuncture, except better pain outcomes were observed when more needles were used and, from patient level analysis involving a sub-set of 5 trials, when a higher number of acupuncture treatment sessions were provided.
The authors of this meta-analysis concluded that there was little evidence that different characteristics of acupuncture or acupuncturists modified the effect of treatment on pain outcomes. Increased number of needles and more sessions appear to be associated with better outcomes when comparing acupuncture to non-acupuncture controls, suggesting that dose is important. Potential confounders include differences in control group and sample size between trials. Trials to evaluate potentially small differences in outcome associated with different acupuncture characteristics are likely to require large sample sizes.
My reading of these collective findings is that it does not matter which type of acupuncture you use nor who uses it; the clinical effects are similar regardless of the most obvious potential determinants. Hardly surprising! In fact, one would expect such results, if one considered that acupuncture is a placebo-treatment.
Alternative medicine thrives in the realm of common chronic conditions which conventional medicine cannot cure and which respond well to treatment with placebos. Irritable bowel syndrome (IBS) is such a condition, and IBS-sufferers who are often frustrated with the symptomatic relief conventional medicine has to offer are only too keen to try any therapy that promises help. There is hardly an alternative therapy which does not claim to be the solution to IBS-symptoms: herbal medicine, mind-body interventions, homeopathy (the subject of my next post), acupuncture, even ‘MOXIBUSTION‘.
Moxibustion is a derivative of acupuncture; instead of needles, this method employs heat to stimulate acupuncture points. Proponents believe that the effects of moxibustion are roughly equivalent to those of acupuncture but many acupuncturists feel that they are less powerful. One website explains: Moxibustion is a traditional Chinese medicine technique that involves the burning of mugwort, a small, spongy herb, to facilitate healing. Moxibustion has been used throughout Asia for thousands of years; in fact, the actual Chinese character for acupuncture, translated literally, means “acupuncture-moxibustion.” The purpose of moxibustion, as with most forms of traditional Chinese medicine, is to strengthen the blood, stimulate the flow of qi, and maintain general health.
Many proponents of moxibustion claim that their treatment works for IBS. The evidence is, however, far less clear. Two recent meta-analyses might tell us more.
The first systematic review and meta-analysis was published by Korean researchers and aimed at critically evaluating the current evidence on moxibustion for improving global symptoms of IBS. The authors conducted extensive searches and found a total of 20 RCTs to be included in their analyses. The risk of bias in these studies was generally high. Compared with pharmacological medications, moxibustion significantly alleviated overall IBS symptoms but there was a moderate inconsistency among the 7 RCTs. Moxibustion combined with acupuncture was more effective than pharmacological therapy but a moderate inconsistency among the 4 studies was found. When moxibustion was added to pharmacological medications or herbal medicine, no additive benefit of moxibustion was shown compared with pharmacological medications or herbal medicine alone. One small sham-controlled trial found no difference between moxibustion and sham control in symptom severity. Moxibustion appeared to be associated with few adverse events but the evidence is limited due to poor reporting.
The authors concluded that moxibustion may provide benefit to IBS patients although the risk of bias in the included studies is relatively high. Future studies are necessary to confirm whether this finding is reproducible in carefully-designed and conducted trials and to firmly establish the place of moxibustion in current practice.
The way I see it, these conclusions are far too optimistic. There was only one RCT that controlled for placebo-effects, and the results of that study were negative. Thus I would conclude that some studies report effectiveness of moxibustion for IBS, yet the effects seem not to be caused by the treatment per se but are most likely due to a placebo-effect.
The second systematic review and meta-analysis was published by Chinese researchers and aimed at evaluating the clinical efficacy and safety of moxibustion and acupuncture in treatment of IBS. The authors included randomized and quasi-randomized clinical trials in their analyses and were able to include 11 trials. Their meta analysis suggests that the effectiveness of the combined methods of acupuncture and moxibustion is superior to conventional western medication treatment. The authors concluded that acupuncture-moxibustion for IBS is better than the conventional western medication treatment.
While the first meta-analysis was at least technically sound, the second seems to have too many flaws to mention: the search methodology was flimsy, many available studies were not included, their risk of bias was not assessed critically, the conclusions are based more on wishful thinking than on the available data, etc.
If we consider that moxibustion is a method of stimulating acupoints, we have to assume that it can at best be as effective as acupuncture, quite possibly slightly less. Thus it is relevant to see what the evidence tells us about acupuncture for IBS. The current Cochrane review of acupuncture for IBS shows that sham-controlled RCTs have found no benefits of acupuncture relative to a credible sham acupuncture control for IBS symptom severity or IBS-related quality of life.
I think I rest my case.
Australian researchers wanted to know whether acupuncture is effective for alleviating the symptoms of fibromyalgia, a common painful condition for which no universally accepted treatment exists. For this purpose, they conducted a Cochrane review. After extensive literature searches, they identified 9 RCTs, extracted their data and assessed risk of bias.
The results show that all studies except one were at low risk of selection bias; five were at risk of selective reporting bias; two were subject to attrition bias (favouring acupuncture); three were subject to performance bias (favouring acupuncture) and one to detection bias (favouring acupuncture).
Three studies utilised electro-acupuncture (EA) and the remainder manual acupuncture (MA) without electrical stimulation.
Low quality evidence from one study (13 participants) showed EA improved symptoms with no adverse events at one month following treatment.
Moderate quality evidence from six studies (286 participants) indicated that acupuncture (EA or MA) was no better than sham acupuncture, except for less stiffness at one month. Subgroup analysis of two studies (104 participants) indicated benefits of EA. Mean pain was 70 points on 0 to 100 point scale with sham treatment; EA reduced pain by 13% (5% to 22%).
Low-quality evidence from one study suggested that MA resulted in poorer physical function: mean function in the sham group was 28 points (100 point scale); treatment worsened function by a mean of 6 points.
Moderate quality evidence from one study (58 participants) found that, compared with standard therapy alone (antidepressants and exercise), adjunct acupuncture therapy reduced pain at one month after treatment.
Low quality evidence from one study (38 participants) showed a short-term benefit of acupuncture over antidepressants in pain relief.
Moderate-quality evidence from one study (41 participants) indicated that deep needling with or without deqi did not differ in pain, fatigue, function or adverse events.
Four studies reported no differences between acupuncture and control or other treatments described at six to seven months follow-up.
No serious adverse events were reported, but there were insufficient adverse events to be certain of the risks.
The authors draw the following conclusions: There is low to moderate-level evidence that compared with no treatment and standard therapy, acupuncture improves pain and stiffness in people with fibromyalgia. There is moderate-level evidence that the effect of acupuncture does not differ from sham acupuncture in reducing pain or fatigue, or improving sleep or global well-being. EA is probably better than MA for pain and stiffness reduction and improvement of global well-being, sleep and fatigue. The effect lasts up to one month, but is not maintained at six months follow-up. MA probably does not improve pain or physical functioning. Acupuncture appears safe. People with fibromyalgia may consider using EA alone or with exercise and medication. The small sample size, scarcity of studies for each comparison, lack of an ideal sham acupuncture weaken the level of evidence and its clinical implications. Larger studies are warranted.
What does all that mean? In my view, it means that there is no sound evidence base for acupuncture as a treatment of fibromyalgia – or as we expressed it in our own systematic review of 2007: The notion that acupuncture is an effective symptomatic treatment for fibromyaligia is not supported by the results from rigorous clinical trials. On the basis of this evidence, acupuncture cannot be recommended for fibromyalgia.
In 2010, NICE recommended acupuncture for chronic low back pain (cLBP). Acupuncturists were of course delighted; the British Acupuncture Council, for instance, stated that they fully support NICE’s (National Institute for Health and Clinical Excellence) decision that acupuncture be made available on the NHS for chronic lower back pain. Traditional acupuncture has been used for over 2,000 years to alleviate back pain and British Acupuncture Council members have for many many years been successfully treating patients for this condition either in private practice or working within the NHS. In effect, therefore, these new guidelines are a rubber stamp of the positive work already being undertaken as well as an endorsement of the wealth of research evidence now available in this area.
More critical experts, however, tended to be surprised about this move and doubted that the evidence was strong enough for a positive recommendation. Now a brand-new meta-analysis sheds more light on this important issue.
Its aim was to determine the effectiveness of acupuncture as a therapy for cLBP. The authors found 13 RCTs which matched their inclusion criteria. Their results show that, compared with no treatment, acupuncture achieved better outcomes in terms of pain relief, disability recovery and better quality of life. These effects were, however, not observed when real acupuncture was compared to sham acupuncture. Acupuncture achieved better outcomes when compared with other treatments. No publication bias was detected.
The authors conclude that acupuncture is an effective treatment for chronic low back pain, but this effect is likely to be produced by the nonspecific effects of manipulation.
In plain English, this means that the effects of acupuncture on cLBP are most likely due to placebo. Should NICE be recommending placebo-treatments and have the tax payer foot the bill? I think I can leave it to my readers to answer this question.
One of the best-selling supplements in the UK as well as several other countries is evening primrose oil (EPO). It is available via all sorts of outlets (even respectable pharmacies – or is that supposedly respectable?), and is being promoted for a wide range of conditions, including eczema. The NIH website is optimistic about its efficacy: “Evening primrose oil may have modest benefits for eczema.” Our brand-new Cochrane review was aimed at critically assessing the effects of oral EPO or borage oil (BO) on the symptoms of atopic eczema, and it casts considerable doubt on this somewhat uncritical view.
Here is what we did: We searched six databases as well as online trials registers and checked the bibliographies of included studies for further references to relevant trials. We corresponded with trial investigators and pharmaceutical companies to identify unpublished and ongoing trials. We also performed a separate search for adverse effects. All RCTs investigating oral intake of EPO or BO for eczema were included.
Two experts independently applied eligibility criteria, assessed risk of bias, and extracted data. We pooled dichotomous outcomes using risk ratios (RR), and continuous outcomes using the mean difference (MD). Where possible, we pooled study results using random-effects meta-analysis and tested statistical heterogeneity.
And here is what we found: 27 studies with a total of 1596 participants met our inclusion criteria: 19 studies tested EPO, and 8 studies assessed BO. A meta-analysis of results from 7 studies showed that EPO failed to improve global eczema symptoms as reported by participants and doctors. Treatment with BO also failed to improve global eczema symptoms. 67% of the studies had a low risk of bias for random sequence generation; 44%, for allocation concealment; 59%, for blinding; and 37%, for other biases.
Our conclusions were clear: Oral borage oil and evening primrose oil lack effect on eczema; improvement was similar to respective placebos used in trials. Oral BO and EPO are not effective treatments for eczema.
The very wide-spread notion that EPO is effective for eczema and a range of other conditions was originally promoted by the researcher turned entrepreneur, D F Horrobin, who claimed that several human diseases, including eczema, were due to a lack of fatty acid precursors and could thus be effectively treated with EPO. In the 1980s, Horrobin began to sell EPO supplements without having conclusively demonstrated their safety and efficacy; this led to confiscations and felony indictments in the US. As chief executive of Scotia Pharmaceuticals, Horrobin obtained licences for several EPO-preparations which later were withdrawn for lack of efficacy. Charges of mismanagement and fraud led to Horrobin being ousted as CEO by the board of the company. Later, Horrobin published a positive meta-analysis of EPO for eczema where he excluded the negative results of the largest published trial, but included results of 7 of his own unpublished studies. When scientists asked to examine the data, Horrobin’s legal team convinced the journal to refuse the request.
The evidence for EPO is negative not just for eczema. To the best of my knowledge, there is not a single disease or symptom for which it demonstrably works. Our own review of the data concluded ” EPO has not been established as an effective treatment for any condition”
Our new Cochrane review might help to put this long saga to rest. In my view, it is a fascinating tale of a scientist being blinded by creed and ambition. The results of such errors can be dramatic. Horrobin misled all of us: patients, health care professionals, scientists, regulators, decision makers, businessmen. This caused unnecessary expense and set back research efforts in a multitude of areas. I find the tale also fascinating from other perspectives; for instance, it begs the question why so many ‘respectable’ manufacturers and retailers are still allowed to make money on EPO. Is it not time to debunk the EPO-myth and say it as clearly as possible: EPO helps only those who financially profit from misleading the public?