Two recent reviews have evaluated the evidence for acupuncture as a means of preventing migraine attacks.
The first review assessed the efficacy and safety of acupuncture for the prophylaxis of episodic or chronic migraine in adult patients compared to pharmacological treatment.
The authors included randomized controlled trials published in western languages that compared any treatment involving needle insertion (with or without manual or electrical stimulation) at acupuncture points, pain points or trigger points, with any pharmacological prophylaxis in adult (≥18 years) with chronic or episodic migraine with or without aura according to the criteria of the International Headache Society.
Nine randomized trials were included encompassing 1,484 patients. At the end of the intervention, a small reduction was found in favor of acupuncture for the number of days with migraine per month: (SMD: -0.37; 95% CI -1.64 to -0.11), and for response rate (RR: 1.46; 95% CI 1.16-1.84). A moderate effect emerged in the reduction of pain intensity in favor of acupuncture (SMD: -0.36; 95% CI -0.60 to -0.13), and a large reduction in favor of acupuncture in both the dropout rate due to any reason (RR 0.39; 95% CI 0.18 to 0.84) and the dropout rate due to adverse event (RR 0.26; 95% CI 0.09 to 0.74). The quality of the evidence was moderate for all these primary outcomes. Results at longest follow-up confirmed these effects.
The authors concluded that, based on moderate certainty of evidence, we conclude that acupuncture is mildly more effective and much safer than medication for the prophylaxis of migraine.
The second review aimed to perform a network meta-analysis to compare the effectiveness and acceptability between topiramate, acupuncture, and Botulinum neurotoxin A (BoNT-A).
The authors searched OVID Medline, Embase, the Cochrane register of controlled trials (CENTRAL), the Chinese Clinical Trial Register, and clinicaltrials.gov for randomized controlled trials (RCTs) that compared topiramate, acupuncture, and BoNT-A with any of them or placebo in the preventive treatment of chronic migraine. A network meta-analysis was performed by using a frequentist approach and a random-effects model. The primary outcomes were the reduction in monthly headache days and monthly migraine days at week 12. Acceptability was defined as the number of dropouts owing to adverse events.
A total of 15 RCTs (n = 2545) could be included. Eleven RCTs were at low risk of bias. The network meta-analyses (n = 2061) showed that acupuncture (2061 participants; standardized mean difference [SMD] -1.61, 95% CI: -2.35 to -0.87) and topiramate (582 participants; SMD -0.4, 95% CI: -0.75 to -0.04) ranked the most effective in the reduction of monthly headache days and migraine days, respectively; but they were not significantly superior over BoNT-A. Topiramate caused the most treatment-related adverse events and the highest rate of dropouts owing to adverse events.
The authors concluded that Topiramate and acupuncture were not superior over BoNT-A; BoNT-A was still the primary preventive treatment of chronic migraine. Large-scale RCTs with direct comparison of these three treatments are warranted to verify the findings.
Unquestionably, these are interesting findings. How reliable are they? Acupuncture trials are in several ways notoriously tricky, and many of the primary studies were of poor quality. This means the results are not as reliable as one would hope. Yet, it seems to me that migraine prevention is one of the indications where the evidence for acupuncture is strongest.
A second question might be practicability. How realistic is it for a patient to receive regular acupuncture sessions for migraine prevention? And finally, we might ask how cost-effective acupuncture is for that purpose and how its cost-effectiveness compares to other options.
The objective of this trial, just published in the BMJ, was to assess the efficacy of manual acupuncture as prophylactic treatment for acupuncture naive patients with episodic migraine without aura. The study was designed as a multi-centre, randomised, controlled clinical trial with blinded participants, outcome assessment, and statistician. It was conducted in 7 hospitals in China with 150 acupuncture naive patients with episodic migraine without aura.
They were given the following treatments:
- 20 sessions of manual acupuncture at true acupuncture points plus usual care,
- 20 sessions of non-penetrating sham acupuncture at heterosegmental non-acupuncture points plus usual care,
- usual care alone over 8 weeks.
The main outcome measures were change in migraine days and migraine attacks per 4 weeks during weeks 1-20 after randomisation compared with baseline (4 weeks before randomisation).
A total of 147 were included in the final analyses. Compared with sham acupuncture, manual acupuncture resulted in a significantly greater reduction in migraine days at weeks 13 to 20 and a significantly greater reduction in migraine attacks at weeks 17 to 20. The reduction in mean number of migraine days was 3.5 (SD 2.5) for manual versus 2.4 (3.4) for sham at weeks 13 to 16 and 3.9 (3.0) for manual versus 2.2 (3.2) for sham at weeks 17 to 20. At weeks 17 to 20, the reduction in mean number of attacks was 2.3 (1.7) for manual versus 1.6 (2.5) for sham. No severe adverse events were reported. No significant difference was seen in the proportion of patients perceiving needle penetration between manual acupuncture and sham acupuncture (79% v 75%).
The authors concluded that twenty sessions of manual acupuncture was superior to sham acupuncture and usual care for the prophylaxis of episodic migraine without aura. These results support the use of manual acupuncture in patients who are reluctant to use prophylactic drugs or when prophylactic drugs are ineffective, and it should be considered in future guidelines.
Considering the many flaws in most acupuncture studies discussed ad nauseam on this blog, this is a relatively rigorous trial. Yet, before we accept the conclusions, we ought to evaluate it critically.
The first thing that struck me was the very last sentence of its abstract. I do not think that a single trial can ever be a sufficient reason for changing existing guidelines. The current Cochrance review concludes that the available evidence suggests that adding acupuncture to symptomatic treatment of attacks reduces the frequency of headaches. Thus, one could perhaps argue that, together with the existing data, this new study might strengthen its conclusion.
In the methods section, the authors state that at the end of the study, we determined the maintenance of blinding of patients by asking them whether they thought the needles had penetrated the skin. And in the results section, they report that they found no significant difference between the manual acupuncture and sham acupuncture groups for patients’ ability to correctly guess their allocation status.
I find this puzzling, since the authors also state that they tried to elicit acupuncture de-qi sensation by the manual manipulation of needles. They fail to report data on this but this attempt is usually successful in the majority of patients. In the control group, where non-penetrating needles were used, no de-qi could be generated. This means that the two groups must have been at least partly de-blinded. Yet, we learn from the paper that patients were not able to guess to which group they were randomised. Which statement is correct?
This may sound like a trivial matter, but I fear it is not.
Like this new study, acupuncture trials frequently originate from China. We and others have shown that Chinese trials of acupuncture hardly ever produce a negative finding. If that is so, one does not need to read the paper, one already knows that it is positive before one has even seen it. Neither do the researchers need to conduct the study, one already knows the result before the trial has started.
You don’t believe the findings of my research nor those of others?
Excellent! It’s always good to be sceptical!
But in this case, do you believe Chinese researchers?
In this systematic review, all RCTs of acupuncture published in Chinese journals were identified by a team of Chinese scientists. An impressive total of 840 trials were found. Among them, 838 studies (99.8%) reported positive results from primary outcomes and two trials (0.2%) reported negative results. The authors concluded that publication bias might be major issue in RCTs on acupuncture published in Chinese journals reported, which is related to high risk of bias. We suggest that all trials should be prospectively registered in international trial registry in future.
So, at least three independent reviews have found that Chinese acupuncture trials report virtually nothing but positive findings. Is that enough evidence to distrust Chinese TCM studies?
But there are even more compelling reasons for taking evidence from China with a pinch of salt:
A survey of clinical trials in China has revealed fraudulent practice on a massive scale. China’s food and drug regulator carried out a one-year review of clinical trials. They concluded that more than 80 percent of clinical data is “fabricated“. The review evaluated data from 1,622 clinical trial programs of new pharmaceutical drugs awaiting regulator approval for mass production. According to the report, much of the data gathered in clinical trials are incomplete, failed to meet analysis requirements or were untraceable. Some companies were suspected of deliberately hiding or deleting records of adverse effects, and tampering with data that did not meet expectations. “Clinical data fabrication was an open secret even before the inspection,” the paper quoted an unnamed hospital chief as saying. Chinese research organisations seem have become “accomplices in data fabrication due to cutthroat competition and economic motivation.”
So, am I claiming the new acupuncture study just published in the BMJ is a fake?
Am I saying that it would be wise to be sceptical?
Sadly, my scepticism is not shared by the BMJ’s editorial writer who concludes that the new study helps to move acupuncture from having an unproven status in complementary medicine to an acceptable evidence based treatment.
Call me a sceptic, but that statement is, in my view, hard to justify!
Chiropractic spinal manipulative therapy (CSMT) for migraine?
There is no good evidence that it works!
On the contrary, there is good evidence that it does NOT work!
A recent and rigorous study (conducted by chiropractors!) tested the efficacy of chiropractic CSMT for migraine. It was designed as a three-armed, single-blinded, placebo -controlled RCT of 17 months duration including 104 migraineurs with at least one migraine attack per month. Active treatment consisted of CSMT (group 1) and the placebo was a sham push manoeuvre of the lateral edge of the scapula and/or the gluteal region (group 2). The control group continued their usual pharmacological management (group 3). The results show that migraine days were significantly reduced within all three groups from baseline to post-treatment. The effect continued in the CSMT and placebo groups at all follow-up time points (groups 1 and 2), whereas the control group (group 3) returned to baseline. The reduction in migraine days was not significantly different between the groups. Migraine duration and headache index were reduced significantly more in the CSMT than in group 3 towards the end of follow-up. Adverse events were few, mild and transient. Blinding was sustained throughout the RCT. The authors concluded that the effect of CSMT observed in our study is probably due to a placebo response.
One can understand that, for chiropractors, this finding is upsetting. After all, they earn a good part of their living by treating migraineurs. They don’t want to lose patients and, at the same time, they need to claim to practise evidence-based medicine.
What is the way out of this dilemma?
They only need to publish a review in which they dilute the irritatingly negative result of the above trial by including all previous low-quality trials with false-positive results and thus generate a new overall finding that alleges CSMT to be evidence-based.
This new systematic review of randomized clinical trials (RCTs) evaluated the evidence regarding spinal manipulation as an alternative or integrative therapy in reducing migraine pain and disability.
The searches identified 6 RCTs eligible for meta-analysis. Intervention duration ranged from 2 to 6 months; outcomes included measures of migraine days (primary outcome), migraine pain/intensity, and migraine disability. Methodological quality varied across the studies. The results showed that spinal manipulation reduced migraine days with an overall small effect size as well as migraine pain/intensity.
The authors concluded that spinal manipulation may be an effective therapeutic technique to reduce migraine days and pain/intensity. However, given the limitations to studies included in this meta-analysis, we consider these results to be preliminary. Methodologically rigorous, large-scale RCTs are warranted to better inform the evidence base for spinal manipulation as a treatment for migraine.
Bob’s your uncle!
Perhaps not perfect, but at least the chiropractic profession can now continue to claim they practice something akin to evidence-based medicine, while happily cashing in on selling their unproven treatments to migraineurs!
But that’s not very fair; research is not for promotion, research is for finding the truth; this white-wash is not in the best interest of patients! I hear you say.
Who cares about fairness, truth or conflicts of interest?
Christine Goertz, one of the review-authors, has received funding from the NCMIC Foundation and served as the Director of the Inter‐Institutional Network for Chiropractic Research (IINCR). Peter M. Wayne, another author, has received funding from the NCMIC Foundation and served as the co‐Director of the Inter‐Institutional Network for Chiropractic Research (IINCR)
And who the Dickens are the NCMIC and the IINCR?
At NCMIC, they believe that supporting the chiropractic profession, including chiropractic research programs and projects, is an important part of our heritage. They also offer business training and malpractice risk management seminars and resources to D.C.s as a complement to the education provided by the chiropractic colleges.
The IINCR is a collaborative effort between PCCR, Yale Center for Medical Informatics and the Osher Center for Integrative Medicine at Brigham and Women’s Hospital and Harvard Medical School. They aim at creating a chiropractic research portfolio that’s truly translational. Vice Chancellor for Research and Health Policy at Palmer College of Chiropractic Christine Goertz, DC, PhD (PCCR) is the network director. Peter Wayne, PhD (Osher Center for Integrative Medicine at Brigham and Women’s Hospital and Harvard Medical School) will join Anthony J. Lisi, DC (Yale Center for Medical Informatics and VA Connecticut Healthcare System) as a co-director. These investigators will form a robust foundation to advance chiropractic science, practice and policy. “Our collective efforts provide an unprecedented opportunity to conduct clinical and basic research that advances chiropractic research and evidence-based clinical practice, ultimately benefiting the patients we serve,” said Christine Goertz.
Really: benefiting the patients?
You could have fooled me!
This systematic review was aimed at evaluating the effects of acupuncture on the quality of life of migraineurs. Only randomized controlled trials that were published in Chinese and English were included. In total, 62 trials were included for the final analysis; 50 trials were from China, 3 from Brazil, 3 from Germany, 2 from Italy and the rest came from Iran, Israel, Australia and Sweden.
Acupuncture resulted in lower Visual Analog Scale scores than medication at 1 month after treatment and 1-3 months after treatment. Compared with sham acupuncture, acupuncture resulted in lower Visual Analog Scale scores at 1 month after treatment.
The authors concluded that acupuncture exhibits certain efficacy both in the treatment and prevention of migraines, which is superior to no treatment, sham acupuncture and medication. Further, acupuncture enhanced the quality of life more than did medication.
The authors comment in the discussion section that the overall quality of the evidence for most outcomes was of low to moderate quality. Reasons for diminished quality consist of the following: no mentioned or inadequate allocation concealment, great probability of reporting bias, study heterogeneity, sub-standard sample size, and dropout without analysis.
Further worrisome deficits are that only 14 of the 62 studies reported adverse effects (this means that 48 RCTs violated research ethics!) and that there was a high level of publication bias indicating that negative studies had remained unpublished. However, the most serious concern is the fact that 50 of the 62 trials originated from China, in my view. As I have often pointed out, such studies have to be categorised as highly unreliable.
In view of this multitude of serious problems, I feel that the conclusions of this review must be re-formulated:
Despite the fact that many RCTs have been published, the effect of acupuncture on the quality of life of migraineurs remains unproven.
A new study published in JAMA investigated the long-term effects of acupuncture compared with sham acupuncture and being placed in a waiting-list control group for migraine prophylaxis. The trial was a 24-week randomized clinical trial (4 weeks of treatment followed by 20 weeks of follow-up). Participants were randomly assigned to 1) true acupuncture, 2) sham acupuncture, or 3) a waiting-list control group. The trial was conducted from October 2012 to September 2014 in outpatient settings at three clinical sites in China. Participants 18 to 65 years old were enrolled with migraine without aura based on the criteria of the International Headache Society, with migraine occurring 2 to 8 times per month.
Participants in the true acupuncture and sham acupuncture groups received treatment 5 days per week for 4 weeks for a total of 20 sessions. Participants in the waiting-list group did not receive acupuncture but were informed that 20 sessions of acupuncture would be provided free of charge at the end of the trial. Participants used diaries to record migraine attacks. The primary outcome was the change in the frequency of migraine attacks from baseline to week 16. Secondary outcome measures included the migraine days, average headache severity, and medication intake every 4 weeks within 24 weeks.
A total of 249 participants 18 to 65 years old were enrolled, and 245 were included in the intention-to-treat analyses. Baseline characteristics were comparable across the 3 groups. The mean (SD) change in frequency of migraine attacks differed significantly among the 3 groups at 16 weeks after randomization; the mean (SD) frequency of attacks decreased in the true acupuncture group by 3.2 (2.1), in the sham acupuncture group by 2.1 (2.5), and the waiting-list group by 1.4 (2.5); a greater reduction was observed in the true acupuncture than in the sham acupuncture group (difference of 1.1 attacks; 95% CI, 0.4-1.9; P = .002) and in the true acupuncture vs waiting-list group (difference of 1.8 attacks; 95% CI, 1.1-2.5; P < .001). Sham acupuncture was not statistically different from the waiting-list group (difference of 0.7 attacks; 95% CI, −0.1 to 1.4; P = .07).
The authors concluded that among patients with migraine without aura, true acupuncture may be associated with long-term reduction in migraine recurrence compared with sham acupuncture or assigned to a waiting list.
Note the cautious phraseology: “… acupuncture may be associated with long-term reduction …”
The authors were, of course, well advised to be so atypically cautious:
- Comparisons to the waiting list group are meaningless for informing us about the specific effects of acupuncture, as they fail to control for placebo-effects.
- Comparisons between real and sham acupuncture must be taken with a sizable pinch of salt, as the study was not therapist-blind and the acupuncturists may easily have influenced their patients in various ways to report the desired result (the success of patient-blinding was not reported but would have gone some way to solving this problem).
- The effect size of the benefit is tiny and of doubtful clinical relevance.
My biggest concern, however, is the fact that the study originates from China, a country where virtually 100% of all acupuncture studies produce positive (or should that be ‘false-positive’?) findings and data fabrication has been reported to be rife. These facts do not inspire trustworthiness, in my view.
So, does acupuncture work for migraine? The current Cochrane review included 22 studies and its authors concluded that the available evidence suggests that adding acupuncture to symptomatic treatment of attacks reduces the frequency of headaches. Contrary to the previous findings, the updated evidence also suggests that there is an effect over sham, but this effect is small. The available trials also suggest that acupuncture may be at least similarly effective as treatment with prophylactic drugs. Acupuncture can be considered a treatment option for patients willing to undergo this treatment. As for other migraine treatments, long-term studies, more than one year in duration, are lacking.
So, maybe acupuncture is effective. Personally, I am not convinced and certainly do not think that the new JAMA study significantly strengthened the evidence.
A new study tested the efficacy of chiropractic spinal manipulative therapy (CSMT) for migraine. It was designed as a three-armed, single-blinded, placebo -controlled RCT of 17 months duration including 104 migraineurs with at least one migraine attack per month. Active treatment consisted of CSMT (group 1) and the placebo was a sham push manoeuvre of the lateral edge of the scapula and/or the gluteal region (group 2). The control group continued their usual pharmacological management (group 3).
The RCT began with a one-month run-in followed by three months intervention. The outcome measures were quantified at the end of the intervention and at 3, 6 and 12 months of follow-up. The primary end-point was the number of migraine days per month. Secondary end-points were migraine duration, migraine intensity and headache index, and medicine consumption.
The results show that migraine days were significantly reduced within all three groups from baseline to post-treatment (P < 0.001). The effect continued in the CSMT and placebo groups at all follow-up time points (groups 1 and 2), whereas the control group (group 3) returned to baseline. The reduction in migraine days was not significantly different between the groups. Migraine duration and headache index were reduced significantly more in the CSMT than in group 3 towards the end of follow-up. Adverse events were few, mild and transient. Blinding was strongly sustained throughout the RCT.
The authors concluded that it is possible to conduct a manual-therapy RCT with concealed placebo. The effect of CSMT observed in our study is probably due to a placebo response.
Chiropractors often cite clinical trials which suggest that CSMT might be effective. The effects sizes are rarely impressive, and it is tempting to suspect that the outcomes are mostly due to bias. Chiropractors, of course, deny such an explanation. Yet, to me, it seems fairly obvious: trials of CSMT are not blind, and therefore the expectation of the patient is likely to have major influence on the outcome.
Because of this phenomenon (and several others, of course), sceptics are usually unconvinced of the value of chiropractic. Chiropractors often respond by claiming that blind studies of physical intervention such as CSMT are not possible. This, however, is clearly not true; there have been several trials that employed sham treatments which adequately mimic CSMT. As these frequently fail to show what chiropractors had hoped, the methodology is intensely disliked by chiropractors.
The above study is yet another trial that adequately controls for patients’ expectation, and it shows that the apparent efficacy of CSMT disappears when this source of bias is properly accounted for. To me, such findings make a lot of sense, and I suspect that most, if not all the ‘positive’ studies of CSMT would turn out to be false positive, once such residual bias is eliminated.
Case reports of adverse effects after chiropractic spinal manipulation usually come as publications in peer-reviewed medical journals. As such they tend to documents that are factual, detached and clinical. This is an intended effect and is meant to increase objectivity; at the same time it omits all of the directness and emotions that are associated with such incidences which can, of course, be important. Here is a case report that is dramatically different. It is a story told by a sibling of the victim (both had been having manipulations for migraines regularly) on this website. As I think it is poignant, I have not changed anything except for shortening it slightly.
My youngest brother has been receiving chiro for… long, however last week he received very, very aggressive neck adjustments 3 times in a row. The last one left him feeling off and he felt like it worsened his migraine. He called me asking if I had ever had an adjustment worsen a headache and I said yes, once or twice. He then told me it was creating a different vision issue than his regular migraine aura. I told him get to emergency ASAP. He had a full stroke 15 minutes later. At the age of 29 years. Thank God he went to ER, he told me he almost went to try to sleep it off after he hung up the phone.
An MRI and CT scan showed that the stroke was NOT a clot that was already formed and agitated/released by the neck adjustment. But that the adjustment had actually caused a large tear in his vertebral artery and that it had in turn caused bleeding into his brain and consequently the stroke.
The doctor told him that had he not come in right when he did, he would most certainly have died or in the best case scenario, been a vegetable.
I realize that perhaps the chiropractor did not realize how aggressive he was being or even consider the trauma he could cause. Or maybe, he made a poor judgement call, he is only human. I have since consulted my own chiropractor, who sadly, is of the opinion that it’s just not possible for a chiropractor to cause such trauma and that it simply was an issue waiting to happen and that the adjustment just ‘helped’ it along. He stated over and over that chiro CANNOT cause a stroke. I am scared enough to not go back. I find physio to help my neck more anyway.
The other part is, the ER doctor told my brother that he has seen what he considers to be an alarming increase in chiropractic related strokes and vertebral artery tears. I realize that nowhere NEAR even 90% of all patients adjusted have this issue, but it definetely exists and it IS scary.
I expect that several apologists will now accuse me again of being alarmist, but I do wonder how often such cases happen and remain unreported. I am certainly not aware that this case has been published in a peer-reviewed journal.
Osteopathy is a difficult subject. In the US, osteopaths are (almost) identical with doctors who have studied conventional medicine and hardly practice any manipulative techniques at all. Elsewhere, osteopaths are alternative healthcare providers specialising in what they like to call ‘osteopathic manipulative therapy’ (OMT). As though this is not confusing enough, osteopaths are doing similar things as chiropractors but are adamant that they are a distinct profession. Despite these assertions, I have seen little to clearly differentiate the two – with one exception perhaps: osteopaths tend to use techniques that are less frequently associated with severe harm.
Despite this confusion, or maybe because of it, we need to ask: DOES OMT WORK?
A recent study was aimed at assessing the effectiveness of OMT on chronic migraineurs using HIT-6 questionnaire, drug consumption, days of migraine, pain intensity and functional disability. All patients admitted to the Department of Neurology of Ancona’s United Hospitals, Italy, with a diagnosis of migraine and without chronic illness, were considered eligible for this 3-armed RCT.
Patients were randomly divided into three (1) OMT+medication therapy, (2) sham+medication therapy and (3) medication therapy only and received 8 treatments during 6 months. Changes in the HIT-6 score were considered as the main outcome measure.
A total of 105 subjects were included. At the end of the study, OMT significantly reduced HIT-6 score, drug consumption, days of migraine, pain intensity and functional disability.
The investigators concluded that these findings suggest that OMT may be considered a valid procedure for the management of migraineurs.
Similar results have been reported elsewhere:
One trial, for instance, concluded: “This study affirms the effects of OMT on migraine headache in regard to decreased pain intensity and the reduction of number of days with migraine as well as working disability, and partly on improvement of HRQoL. Future studies with a larger sample size should reproduce the results with a control group receiving placebo treatment in a long-term follow-up.”
Convinced? No, I am not.
Why? Because the studies that do exist seem a little too good to be true; because they are few and far between, because the few studies tend to be flimsy and have been published in dodgy journals, because they lack independent replications, and because critical reviews seem to conclude that OMT is nowhere near as promising as some osteopaths would like us to believe: “Further studies of improved quality are necessary to more firmly establish the place of physical modalities in the treatment of primary headache disorders. With the exception of high velocity chiropractic manipulation of the neck, the treatments are unlikely to be physically dangerous, although the financial costs and lost treatment opportunity by prescribing potentially ineffective treatment may not be insignificant. In the absence of clear evidence regarding their role in treatment, physicians and patients are advised to make cautious and individualized judgments about the utility of physical treatments for headache management; in most cases, the use of these modalities should complement rather than supplant better-validated forms of therapy.”
Lots of alternative therapies are advocated for migraine. Few of them are supported by good evidence. An exception could be the herbal remedy FEVERFEW.
This review is an update of a previously published review in the Cochrane Database of Systematic Reviews on ‘Feverfew for preventing migraine’. Feverfew (Tanacetum parthenium L.) extract is a herbal remedy, which has been used for preventing attacks of migraine. Our aim was to systematically review the evidence from double-blind, randomised, clinical trials (RCTs) assessing the clinical efficacy and safety of feverfew monopreparations versus placebo for preventing migraine.
For this updated version of the review we searched CENTRAL, MEDLINE, EMBASE and AMED to January 2015. We contacted manufacturers of feverfew and checked the bibliographies of identified articles for further trials.
We included randomised, placebo-controlled, double-blind trials assessing the efficacy of feverfew monopreparations for preventing migraine in migraine sufferers of any age. We included trials using clinical outcome measures, while we excluded trials focusing exclusively on physiological parameters. There were no restrictions regarding the language of publication.
We systematically extracted data on patients, interventions, methods, outcome measures, results and adverse events. We assessed risk of bias using the Cochrane ‘Risk of bias’ tool and evaluated methodological quality using the Oxford Quality Scale developed by Jadad and colleagues. Two review authors independently selected studies, assessed methodological quality and extracted data. We resolved disagreements concerning evaluation of individual trials through discussion.
We identified one new study for this update, resulting in a total of 6 trials (561 patients) meeting the inclusion criteria. Five of the 6 trials reported on the main outcome measure which was migraine frequency. Although 5 of the trials were generally of good methodological quality, all studies were either of unclear or high risk of bias with regards to sample size. Pooled analysis of the results was not possible due to the lack of common outcome measures and heterogeneity between studies in terms of participants, interventions and designs. The most recent trial added to this update was rigorous and larger (n = 218) than previous studies. It used a stable feverfew extract at a dose determined by a previous dose-finding trial. It reported that feverfew reduced migraine frequency by 1.9 attacks from 4.8 to 2.9 and placebo by 1.3 from to 4.8 to 3.5 per month. This difference in effect between feverfew and placebo was thus 0.6 attacks per month. For the secondary outcome measures such as intensity and duration of migraine attacks, incidence and severity of nausea and vomiting, and global assessment no statistically significant differences between feverfew and placebo were reported.
The results of previous trials were not convincing: three trials reporting positive effects of feverfew were all of small sample size (17 to 60 participants), while two rigorous trials (n = 50, 147) did not find significant differences between feverfew and placebo.
Only mild and transient adverse events of feverfew, most commonly gastrointestinal complaints and mouth ulcers, were reported in the included trials.
We concluded that, since the last version of this review, one larger rigorous study has been included, reporting a difference in effect between feverfew and placebo of 0.6 attacks per month. This adds some positive evidence to the mixed and inconclusive findings of the previous review. However, this constitutes low quality evidence, which needs to be confirmed in larger rigorous trials with stable feverfew extracts and clearly defined migraine populations before firm conclusions can be drawn. It appears from the data reviewed that feverfew is not associated with any major safety concerns.
So, good or bad news for migraine sufferers? I suppose it depends on whether you are an optimist or a pessimist. I would say that, considering the mostly bad news about alternative medicine for migraine, it is relative good news: patients who want to try something ‘natural’ could do so, particularly in view of the lack of serious risks.
“If ever there was a permanent cure for migraine, homeopathic medicines are the only one that can do this miracle. It may sound like an overstatement and quite quackerish, but it’s true. Long term treatment with homeopathy has an excellent cure for migraine headaches.” Statements like this can be found by the thousands on the internet, not just in relation to migraine but also about osteoarthritis. Both migraine and osteoarthritis are important domains for homeopathy, and most homeopaths would not doubt for a second that they can treat these conditions effectively. This is why it is so important to highlight the few sources which are not misleading consumers into making the wrong therapeutic decisions.
‘Healthcare Improvement Scotland’ (HCIS) have just published advice for patients suffering from migraine and osteoarthritis (the full document with all the evidence can be found here). I think it is worth having a close look and I therefore cite it in full:
Homeopathic remedies are prepared by repeated dilution and vigorous shaking of substances in water. Remedies are prepared from substances that in healthy people cause the signs and symptoms of the condition being treated. The more dilute the remedy is the more potent it becomes so that the most potent remedies are unlikely to contain any of the original substance.
People in Scotland have access to homeopathy through some GPs or a referral to homeopaths in the private sector, regional NHS clinics or the Centre for Integrative Care (CIC) (formerly Glasgow Homeopathic Hospital). Not all NHSScotland health boards provide funding for homeopathy; investment varies widely among those that do, and individual boards have begun to review funding for homeopathy services.
- Evidence of clinical effectiveness was reviewed from systematic reviews of four placebo controlled randomised trials of homeopathy for migraine published between 1991 and 1997; and systematic reviews of four active treatment controlled randomised trials of homeopathy for osteoarthritis published between 1983 and 2000. The quality of the evidence was low to moderate.
- Homeopathy for migraine has not been compared with active treatment in randomised controlled trials (RCTs). Of four RCTs comparing homeopathy with placebo, only one found homeopathy to be superior.
- Three RCTs in osteoarthritis comparing homeopathy with medicines for pain relief found either no difference between the interventions, or that analgesic treatment had a better effect than homeopathy. A further RCT comparing intra-articular injection of a homeopathic remedy with hyaluronic acid injections showed similar pain reduction in both groups.
- Published systematic reviews of homeopathy for migraine and osteoarthritis contain insufficient information to inform conclusions about safety.
- No evidence on the cost effectiveness of homeopathy for migraine was identified; and the evidence from a single cost-minimisation analysis of one homeopathic preparation for osteoarthritis is not generalisable to the UK.
- Homeopathy for migraine has not been compared with standard care in RCTs and no evidence of cost effectiveness has been identified..
- There is insufficient evidence to determine whether or not homeopathic treatment for osteoarthritis is clinically effective compared with standard care, and no relevant evidence of cost effectiveness has been identified.
- The evidence does not support treating migraine or osteoarthritis with homeopathy.
Before the fans of homeopathy start shouting “THIS IS ALL RUBBISH AND DISREGARDS IMPORTANT EVIDENCE!!!”, I should mention that the top experts in homeopathy were asked to contribute their evidence and were unable to find any convincing data that would have changed this negative verdict. And it is important to point out that HCIS is a respected, independent organisation that issues statements based on thorough, unbiased reviews of the evidence.
As I reported a while ago, the Australian ‘NATIONAL HEALTH AND MEDICAL RESEARCH COUNCIL’ has assessed the effectiveness of homeopathy. The evaluation looks like the most comprehensive and most independent in the history of homeopathy. Its draft report concluded that “the evidence from research in humans does not show that homeopathy is effective for treating the range of health conditions considered.”
So, the HCIS is in excellent company and I have no doubt whatsoever that this new statement is correct – but I also have little doubt that homeopaths will dispute it.