My aim with this blog is to eventually cover most of the 400 or so different alternative therapies and diagnostic techniques. So far, I have focused on some of the most popular modalities; and this means, I have neglected many others. Today, it is time, I think, to discuss aromatherapy, after all, it is one of the most popular forms of alternative medicine in the UK.
Aromatherapists use essential oils, and this is where the confusion starts. They are called “essential” not because humans cannot do without them, like essential nutrients, for instance; they are called “essential” because they are made of flower ESSENCES. The man who ‘discovered’ aromatherapy was a chemist who accidentally had burnt his hand and put some lavender essence on the burn. It healed very quickly, and he thus concluded that essential oils can be useful therapeutics.
Today’s aromatherapists would rarely use the pure essential oil; they dilute it in an inert carrier oil and usually apply it via a very gentle massage to the skin. They believe that specific oils have specific effects for specific conditions. As these oils contain pharmacologically active ingredients, some of these assumptions might even be correct. The question, however, is one of concentration. Do these ingredients reach the target organ in sufficient quantities? Are they absorbed through the skin at all? Does smelling them have a sufficiently large effect to produce the claimed benefit?
The ‘acid test’ for any therapeutic claim is, as always, the clinical trial. As it happens a new paper has just become available. The aim of this randomised study was to determine the effects of inhalation aromatherapy on pregnant women. Essential oils with high linalool and linalyl acetate content were selected and among these the one preferred by the participant was used. Thirteen pregnant women in week 28 of a single pregnancy were randomly assigned into an aromatherapy and a control group. The main outcome measures were several validated scores to assess mood and the heart-rate variability. The results showed significant differences in the Tension-Anxiety score and the Anger-Hostility score after aromatherapy. Heart rate variability changes indicated that the parasympathetic nerve activity increased significantly in the verum group. The authors concluded that aromatherapy inhalation was effective and suggest that more research is warranted.
I have several reasons for mentioning this study here.
1st research into aromatherapy is rare and therefore any new trial of this popular treatment might be important.
2nd aromatherapy is mostly (but not in this study) used in conjunction with a gentle, soothing massage; any outcome of such an intervention is difficult to interpret: we cannot then know whether it was the massage or the oil that produced the observed effect. The present trial is different and might allow conclusions specifically about the effects of the essential oils.
3rd the study displays several classic methodological mistakes which are common in trials of alternative medicine. By exposing them, I hope that they might become less frequent in future.
The most obvious flaw is its tiny sample size. What is an adequate size, people often ask. This question is unfortunately unanswerable. To determine the adequate sample size, it is best to conduct a pilot study or use published data to calculate the required number of patients needed for the specific trial you are planning. Any statistician will be able to help you with this.
The second equally obvious flaw relates to the fact that the results and the conclusions of this study were based on comparing the outcome measures before with those after the interventions within one intervention group. The main reason for taking the trouble of running a control group in a clinical trial is that the findings from the experimental group are compared to those of the control group. Only such inter-group comparisons can tell us whether the results were actually caused by the intervention and not by other factors such as the passage of time, a placebo-effect etc.
In the present study, the authors seem to be aware of their mistake and mention that there were no significant differences in outcomes when the two groups were compared. Yet they fail to draw the right conclusion from this fact. It means that their study demonstrated that aromatherapy inhalation had no effect on the outcomes studied.
So, what does the reliable trial evidence on aromatherapy tell us?
A clinical trial in which I was involved failed to show that it improves the mood or quality of life of cancer patients. But one swallow does not make a summer; what do systematic reviews of all available trials indicate?
The first systematic review was probably the one we published in 2000. We then located 12 randomised clinical trials: six of them had no independent replication; six related to the relaxing effects of aromatherapy combined with massage. These 6 studies collectively suggested that aromatherapy massage has a mild but short-lasting anxiolytic effect. These effects of aromatherapy are probably not strong enough for it to be considered for the treatment of anxiety. We concluded that the hypothesis that it is effective for any other indication is not supported by the findings of rigorous clinical trials.
Since then several other systematic reviews have emerged. We therefore decided to summarise their findings in an overview of all available reviews. We searched 12 electronic databases and our departmental files without restrictions of time or language. The methodological quality of all systematic reviews was evaluated independently by two authors. Of 201 potentially relevant publications, 10 met our inclusion criteria. Most of the systematic reviews were of poor methodological quality. The clinical subject areas were hypertension, depression, anxiety, pain relief, and dementia. For none of the conditions was the evidence convincing. Our conclusions therefore had to be cautious: due to a number of caveats, the evidence is not sufficiently convincing that aromatherapy is an effective therapy for any condition.
Finally, we also investigated the safety of aromatherapy by assessing all published data regarding adverse effects. Forty two primary reports met our inclusion criteria. In total, 71 patients had experienced adverse effects after aromatherapy which ranged from mild to severe and included one fatality. The most common adverse effect was dermatitis. Lavender, peppermint, tea tree oil and ylang-ylang were the most common essential oils responsible for adverse effects. We concluded that aromatherapy has the potential to cause adverse effects some of which are serious. Their frequency remains unknown.
And what is the conclusion of all this? To me, it seems fairly straight forward: Aromatherapy is not demonstrably effective for any condition. It also is not entirely free of risks. Its risk/benefit profile is thus not positive which can only mean that it is not a useful or recommendable treatment for anybody who is ill.
Reflexology is one of the most popular of all alternative therapies. Anyone who has ever had a session knows why: it is a strangely pleasant and oddly agreeable experience. Reflexologists massage your feet which can be mildly painful but usually is quite relaxing. They look for and subsequently focus on areas of tenderness believing they correspond to specific organs or whole organ systems. Even though few reflexologists would admit to it, they tend to make vague and unreliable diagnoses: if they feel something unusual at a certain point of the sole of your foot, they assume that a certain inner organ is in trouble. Reflexologists even have maps where the sole of a foot is depicted showing which area corresponds to which organ.
The treatment might be enjoyable but the assumptions that underpin it are nonsensical for at least two reasons: firstly, there are no nerve or other connections between a specific area on the sole of a foot and a certain organ. Secondly, the maps which reflexologists employ differ and fail to agree which area corresponds to which organ. Thus there are inconsistencies within the realm of reflexology and there are inconsistencies in relation to the known facts regarding physiology, anatomy etc.
Proponents of reflexology are quite undisturbed by these problems and seem to believe that not their assumptions but science must be wrong. After all, reflexology does work! That is to say that patients perceive benefit from it, pay out of their own pocket for the experience and tend to come back for more.
Several years ago, we asked 8 UK professional organisations of reflexology which conditions they thought could be treated effectively with reflexology. We gave them a list of 25 conditions to chose from, many of which were serious, e.g. cancer and AIDS. Collectively, the organisations felt that 22 of these illnesses would respond to reflexology.
But this is opinion, not evidence! What do the trial data tell us? Is reflexology more than a placebo?
As with many other areas of alternative medicine, controlled clinical trials are scarce; but this is not to say that none at all are available. Our own trial of reflexology for menopausal symptoms failed to show that this therapy has any effects beyond placebo. More recently, we published a systematic review to evaluate all of the 23 studies that had been published at that stage. They related to a wide range of medical conditions and their methodological quality was often poor. Nine high quality randomised clinical trials (RCTs) generated negative findings. Eight RCTs suggested that reflexology is effective for the following conditions: diabetes, premenstrual syndrome, cancer patients, multiple sclerosis, symptomatic idiopathic detrusor over-activity and dementia. These studies, however, were wide open to bias. Therefore, our conclusions had to be cautious: the best clinical evidence does not demonstrate convincingly reflexology to be an effective treatment for any medical condition.
For you and me, this simply means that there is currently no good evidence to suggest that reflexology works. But the story does not end here. There will be more studies and enthusiasts are most likely to concede that our conclusions were incorrect. In fact, a further trial has just become available.
This new single-blind, randomized and placebo controlled study included 20 moderately to severely affected multiple sclerosis patients. Each participant received for 8 weeks, 1 hour per week of either reflexology or sham reflexology. The primary outcome measure was the Multiple Sclerosis Impact Scale at baseline, 8 weeks and 16 weeks. The results revealed improvements in both groups but no statistically significant differences between the two groups at either 8 or 16 weeks. The conclusions of the investigators were clear: The results do not support the use of reflexology for symptom relief in a more disabled multiple sclerosis population and are strongly suggestive of a placebo response.
There is, of course, nothing wrong with a relaxing foot-massage; it is agreeable, no doubt, and if someone wants to pay for the luxury, why not? By contrast, there is a lot wrong with reflexology, I think. A foot-massage is not administered under the pretence of generating any specific therapeutic effects. Reflexologists, however, claim they can exert highly specific effects on inner organs, influence the natural history of a wide range of diseases, and provide reliable diagnoses. They thus mislead their clients. This is not just wrong, it also has the potential to do serious harm. I believe it is time to end this nonsense.
The developed world is in the middle of a major obesity epidemic. It is predicted to cause millions of premature deaths and billions of dollars, money that would be badly needed elsewhere. The well-known method of eating less and moving more is most efficacious but sadly not very effective, that is to say people do not easily adopt and adhere to it. This is why many experts are searching for a treatment that works and is acceptable to all or at least most patients.
Entrepreneurs of alternative medicine have long jumped on this band waggon. They have learnt that the regulations are lax or non-existent, that consumers are keen to believe anything they tell them and that the opportunities to make a fast buck are thus enormous. Today, they are offering an endless array of treatments which are cleverly marketed, for instance via the Internet.
Since many years, my research team are involved in a programme of assessing the alternative slimming aids mostly through systematic reviews and occasionally also through conducting our own clinical trials. Our published analyses include the following treatments:
Supplements containing conjugated linoleic acid
There are, of course, many more but, for most, no evidence exist at all. The treatments listed above have all been submitted to clinical trials. The results show invariably that the outcomes were not convincingly positive: either there were too few data, or there were too many flaws in the studies, or the weight reduction achieved was too small to be clinically relevant.
Our latest systematic review is a good example; its aim was to evaluate the evidence from randomized controlled trials (RCTs) involving the use of the African Bush Mango, Irvingia gabonensis, for body weight reduction in obese and overweight individuals. Three RCTs were identified, and all had major methodological flaws. All RCTs reported statistically significant reductions in body weight and waist circumference favoring I. gabonensis over placebo. They also suggested positive effects of I. gabonensis on blood lipids. Adverse events included headache and insomnia. Despite these apparently positive findings, our conclusions had to be cautious: “Due to the paucity and poor reporting quality of the RCTs, the effect of I. gabonensis on body weight and related parameters are unproven. Therefore, I. gabonensis cannot be recommended as a weight loss aid. Future research in this area should be more rigorous and better reported.”
People who want to loose weight are often extremely desperate and ready to try anything. They are thus easy victims of the irresponsible promises that are being made on the Internet and elsewhere. Despite the overwhelmingly evidence to the contrary, consumers are led to believe that alternative slimming aids are effective. What is more, they are also misled to assume they are risks-free. This latter assumption is false too: apart from the harm done to the patient’s bank account, many alternative slimming aids are associated with side-effects which, in some cases, are serious and can even include death.
The conclusion from all this is short and simple: alternative slimming aids are bogus.
Clinical trials of acupuncture can be quite challenging. In particular, it is often difficult to make sure that any observed outcome is truly due to the treatment and not caused by some other factor(s). How tricky this can be, shows a recently published study.
A new RCT has all (well, almost all) the features of a rigorous study. It tested the effects of acupuncture in patients suffering from hay fever. The German investigators recruited 46 specialized physicians in 6 hospital clinics and 32 private outpatient clinics. In total, 422 patients with IgE sensitization to birch and grass pollen were randomized into three groups: 1) acupuncture plus rescue medication (RM) (n= 212), 2) sham acupuncture plus RM (n= 102), or 3) RM alone (n= 108). Twelve acupuncture sessions were provided in groups 1 and 2 over 8 weeks. The outcome measures included changes in the Rhinitis Quality of Life Questionnaire (RQLQ) overall score and the RM score (RMs) from baseline to weeks 7, 8 and 16 in the first year as well as week 8 in the second year after randomization.
Compared with sham acupuncture and with RM, acupuncture was associated with improvement in RQLQ score and RMS. There were no differences after 16 weeks in the first year. After the 8-week follow-up phase in the second year, small improvements favoring real acupuncture over sham were noted.
Based on these results, the authors concluded that “acupuncture led to statistically significant improvements in disease-specific quality of life and antihistamine use measures after 8 weeks of treatment compared with sham acupuncture and with RM alone, but the improvements may not be clinically significant.”
The popular media were full of claims that this study proves the efficacy of acupuncture. However, I am not at all convinced that this conclusion is not hopelessly over-optimistic.
It might not have been the acupuncture itself that led to the observed improvements; they could well have been caused by several factors unrelated to the treatment itself. To understand my concern, we need to look closer at the actual interventions employed by the investigators.
The real acupuncture was done on acupuncture points thought to be indicated for hay fever. The needling was performed as one would normally do it, and the acupuncturists were asked to treat the patients in group 1 in such a way that they were likely to experience the famous ‘de-qi’ feeling.
The sham acupuncture, by contrast, was performed on non-acupuncture points; acupuncturists were asked to use shallow needling only and they were instructed to try not to produce ‘de-qi’.
This means that the following factors in combination or alone could have caused [and in my view probably did cause] the observed differences in outcomes between the acupuncture and the sham group:
1) verbal or non-verbal communication between the acupuncturists and the patient [previous trials have shown this factor to be of crucial importance]
2) the visibly less deep needling in the sham-group
3) the lack of ‘de-qi’ experience in the sham-group.
Sham-treatments in clinical trials serve the purpose of a placebo. They are thus meant to be indistinguishable from the verum. If that is not the case [as in the present study], the trial cannot be accepted as being patient-blind. If a trial is not patient-blind, the expectations of patients will most certainly influence the results.
Therefore I believe that the marginal differences noted in this study were not due to the effects of acupuncture per se, but were an artifact caused through de-blinding of the patients. De facto, neither the patients nor the acupuncturists were blinded in this study.
If that is true, the effects were not just not clinically relevant, as noted by the authors, they also had nothing to do with acupuncture. In other words, acupuncture is not of proven efficacy for this condition – a verdict which is also supported by our systematic review of the subject which concluded that “the evidence for the effectiveness of acupuncture for the symptomatic treatment or prevention of allergic rhinitis is mixed. The results for seasonal allergic rhinitis failed to show specific effects of acupuncture…”
Once again, we have before us a study which looks impressive at first glance. At closer scrutiny, we find, however, that it had important design flaws which led to false positive results and conclusions. In my view, it would have been the responsibility of the authors to discuss these limitations in full detail and to draw conclusions that take them into account. Moreover, it would have been the duty of the peer-reviewers and journal editors to pick up on these points. Instead the editors even commissioned an accompanying editorial which displays an exemplary lack of critical thinking.
Having failed to do any of this, they are in my opinion all guilty of misleading the world media who reported extensively and often uncritically on this new study thus misleading us all. Sadly, the losers in this bonanza of incompetence are the many hay fever sufferers who will now be trying (and paying for) useless treatments.
This week is acupuncture awareness week, and I will use this occasion to continue focusing on this therapy. This first time ever event is supported by the British Acupuncture Council who state that it aims to “help better inform people about the ancient practice of traditional acupuncture. With 2.3 million acupuncture treatments carried out each year, acupuncture is one of the most popular complementary therapies practised in the UK today.“
Right, let’s inform people about acupuncture then! Let’s show them that there is often more to acupuncture research than meets the eye.
My team and I have done lots of research into acupuncture and probably published more papers on this than any other subject. We had prominent acupuncturists on board from the UK, Korea, China and Japan, we ran conferences, published books and are proud to have been innovative and productive in our multidisciplinary research. But here I do not intend to dwell on our own achievements, rather I will highlight several important new papers in this area.
Korean authors just published a meta-analysis to assess the effectiveness of acupuncture as therapy for gouty arthritis. Ten RCTs involving 852 gouty arthritis patients were included. Six studies of 512 patients reported a significant decrease in uric acid in the treatment group compared with a control group, while two studies of 120 patients reported no such effect. The remaining four studies of 380 patients reported a significant decrease in pain in the treatment group.
The authors conclude “that acupuncture is efficacious as complementary therapy for gouty arthritis patients”.
We should be delighted with such a positive and neat result! Why then do I hesitate and have doubts?
I believe that this paper reveals several important issues in relation to systematic reviews of Chinese acupuncture trials and studies of other TCM interventions. In fact, this is my main reason for discussing the new meta-analysis here. The following three points are crucial, in my view:
1) All the primary studies were from China, and 8 of the 10 were only available in Chinese.
2) All of them had major methodological flaws.
3) It has been shown repeatedly that all acupuncture-trials from China are positive.
Given this situation, the conclusions of any review for which there are only Chinese acupuncture studies might as well be written before the actual research has started. If the authors are pro-acupuncture, as the ones of the present article clearly are, they will conclude that “acupuncture is efficacious“. If the research team has some critical thinkers on board, the same evidence will lead to an entirely different conclusion, such as “due to the lack of rigorous trials, the evidence is less than compelling.“
Systematic reviews are supposed to be the best type of evidence we currently have; they are supposed to guide therapeutic decisions. I find it unacceptable that one and the same set of data could be systematically analysed to generate such dramatically different outcomes. This is confusing and counter-productive!
So what is there to do? How can we prevent being misled by such articles? I think that medical journals should refuse to publish systematic reviews which so clearly lack sufficient critical input. I also believe that reviewers of predominantly Chinese studies should provide English translations of these texts so that they can be independently assessed by those who are not able to read Chinese – and for the sake of transparency, journal editors should insist on this point.
And what about the value of acupuncture for gouty arthritis? I think I let the readers draw their own conclusion.
Everyone knows, I think, that smoking is bad for our health. Why then do so many of us still smoke? Because smoking is addictive – and addictions are, by definition, far from easy to get rid of. Many smokers try acupuncture, and acupuncturists are making a ‘pretty penny’ on the assumption that their treatment is an effective way to stop the habit. But what does the best evidence tell us?
A new randomized, double-blind, placebo-controlled clinical trial with 125 smokers was conducted to determine whether ear acupuncture with electrical stimulation (auriculotherapy) once a week for 5 consecutive weeks is more effective than sham treatment.
The results showed that there was no difference in the rate of smoking cessation between the two groups. After 6 weeks, the auriculotherapy group achieved a rate of 20.9% abstinence which was not significantly different from the 17.9% in the sham group.
The authors of this study concluded that “the results … do not support the use of auriculotherapy to assist with smoking cessation. It is possible that a longer treatment duration, more frequent sessions, or other modifications of the intervention protocol used in this study may result in a different outcome. However, based on the results of this study, there is no evidence that auriculotherapy is superior to placebo when offered once a week for 5 weeks, as described in previous uncontrolled studies.”
Of course, they are correct to state that, theoretically, a different treatment regimen might have generated different outcomes. But how likely is that in reality?
To answer this question, we might consult the Cochrane review on the subject (which incidentally is close to my heart: I initiated it many years ago and was its senior author until it was plagiarised by my former co-worker and my name was replaced by that of his new boss [never a dull day in alternative medicine research!]).
The latest version of this article concludes that “there is no consistent, bias-free evidence that acupuncture, acupressure, laser therapy or electrostimulation are effective for smoking cessation, but lack of evidence and methodological problems mean that no firm conclusions can be drawn. Further, well designed research into acupuncture, acupressure and laser stimulation is justified since these are popular interventions and safe when correctly applied, though these interventions alone are likely to be less effective than evidence-based interventions”
This is a very, very (yes, I meant very, very) odd conclusion, I think. If I had still been an author of this plagiarised paper, I would have suggested something a little more straightforward: 33 studies of various types of acupuncture for smoking cessation are currently available (if we include the new trial, the number is 34). The totality of this evidence fails to show that acupuncture is effective. Therefore acupuncture should NOT be considered a valid option for this indication.
Since weeks I have been searching for new (2013) studies which actually report POSITIVE results. I like good news as much as the next man but, in my line of business, it seems awfully hard to come by. Therefore I am all the more delighted to present these two new articles to my readers.
The first study is a randomized trial with patients suffering from metastatic cancer who received one of three interventions: massage therapy, no-touch intervention or usual care. Primary outcomes were pain, anxiety, and alertness; secondary outcomes were quality of life and sleep. The mean number of massage therapy sessions per patient was 2.8.
The results show significant improvement in the quality of life of the patients who received massage therapy after 1-week follow-up which was not observed in either of the other groups. Unfortunately, the difference was not sustained at 1 month. There were also trends towards improvement in pain and sleep of the patients after massage. No serious adverse events were noted.
The authors conclude that “providing therapeutic massage improves the quality of life at the end of life for patients and may be associated with further beneficial effects, such as improvement in pain and sleep quality. Larger randomized controlled trials are needed to substantiate these findings“.
The second study examined the effectiveness of a back massage for improving sleep quality in 60 postpartum women suffering from poor sleep. They were randomized to either the intervention or the control group. Participants in both groups received the same care except for the back massages. The intervention group received one 20-minutes back massage at the same time each evening for 5 consecutive days by a certified massage therapist. The outcome measure was the Pittsburgh Sleep Quality Index (PSQI). The results showed that the changes in mean PSQI were significantly lower in the intervention group than in controls indicating a positive effect of massage on sleep quality.
The authors’ conclusions were clear: “an intervention involving back massage in the postnatal period significantly improved the quality of sleep.”
Where I was trained (Germany), massage is not deemed to be an alternative but an entirely mainstream treatment. Despite this fact, there is precious little evidence to demonstrate that it is effective. Our own research has found encouraging evidence for a range of conditions, including autism, cancer palliation, constipation, DOMS and back pain. In addition, we have shown that massage is not entirely free of risks but that its potential for harm is very low (some might say that this was never in question but it is good to have a bit more solid evidence).
The new studies are, of course, not without flaws; this can hardly be expected in an area where logistical, financial and methodological problems abound. The fact that there are many different approaches to massage does not make things easier either. The new evidence is nevertheless encouraging and seems to suggest that massage has relaxing effects which are clinically relevant. In my view, massage is a therapy worth considering for more rigorous research.
Acupuncture remains a highly controversial treatment: its mechanism of action is less than clear and the clinical results are equally unconvincing. Of course, one ought to differentiate between different conditions; the notion that acupuncture is a panacea is most certainly nonsense.
In many countries, acupuncture is being employed mostly in the management of pain, and it is in this area where the evidence is perhaps most encouraging. Yet, even here the evidence from the most rigorous clinical trials seems to suggest that much, if not all of the effects of acupuncture might be due to placebo.
Moreover, we ought to be careful with generalisations and ask what type of pain? One very specific pain is that caused by aromatase inhibitors (AI), a medication frequently prescribed to women suffering from breast cancer. Around 50 % of these patients complain of AI-associated musculoskeletal symptoms (AIMSS) and 15 % discontinue treatment because of these complaints. So, can acupuncture help these women?
A recent randomised, sham-controlled trial tested whether acupuncture improves AIMSS. Postmenopausal women with early stage breast cancer, experiencing AIMSS were randomized to eight weekly real or sham acupuncture sessions. The investigators evaluated changes in the Health Assessment Questionnaire Disability Index (HAQ-DI) and pain visual analog scale (VAS). Serum estradiol, β-endorphin, and proinflammatory cytokine concentrations were also measured pre and post-intervention. In total, 51 women were enrolled of whom 47 were evaluable (23 randomized to real and 24 to sham acupuncture).
Baseline characteristics turned out to be balanced between groups with the exception of a higher HAQ-DI score in the real acupuncture group. The results failed to show a statistically significant difference in reduction of HAQ-DI or VAS between the two groups. Following eight weekly treatments, a significant reduction of IL-17 was noted in both groups. No significant modulation was seen in estradiol, β-endorphin, or other proinflammatory cytokine concentrations in either group. No difference in AIMSS changes between real and sham acupuncture was seen.
Even though this study was not large, it was rigorously executed and well-reported. As many acupuncturists claim that their treatment alleviates pain and as many women suffering from AM-induced pain experience benefit, acupuncture advocates will nevertheless claim that the findings of this study are wrong, misleading or irrelevant. The often remarkable discrepancy between experience and evidence will again be the subject of intense discussions. How can a tiny trial overturn the experience of so many?
The answer is: VERY EASILY! In fact, the simplest explanation is that both are correct. The trial was well-done and its findings are thus likely to be true. The experience of patients is equally true – yet it relies not on the effects of acupuncture per se, but on the context in which it is given. In simple language, the effects patients experience after acupuncture are due to a placebo-response.
This is the only simple explanation which tallies with both the evidence and the experience. Once we think about it carefully, we realise that acupuncture is highly placebo-genic:
It is exotic.
It is invasive.
It is slightly painful.
It involves time with a therapist.
It involves touch.
If anyone had the task to develop a treatment that maximises placebo-effects, he could not come up with a better intervention!
Ahhh, will acupuncture-fans say, this means that acupuncture is a helpful therapy. I don’t care how it works, as long as it does help. Did we not just cover this issues in some detail? Indeed we did – and I do not feel like re-visiting the three fallacies which underpin this sentence again.
During the last decade, Professor Claudia Witt and co-workers from the Charite in Berlin have published more studies of homeopathy than any other research group. Much of their conclusions are over-optimistic and worringly uncritical, in my view. Their latest article is on homeopathy as a treatment of eczema. As it happens, I have recently published a systematic review of this subject; it concluded that “the evidence from controlled clinical trials… fails to show that homeopathy is an efficacious treatment for eczema“. The question therefore arises whether the latest publication of the Berlin team changes my conclusion in any way.
Their new article describes a prospective multi-centre study which included 135 children with mild to moderate atopic eczema. The parents of the kids enrolled in this trial were able to choose either homeopathic or conventional doctors for their children who treated them as they saw fit. The article gives only scant details about the actual treatments administered. The main outcome of the study was a validated symptom score at 36 months. Further endpoints included quality of life, conventional medicine consumption, safety and disease related costs at six, 12 and 36 months.
The results showed no significant differences between the groups at 36 months. However, the children treated conventionally seemed to improve quicker than those in the homeopathy group. The total costs were about twice higher in the homoeopathic compared to the conventional group. The authors conclude as follows: “Taking patient preferences into account, while being unable to rule out residual confounding, in this long-term observational study, the effects of homoeopathic treatment were not superior to conventional treatment for children with mild to moderate atopic eczema, but involved higher costs“.
At least one previous report of this study has been available for some time and had thus been included in my systematic review. It is therefore unlikely that this new analysis might change my conclusion, particularly as the trial by Witt et al has many flaws. Here are just some of the most obvious ones:
Patients were selected according to parents’ preferences.
This means expectations could have played an important role.
It also means that the groups were not comparable in various, potentially important prognostic variables.
Even though much of the article reads as though the homeopaths exclusively employed homeopathic remedies, the truth is that both groups received similar amounts of conventional care and treatments. In other words, the study followed a ‘A+B versus B’ design (here is the sentence that best gives the game away “At 36 months the frequency of daily basic skin care was… comparable in both groups, as was the number of different medications (including corticosteroids and antihistamines)…”). I have previously stated that this type of study-design can never produce a negative result because A+B is always more than B.
Yet, at first glance, this new study seems to prove my thesis wrong: even though the parents chose their preferred options, and even though all patients were treated conventionally, the addition of homeopathy to conventional care failed to produce a better clinical outcome. On the contrary, the homeopathically treated kids had to wait longer for their symptoms to ease. The only significant difference was that the addition of homeopathy to conventional eczema treatments was much more expensive than conventional therapy alone (this finding is less than remarkable: even the most useless additional intervention costs money).
So, is my theory about ‘A+B versusB’ study-designs wrong? I don’t think so. If B equals zero, one would expect exactly the finding Witt et al produced: A+0=A. In turn, this is not a compliment for the homeopaths of this study: they seem to have been incapable of even generating a placebo-response. And this might indicate that homeopathy was not even usefull as a means to generate a placebo-response. Whatever interpretation one adopts, this study tells us very little of value (as children often grow out of eczema, we cannot even be sure whether the results are not simply a reflection of the natural history of the disease); in my view, it merely demonstrates that weak study designs can only create weak findings which, in this particular case, are next to useless.
The study was sponsored by the Robert Bosch Stiftung, an organisation which claims to be dedicated to excellence in research and which has, in the past, spent millions on researching homeopathy. It seems doubtful that trials of this caliber can live up to any claim of excellence. In any case, the new analysis is certainly no reason to change the conclusion of my systematic review.
To their credit, Witt et al are well aware of the many weaknesses of their study. Perhaps in an attempt to make them appear less glaring, they stress that “the aim of this study was to reflect the real world situation“.Usually I do not accept the argument that pragmatic trials cannot be rigorous – but I think Witt et al do have a point here: the real word tells us that homeopathic remedies are pure placebos!