One of the most common claims of alternative practitioners is that they take a holistic approach to health care. And it is this claim which attracts many consumers. It also makes conventional medicine look bad, reductionist and inhuman, as it implies that mainstream medicine is non-holistic.
The claim can be easily disclosed to be a straw man, because all good medicine was, is and always will be holistic. Moreover, the claim amounts to a falsehood, because much of alternative medicine is everything but holistic. I will try to explain what I mean using the recent example of acupuncture for neck pain, but I could have used almost any other alternative treatment and any other human complaint/condition/disease:
- chiropractic for back pain;
- homeopathy for asthma;
- energy healing for depression;
- aromatherapy for jet lag;
- etc. etc.
The recent trial found that adding acupuncture to usual care yields a slightly better outcome than usual care alone. This is hardly a big deal; adding a good cup of tea and a compassionate chat to usual care might have done a similar thing. Acupuncturists, however, will say that their holistic approach is successful.
How holistic is acupuncture?
A ‘Western’ acupuncturist would normally ask what is wrong with the patient; in the case of neck pain, he would probably ask several further questions about the history of the condition, when the pain occurs, what aggravates it etc. Then he might conduct a physical examination of his patient. Eventually, he would get out his needles and start the treatment.
A ‘traditional’ acupuncturist would ask similar questions, feel the pulse, look at the tongue and make a diagnosis in terms of yin and yang imbalance. Eventually, he too would get out his needles and start the treatment.
Is that holistic?
Certainly not! If we look at alternative practitioners in general, we cannot fail to notice that they tend to be the very opposite of holistic. They usually attribute a patients illness to one single cause such as yin/yang imbalance (acupuncture), subluxation (chiropractic), impediment of the life force (homeopathy), etc.
Holistic means that the patient is understood as a whole person. Our neck pain patient might have physical problems such as muscular tension; the acupuncturists might well have realised this and placed their needles accordingly. But neck pain, like most other symptoms, can have many other dimensions:
- there could be stress;
- there could be an ergonomically disadvantageous work place;
- there could be a history of injury;
- there could be a malformation of the spine;
- there could be a tumour;
- there could be an inflammation;
- there could be many other specific diseases;
- there could be relationship problems, et. etc.
Of course, the acupuncturists will claim that, during an acupuncture session, they will pick up on all of these. However, in my experience, this is little more than wishful thinking. And even if they did pick up other dimensions of the patient’s complaint, what can they do about it? They can (and often do) give rather amateur advice. This may be meant most kindly but it is rarely optimal.
And what about conventional practitioners, aren’t they even worse?
True, there often is far too much room for improvement. But at least the concept of multifactorial conditions and treatments is deeply ingrained in everyone who has been to medical school. We learn that symptoms/complaints/conditions/diseases are almost invariably multifactorial; they have many causes and contributing factors which can interact in complex ways. Therefore, responsible physicians always consider to treat patients in multifactorial ways; in the case of our neck pain patient:
- the stress might need a relaxation programme,
- the work place might need the input of an occupational therapist;
- in case of an old injury, a physio might be needed;
- specific conditions might need to be seen by a range of medical specialists;
- muscular tension could be reduced by a massage therapist;
- relationship problems might require the help of a psychologist; etc. etc.
I am NOT saying that all of this is necessary in each and every case. But I am saying that, in conventional medicine, both the awareness and the possibility for a professional multidisciplinary approach is well established. You don’t believe me? Ask a physiotherapist or an occupational therapist who refers more patients to them, an acupuncturist or a GP!
Alternative practitioners claim to be holistic and some might even be aware of the complexity of their patients’ symptoms. But, at best, they have an amateur approach to this complexity by dabbling themselves in issuing more or less suited advice. They are not adequately trained to do this job, and they refer very rarely.
My conclusion: professional multidiscipinarity is an approach deeply engrained in conventional medicine (we don’t often call it holism, perhaps because many doctors associate this term with charlatans), and it beats the mostly amateurish pseudo-holism of alternative practitioners any time.
The aim of this study was to evaluate clinical effectiveness of Alexander Technique lessons or acupuncture versus usual care for persons with chronic, nonspecific neck pain.
Patients with neck pain lasting at least 3 months, a score of at least 28% on the Northwick Park Questionnaire (NPQ) for neck pain and associated disability, and no serious underlying pathology were randomised to receive 12 acupuncture sessions or 20 one-to-one Alexander lessons (both 600 minutes total) plus usual care versus usual care alone. The NPQ score at 0, 3, 6, and 12 months (primary end point) and Chronic Pain Self-Efficacy Scale score, quality of life, and adverse events (secondary outcomes) served as outcome measures. 517 patients were recruited. Their median duration of neck pain was 6 years. Mean attendance was 10 acupuncture sessions and 14 Alexander lessons. Between-group reductions in NPQ score at 12 months versus usual care were 3.92 percentage points for acupuncture (95% CI, 0.97 to 6.87 percentage points) (P = 0.009) and 3.79 percentage points for Alexander lessons (CI, 0.91 to 6.66 percentage points) (P = 0.010). The 12-month reductions in NPQ score from baseline were 32% for acupuncture and 31% for Alexander lessons. Participant self-efficacy improved for both interventions versus usual care at 6 months (P < 0.001) and was significantly associated (P < 0.001) with 12-month NPQ score reductions (acupuncture, 3.34 percentage points [CI, 2.31 to 4.38 percentage points]; Alexander lessons, 3.33 percentage points [CI, 2.22 to 4.44 percentage points]). No reported serious adverse events were considered probably or definitely related to either intervention.
The authors drew the following conclusions: acupuncture sessions and Alexander Technique lessons both led to significant reductions in neck pain and associated disability compared with usual care at 12 months. Enhanced self-efficacy may partially explain why longer-term benefits were sustained.
Where to begin? There is much to be criticised about this study!
For starters, the conclusions are factually wrong. They should read “acupuncture sessions plus usual care and Alexander Technique lessons plus usual care both led to significant reductions in neck pain and associated disability compared with usual care at 12 months. Enhanced self-efficacy may partially explain why longer-term benefits were sustained.
On this blog, we have repeatedly discussed the ‘A+B versus B’ study design and the fact that it cannot provide information about cause and effect because it fails to control for placebo effects and the extra attention, time and empathy (for instance here and here). I suspect that this is the reason why it is so very popular in alternative medicine. It can make ineffective therapies appear to be effective.
Another point is a more clinical concern. Neck pain is not a disease, it is a symptom. In medicine we should, whenever possible, try to treat the cause of the underlying condition and not the symptom. Acupuncture is at best a symptomatic treatment. Usual care is often not very effective because we normally fail to see the cause of neck pain. In my view, alternative treatments should either be tested against placebo or sham interventions or against optimal care.
What is optimal care for nonspecific neck pain? As its causes are often unclear and usually multifactorial, the optimal treatment needs to be multifactorial (one could also call it holistic) as well. The causes often range from poor ergometric conditions at work to muscular tension, stress, psychological problems etc. Thus optimal care would be a team work tailor-made for each patient possibly including physiotherapists, pain specialists, clinical psychologists, orthopaedic surgeons etc.
My points here are:
- neither acupuncture nor Alexander technique take account of this complexity,
- they claim to be holistic but, in fact, this turns out to be merely a good sales-slogan,
- usual care is usually no good,
- if pragmatic trials using the ‘A+B versus B’ design make any sense at all, they should employ not usual care but optimal care for the control group.
In the end, we are left with a study that looks fairly rigorous at first sight, but that really tells us next to nothing (except that dedicating 600 minutes to patients in pain is not without effect). I am truly surprised that a top journal like the Annals of Internal Medicine decided to publish it.
Alternative medicine (AM) use has become popular among patients with cancer. I find this very easy to understand: faced with such a grave diagnosis, who would not be tempted to try everything that is being promoted as being helpful. And, by Jove, promoted it is! But does it do any good?
The evidence clearly shows that no form of AM is capable of changing the natural history of any form of cancer. This means the millions of websites that imply otherwise are criminally wrong and frightfully dangerous.
But some AMs might still be useful, namely for improving symptoms, well-being and quality of life (QOL) as supportive or palliative therapies. Unfortunately the evidence for this assumption is less sound than AM fans try to make us believe. Before this background, better research is needed and more trials would be welcome. A brand-new paper might tell us more.
The purposes of this study were to compare the QOL in CAM users and non-CAM users and to determine whether AM use influences QOL among breast cancer patients during chemotherapy.
A cross-sectional survey was conducted at two outpatient chemotherapy centers. A total of 546 patients completed the questionnaires on AM use. QOL was evaluated based on the European Organization for Research and Treatment of Cancer (EORTC) core quality of life (QLQ-C30) and breast cancer-specific quality of life (QLQ-BR23) questionnaires.
A total of 70.7% of patients were identified as AM users. There was no significant difference in global health status scores and in all 5 subscales of the QLQ C30 functional scales between AM users and non-AM users. On the QLQ-C30 symptom scales, AM users (44.96±3.89) had significantly (p = 0.01) higher mean scores for financial difficulties than non-AM users (36.29±4.81). On the QLQ-BR23 functional scales, AM users reported significantly higher mean scores for sexual enjoyment (6.01±12.84 vs. 4.64±12.76, p = 0.04) than non-AM users. On the QLQ-BR23 symptom scales, AM users reported higher systemic therapy side effects (41.34±2.01 vs. 37.22±2.48, p = 0.04) and breast symptoms (15.76±2.13 vs. 11.08±2.62, p = 0.02) than non-AM users. Multivariate logistic regression analysis indicated that the use of CAM modality was not significantly associated with higher global health status scores (p = 0.71).
The authors drew the following conclusions: While the findings indicated that there was no significant difference between users and non-users of AM in terms of QOL, AM may be used by health professionals as a surrogate to monitor patients with higher systemic therapy side effects and breast symptoms. Furthermore, given that AM users reported higher financial burdens (which may have contributed to increased distress), patients should be encouraged to discuss the potential benefits and/or disadvantages of using AM with their healthcare providers.
One needs to caution, of course, that this was not an RCT, and therefore cause and effect cannot be taken for granted. Nevertheless, I believe, that these findings should make us think critically about the wide-spread notion that the supportive and palliative use of AM leads to an improvement of QOL in cancer patients.
An Indian chain of homeopathic clinics, Dr Batra’s, has just opened its first branch in London. The new website is impressive. It claims homeopathy is effective for the following conditions:
Hair loss? Are they serious? Have they not seen pictures of Samuel Hahnemann?
I decided to look into the psoriasis claim a little closer. This is what they state regarding the homeopathic treatment of psoriasis:
Research-based evidences speak clear and loud of the success of homeopathy in treating psoriasis.
A study published in the Journal of the European Academy of Dermatology and Venereology, a conventional medical Journal, showed that psoriasis patients experienced significant improvement in their quality of life and reduction in their psoriasis symptoms with homeopathy. And this was without any kind of side-effects whatsoever. Of the 82 patients involved in the study that went on for 2 years, many had suffered psoriasis for as long as 15 years and had previously unsuccessfully tried conventional treatments.
At Dr. Batra’s we have successfully treated more than 25,000 cases of psoriasis with homeopathy over the last 35 years. Our safe and scientific solutions have brought smiles to many suffering patients of psoriasis. In fact, a study conducted by A.C. Nielson showed that as compared to general practitioners, specialists and local homeopaths, a higher than average improvement is seen at Dr. Batra’s in treatment of skin ailments.
To the reader who does not look deeper, this may sound fairly convincing. Sadly, it is not. The first study cited above was an uncontrolled trial. Here is its abstract:
Design Prospective multicentre observational study. Objective To evaluate details and effects of homeopathic treatment in patients with psoriasis in usual medical care. Methods Primary care patients were evaluated over 2 years using standardized questionnaires, recording diagnoses and complaints severity, health-related quality of life (QoL), medical history, consultations, all treatments, and use of other health services. Results Forty-five physicians treated 82 adults, 51.2% women, aged 41.6 +/- 12.2 (mean +/- SD) years. Patients had psoriasis for 14.7 +/- 11.9 years; 96.3% had been treated before. Initial case taking took 127 +/- 47 min. The 7.4 +/- 7.4 subsequent consultations (duration: 19.4 +/- 10.5 min) cumulated to 169.0 +/- 138.8 min. Patients received 6.0 +/- 4.9 homeopathic prescriptions. Diagnoses and complaints severity improved markedly with large effect sizes (Cohen’s d= 1.02-2.09). In addition, QoL improved (SF-36 physical component score d = 0.26, mental component score d = 0.49), while conventional treatment and health service use were considerably reduced. Conclusions Under classical homeopathic treatment, patients with psoriasis improved in symptoms and QoL.
It is clear that, due to the lack of a control group, no causal inference can be made between the treatment and the outcome. To claim that otherwise is in my view bogus.
I should mention that there is not a single controlled clinical trial of homeopathy for psoriasis that would support the claim that it is effective.
The second study is not listed in Medline. In fact, the only publication of an author by the name of ‘A C Nielson’ is entitled ‘Are men more intuitive when it comes to eating and physical activity?’. Until I see the evidence, I very much doubt that the study cited above produced strong evidence that homeopathy is an effective cure for psoriasis.
Dr Batra’s chain of clinics boasts to provide the best quality and the highest standards of services that percolate down to all levels in an organisation. Everyone in the institute and those associated with it strive for excellence in whatever they do. Measuring the degree of customer satisfaction was the fundamental concept on which this homeopathic institute’s commitment to become a patient-driven institution was built.
Nice words! SHAME THAT THEY HAVE DECIDED TO DILUTE THEIR TRUTH HOMEOPATHICALLY!
Anthroposophic medicine is based on Rudolf Steiner’s mystical ideas. It is popular in Germany and is slowly also spreading to other countries. Anthroposophic drugs are prepared according to ancient notions of alchemy and are fly in the face of modern pharmacology. Anthroposophic doctors treat all sorts of diseases, and their treatments include anthroposophic medications, and a range of other modalities.
A recent paper reported a secondary analysis from an observational study of 529 children with respiratory or ear infections (RTI/OM) <18 years from Europe and the USA. Their caregivers had chosen to consult physicians offering either anthroposophic (A-) or conventional (C-) treatment for RTI/OM.
During the 28-day follow-up antibiotics were prescribed to 5.5% of A-patients and 25.6% of C-patients (P < 0.001); the unadjusted odds ratio for non-prescription in A- versus C-patients was 6.58 (95%-CI 3.45-12.56); after adjustment for demographics and morbidity it was 6.33 (3.17-12.64). Antibiotic prescription rates in recent observational studies with similar patients in similar settings, ranged from 31.0% to 84.1%. Compared to C-patients, A-patients also had much lower use of analgesics, somewhat quicker symptom resolution, and higher caregiver satisfaction. Adverse drug reactions were infrequent (2.3% in both groups) and not serious.
What can we conclude from these data?
Not a lot, I fear!
The authors of the study are a little more optimistic than I; they conclude that this analysis from a prospective observational study under routine primary care conditions showed a very low use of antibiotics and analgesics/antipyretics in children treated for RTI/OM by physicians offering AM therapy, compared to current practice in conventional therapy settings (antibiotics prescribed to 5% versus 26% of A- and C-patients, respectively, during days 0–28; antipyretics prescribed to 3% versus 26%). The AM treatment entailed no safety problem and was not associated with delayed short-term recovery. These differences could not explained by differences in demographics or baseline morbidity. The low antibiotic use is consistent with findings from other studies of paediatric RTI/OM in AM settings.
They are clearly careful to avoid causal inferences; but are they implying them? I would like to know what you think.
While my last post was about the risk following some naturopaths’ advice, this one is about the effectiveness of naturopathic treatments. This is a complex subject, not least because naturopaths use a wide range of therapies (as the name implies, they pride themselves of employing all therapeutic means supplied by nature). Some of these interventions are clearly supported by good evidence; for instance, nobody would doubt the effectiveness of a healthy diet or the benefits of regular exercise. But what about all the other treatments naturopaths use? The best approach to find an answer might be to assess not each single therapy but to evaluate the entire package of the naturopathic approach, and not a single study but all such trials.
This is precisely what US researchers have recently done. The purpose of this interesting, new systematic review was to compile and consolidate research that has investigated the whole practice of naturopathic medicine as it is practiced in community settings in order to better assess the quantity and quality of the research, and clinical effect, if any.
In order to get included into the review, studies had to report results from multi-modal treatment delivered by North American naturopathic doctors. The effect size for each study was calculated; no meta-analysis was undertaken.
Fifteen studies met the authors’ inclusion criteria. They covered a wide range of chronic diseases. Most studies had low to medium risks of bias including acknowledged limitations of pragmatic trials. Effect sizes for the primary medical outcomes varied and were statistically significant in 10 out of 13 studies. A quality of life metric was included in all of the RCTs with medium effect size and statistical significance in some subscales.
The authors concluded that previous reports about the lack of evidence or benefit of naturopathic medicine (NM) are inaccurate; a small but compelling body of research exists. Further investigation is warranted into the effectiveness of whole practice NM across a range of health conditions.
This sounds like good news for naturopathy! However, there are several important caveats:
- the authors seem to have only looked at US studies (naturopathy is a European tradition!),
- the searches were done three years ago, and more recent data were thus omitted,
- the authors included all sorts of investigations, even uncontrolled studies; only 6 were RCTs,
- rigorous trials were very scarce; and for each condition, they were even more so,
- the authors mention the PRISMA guidelines for systematic reviews implying that they followed them but, in fact, they did not.
My biggest concern, however, is something else. It relates to the interventions tested in these studies. The authors claim that their results table provides full details on this issue but this is unfortunately not true. All we have by way of an explanation is the authors’ remark that the interventions tested in the studies of their review included diet counseling and nutritional recommendations, specific home exercises and physical activity recommendations, deep breathing techniques or other stress reduction strategies, dietary supplements including vitamins, hydrotherapy, soft-tissue manual techniques, electrical muscle stimulation, and botanical medicines.
Survey data from two US states tell us that the most commonly prescribed naturopathic therapeutics are botanical medicines (51% of visits in Connecticut, 43% in Washington), vitamins (41% and 43%), minerals (35% and 39%), homeopathy (29% and 19%) and allergy treatments (11% and 13%). They also inform us that the mean length of a consultation with an US naturopath is about 40 minutes.
I think, this puts things into perspective. If I advise a patient with diabetes or hypertension or coronary heat disease to follow an appropriate diet, exercise and to adhere to some stress reduction program, if in addition I show empathy and compassion during a 40 minute consultation and make sure that my advise is taken seriously and subsequently adhered to, the outcome is likely to be positive. Naturopaths may elect to call this package of intervention ‘naturopathy’, however, I would call it good conventional medicine.
The problem, I think is clear: good therapeutic advice is effective but it is not naturopathy, and it cannot be used to justify the use of doubtful interventions like homeopathy or all sorts of dodgy supplements. Testing whole treatment packages of this nature can therefore lead to highly misleading results, particularly if the researchers draw unwarranted conclusions about specific schools of health care.
When I come across a study with the aim to “examine the effectiveness of acupuncture to relieve symptoms commonly observed in patients in a hospice program” my hopes are high. When I then see that its authors are from the ‘New England School of Acupuncture’, the ‘All Care Hospice and the ‘Tufts University School of Medicine, Boston, my hopes for a good piece of science are even higher. So, let’s see what this new paper has to offer.
A total of 26 patients participated in this acupuncture ‘trial’, receiving a course of weekly treatments that ranged from 1 to 14 weeks. The average number of treatments was five. The Edmonton Symptom Assessment Scale (ESAS) was used to assess the severity of pain, tiredness, nausea, depression, anxiety, drowsiness, appetite, well-being, and dyspnoea. A two-tailed, paired t test was applied to the data to compare symptom scores pre- versus post-acupuncture treatment. Patients enrolled in All Care Hospice’s home care program were given the option to receive acupuncture to supplement usual care offered by the hospice team. Treatment was provided by licensed acupuncturists in the patient’s place of residence.
The results indicated that 7 out of 9 symptoms were significantly improved with acupuncture, the exceptions being drowsiness and appetite. Although the ESAS scale demonstrated a reduction in symptom severity post-treatment for both drowsiness and appetite, this reduction was not found to be significant.
At tis stage, I have lost most of my hopes for good science. This is not a ‘trial’ but a glorified case-series. There is no way that the stated aim can be pursued with this type of methodology. There is no reason whatsoever to assume that the observed outcome can be attributed to acupuncture; the additional attention given to these patients is but one of several factors that are quite sufficient to explain their symptomatic improvements.
This is yet another disappointment then from the plethora of ‘research’ into alternative medicine that, on closer inspection, turns out to be little more than thinly disguised promotion of quackery. These days, I can bear such disappointments quite well – after all, I had many years to get used to them. What I find more difficult to endure is the anger that overcomes me when I read the authors’ conclusion: Acupuncture was found to be effective for the reduction and relief of symptoms that commonly affect patient QOL. Acupuncture effectively reduced symptoms of pain, tiredness, nausea, depression, anxiety, and shortness of breath, and enhanced feelings of well-being. More research is required to assess the long-term benefits and symptom reduction of acupuncture in a palliative care setting.
This is not disappointing; in my view, this is scientific misconduct by
- the authors,
- the institutions employing the authors,
- the ethics committee that has passed the ‘research’,
- the sponsors of the ‘research’,
- the peer-reviewers of the paper,
- the journal and its editors responsible for publishing this paper.
The fact that this sort of thing happens virtually every day in the realm of alternative medicine does not render this case less scandalous, it merely makes it more upsetting.
A new RCT of Reiki healing has been published by US authors from the following institutions: Union Institute & University, Psychology Program, Brattleboro, VT, Coyote Institute, Augusta and Bangor, ME, Eastern Maine Medical Center and Acadia Hospital, Bangor, ME, University of New England College of Osteopathic Medicine, Biddeford, ME, Coyote Institute, Orono, ME. The purpose of this study was to determine if 30 minutes of healing touch could reduce burnout in community mental health clinicians.
The authors utilized a crossover design to explore the efficacy of Reiki versus sham Reiki, a pseudo treatment performed by volunteers who had no experience with Reiki and pretended to be healers vis-à-vis the patients. This sham control intervention was designed to mimic true Reiki.
Subjects were randomized to whether they started with Reiki or sham. The Maslach Burnout Inventory-Human Services Survey (MBI-HSS) and the Measure Your Medical Outcome Profile Version 2 (MYMOP-2) were used as outcome measures. Multilevel modeling was used to represent the relations among variables.
The results showed that real Reiki was significantly better than sham Reiki in reducing burnout among community mental health clinicians. Reiki was significant in reducing depersonalization, but only among single people. Reiki reduced the primary symptom on the MYMOP also only among single people.
The authors concluded that the effects of Reiki were differentiated from sham Reiki. Reiki could be helpful in community mental health settings for the mental health of the practitioners.
My team has published on Reiki (see here and here, for instance), and on this blog I have repeatedly been expressed my doubts that Reiki is more than an elaborate placebo (see here and here, for instance). Do these new results mean that I need to eat my words and henceforth praise the wonders of Reiki? No, I don’t think so!
Having conducted studies on ‘energy healing’ myself, I know only too well of the many pitfalls and possibilities of generating false-positive findings with such research. This new study has many flaws, but we need not look far to find the reason for the surprising and implausible finding. Here is my explanation why this study suggests one placebo to be superior to another placebo.
The researchers had to recruit 16 Reiki healers and several non-Reiki volunteers to perform the interventions on the small group of patients. It goes without saying that the Reiki healers were highly motivated to demonstrate the value of their therapy. This means they (unintentionally?) used verbal and non-verbal communication to maximise the placebo effect of their treatment. The sham healers, of course, lacked such motivation. In my view, this seemingly trivial difference alone is capable of producing the false-positive result above.
There are, of course, ways of minimising the danger of such confounding. In our own study of ‘energy healing’ with sham healers as controls, for instance, we instructed both the healers and the sham healers to abstain from all communication with their patients, we filmed each session to make sure, and we asked each patient to guess which treatment they had received. None of these safeguards were incorporated in the present study – I wonder why!
The press officers of journals like to send out press-releases of articles which are deemed to be particularly good and important. Sadly, it is not often that articles on alternative medicine fulfil these criteria. I was therefore excited to receive this press-release which seemed encouraging, to say the least:
Medical evidence supports the potential for acupuncture to be significantly more effective in the treatment of dermatologic conditions such as dermatitis, pruritus, and urticaria than alternative treatment options, “placebo acupuncture,” or no treatment, according to a review of the medical literature published in The Journal of Alternative and Complementary Medicine, a peer-reviewed publication from Mary Ann Liebert, Inc., publishers…
The abstract was equally promising:
Objectives: Acupuncture is a form of Traditional Chinese Medicine that has been used to treat a broad range of medical conditions, including dermatologic disorders. This systematic review aims to synthesize the evidence on the use of acupuncture as a primary treatment modality for dermatologic conditions.
Methods: A systematic search of MEDLINE, EMBASE, and the Cochrane Central Register was performed. Studies were limited to clinical trials, controlled studies, case reports, comparative studies, and systematic reviews published in the English language. Studies involving moxibustion, electroacupuncture, or blood-letting were excluded.
Results: Twenty-four studies met inclusion criteria. Among these, 16 were randomized controlled trials, 6 were prospective observational studies, and 2 were case reports. Acupuncture was used to treat atopic dermatitis, urticaria, pruritus, acne, chloasma, neurodermatitis, dermatitis herpetiformis, hyperhidrosis, human papillomavirus wart, breast inflammation, and facial elasticity. In 17 of 24 studies, acupuncture showed statistically significant improvements in outcome measurements compared with placebo acupuncture, alternative treatment options, and no intervention.
Conclusions: Acupuncture improves outcome measures in the treatment of dermatitis, chloasma, pruritus, urticaria, hyperhidrosis, and facial elasticity. Future studies should ideally be double-blinded and standardize the control intervention.
One has to read the actual full text article to understand that the evidence presented here is dodgy to the extreme. In fact, one has to go into the tedious details of the methods section to find the reasons why: All searches were limited to clinical trials, controlled studies, case reports, comparative studies, and systematic reviews published in the English language.
There are many more weaknesses of this review, but the inclusion of uncontrolled studies and even anecdotes is, in my view, a virtual death sentence to its credibility. It means that no general conclusions about the effectiveness of acupuncture, such as the authors have decided to make, are possible.
Such overt exaggerations are sadly no rarities in the realm of alternative medicine. I think, this begs a number of serious questions:
- Does this cross the line between flawed research and scientific misconduct?
- Why did the reviewers not pick up these flaws?
- Why did the editor pass this article for publication?
- How can the publisher tolerate such dubious behaviour?
- Should this journal (which I have commented on before here and which is one with the highest impact factor of all the alt med journals) be de-listed from Medline?
I don’t think that we will get answers from the people responsible for this disgrace, but I would like to learn my readers’ opinions.
A paper entitled ‘Real world research: a complementary method to establish the effectiveness of acupuncture’ caught my attention recently. I find it quite remarkable and think it might stimulate some discussion on this blog. Here is its abstract:
Acupuncture has been widely used in the management of a variety of diseases for thousands of years, and many relevant randomized controlled trials have been published. In recent years, many randomized controlled trials have provided controversial or less-than-convincing evidence that supports the efficacy of acupuncture. The clinical effectiveness of acupuncture in Western countries remains controversial.
Acupuncture is a complex intervention involving needling components, specific non-needling components, and generic components. Common problems that have contributed to the equivocal findings in acupuncture randomized controlled trials were imperfections regarding acupuncture treatment and inappropriate placebo/sham controls. In addition, some inherent limitations were also present in the design and implementation of current acupuncture randomized controlled trials such as weak external validity. The current designs of randomized controlled trials of acupuncture need to be further developed. In contrast to examining efficacy and adverse reaction in a “sterilized” environment in a narrowly defined population, real world research assesses the effectiveness and safety of an intervention in a much wider population in real world practice. For this reason, real world research might be a feasible and meaningful method for acupuncture assessment. Randomized controlled trials are important in verifying the efficacy of acupuncture treatment, but the authors believe that real world research, if designed and conducted appropriately, can complement randomized controlled trials to establish the effectiveness of acupuncture. Furthermore, the integrative model that can incorporate randomized controlled trial and real world research which can complement each other and potentially provide more objective and persuasive evidence.
In the article itself, the authors list seven criteria for what they consider good research into acupuncture:
- Acupuncture should be regarded as complex and individualized treatment;
- The study aim (whether to assess the efficacy of acupuncture needling or the effectiveness of acupuncture treatment) should be clearly defined and differentiated;
- Pattern identification should be clearly specified, and non-needling components should also be considered;
- The treatment protocol should have some degree of flexibility to allow for individualization;
- The placebo or sham acupuncture should be appropriate: knowing “what to avoid” and “what to mimic” in placebos/shams;
- In addition to “hard evidence”, one should consider patient-reported outcomes, economic evaluations, patient preferences and the effect of expectancy;
- The use of qualitative research (e.g., interview) to explore some missing areas (e.g., experience of practitioners and patient-practitioner relationship) in acupuncture research.
Furthermore, the authors list the advantages of their RWR-concept:
- In RWR, interventions are tailored to the patients’ specific conditions, in contrast to standardized treatment. As a result, conclusions based on RWR consider all aspects of acupuncture that affect the effectiveness.
- At an operational level, patients’ choice of the treatment(s) decreases the difficulties in recruiting and retaining patients during the data collection period.
- The study sample in RWR is much more representative of the real world situation (similar to the section of the population that receives the treatment). The study, therefore, has higher external validity.
- RWR tends to have a larger sample size and longer follow-up period than RCT, and thus is more appropriate for assessing the safety of acupuncture.
The authors make much of their notion that acupuncture is a COMPLEX INTERVENTION; specifically they claim the following: Acupuncture treatment includes three aspects: needling, specific non-needling components drove by acupuncture theory, and generic components not unique to acupuncture treatment. In addition, acupuncture treatment should be performed on the basis of the patient condition and traditional Chinese medicine (TCM) theory.
There is so much BS here that it is hard to decide where to begin refuting. As the assumption of acupuncture or other alternative therapies being COMPLEX INTERVENTIONS (and therefore exempt from rigorous tests) is highly prevalent in this field, let me try to just briefly tackle this one.
The last time I saw a patient and prescribed a drug treatment I did all of the following:
- I greeted her, asked her to sit down and tried to make her feel relaxed.
- I first had a quick chat about something trivial.
- I then asked why she had come to see me.
- I started to take notes.
- I inquired about the exact nature and the history of her problem.
- I then asked her about her general medical history, family history and her life-style.
- I also asked about any psychological problems that might relate to her symptoms.
- I then conducted a physical examination.
- Subsequently we discussed what her diagnosis might be.
- I told her what my working diagnosis was.
- I ordered a few tests to either confirm or refute it and explained them to her.
- We decided that she should come back and see me in a few days when her tests had come back.
- In order to ease her symptoms in the meanwhile, I gave her a prescription for a drug.
- We discussed this treatment, how and when she should take it, adverse effects etc.
- We also discussed other therapeutic options, in case the prescribed treatment was in any way unsatisfactory.
- I reassured her by telling her that her condition did not seem to be serious and stressed that I was confident to be able to help her.
- She left my office.
The point I am trying to make is: prescribing an entirely straight forward drug treatment is also a COMPLEX INTERVENTION. In fact, I know of no treatment that is NOT complex.
Does that mean that drugs and all other interventions are exempt from being tested in rigorous RCTs? Should we allow drug companies to adopt the RWR too? Any old placebo would pass that test and could be made to look effective using RWR. In the example above, my compassion, care and reassurance would alleviate my patient’s symptoms, even if the prescription I gave her was complete rubbish.
So why should acupuncture (or any other alternative therapy) not be tested in proper RCTs? I fear, the reason is that RCTs might show that it is not as effective as its proponents had hoped. The conclusion about the RWR is thus embarrassingly simple: proponents of alternative medicine want double standards because single standards would risk to disclose the truth.