A recent post of mine seems to have stimulated a lively discussion about the question IS THERE ANY GOOD EVIDENCE AT ALL FOR OSTEOPATHIC TREATMENTS? By and large, osteopaths commented that they are well aware that their signature interventions for their most frequently treated condition (back pain) lack evidential support and that more research is needed. At the same time, many osteopaths seemed to see little wrong in making unsubstantiated therapeutic claims. I thought this was remarkable and feel encouraged to write another post about a similar topic.
Most osteopaths treat children for a wide range of conditions and claim that their interventions are helpful. They believe that children are prone to structural problems which can be corrected by their interventions. Here is an example from just one of the numerous promotional websites on this topic:
STRUCTURAL PROBLEMS, such as those affecting the proper mobility and function of the body’s framework, can lead to a range of problems. These may include:
- Postural – such as scoliosis
- Respiratory – such as asthma
- Manifestations of brain injury – such as cerebral palsy and spasticity
- Developmental – with delayed physical or intellectual progress, perhaps triggering learning behaviour difficulties
- Infections – such as ear and throat infections or urinary disturbances, which may be recurrent.
OSTEOPATHY can assist in the prevention of health problems, helping children to make a smooth transition into normal, healthy adult life.
As children cannot give informed consent, this is even more tricky than treating adults with therapies of questionable value. It is therefore important, I think, to ask whether osteopathic treatments of children is based on evidence or just on wishful thinking or the need to maximise income. As it happens, my team just published an article about these issues in one of the highest-ranking paediatrics journal.
The objective of our systematic review was to critically evaluate the effectiveness of osteopathic manipulative treatment (OMT) as a treatment of paediatric conditions. Eleven databases were searched from their respective inceptions to November 2012. Only randomized clinical trials (RCTs) were included, if they tested OMT against any type of control intervention in paediatric patients. The quality of all included RCTs was assessed using the Cochrane criteria.
Seventeen trials met our inclusion criteria. Only 5 RCTs were of high methodological quality. Of those, 1 favoured OMT, whereas 4 revealed no effect compared with various control interventions. Replications by independent researchers were available for two conditions only, and both failed to confirm the findings of the previous studies. Seven RCTs suggested that OMT leads to a significantly greater reduction in the symptoms of asthma, congenital nasolacrimal duct obstruction, daily weight gain and length of hospital stay, dysfunctional voiding, infantile colic, otitis media, or postural asymmetry compared with various control interventions. Seven RCTs indicated that OMT had no effect on the symptoms of asthma, cerebral palsy, idiopathic scoliosis, obstructive apnoea, otitis media, or temporo-mandibular disorders compared with various control interventions. Three RCTs did not report between-group comparisons. The majority of the included RCTs did not report the incidence rates of adverse-effects.
Our conclusion is likely to again dissatisfy many osteopaths: The evidence of the effectiveness of OMT for paediatric conditions remains unproven due to the paucity and low methodological quality of the primary studies.
So, what does this tell us? I am sure osteopaths will disagree, but I think it shows that for no paediatric condition do we have sufficient evidence to show that OMT is effective. The existing RCTs are mostly of low quality. There is a lack of independent replication of the few studies that suggested a positive outcome. And to make matters even worse, osteopaths seem to be violating the most basic rule of medical research by not reporting adverse-effects in their clinical trials.
I rest my case – at least for the moment.
Antioxidant vitamins include vitamin E, beta-carotene, and vitamin C. They are often recommended and widely used for preventing major cardiovascular outcomes. However, the effect of antioxidant vitamins on cardiovascular events remains unclear. There is plenty of evidence but the trouble is that it is not always of high quality and confusingly contradictory. Consequently, it is possible to cherry-pick the studies you prefer in order to come up with the answer you like. That this approach is counter-productive should be obvious to every reader of this blog. Only a rigorous systematic review can provide an answer that is as reliable as possible with the data available to date. Chinese researchers have just published such an assessment.
They searched PubMed, EmBase, the Cochrane Central Register of Controlled Trials, and the proceedings of major conferences for relevant investigations. To be eligible, studies had to be randomized, placebo-controlled trials reporting on the effects of antioxidant vitamins on cardiovascular outcomes. The primary outcome measures were major cardiovascular events, myocardial infarction, stroke, cardiac death, total death, and any adverse events.
The searches identified 293 articles of which 15 RCTs reporting data on 188209 participants met the inclusion criteria. In total, these studies reported 12749 major cardiovascular events, 6699 myocardial infarction, 3749 strokes, 14122 total death, and 5980 cardiac deaths. Overall, antioxidant vitamin supplementation, as compared to placebo, had no effect on major cardiovascular events (RR, 1.00; 95% CI, 0.96-1.03), myocardial infarction (RR, 0.98; 95% CI, 0.92-1.04), stroke (RR, 0.99; 95% CI, 0.93-1.05), total death (RR, 1.03; 95% CI, 0.98-1.07), cardiac death (RR, 1.02; 95% CI, 0.97-1.07), revascularization (RR, 1.00; 95% CI, 0.95-1.05), total CHD (RR, 0.96; 95% CI, 0.87-1.05), angina (RR, 0.98; 95% CI, 0.90-1.07), and congestive heart failure (RR, 1.07; 95% CI, 0.96 to 1.19).
The authors’ conclusion from these data could not be clearer: Antioxidant vitamin supplementation has no effect on the incidence of major cardiovascular events, myocardial infarction, stroke, total death, and cardiac death.
Few subjects in the realm of nutrition have attracted as much research during recent years as did antioxidants, and it is hard to think of a disease for which they are not recommended by this expert or another. Cardiovascular disease used to be the flag ship in this fleet of conditions; not so long ago, even the conventional medical wisdom sympathized with the notion that the regular supplementation of our diet with antioxidant vitamins might reduce the risk of cardiovascular disease and mortality.
Today, the pendulum has swung back, and it now seems to be mostly the alternative scene that still swears by antioxidants for that purpose. Nobody doubts that antioxidants have important biological functions, but this excellent meta-analysis quite clearly and fairly convincingly shows that buying antioxidant supplements is a waste of money. It does not promote cardiovascular health, it merely generates very expensive urine.
According to the UK General Osteopathic Council, osteopathy is a system of diagnosis and treatment for a wide range of medical conditions. It works with the structure and function of the body, and is based on the principle that the well-being of an individual depends on the skeleton, muscles, ligaments and connective tissues functioning smoothly together.
To an osteopath, for your body to work well, its structure must also work well. So osteopaths work to restore your body to a state of balance, where possible without the use of drugs or surgery. Osteopaths use touch, physical manipulation, stretching and massage to increase the mobility of joints, to relieve muscle tension, to enhance the blood and nerve supply to tissues, and to help your body’s own healing mechanisms. They may also provide advice on posture and exercise to aid recovery, promote health and prevent symptoms recurring.
In case this sounds a bit vague to you, and in case you wonder what this “wide range of conditions” might be, rest assured, you are not alone. So let’s try to be a little more concrete and clear up some of the confusion around this profession. There are two very different types of osteopaths: US osteopaths are virtually identical with conventionally trained physicians; their qualification is equivalent to those of medical practitioners and they can, for instance, specialise to become GPs or neurologists or surgeons etc. Elsewhere, osteopaths are non-medically qualified alternative practitioners. In the UK, they are regulated by statute, in other counties not. And as to the “wide range of conditions”, I am not aware of any disease or symptom for which the evidence is convincing.
Osteopaths most commonly treat patients suffering from Chronic Non-Specific Low Back Pain (CNSLBP) using a set of non-drug interventions, particularly manual therapies such as spinal mobilisation and manipulation. The question is how well are these techniques supported by reliable evidence. To answer it, we must not cherry-pick our evidence but we need to consider the totality of the reliable studies; in other words, we need an up-to-date systematic review. Such an assessment of clinical research into osteopathic intervention for CNSLBP was recently published by Australian experts.
A thorough search of the literature in multiple electronic databases was undertaken, and all articles were included that reported clinical trials; had adult participants; tested the effectiveness and/or efficacy of osteopathic manual therapies applied by osteopaths, and had a study condition of CNSLBP. The quality of the trials was assessed using the Cochrane criteria. Initial searches located 809 papers, 772 of which were excluded on the basis of abstract alone. The remaining 37 papers were subjected to a detailed analysis of the full text, which resulted in 35 further articles being excluded. There were thus only two studies assessing the effectiveness of manual therapies applied by osteopaths in adult patients with CNSLBP. The results of one trial suggested that the osteopathic intervention was similar in effect to a sham intervention, and the other implies equivalence of effect between osteopathic intervention, exercise and physiotherapy.
I guess, this comes as a bit of a surprise to many consumers who have been told over and over again by osteopaths and their supporters that the evidence is sound. Personally, I am not at all surprised because, two years ago, we published a similar review, albeit with a wider spectrum of conditions, namely any type of musculoskeletal pain. We managed to include a total of 16 RCTs. Five of them suggested that osteopathy leads to a significantly stronger reduction of musculoskeletal pain than a range of control interventions. However, 11 RCTs indicated that osteopathy, compared to controls, generates no change in musculoskeletal pain. At the time, we felt that these data fail to produce compelling evidence for the effectiveness of osteopathy as a treatment of musculoskeletal pain.
This lack of convincing evidence is in sharp contrast to the image of osteopaths as back pain specialists. The UK General Osteopathic council, for instance, sates that Osteopaths’ patients include the young, older people, manual workers, office professionals, pregnant women, children and sports people. Patients seek treatment for a wide variety of conditions, including back pain…In addition, thousands of websites try to convince the consumer that osteopathy is a well-proven therapy for chronic low back pain – not to mention the many other conditions for which the evidence is even less sound.
As so often in alternative medicine, these claims seem to be based more on wishful thinking than on reliable evidence. And as so often, the victims of bogus claims are the consumers who are being misled into making wrong therapeutic decisions, wasting money, and delaying recovery from illness.
Lymph oedema in the arms or legs is a frequent complication after lymph-node dissections for cancer. Treatment or prevention can be difficult, and the results are often unsatisfactory. Consequently, the burden of suffering of cancer patients affected by this problem is immense.
Amongst several options, a little-known massage technique, called lymph-drainage (or lymphatic drainage, LD), is sometimes recommended. It consists of gentle manual movements which lightly push the lymph fluid through the lymphatic vessels that eventually enter into the blood circulation. During a session of lymph-drainage, a specially trained massage therapist lightly moves his or her hands along the lymph vessels to facilitate the lymph flow. The treatment is agreeable and relaxing, but does it really reduce the oedema?
A recent systematic review and meta-analysis of RCTs evaluated the effectiveness of LD in the prevention and treatment of breast-cancer related lymph-oedema. The primary outcome for prevention was the incidence of postoperative lymph-oedema. The outcome for management of was a reduction in oedema volume.
In total, 10 RCTs with altogether 566 patients were identified. Two studies evaluating the preventive outcome of LD found no significant difference in the incidence of lymph-oedema between the LD and standard treatments. Seven studies assessed the reduction in arm volume, and found no significant difference between the LD and standard treatments.
The authors conclusion was negative about the value of LD: The current evidence from RCTs does not support the use of LD in preventing or treating lymph-oedema. However, clinical and statistical inconsistencies between the various studies confounded our evaluation of the effect of LD on breast-cancer-related lymph-oedema.
Perhaps a brand-new clinical trial which had not been included in the above assessment would have persuaded the authors to be a little more optimistic. This study evaluated the effectiveness of LD in the prevention of lymph-oedema after treatment of breast cancer. The study-population consisted of 67 women, who had undergone surgery for breast cancer. From the second day of surgery, 33 randomly chosen women were given LD. The control group consisted of 34 women who did not receive LD. Measurements of the volumes of both arms were taken before surgery and on days 2, 7, 14, and at 3 and 6 months after surgery.
Among the women who did not have LD, a significant increase in the arm volume on the operated side was observed after 6 month. There was no statistically significant increase in the volume of the upper limb on the operated side in women who underwent LD.
The authors conclude that regardless of the surgery type and the number of the lymph nodes removed, LD effectively prevented lymph-oedema of the arm on the operated side. Even in high risk breast cancer treatments (operation plus irradiation), LD was demonstrated to be effective against arm volume increase. Even though confirmatory studies are needed, this study demonstrates that LD administered early after operation for breast cancer should be considered for the prevention of lymph-oedema.
So, does LD reduce oedema or not? This does not seem to be such a difficult question that it should take decades to resolve! And who would doubt that it is an important one? Lymph-oedema has the potential to seriously impede the quality of life of many patients, and it can even contribute to unnecessary mortality. The fact that the few available studies are too small and too weak to generate reliable results is disappointing and shines a dim light on the supposedly patient-centred research in oncology, in my view.
The concept of LD is plausible, at least some of the findings from clinical trials are encouraging, and the problem of lymph-oedema is both prevalent and relevant. So what is stopping us from funding a large, well-designed and definitive study?
Ignaz von Peczely (1826-1911), a Hungarian physician, got the idea for iridology (or iris-diagnosis) more than a century ago, after seeing streaks in the iris of a man he was treating for a broken leg, and similar phenomena the iris of an owl whose leg von Peczely had broken many years before. He subsequently became convinced that his method was able to distinguish between healthy organs and those that are overactive, inflamed, or distressed. Iridology became internationally known when US chiropractors began adopting this method in their clinical practice. In the United States, most insurance programs do not cover iridology but, in some European countries, they often do. In Germany, for instance, 80% of the Heilpraktiker (non-medically qualified health practitioners) practice iridology.
Iridologists claim to be able to diagnose the health status of an individual, medical conditions or predispositions to disease through abnormalities of pigmentation in the iris. The popularity of iridology renders it necessary to ask whether this method is valid.
The aim of my systematically review from 1999 was to critically evaluate all available, reliable tests of iridology as a diagnostic tool. Four case control studies were included; these are investigations where iridologists are asked to tell by looking at the iris of individuals whether that person does or does not have a certain condition. The majority of these studies suggested that iridology is not a valid diagnostic method. Back then, I concluded that “the validity of iridology as a diagnostic tool is not supported by scientific evaluations. Patients and therapists should be discouraged from using this method.”
Since the publication of my article, several further studies have emerged:
One German team conducted a study investigating the applicability of iridology as a screening method for colorectal cancer. Digital color slides were obtained from both eyes of 29 patients with histologically diagnosed colorectal cancer and from 29 age- and gender-matched healthy control subjects. The slides were presented in random order to acknowledged iridologists without knowledge of the number of patients in the two categories. The iridologists correctly detected 51.7% and 53.4%, respectively, of the patients’ slides; therefore, the likelihood was statistically no better than chance. Sensitivity was, respectively, 58.6% and 55.2%, and specificity was 44.8% and 51.7%. The authors’ conclusion was blunt: “Iridology had no validity as a diagnostic tool for detecting colorectal cancer in this study.”
A study from South Africa aimed to determine the efficacy of iridology in the identification of moderate to profound sensorineural hearing loss in adolescents. A controlled trial was conducted with an iridologist, blind to the actual hearing status of participants, analysing the irises of participants with and without hearing loss. Fifty hearing impaired and fifty normal hearing subjects, between the ages of 15 and 19 years, controlled for gender, participated in the study. An experienced iridologist analysed the randomised set of participants’ irises. A 70% correct identification of hearing status was obtained with a false negative rate of 41% compared to a 19% false positive rate. The respective sensitivity and specificity rates therefore were 59% and 81%. The authors of this investigation concluded that “iridological analysis of hearing status indicated a statistically significant relationship to actual hearing status (P < 0.05). Although statistically significant sensitivity and specificity rates for identifying hearing loss by iridology were not comparable to those of traditional audiological screening procedures.”
A further German study investigated the value of iridology as a diagnostic tool in detecting some common cancers. One hundred ten subjects were enrolled; 68 subjects had histologically proven cancers of the breast, ovary, uterus, prostate, or colorectum, and 42 were cancer-free controls. All subjects were examined by an experienced practitioner of iridology, who was unaware of their medical details. He was allowed to suggest up to five diagnoses for each subject and his results were then compared with each subject’s medical diagnosis to determine the accuracy of iridology in detecting malignancy. Iridology identified the correct diagnosis in only 3 cases (sensitivity, 0.04). The authors concluded that “iridology was of no value in diagnosing the cancers investigated in this study.”
Based on these results it is impossible, I think, to claim that iridology is a valid or useful diagnostic tool. As there is no anatomical or physiological basis for its assumptions, iridology is not biologically plausible. Furthermore, the available clinical evidence does not support its validity as a diagnostic tool. In other words, iridology is bogus. This statement is in sharp contract to the information consumers receive about the method on uncounted websites, books, articles, etc. One website picked at random provides the following information:
The iris reveals changing conditions of every part and organ of the body. Every organ and part of the body is represented in the iris in a well defined area. In addition, through various marks, signs, and discoloration in the iris, nature reveals inherited weaknesses and strengths.
By means of this art / science, an iridologist (one who studies the coloration and fiber structure of the eye) can tell an individual his/her inherited and acquired tendencies towards health and disease, his current condition in general, and the state of every organ in particular.
Iridology cannot detect a specific disease, but, can tell an individual if they have over or under activity in specific areas of the body. For example, an under-active pancreas might indicate a diabetic condition.
Another source claims:
The underlying platform of iridology is that that eyes act as a ‘window’ to a person’s health & well being. This ‘window’ enables the practitioner to see whether areas or organs within the body are healthy, inflamed or ‘over active’. It also enables them to assess a person’s past/ possible future health problems & consider if the patient has a susceptibility to certain diseases. It is important to understand that iridology is simply a method of diagnosis & analysis.
You may well think that none of this really matters. Who cares whether iridology is bogus or not! I would argue that it does matter. Bogus methods cost money that could be better spent elsewhere. More importantly, false positive and false negative diagnoses generated by bogus diagnostic methods can put lives at risk.
But there is a more general and perhaps more crucial point here: alternative medicine is an area where people far too easily get away with ignoring the published evidence and scientific consensus. In the last two decades, I have seen many alternative modalities getting scientifically dis-proven; not in a single such instance can I remember that the corresponding alternative practitioners and their professional organisations took any notice of this fact, and not once did I notice that their practice had changed.
If research is systematically ignored, it becomes a useless appendix. More importantly, progress is then stifled to the detriment of all our best interests.
Acupuncture has remained one of the most controversial topics in the area of alternative medicine. Is it plausible? Is it safe? Is it effective? The arguments have been raging for decades and are by no means settled yet. The June issue of Anesth. Analg. is partly dedicated to this debate; the editor has invited two teams of experts to put forward their contrasting views.
The team of experts arguing in support of acupuncture conclude as follows: “clinical trials support the efficacy of acupuncture in reducing post-operative nausea and vomiting and postoperative pain; however, evidence supporting acupuncture as a treatment for chronic pain conditions is mixed. It should be noted that acupuncture trials in chronic pain have concluded that acupuncture treatment is often superior to standard of care or wait list controls and that acupuncture has minimal side effects and is cost effective. Brain imaging studies have demonstrated that there are different neural correlates between verum and sham acupuncture stimulation. Additionally, all clinical trials and many research studies have assumed that the acupuncture effect is equal to the “needle” effect, failing to recognize that factors in addition to specific effects of needling are also important contributors to the therapeutic effect of acupuncture in the setting of chronic pain.
Last, acupuncture is an ancient medical intervention first developed in an era when there were no laboratory tests, technology, or science of anatomy. The reason that the practice of acupuncture has survived for thousands of years is because it has evolved over time, with changes ranging from the number of acupuncture points to the practice techniques. Instead of criticizing this ancient art with arguments culled from modern medicine and science, physicians and scientists should try to integrate current knowledge into this ancient, yet ever-evolving practice so it may be used to treat conditions for which pharmaceutical interventions are ineffective and/or potentially dangerous. Over the last decade, there has been a growing green movement and eco-sustainability trend as well as an increased awareness that the same medication may not be effective in treating every patient with the same biomedical diagnosis. This “new age-integrative medicine” in Western culture promotes a patient-oriented medical practice that complements the ancient Chinese theory behind acupuncture practice. Overall, acupuncture practice should not be seen as a placebo intervention or merely a needle therapy, but a medical option that not only treats disorders but also fosters a greater awareness of how harmonic interactions between self, family, work, and environment play a role in promoting health and restoring order”.
The two experts arguing against the usefulness of acupuncture draw the following conclusions: “It is clear from meta-analyses that results of acupuncture trials are variable and inconsistent, even for single conditions. After thousands of trials of acupuncture and hundreds of systematic reviews,arguments continue unabated. In 2011, Pain published an editorial that summed up the present situation well.
“Is there really any need for more studies? Ernst et al. point out that the positive studies conclude that acupuncture relieves pain in some conditions but not in other very similar conditions. What would you think if a new pain pill was shown to relieve musculoskeletal pain in the arms but not in the legs? The most parsimonious explanation is that the positive studies are false positives. In his seminal article on why most published research findings are false, Ioannidis points out that when a popular but ineffective treatment is studied, false positive results are common for multiple reason, including bias and low prior probability.”
Since it has proved impossible to find consistent evidence after more than 3000 trials, it is time to give up. It seems very unlikely that the money that it would cost to do another 3000 trials would be well-spent.
A small excess of positive results after thousands of trials is most consistent with an inactive intervention. The small excess is predicted by poor study design and publication bias. Furthermore, Simmons et al. demonstrated that exploitation of “undisclosed flexibility in data collection and analysis” can produce statistically positive results even from a completely nonexistent effect. They say this is “… not driven by a willingness to deceive but by the self-serving interpretation of ambiguity, which enables us to convince ourselves that whichever decisions produced the most publishable outcome must have also been the most appropriate.”
With acupuncture, in particular, there is documented profound bias among proponents. Existing studies are also contaminated by variables other than acupuncture, such as the frequent inclusion of “electroacupuncture” which is essentially transdermal electrical nerve stimulation masquerading as acupuncture.
The best controlled studies show a clear pattern, with acupuncture the outcome does not depend on needle location or even needle insertion. Since these variables are those that define acupuncture, the only sensible conclusion is that acupuncture does not work. Everything else is the expected noise of clinical trials, and this noise seems particularly high with acupuncture research. The most parsimonious conclusion is that with acupuncture there is no signal, only noise.
The interests of medicine would be best-served if we emulated the Chinese Emperor Dao Guang and issued an edict stating that acupuncture and moxibustion should no longer be used in clinical practice.
No doubt acupuncture will continue to exist on the “High Streets” where they can be tolerated as a voluntary self-imposed tax on the gullible (as long as they do not make unjustified claims).”
The readers of this blog will no doubt make up their own mind as to which arguments are stronger, more logical, more convincing, and based on more reliable evidence. I recommend reading the full articles and studying the references.
Personally, I have no hesitation in agreeing with the second, more sceptical view, and I have to admit finding the pro-acupuncture arguments weak as well as full of clichés, fallacies and errors.
I look forward to a lively discussion.
A stroke is a condition where brain cells get irreversibly damaged either by a haemorrhage in the brain or by a blood clot cutting off oxygen supply. This process leaves most patients with neurological deficits such as difficulties in moving, speaking, concentrating etc. As other parts of the brain learn to take over, these problems can partly or completely resolve themselves over time, but many patients are left with permanent handicaps. Stroke-rehabilitation can minimise these problems, and there is a long-standing debate as to which measures are most effective. Acupuncture has been discussed as a method to improve the results of stroke-rehabilitation, but the evidence is hotly disputed. This is why a new study in this area is an important contribution to our existing knowledge.
The aim of this randomised trial was to test the effectiveness of acupuncture in promoting the recovery of patients with ischaemic stroke and to determine whether the outcomes of combined physiotherapy and acupuncture are superior to those with physiotherapy alone. The Chinese investigators recruited 120 patients who received one of three daily treatments: 1) acupuncture, 2) physiotherapy, 3) physiotherapy combined with acupuncture. Motor function in the limbs was measured with the Fugl-Meyer assessment (FMA); the modified Barthel index (MBI) was used to rate activities of daily living; both of these measures are validated and well-established. All evaluations were performed by assessors blinded to treatment allocation.
At baseline, FMA and MBI scores did not significantly differ among the treatment groups. Compared with baseline, on day 28 of therapy, the mean FMA scores of the physiotherapy, acupuncture, and combined treatment groups had increased by 65.6%, 57.7%, and 67.2%, respectively; on day 56, FMA scores had increased by 88.1%, 64.5%, and 88.6%, respectively. The respective MBI scores in the three groups had increased by 85.2%, 60.4%, and 63.4% at day 28 and by 108.0%, 71.2%, and 86.2% at day 56, respectively. However, FMA scores did not significantly differ between the three treatment groups on the 28th day. By the day 56, the FMA and MBI scores of the physiotherapy group were 46.1% and 33.2% greater, respectively, than those in the acupuncture group. No significant differences were seen between the combined treatment group and the other groups. The FMA subscores for the upper extremities did not show significant improvements in any group on day 56.
The authors draw the following conclusion: “Acupuncture is less effective for the outcome measures studied than is physiotherapy. Moreover, the therapeutic effect of combining acupuncture with physiotherapy was not superior to that of physiotherapy alone. A larger-scale clinical trial is necessary to confirm these finding.”
Our own study arrived at similarly disappointing conclusions: “Acupuncture is not superior to sham treatment for recovery in activities of daily living and health-related quality of life after stroke, although there may be a limited effect on leg function in more severely affected patients“. Our review of all 10 sham-controlled RCTs in this area is also in line with the results of this new study: “Our meta-analyses of data from rigorous randomized sham-controlled trials did not show a positive effect of acupuncture as a treatment for functional recovery after stroke”
I am quite sure that some acupuncture-enthusiasts will dispute this evidence. They might argue that I am too critical, the trials were not done optimally, that acupuncturists have seen plenty of good results in their clinical practice, that acupuncture is a complex intervention that does not fit into the straight jacket of an RCT, that this or that “prestigious” organisation recommends acupuncture for stroke patients, that it would be wrong not to give acupuncture a try etc. etc. I would counter that the reliable evidence available to date is sufficiently conclusive to stop claiming that acupuncture is effective and thus give false hope to severely suffering, vulnerable patients. Moreover, I would advocate using the sparse available resources to help stroke victims with treatments that demonstrably work.
Some national and international guidelines advise physicians to use spinal manipulation for patients suffering from acute (and chronic) low back pain. Many experts have been concerned about the validity of this advice. Now an up-date of the Cochrane review on this subject seems to provide clarity on this rather important matter.
Its aim was to assess the effectiveness of spinal manipulative therapy (SMT) as a treatment of acute low back pain. Randomized controlled trials (RCTs) testing manipulation/mobilization in adults with low back pain of less than 6-weeks duration were included. The primary outcome measures were pain, functional status and perceived recovery. Secondary endpoints were return-to-work and quality of life. Two authors independently conducted the study selection, risk of bias assessment and data extraction. The effects were examined for SMT versus inert interventions, sham SMT, other interventions, and for SMT as an adjunct to other forms of treatment.
The researchers identified 20 RCTs with a total number of 2674 participants, 12 (60%) RCTs had not been included in the previous version of this review. Only 6 of the 20 studies had a low risk of bias. For pain and functional status, there was low- to very low-quality evidence suggesting no difference in effectiveness of SMT compared with inert interventions, sham SMT or as adjunct therapy. There was varying quality of evidence suggesting no difference in effectiveness of SMT compared with other interventions. Data were sparse for recovery, return-to-work, quality of life, and costs of care.
The authors draw the following conclusion: “SMT is no more effective for acute low back pain than inert interventions, sham SMT or as adjunct therapy. SMT also seems to be no better than other recommended therapies. Our evaluation is limited by the few numbers of studies; therefore, future research is likely to have an important impact on these estimates. Future RCTs should examine specific subgroups and include an economic evaluation.”
In other words, guidelines that recommend SMT for acute low back pain are not based on the current best evidence. But perhaps the situation is different for chronic low back pain? The current Cochrane review of 26 RCTs is equally negative: “High quality evidence suggests that there is no clinically relevant difference between SMT and other interventions for reducing pain and improving function in patients with chronic low-back pain. Determining cost-effectiveness of care has high priority. Further research is likely to have an important impact on our confidence in the estimate of effect in relation to inert interventions and sham SMT, and data related to recovery.”
This clearly begs the question why many of the current guidelines seem to mislead us. I am not sure I know the answer to this one; however I suspect that the panels writing the guidelines might have been dominated by chiropractors and osteopaths or their supporters who have not exactly made a name for themselves for being impartial. Whatever the reason, I think it is time for a re-think and for up-dating guidelines which are out of date and misleading.
Similarly, it might be time to question for what conditions chiropractors and osteopaths, the two professions who use spinal manipulation/mobilisation most, do actually offer anything of real value at all. Back pain and SMT are clearly their domains; if it turns out that SMT is not evidence-based for back pain, what is left? There is no good evidence for anything else, as far as I can see. To make matters worse, there are quite undeniable risks associated with SMT. The conclusion of such considerations is, I fear, obvious: the value of and need for these two professions should be re-assessed.
Evidence-based medicine (EBM) is a tool which enables health care professionals to optimize the chances for patients to be treated according to ethically, legally and medically accepted standards. Many proponents of alternative medicine used to reject the principles of EBM, not least because there is precious little good evidence from reliable clinical trials to support their treatments. In recent years, however, some alternative practitioners have stopped trying to swim against the tide.
They have discreetly changed their tune claiming that they do, in fact, practice EBM. Their argument usually holds that EBM represents much more than just data from clinical trials and that they actually do abide by the rules of EBM when treating their patients. The former claim is correct but the latter is not.
In order to explain why, we ought to first define our terminology. During recent years, several descriptions of EBM have become available. According to David Sackett, who was part of the McMaster group that coined the term, EBM is “the conscientious, explicit and judicious use of current best evidence in making decisions about the care of individual patients. The practice of evidence-based medicine means integrating individual clinical experience with the best available external clinical evidence from systematic research”. As proposed by Sackett, the practice of EBM rests on the following three pillars:
- External Evidence– clinically relevant and reliable research mostly from clinical investigations into the efficacy and safety of therapeutic interventions – in other words clinical trials and systematic reviews. In a previous blog-post, I have elaborated on the question what evidence means.
- Clinical Expertise– the ability to use clinical skills to identify each patient’s unique health state, diagnosis and risks as well as his/her chances to benefit from the available therapeutic options.
- Patient Values– the individual preferences, concerns and expectations of the patient which are important in order to meet the patient’s needs.
So, how can a homeopath treating a patient with migraine, a chiropractor manipulating a child with asthma, or an acupuncturist needling a consumer for smoking cessation claim to practice EBM? The best available external evidence shows that neither of these therapies is effective. In fact, it even suggests that these options are ineffective for the above-named indications.
Using the first example of the homeopath, the scenario goes something like this: a homeopath believes in the ability of homeopathy and has the clinical expertise in it (he probably has clinical expertise in nothing else but homeopathy). His patient’s preference is very clearly with homeopathy (otherwise, she would not have consulted him). It follows that the homeopath does embrace two pillars of EBM. As to the third pillar – external evidence – he is adamant that clinical trials cannot do justice to something as holistic, subtle, individualized etc. Therefore he refuses to recognize the trial data as conclusive and rather trusts his experience which might be substantial.
I am sure that this line of arguing can convince some people; it certainly seems to appear compelling to those alternative practitioners who claim to practice EBM. However, I cannot agree with them.
The reason is simple: the practice of EBM must rest on three pillars, and each one of those three pillars is essential; we cannot just pick the ones we happen to like and drop the ones which we find award, we need them all.
We might be generous and grant that the homeopath’s pseudo-EBM argument outlined above suggests that his practice rests on two of the three pillars. However, the third one is absent and has been replaced by a bizarre imitation. To pretend that external evidence can be substituted by something else is erroneous and introduces double standards which are not acceptable – not because this would be against some bloodless principles of nit-picking academics, but because it would not be in the best interest of the patient. And, after all, the primary concern of EBM has to be the patient.
Many cancer patients will suffer from severe, debilitating fatigue during the course of their illness. The exact cause of this common symptom is not entirely clear. Most likely it is due to a combination of the cancer and the treatments used to cure it. Managing cancer-related fatigue (CRF) is thus an important part of the palliative and supportive care of cancer patients. Acupuncture is often advocated for this purpose and many centres use it routinely. The question therefore is, does it work?
The most recent trial on this subject was aimed at assessing the effectiveness of maintenance acupuncture in the management of CRF; acupuncture or self-acupuncture/self-needling was compared with no such treatment. Breast cancer patients who previously had received acupuncture were randomized to have 4 acupuncturist-delivered weekly sessions, 4 self-administered weekly acupuncture sessions (self-needling); or no acupuncture at all. The primary outcome-measure was general fatigue, while mood, quality of life and safety served as secondary endpoints. In total, 197 patients were randomized: 65 to therapist-delivered sessions, 67 to self-acupuncture/self-needling and 65 to no further acupuncture. The results failed to demonstrate significant inter-group differences in any of the parameters evaluated. The authors concluded that “maintenance acupuncture did not yield important improvements beyond those observed after an initial clinic-based course of acupuncture“.
But this is just one single of several available studies. Acupuncture-fans might suspect me of cherry-picking a largely negative study. If we want a fair verdict, we must consider the totality of the evidence. The aim of our systematic review was therefore to critically evaluate the effectiveness of acupuncture (AT) for CRF based on all the trial data available to us.
Fourteen databases were searched from their respective inception to November 2012. Randomized clinical trials (RCTs) of AT for the treatment of CRF were considered for inclusion. The risk of bias/methodological quality was assessed using the method suggested by the Cochrane Collaboration. Seven RCTs met the eligibility criteria. Most were small pilot studies with serious methodological flaws. Four of them showed effectiveness of AT or AT in addition to usual care (UC) over sham AT, UC, enhanced UC, or no intervention for alleviating CRF. Three RCTs failed to demonstrate an effect of AT over sham treatment.
Our conclusion had to be cautious: “Overall, the quantity and quality of RCTs included in the analysis were too low to draw meaningful conclusions. Even in the positive trials, it remained unclear whether the observed outcome was due to specific effects of AT or nonspecific effects of care. Further research is required to investigate whether AT demonstrates specific effects on CRF”
There will, of course, be those who claim that no trial evidence is needed in this case; if a cancer-patient benefits from the treatment, she should have it regardless of whether it works as a placebo or has effects beyond that. I do sympathize with this attitude but should point out that there are a number of points to consider when making it:
2) There are other treatments against CRF; if we blindly advocate acupuncture, we might not offer the best option to our patients.
3) If we spend our limited resources on acupuncture, we might not afford treatments which are more effective.
4) If we are happy using acupuncture because it conveys a sizable placebo-effect, how will we make progress in finding treatments that are more effective?
It is therefore difficult to decide whether or not to recommend acupuncture for CRF. There are some arguments for both sides. Skeptics or critical thinkers or clinicians adhering to the principles of evidence-based medicine are unlikely to condone it, and some people might accuse them for cruelly and heartlessly denying severely ill patients help which they so badly need. Personally, I fail to see what is cruel or heartless in insisting that these patients receive the treatment which demonstrably works best – and that does not seem to be acupuncture.