A recent post of mine seems to have stimulated a lively discussion about the question IS THERE ANY GOOD EVIDENCE AT ALL FOR OSTEOPATHIC TREATMENTS? By and large, osteopaths commented that they are well aware that their signature interventions for their most frequently treated condition (back pain) lack evidential support and that more research is needed. At the same time, many osteopaths seemed to see little wrong in making unsubstantiated therapeutic claims. I thought this was remarkable and feel encouraged to write another post about a similar topic.
Most osteopaths treat children for a wide range of conditions and claim that their interventions are helpful. They believe that children are prone to structural problems which can be corrected by their interventions. Here is an example from just one of the numerous promotional websites on this topic:
STRUCTURAL PROBLEMS, such as those affecting the proper mobility and function of the body’s framework, can lead to a range of problems. These may include:
- Postural – such as scoliosis
- Respiratory – such as asthma
- Manifestations of brain injury – such as cerebral palsy and spasticity
- Developmental – with delayed physical or intellectual progress, perhaps triggering learning behaviour difficulties
- Infections – such as ear and throat infections or urinary disturbances, which may be recurrent.
OSTEOPATHY can assist in the prevention of health problems, helping children to make a smooth transition into normal, healthy adult life.
As children cannot give informed consent, this is even more tricky than treating adults with therapies of questionable value. It is therefore important, I think, to ask whether osteopathic treatments of children is based on evidence or just on wishful thinking or the need to maximise income. As it happens, my team just published an article about these issues in one of the highest-ranking paediatrics journal.
The objective of our systematic review was to critically evaluate the effectiveness of osteopathic manipulative treatment (OMT) as a treatment of paediatric conditions. Eleven databases were searched from their respective inceptions to November 2012. Only randomized clinical trials (RCTs) were included, if they tested OMT against any type of control intervention in paediatric patients. The quality of all included RCTs was assessed using the Cochrane criteria.
Seventeen trials met our inclusion criteria. Only 5 RCTs were of high methodological quality. Of those, 1 favoured OMT, whereas 4 revealed no effect compared with various control interventions. Replications by independent researchers were available for two conditions only, and both failed to confirm the findings of the previous studies. Seven RCTs suggested that OMT leads to a significantly greater reduction in the symptoms of asthma, congenital nasolacrimal duct obstruction, daily weight gain and length of hospital stay, dysfunctional voiding, infantile colic, otitis media, or postural asymmetry compared with various control interventions. Seven RCTs indicated that OMT had no effect on the symptoms of asthma, cerebral palsy, idiopathic scoliosis, obstructive apnoea, otitis media, or temporo-mandibular disorders compared with various control interventions. Three RCTs did not report between-group comparisons. The majority of the included RCTs did not report the incidence rates of adverse-effects.
Our conclusion is likely to again dissatisfy many osteopaths: The evidence of the effectiveness of OMT for paediatric conditions remains unproven due to the paucity and low methodological quality of the primary studies.
So, what does this tell us? I am sure osteopaths will disagree, but I think it shows that for no paediatric condition do we have sufficient evidence to show that OMT is effective. The existing RCTs are mostly of low quality. There is a lack of independent replication of the few studies that suggested a positive outcome. And to make matters even worse, osteopaths seem to be violating the most basic rule of medical research by not reporting adverse-effects in their clinical trials.
I rest my case – at least for the moment.
Tai Chi, as we know it in the West, is said to promote the smooth flow of “energy” throughout the body by performing postures, slow meditative movements and controlled breathing. Tai Chi is also supposed to help increasing flexibility, suppleness, balance and coordination. According to enthusiasts, the smooth, gentle movements of Tai Chi aid relaxation and help to keep the mind calm and focused.
Tai Chi has become popular in Western countries and is being considered for a surprisingly wide range of conditions. The patient/consumer is taught to perform postures, slow meditative movements and controlled breathing. The concepts underlying Tai Chi are strange, but that does not necessarily mean that the treatment is not effective for certain illnesses or symptoms.
There has been a surprising amount of research in this area, and some studies have generated encouraging results. A recent study which is unfortunately not available electronically ( Wu, WF; Muheremu, A; Chen, CH; Liu, WG; Sun, L. Effectiveness of Tai Chi Practice for Non-Specific Chronic Low Back Pain on Retired Athletes: A Randomized Controlled Study. JOURNAL OF MUSCULOSKELETAL PAIN 2013, 21:1, p.37-45) tested the effectiveness of Tai Chi for chronic back pain. Specifically, the researchers wanted to determine whether regular Tai Chi practice is superior to other means of sports rehabilitation in relieving non-specific chronic low back pain [LBP] in a younger population. They randomized 320 former athletes suffering from chronic LBP into a treatment [tai chi practice] and several control groups [regular sessions with swimming, backward walking or jogging, or no such interventions]. At the beginning, middle, and end of a six-month intervention, patients from all groups completed questionnaires assessing the intensity of LBP; in addition, a physical examination was conducted.
After 3 and 6 months, no statistically significant difference in the intensity of LBP was demonstrated between the Tai Chi and swimming. However, significant differences were demonstrated between the Tai Chi and backward walking, jogging, and no exercise groups.
The authors’ concluded that “Tai chi has better efficacy than certain other sports on the treatment of non-specific chronic LBP.”
This is only the second RCT of Tai chi for back pain. The first such study consisted of 160 volunteers between ages 18 and 70 years with persistent nonspecific low back pain. The experimental group (n = 80) had 18 Tai Chi sessions over a 10-week period. The waitlist control group continued with their usual health care. Bothersomeness of symptoms was the primary outcome, and secondary outcomes included pain intensity and pain-related disability. Tai Chi reduced bothersomeness of back symptoms by 1.7 points on a 0-10 scale, reduced pain intensity by 1.3 points on a 0-10 scale, and improved self-report disability by 2.6 points on the 0-24 Roland-Morris Disability Questionnaire scale. The authors of this RCT concluded that a 10-week Tai Chi program improved pain and disability outcomes and can be considered a safe and effective intervention for those experiencing long-term low back pain symptoms.
My own team have conducted their fair share of Tai Chi research. Specifically,we have published several systematic reviews of Tai Chi as an adjunctive or supportive treatment of various conditions, and the conclusions (in italics) have been mixed.
DIABETES: The existing evidence does not suggest that tai chi is an effective therapy for type 2 diabetes.
HYPERTENSION: The evidence for tai chi in reducing blood pressure in the elderly individuals is limited.
BREAST CANCER: the existing trial evidence does not show convincingly that tai chi is effective for supportive breast cancer care.
IMPROVEMENT OF AEROBIC EXCERCISE CAPACITY: the existing evidence does not suggest that regular tai chi is an effective way of increasing aerobic capacity.
PARKINSON’S DISEASE: the evidence is insufficient to suggest tai chi is an effective intervention for Parkinson’s Disease.
OSTEOPOROSIS: The evidence for tai chi in the prevention or treatment of osteoporosis is not convincing.
OSTEOARTHRITIS: there is some encouraging evidence suggesting that tai chi may be effective for pain control in patients with knee OA.
RHEUMATOID ARTHRITIS: Collectively this evidence is not convincing enough to suggest that tai chi is an effective treatment for RA.
Finally, an overview over all systematic reviews of Tai Chi suggested that the only area where the evidence is convincing is the prevention of falls in the elderly.
I think, this indicates that we should not pin our hopes too high as to the therapeutic value of Tai Chi. In particular, for back pain, the evidence might be optimistically judged as encouraging, but it is by no means convincing; the effect size seems to be small and two studies are not enough to issue general recommendations. On the other hand, considering that there is so little to offer to back pain patients, I concede that this is an area that should be studied further. Meanwhile, one could argue that Tai Chi can be fun and is devoid of risks – so, why not give it a try?
According to the UK General Osteopathic Council, osteopathy is a system of diagnosis and treatment for a wide range of medical conditions. It works with the structure and function of the body, and is based on the principle that the well-being of an individual depends on the skeleton, muscles, ligaments and connective tissues functioning smoothly together.
To an osteopath, for your body to work well, its structure must also work well. So osteopaths work to restore your body to a state of balance, where possible without the use of drugs or surgery. Osteopaths use touch, physical manipulation, stretching and massage to increase the mobility of joints, to relieve muscle tension, to enhance the blood and nerve supply to tissues, and to help your body’s own healing mechanisms. They may also provide advice on posture and exercise to aid recovery, promote health and prevent symptoms recurring.
In case this sounds a bit vague to you, and in case you wonder what this “wide range of conditions” might be, rest assured, you are not alone. So let’s try to be a little more concrete and clear up some of the confusion around this profession. There are two very different types of osteopaths: US osteopaths are virtually identical with conventionally trained physicians; their qualification is equivalent to those of medical practitioners and they can, for instance, specialise to become GPs or neurologists or surgeons etc. Elsewhere, osteopaths are non-medically qualified alternative practitioners. In the UK, they are regulated by statute, in other counties not. And as to the “wide range of conditions”, I am not aware of any disease or symptom for which the evidence is convincing.
Osteopaths most commonly treat patients suffering from Chronic Non-Specific Low Back Pain (CNSLBP) using a set of non-drug interventions, particularly manual therapies such as spinal mobilisation and manipulation. The question is how well are these techniques supported by reliable evidence. To answer it, we must not cherry-pick our evidence but we need to consider the totality of the reliable studies; in other words, we need an up-to-date systematic review. Such an assessment of clinical research into osteopathic intervention for CNSLBP was recently published by Australian experts.
A thorough search of the literature in multiple electronic databases was undertaken, and all articles were included that reported clinical trials; had adult participants; tested the effectiveness and/or efficacy of osteopathic manual therapies applied by osteopaths, and had a study condition of CNSLBP. The quality of the trials was assessed using the Cochrane criteria. Initial searches located 809 papers, 772 of which were excluded on the basis of abstract alone. The remaining 37 papers were subjected to a detailed analysis of the full text, which resulted in 35 further articles being excluded. There were thus only two studies assessing the effectiveness of manual therapies applied by osteopaths in adult patients with CNSLBP. The results of one trial suggested that the osteopathic intervention was similar in effect to a sham intervention, and the other implies equivalence of effect between osteopathic intervention, exercise and physiotherapy.
I guess, this comes as a bit of a surprise to many consumers who have been told over and over again by osteopaths and their supporters that the evidence is sound. Personally, I am not at all surprised because, two years ago, we published a similar review, albeit with a wider spectrum of conditions, namely any type of musculoskeletal pain. We managed to include a total of 16 RCTs. Five of them suggested that osteopathy leads to a significantly stronger reduction of musculoskeletal pain than a range of control interventions. However, 11 RCTs indicated that osteopathy, compared to controls, generates no change in musculoskeletal pain. At the time, we felt that these data fail to produce compelling evidence for the effectiveness of osteopathy as a treatment of musculoskeletal pain.
This lack of convincing evidence is in sharp contrast to the image of osteopaths as back pain specialists. The UK General Osteopathic council, for instance, sates that Osteopaths’ patients include the young, older people, manual workers, office professionals, pregnant women, children and sports people. Patients seek treatment for a wide variety of conditions, including back pain…In addition, thousands of websites try to convince the consumer that osteopathy is a well-proven therapy for chronic low back pain – not to mention the many other conditions for which the evidence is even less sound.
As so often in alternative medicine, these claims seem to be based more on wishful thinking than on reliable evidence. And as so often, the victims of bogus claims are the consumers who are being misled into making wrong therapeutic decisions, wasting money, and delaying recovery from illness.
The vexing question whether the acupuncture needle is as safe as most acupuncturists seem to believe has been raised several times before on this blog. Here is a new case-report by Japanese authors which sheds an interesting light on this issue.
A 62-year-old man was admitted to A+E complaining of dizziness and diaphoresis. He had received an acupuncture treatment in the sub-xyphoid area (lower 2 cm and left 1 cm point from the lower xyphoid process border) only about one hour ago. He had a history of cerebral infarction and atrial fibrillation, and the latter condition was treated with 2 mg warfarin per day. On admission, the acupuncture needle was still sticking in his sub-sternum.
His blood pressure was 80/50 mm Hg, and tachycardia with 110 beats/min was noted. The acupuncture-needle was duly removed, but the patient went into cardiac arrest and had to be resuscitated. Because his international normalized ratio was 1.99, 2 pints of fresh frozen plasma and 5 mg of vitamin K were administered at that stage. A transthoracic echocardiography revealed pericardial effusion with early diastolic collapse of the right ventricle. Emergency pericardiocentesis using a sub-costal approach was performed. After drainage of 500 mL of sanguineous effusion, the patient seemed to stabilize.
Two hours later, the drainage of pericardial effusion amounted to around 1000 mL, and cardiac arrest re-developed. After another resuscitation, an operation was performed under cardiopulmonary bypass (CPB). A median sternotomy allowed visualization of huge hematomas over the right atrium and ventricle. After the hematomas had been evacuated, pulsating blood loss from the marginal branch of the right coronary artery was identified. The vessel had been torn into pieces, and it was ligated which stopped the bleeding. Thereafter, the patient remained hemodynamically stable. Subsequently the patient made an uneventful recovery and, eventually, he was discharged without further complications.
The authors of this case-report conclude as follows: To our best knowledge, this appears to be the first case of an acupuncture-related coronary artery injury. The important causes of this unfortunate adverse event are a lack of anatomic knowledge and an incorrect application of the procedure. It can be avoided that acupuncture leads to cardiac tamponade like most serious complications….every acupuncturist should be aware of the possible and life-threatening adverse events and be adequately trained to prevent them.
In 2011, we published a review of all cases of cardiac tamponade after acupuncture. At the time, we found a total of 26 such incidences. In 14 patients, the complications were fatal. In most reports, there was little doubt about causality. We concluded that cardiac tamponade is a serious, often fatal complication after acupuncture. As it is theoretically avoidable, acupuncturists should be trained to minimize the risk.
Acupuncture-fans will, of course, claim (as before) that it is alarmist to go on about risks of acupuncture or alternative medicine which are so minute that they are dwarfed by those of conventional health care. And I will counter (as before) that it is never the absolute risk that counts, but that it is the risk benefit balance which defines the value of any therapeutic intervention. As long as we have no solid proof that acupuncture is more than a “theatrical placebo“, even a tiny risk weighs heavily and seems unacceptable.
But the true significance of this case-report lies elsewhere, in my view: risks of this nature can and should be avoided. The only way to achieve this aim is to train and educate acupuncturists properly. At present this does not seem to be the case, particularly in Asian countries where acupuncture is most popular. It is up to the acupuncture communities across the globe to get their act together.
Lymph oedema in the arms or legs is a frequent complication after lymph-node dissections for cancer. Treatment or prevention can be difficult, and the results are often unsatisfactory. Consequently, the burden of suffering of cancer patients affected by this problem is immense.
Amongst several options, a little-known massage technique, called lymph-drainage (or lymphatic drainage, LD), is sometimes recommended. It consists of gentle manual movements which lightly push the lymph fluid through the lymphatic vessels that eventually enter into the blood circulation. During a session of lymph-drainage, a specially trained massage therapist lightly moves his or her hands along the lymph vessels to facilitate the lymph flow. The treatment is agreeable and relaxing, but does it really reduce the oedema?
A recent systematic review and meta-analysis of RCTs evaluated the effectiveness of LD in the prevention and treatment of breast-cancer related lymph-oedema. The primary outcome for prevention was the incidence of postoperative lymph-oedema. The outcome for management of was a reduction in oedema volume.
In total, 10 RCTs with altogether 566 patients were identified. Two studies evaluating the preventive outcome of LD found no significant difference in the incidence of lymph-oedema between the LD and standard treatments. Seven studies assessed the reduction in arm volume, and found no significant difference between the LD and standard treatments.
The authors conclusion was negative about the value of LD: The current evidence from RCTs does not support the use of LD in preventing or treating lymph-oedema. However, clinical and statistical inconsistencies between the various studies confounded our evaluation of the effect of LD on breast-cancer-related lymph-oedema.
Perhaps a brand-new clinical trial which had not been included in the above assessment would have persuaded the authors to be a little more optimistic. This study evaluated the effectiveness of LD in the prevention of lymph-oedema after treatment of breast cancer. The study-population consisted of 67 women, who had undergone surgery for breast cancer. From the second day of surgery, 33 randomly chosen women were given LD. The control group consisted of 34 women who did not receive LD. Measurements of the volumes of both arms were taken before surgery and on days 2, 7, 14, and at 3 and 6 months after surgery.
Among the women who did not have LD, a significant increase in the arm volume on the operated side was observed after 6 month. There was no statistically significant increase in the volume of the upper limb on the operated side in women who underwent LD.
The authors conclude that regardless of the surgery type and the number of the lymph nodes removed, LD effectively prevented lymph-oedema of the arm on the operated side. Even in high risk breast cancer treatments (operation plus irradiation), LD was demonstrated to be effective against arm volume increase. Even though confirmatory studies are needed, this study demonstrates that LD administered early after operation for breast cancer should be considered for the prevention of lymph-oedema.
So, does LD reduce oedema or not? This does not seem to be such a difficult question that it should take decades to resolve! And who would doubt that it is an important one? Lymph-oedema has the potential to seriously impede the quality of life of many patients, and it can even contribute to unnecessary mortality. The fact that the few available studies are too small and too weak to generate reliable results is disappointing and shines a dim light on the supposedly patient-centred research in oncology, in my view.
The concept of LD is plausible, at least some of the findings from clinical trials are encouraging, and the problem of lymph-oedema is both prevalent and relevant. So what is stopping us from funding a large, well-designed and definitive study?
Alternative medicine has the image of being gentle and risk-free; it is therefore frequently used for children. German experts have just published an important article on this rather controversial topic.
They performed a systematic synthesis of all Cochrane reviews in paediatrics assessing the efficacy, clinical implications and limitations of alternative medicine use in children. The main outcome variables were: percentage of reviews concluding that a certain intervention provides a benefit, percentage of reviews concluding that a certain intervention should not be performed, and percentage of studies concluding that the current level of evidence is inconclusive. A total of 135 reviews were included – most from the United Kingdom (29), Australia (24) and China (24). Only 5 (3.7%) reviews gave a recommendation in favour of a certain intervention; 26 (19.4%) issued a conditional positive recommendation. The 5 positive recommendations were:
1) Calcium supplements during pregnancy for prevention of hypertension and related conditions
2) Creatinine supplements for treating muscular disorders
3) Zinc supplements for prevention of pneumonia
4) Probiotics for prevention of upper respiratory infections
5) Acupuncture for prevention of post-operative nausea and vomiting
Nine (6.6%) reviews concluded that certain interventions should not be performed. Ninety-five reviews (70.3%) were inconclusive. The proportion of inconclusive reviews increased over time. The three most common criticisms of the quality of the primary studies included were: more research needed (82), low methodological quality (57) and small number of study participants (48).
The authors concluded: Given the disproportionate number of inconclusive reviews, there is an ongoing need for high quality research to assess the potential role of CAM in children. Unless the study of CAM is performed to the same science-based standards as conventional therapies, CAM therapies risk being perpetually marginalised by mainstream medicine.
As it happens, we published a very similar review two years ago. At the time (and using slightly different inclusion criteria), we identified a total of 17 systematic reviews. They related to acupuncture, chiropractic, herbal medicine, homeopathy, hypnotherapy, massage and yoga. Results were unconvincing for most conditions, but there was some evidence to suggest that acupuncture may be effective for postoperative nausea and vomiting, and that hypnotherapy may be effective in reducing procedure-related pain. Most of the reviews failed to mention the incidence of adverse effects of the alternative treatments in question. Our conclusions were as follows: “Although there is some encouraging evidence for hypnosis, herbal medicine and acupuncture, there is insufficient evidence to suggest that other CAMs are effective for the treatment of childhood conditions. Many of the systematic reviews included in this overview were of low quality, as were the randomised clinical trials within those reviews, further reducing the weight of that evidence. Future research in CAM for children should conform to the reporting standards outlined in the CONSORT and PRISMA guidelines.”
Treating children with unproven or dis-proven therapies is even more problematic than treating adults in this way. The main reason is that children cannot give informed consent. Thus alternative medicine for children can open difficult ethical questions, and sometimes I wonder where the line is between the application of bogus treatments and child-abuse. Examples are parents who opt for homeopathic vaccinations instead of conventional ones, or paediatric cancer patients who are being treated with bogus alternatives such as laetrile.
Why would parents not want the most effective therapy for their children? Why would anyone opt for dubious alternatives? The main reason, I think, must be misinformation. Parents who use alternative medicine are convinced they are effective and safe because they have been misinformed. We only need to google ALTERNATIVE MEDICINE to see for ourselves what utter nonsense and dangerous rubbish is being promoted under this umbrella.
Misinformation is the foremost reason why well-meaning parents (mis-) treat their children with alternative medicine. The results can be disastrous. Misinformation can kill!
A stroke is a condition where brain cells get irreversibly damaged either by a haemorrhage in the brain or by a blood clot cutting off oxygen supply. This process leaves most patients with neurological deficits such as difficulties in moving, speaking, concentrating etc. As other parts of the brain learn to take over, these problems can partly or completely resolve themselves over time, but many patients are left with permanent handicaps. Stroke-rehabilitation can minimise these problems, and there is a long-standing debate as to which measures are most effective. Acupuncture has been discussed as a method to improve the results of stroke-rehabilitation, but the evidence is hotly disputed. This is why a new study in this area is an important contribution to our existing knowledge.
The aim of this randomised trial was to test the effectiveness of acupuncture in promoting the recovery of patients with ischaemic stroke and to determine whether the outcomes of combined physiotherapy and acupuncture are superior to those with physiotherapy alone. The Chinese investigators recruited 120 patients who received one of three daily treatments: 1) acupuncture, 2) physiotherapy, 3) physiotherapy combined with acupuncture. Motor function in the limbs was measured with the Fugl-Meyer assessment (FMA); the modified Barthel index (MBI) was used to rate activities of daily living; both of these measures are validated and well-established. All evaluations were performed by assessors blinded to treatment allocation.
At baseline, FMA and MBI scores did not significantly differ among the treatment groups. Compared with baseline, on day 28 of therapy, the mean FMA scores of the physiotherapy, acupuncture, and combined treatment groups had increased by 65.6%, 57.7%, and 67.2%, respectively; on day 56, FMA scores had increased by 88.1%, 64.5%, and 88.6%, respectively. The respective MBI scores in the three groups had increased by 85.2%, 60.4%, and 63.4% at day 28 and by 108.0%, 71.2%, and 86.2% at day 56, respectively. However, FMA scores did not significantly differ between the three treatment groups on the 28th day. By the day 56, the FMA and MBI scores of the physiotherapy group were 46.1% and 33.2% greater, respectively, than those in the acupuncture group. No significant differences were seen between the combined treatment group and the other groups. The FMA subscores for the upper extremities did not show significant improvements in any group on day 56.
The authors draw the following conclusion: “Acupuncture is less effective for the outcome measures studied than is physiotherapy. Moreover, the therapeutic effect of combining acupuncture with physiotherapy was not superior to that of physiotherapy alone. A larger-scale clinical trial is necessary to confirm these finding.”
Our own study arrived at similarly disappointing conclusions: “Acupuncture is not superior to sham treatment for recovery in activities of daily living and health-related quality of life after stroke, although there may be a limited effect on leg function in more severely affected patients“. Our review of all 10 sham-controlled RCTs in this area is also in line with the results of this new study: “Our meta-analyses of data from rigorous randomized sham-controlled trials did not show a positive effect of acupuncture as a treatment for functional recovery after stroke”
I am quite sure that some acupuncture-enthusiasts will dispute this evidence. They might argue that I am too critical, the trials were not done optimally, that acupuncturists have seen plenty of good results in their clinical practice, that acupuncture is a complex intervention that does not fit into the straight jacket of an RCT, that this or that “prestigious” organisation recommends acupuncture for stroke patients, that it would be wrong not to give acupuncture a try etc. etc. I would counter that the reliable evidence available to date is sufficiently conclusive to stop claiming that acupuncture is effective and thus give false hope to severely suffering, vulnerable patients. Moreover, I would advocate using the sparse available resources to help stroke victims with treatments that demonstrably work.
One of the best-selling supplements in the UK as well as several other countries is evening primrose oil (EPO). It is available via all sorts of outlets (even respectable pharmacies – or is that supposedly respectable?), and is being promoted for a wide range of conditions, including eczema. The NIH website is optimistic about its efficacy: “Evening primrose oil may have modest benefits for eczema.” Our brand-new Cochrane review was aimed at critically assessing the effects of oral EPO or borage oil (BO) on the symptoms of atopic eczema, and it casts considerable doubt on this somewhat uncritical view.
Here is what we did: We searched six databases as well as online trials registers and checked the bibliographies of included studies for further references to relevant trials. We corresponded with trial investigators and pharmaceutical companies to identify unpublished and ongoing trials. We also performed a separate search for adverse effects. All RCTs investigating oral intake of EPO or BO for eczema were included.
Two experts independently applied eligibility criteria, assessed risk of bias, and extracted data. We pooled dichotomous outcomes using risk ratios (RR), and continuous outcomes using the mean difference (MD). Where possible, we pooled study results using random-effects meta-analysis and tested statistical heterogeneity.
And here is what we found: 27 studies with a total of 1596 participants met our inclusion criteria: 19 studies tested EPO, and 8 studies assessed BO. A meta-analysis of results from 7 studies showed that EPO failed to improve global eczema symptoms as reported by participants and doctors. Treatment with BO also failed to improve global eczema symptoms. 67% of the studies had a low risk of bias for random sequence generation; 44%, for allocation concealment; 59%, for blinding; and 37%, for other biases.
Our conclusions were clear: Oral borage oil and evening primrose oil lack effect on eczema; improvement was similar to respective placebos used in trials. Oral BO and EPO are not effective treatments for eczema.
The very wide-spread notion that EPO is effective for eczema and a range of other conditions was originally promoted by the researcher turned entrepreneur, D F Horrobin, who claimed that several human diseases, including eczema, were due to a lack of fatty acid precursors and could thus be effectively treated with EPO. In the 1980s, Horrobin began to sell EPO supplements without having conclusively demonstrated their safety and efficacy; this led to confiscations and felony indictments in the US. As chief executive of Scotia Pharmaceuticals, Horrobin obtained licences for several EPO-preparations which later were withdrawn for lack of efficacy. Charges of mismanagement and fraud led to Horrobin being ousted as CEO by the board of the company. Later, Horrobin published a positive meta-analysis of EPO for eczema where he excluded the negative results of the largest published trial, but included results of 7 of his own unpublished studies. When scientists asked to examine the data, Horrobin’s legal team convinced the journal to refuse the request.
The evidence for EPO is negative not just for eczema. To the best of my knowledge, there is not a single disease or symptom for which it demonstrably works. Our own review of the data concluded ” EPO has not been established as an effective treatment for any condition”
Our new Cochrane review might help to put this long saga to rest. In my view, it is a fascinating tale of a scientist being blinded by creed and ambition. The results of such errors can be dramatic. Horrobin misled all of us: patients, health care professionals, scientists, regulators, decision makers, businessmen. This caused unnecessary expense and set back research efforts in a multitude of areas. I find the tale also fascinating from other perspectives; for instance, it begs the question why so many ‘respectable’ manufacturers and retailers are still allowed to make money on EPO. Is it not time to debunk the EPO-myth and say it as clearly as possible: EPO helps only those who financially profit from misleading the public?
If we believe homeopaths, we might get the impression that homeopathy is firmly established in mainstream health care. “They would say that, wouldn’t they?” To convince skeptics, we might want to have a bit more than wishful thinking.
We have just published a systematic review in order to instill some evidence into this debate. Our aim was to evaluate all the data from recent surveys of GPs and assess their involvement with and attitudes towards homeopathy. We searched 7 electronic databases to identify all relevant articles. Data extraction was conducted by three independent reviewers. Thirteen surveys met the inclusion criteria. Their findings suggest that less than 10% of GPs treated patients with homeopathy; referral rates varied hugely and ranged from 4.6% to 73%.
Two surveys also assessed GPs’ endorsement of homeopathy; they suggested that less than 15% of GPs were endorsing homeopathy. One survey asked about GPs’ personal usage of homeopathy and reported less than 10% had used this form of therapy on themselves.
Three surveys investigated adverse events (AEs) from homeopathic treatments. One was solely focussed on AEs which were classified as “serious” (either life threatening or likely to cause disability or sever morbidity) or non-serious. In total, 21 “indirect” serious AEs were reported (e.g., stopping medication, refusing immunisation, refusing cancer treatment, delaying diagnosis). Another survey found that 14% of GPs reported AEs following homeopathic treatment within a year. Other authors reported that the discontinuation of conventional asthma treatment in favour of a homeopathic remedy had led to cardiovascular arrest.
These data shed a much more sober light on the use of homeopathy in the UK. They fail to show that homeopathy is well-accepted by British GPs. More importantly perhaps they disclose serious problems with the use of homeopathy.
This post has an odd title and addresses an odd subject. I am sure some people reading it will ask themselves “has he finally gone potty; is he a bit xenophobic, chauvinistic, or what?” I can assure you none of the above is the case.
Since many years, I have been asked to peer-review Chinese systematic reviews and meta-analyses of TCM-trials submitted to various journals and to the Cochrane Collaboration for publication, and I estimate that around 300 such articles are available today. Initially, I thought they were a valuable contribution to our knowledge, particularly for the many of us who cannot read Chinese languages. I hoped they might provide reliable information about this huge and potentially important section of the TCM-evidence. After doing this type of work for some time, I became more and more frustrated; now I have decided not to accept this task any longer – not because it is too much trouble, but because I have come to the conclusion that these articles are far less helpful than I had once assumed; in fact, I now fear that they are counter-productive.
In order to better understand what I mean, it might be best to use an example; this recent systematic review seems as good for that purpose as any.
Its Chinese authors “hypothesized that the eligible trials would provide evidence of the effect of Chinese herbs on bone mineral density (BMD) and the therapeutic benefits of Chinese medicine treatment in patients with bone loss“. Randomized controlled trials (RCTs) were thus retrieved for a systematic review from Medline and 8 Chinese databases. The authors identified 12 RCTs involving a total of 1816 patients. The studies compared Chinese herbs with placebo or standard anti-osteoporotic therapy. The pooled data from these RCTs showed that the change of BMD in the spine was more pronounced with Chinese herbs compared to the effects noted with placebo. Also, in the femoral neck, Chinese herbs generated significantly higher increments of BMD compared to placebo. Compared to conventional anti-osteoporotic drugs, Chinese herbs generated greater BMD changes.
In their abstract, the part on the paper that most readers access, the authors reached the following conclusions: “Our results demonstrated that Chinese herb significantly increased lumbar spine BMD as compared to the placebo or other standard anti-osteoporotic drugs.” In the article itself, we find this more detailed conclusion: “We conclude that Chinese herbs substantially increased BMD of the lumbar spine compared to placebo or anti-osteoporotic drugs as indicated in the current clinical reports on osteoporosis treatment. Long term of Chinese herbs over 12 months of treatment duration may increase BMD in the hip more effectively. However, further studies are needed to corroborate the positive effect of increasing the duration of Chinese herbs on outcome as the results in this analysis are based on indirect comparisons. To date there are no studies available that compare Chinese herbs, Chinese herbs plus anti-osteoporotic drugs, and anti-osteoporotic drug versus placebo in a factorial design. Consequently, we are unable to draw any conclusions on the possible superiority of Chinese herbs plus anti-osteoporotic drug versus anti-osteoporotic drug or Chinese herb alone in the context of BMD.“
Most readers will feel that this evidence is quite impressive and amazingly solid; they might therefore advocate routinely using Chinese herbs for the common and difficult to treat problem of osteoporosis. The integration of TCM might avoid lots of human suffering, prolong the life of many elderly patients, and save us all a lot of money. Why then am I not at all convinced?
The first thing to notice is the fact that we do not really know which of the ~7000 different Chinese herbs should be used. The article tells us surprisingly little about this crucial point. And even, if we manage to study this question in more depth, we are bound to get thoroughly confused; there are simply too many herbal mixtures and patent medicines to easily identify the most promising candidates.
The second and more important hurdle to making sense of these data is the fact that most of the primary studies originate from inaccessible Chinese journals and were published in Chinese languages which, of course, few people in the West can understand. This is entirely our fault, some might argue, but it does mean that we have to believe the authors, take their words at face value, and cannot check the original data. You may think this is fine, after all, the paper has gone through a rigorous peer-review process where it has been thoroughly checked by several top experts in the field. This, however, is a fallacy; like you and me, the peer-reviewers might not read Chinese either! (I don’t, and I reviewed quite a few of these papers; in some instances, I even asked for translations of the originals to do the job properly but this request was understandably turned down) In all likelihood, the above paper and most similar articles have not been properly peer-reviewed at all.
The third and perhaps most crucial point can only be fully appreciated, if we were able to access and understand the primary studies; it relates to the quality of the original RCTs summarised in such systematic reviews. The abstract of the present paper tells us nothing at all about this issue. In the paper, however, we do find a formal assessment of the studies’ risk of bias which shows that the quality of the included RCTs was poor to very poor. We also find a short but revealing sentence: “The reports of all trials mentioned randomization, but only seven described the method of randomization.” This remark is much more significant than it may seem: we have shown that such studies use such terminology in a rather adventurous way; reviewing about 2000 of these allegedly randomised trials, we found that many Chinese authors call a trial “randomised” even in the absence of a control group (one cannot randomise patients and have no control group)! They seem to like the term because it is fashionable and makes publication of their work easier. We thus have good reason to fear that some/many/most of the studies were not RCTs at all.
The fourth issue that needs mentioning is the fact that very close to 100% of all Chinese TCM-trials report positive findings. This means that either TCM is effective for every indication it is tested for (most unlikely, not least because there are many negative non-Chinese trials of TCM), or there is something very fundamentally wrong with Chinese research into TCM. Over the years, I have had several Chinese co-workers in my team and was invariably impressed by their ability to work hard and efficiently; we often discussed the possible reasons for the extraordinary phenomenon of 0% negative Chinese trials. The most plausible answer they offered was this: it would be most impolite for a Chinese researcher to produce findings which contradict the opinion of his/her peers.
In view of these concerns, can we trust the conclusions of such systematic reviews? I don’t think so – and this is why I have problems with research of this nature. If there are good reasons to doubt their conclusions, these reviews might misinform us systematically, they might not further but hinder progress, and they might send us up the garden path. This could well be in the commercial interest of the Chinese multi-billion dollar TCM-industry, but it would certainly not be in the interest of patients and good health care.