Alternative medicine has the image of being gentle and risk-free; it is therefore frequently used for children. German experts have just published an important article on this rather controversial topic.
They performed a systematic synthesis of all Cochrane reviews in paediatrics assessing the efficacy, clinical implications and limitations of alternative medicine use in children. The main outcome variables were: percentage of reviews concluding that a certain intervention provides a benefit, percentage of reviews concluding that a certain intervention should not be performed, and percentage of studies concluding that the current level of evidence is inconclusive. A total of 135 reviews were included – most from the United Kingdom (29), Australia (24) and China (24). Only 5 (3.7%) reviews gave a recommendation in favour of a certain intervention; 26 (19.4%) issued a conditional positive recommendation. The 5 positive recommendations were:
1) Calcium supplements during pregnancy for prevention of hypertension and related conditions
2) Creatinine supplements for treating muscular disorders
3) Zinc supplements for prevention of pneumonia
4) Probiotics for prevention of upper respiratory infections
5) Acupuncture for prevention of post-operative nausea and vomiting
Nine (6.6%) reviews concluded that certain interventions should not be performed. Ninety-five reviews (70.3%) were inconclusive. The proportion of inconclusive reviews increased over time. The three most common criticisms of the quality of the primary studies included were: more research needed (82), low methodological quality (57) and small number of study participants (48).
The authors concluded: Given the disproportionate number of inconclusive reviews, there is an ongoing need for high quality research to assess the potential role of CAM in children. Unless the study of CAM is performed to the same science-based standards as conventional therapies, CAM therapies risk being perpetually marginalised by mainstream medicine.
As it happens, we published a very similar review two years ago. At the time (and using slightly different inclusion criteria), we identified a total of 17 systematic reviews. They related to acupuncture, chiropractic, herbal medicine, homeopathy, hypnotherapy, massage and yoga. Results were unconvincing for most conditions, but there was some evidence to suggest that acupuncture may be effective for postoperative nausea and vomiting, and that hypnotherapy may be effective in reducing procedure-related pain. Most of the reviews failed to mention the incidence of adverse effects of the alternative treatments in question. Our conclusions were as follows: “Although there is some encouraging evidence for hypnosis, herbal medicine and acupuncture, there is insufficient evidence to suggest that other CAMs are effective for the treatment of childhood conditions. Many of the systematic reviews included in this overview were of low quality, as were the randomised clinical trials within those reviews, further reducing the weight of that evidence. Future research in CAM for children should conform to the reporting standards outlined in the CONSORT and PRISMA guidelines.”
Treating children with unproven or dis-proven therapies is even more problematic than treating adults in this way. The main reason is that children cannot give informed consent. Thus alternative medicine for children can open difficult ethical questions, and sometimes I wonder where the line is between the application of bogus treatments and child-abuse. Examples are parents who opt for homeopathic vaccinations instead of conventional ones, or paediatric cancer patients who are being treated with bogus alternatives such as laetrile.
Why would parents not want the most effective therapy for their children? Why would anyone opt for dubious alternatives? The main reason, I think, must be misinformation. Parents who use alternative medicine are convinced they are effective and safe because they have been misinformed. We only need to google ALTERNATIVE MEDICINE to see for ourselves what utter nonsense and dangerous rubbish is being promoted under this umbrella.
Misinformation is the foremost reason why well-meaning parents (mis-) treat their children with alternative medicine. The results can be disastrous. Misinformation can kill!
A team of Swiss and UK chiropractors just published a survey to determine which management options their colleagues would choose in response to several clinical case scenarios. In order to avoid the accusations of citing out of context, or misreporting the findings in other ways, the wording of the following post is close to the original text of the article.
The clinical scenarios refer to treatments which appear not to be successful, not indicated, possibly harmful or where a patient might be suffering from a treatment-induced complication:
Scenario 1. A patient with non-specific low back pain has not improved at all after 4–6 treatments.
Scenario 2. A patient, who has a simple neck problem with no previous long-term problems, has now improved at least 80% and stayed at this level for a couple of weeks.
Scenario 3. A patient returns from the last treatment with a new distal pain (e.g. sciatica when treated only for localized LBP, or brachialgia when treated only for local neck pain).
Scenario 4. An elderly woman complains about immediate chest pain on inspiration after manual treatment directed to her thoracic spine.
It is worth noting that scenario 4 is the most dramatic but it is by far not the worst case scenario; this would have been the case of a patient who develops signs of a stroke after neck manipulation. It is telling, I think, that this possibility has been excluded in the survey.
The following 9 management options were provided:
• I would re-evaluate the patient with a view to establishing a better diagnosis
• I would send the patient for diagnostic imaging
• I would change my treatment approach and use another technique
• I would send the patient for a second opinion to another healthcare professional but keep on monitoring their condition
• I would try a few times more
• I would encourage the patient to continue the treatment until their spine is subluxation-free
• I would stop treatment and monitor the patient regularly
• I would stop the treatment, apologise and report the event to the chiropractic reporting and learning system
• I would stop the treatment, but tell the patient that s/he is welcome to return if they feel the need
To each of these options, the chiropractors could answer by ticking: ‘never’, ‘unlikely’, ‘likely’ and ‘most likely’.
In a second part of the questionnaire the researchers assessed the chiropractors’ general attitude towards safety issues by seeking the level of agreement on a five-point scale, with the responses ‘strongly disagree’, ‘disagree’, ‘neither agree nor disagree’, ‘agree’ and ‘strongly agree’, with 23 statements relating to six different safety dimensions, as follows:
• Teamwork – helping out, relationships, respect, teamwork-emphasis
• Work pressure – rushing, overwork, staff contingent, patient numbers
• Staff training – in response to new processes, on-the-job, appropriateness of tasks
• Process and standardisation – organisation, procedures, workflow, processes
• Communication openness – ideas for improvement, alternative views, asking questions, voicing disagreement
• Patient tracking/follow-up – reminders, documentation, reports, monitoring
260 Swiss and 1258 UK chiropractors were invited to complete the questionnaire. Responses were received from 76% of the Swiss and from 31% of the UK chiropractors. The dismal response rate for UK chiropractors seems to speak volumes.
The results of this survey indicate that both Swiss and UK chiropractors tend to manage clinical scenarios where treatment appears not to be successful, not indicated, possibly harmful or where a serious complication might have occurred, by re-evaluating their care. Stopping treatment and/or incident reporting to a safety incident reporting and learning system were generally found to be unlikely courses of action. The authors believe that this unlikeliness of safety incident reporting is due to a range of recognised barriers, although Swiss and UK chiropractors are positive about local communication and openness which are important tenets for safety incident reporting. The observed positivity towards key aspects of clinic safety indicates a developing safety culture within the Swiss and UK chiropractic professions.
In this context, scenario 4 is the most dramatic and therefore the most relevant scenario -but, as noted above, not a worst case scenario. It suggested a rib fracture as a result of chiropractic manipulation, with osteoporosis as a possible risk factor. The authors state that there is a strong argument for such an incident to be reported because patient injury occurred and because reflection on the detailed circumstances of the case, shared with colleagues, might serve to minimise the risk of such an occurrence happening elsewhere. However, incident reporting was found to be an unlikely option and comments revealed that this may be due to a perceived connection of reporting with guilt and error, as has been identified with other healthcare reporting initiatives, or only warranted in extreme cases.
The survey also showed that 33% of UK and 48% of Swiss chiropractors seem to work alone. In the eyes of the authors, this is limiting opportunities for fostering a safety culture through activities such as teamwork.
The authors draw the following conclusions:
• This study prompted chiropractors to reflect on aspects of clinical risk.
• Swiss and UK chiropractors tend to manage potentially risky clinical scenarios by reevaluating their care and changing their approach
• Safety incident reporting to an online system is currently an unlikely course of action, probably due to previously recognised barriers, although Swiss and UK chiropractors are positive about local communication and openness which are important tenets for safety incident reporting.
• Barriers to the use of safety incident reporting systems need to be addressed in order to encourage wider use of the existing systems.
• A significant proportion of Swiss and UK chiropractors practice in a single-handed environment. We suggest that single-handed practitioners have most to gain from participation in a national safety incident reporting and learning system.
• Female chiropractors appear to be more risk-averse than male chiropractors.
• Positivity towards key aspects of clinic safety indicate a developing safety culture within the Swiss and UK chiropractic professions.
In my view, the findings of this survey are deeply worrying and the interpretation of the authors is not far from an attempt to ‘white-wash’ the results. Like with most investigations of this nature, the results are wide open to selection bias; particularly the dismal UK response rate begs many questions. In all likelihood, reality is much worse than implied by the results of this investigation. And these results clearly show that, even with a fairly dramatic safety incident, chiropractors fail to respond adequately. There is no doubt in my mind: chiropractors put patients at risk.
Ignaz von Peczely (1826-1911), a Hungarian physician, got the idea for iridology (or iris-diagnosis) more than a century ago, after seeing streaks in the iris of a man he was treating for a broken leg, and similar phenomena the iris of an owl whose leg von Peczely had broken many years before. He subsequently became convinced that his method was able to distinguish between healthy organs and those that are overactive, inflamed, or distressed. Iridology became internationally known when US chiropractors began adopting this method in their clinical practice. In the United States, most insurance programs do not cover iridology but, in some European countries, they often do. In Germany, for instance, 80% of the Heilpraktiker (non-medically qualified health practitioners) practice iridology.
Iridologists claim to be able to diagnose the health status of an individual, medical conditions or predispositions to disease through abnormalities of pigmentation in the iris. The popularity of iridology renders it necessary to ask whether this method is valid.
The aim of my systematically review from 1999 was to critically evaluate all available, reliable tests of iridology as a diagnostic tool. Four case control studies were included; these are investigations where iridologists are asked to tell by looking at the iris of individuals whether that person does or does not have a certain condition. The majority of these studies suggested that iridology is not a valid diagnostic method. Back then, I concluded that “the validity of iridology as a diagnostic tool is not supported by scientific evaluations. Patients and therapists should be discouraged from using this method.”
Since the publication of my article, several further studies have emerged:
One German team conducted a study investigating the applicability of iridology as a screening method for colorectal cancer. Digital color slides were obtained from both eyes of 29 patients with histologically diagnosed colorectal cancer and from 29 age- and gender-matched healthy control subjects. The slides were presented in random order to acknowledged iridologists without knowledge of the number of patients in the two categories. The iridologists correctly detected 51.7% and 53.4%, respectively, of the patients’ slides; therefore, the likelihood was statistically no better than chance. Sensitivity was, respectively, 58.6% and 55.2%, and specificity was 44.8% and 51.7%. The authors’ conclusion was blunt: “Iridology had no validity as a diagnostic tool for detecting colorectal cancer in this study.”
A study from South Africa aimed to determine the efficacy of iridology in the identification of moderate to profound sensorineural hearing loss in adolescents. A controlled trial was conducted with an iridologist, blind to the actual hearing status of participants, analysing the irises of participants with and without hearing loss. Fifty hearing impaired and fifty normal hearing subjects, between the ages of 15 and 19 years, controlled for gender, participated in the study. An experienced iridologist analysed the randomised set of participants’ irises. A 70% correct identification of hearing status was obtained with a false negative rate of 41% compared to a 19% false positive rate. The respective sensitivity and specificity rates therefore were 59% and 81%. The authors of this investigation concluded that “iridological analysis of hearing status indicated a statistically significant relationship to actual hearing status (P < 0.05). Although statistically significant sensitivity and specificity rates for identifying hearing loss by iridology were not comparable to those of traditional audiological screening procedures.”
A further German study investigated the value of iridology as a diagnostic tool in detecting some common cancers. One hundred ten subjects were enrolled; 68 subjects had histologically proven cancers of the breast, ovary, uterus, prostate, or colorectum, and 42 were cancer-free controls. All subjects were examined by an experienced practitioner of iridology, who was unaware of their medical details. He was allowed to suggest up to five diagnoses for each subject and his results were then compared with each subject’s medical diagnosis to determine the accuracy of iridology in detecting malignancy. Iridology identified the correct diagnosis in only 3 cases (sensitivity, 0.04). The authors concluded that “iridology was of no value in diagnosing the cancers investigated in this study.”
Based on these results it is impossible, I think, to claim that iridology is a valid or useful diagnostic tool. As there is no anatomical or physiological basis for its assumptions, iridology is not biologically plausible. Furthermore, the available clinical evidence does not support its validity as a diagnostic tool. In other words, iridology is bogus. This statement is in sharp contract to the information consumers receive about the method on uncounted websites, books, articles, etc. One website picked at random provides the following information:
The iris reveals changing conditions of every part and organ of the body. Every organ and part of the body is represented in the iris in a well defined area. In addition, through various marks, signs, and discoloration in the iris, nature reveals inherited weaknesses and strengths.
By means of this art / science, an iridologist (one who studies the coloration and fiber structure of the eye) can tell an individual his/her inherited and acquired tendencies towards health and disease, his current condition in general, and the state of every organ in particular.
Iridology cannot detect a specific disease, but, can tell an individual if they have over or under activity in specific areas of the body. For example, an under-active pancreas might indicate a diabetic condition.
Another source claims:
The underlying platform of iridology is that that eyes act as a ‘window’ to a person’s health & well being. This ‘window’ enables the practitioner to see whether areas or organs within the body are healthy, inflamed or ‘over active’. It also enables them to assess a person’s past/ possible future health problems & consider if the patient has a susceptibility to certain diseases. It is important to understand that iridology is simply a method of diagnosis & analysis.
You may well think that none of this really matters. Who cares whether iridology is bogus or not! I would argue that it does matter. Bogus methods cost money that could be better spent elsewhere. More importantly, false positive and false negative diagnoses generated by bogus diagnostic methods can put lives at risk.
But there is a more general and perhaps more crucial point here: alternative medicine is an area where people far too easily get away with ignoring the published evidence and scientific consensus. In the last two decades, I have seen many alternative modalities getting scientifically dis-proven; not in a single such instance can I remember that the corresponding alternative practitioners and their professional organisations took any notice of this fact, and not once did I notice that their practice had changed.
If research is systematically ignored, it becomes a useless appendix. More importantly, progress is then stifled to the detriment of all our best interests.
Indian homeopaths recently published a clinical trial aimed at evaluating homeopathic treatment in the management of diabetic polyneuropathy. The condition affects many diabetic patients; its symptoms include tingling, numbness, burning sensation in the feet and pain, particularly at night. The best treatment consists of adequate metabolic control of the underlying diabetes. The pain can be severe often does not respond adequately to conventional pain-killers. It is therefore obvious that any new, effective treatment would be more than welcome.
The new trial is a prospective observational study which was carried out from October 2005 to September 2009 by the Indian Central Council for Research in Homeopathy at its five Institutes. Patients suffering diabetic polyneuropathy (DPN) were screened and enrolled in the study, if they fulfilled the inclusion and exclusion criteria. The Diabetic Distal Symmetric Polyneuropathy Symptom Score (DDSPSS), developed by the Council, served as the primary outcome measure.
A total of 15 homeopathic medicines were identified after repertorizing the nosological symptoms and signs of the disease. The appropriate constitutional medicine was selected and prescribed in the 30, 200 and 1 M potencies on an individualized basis. Patients were followed up for 12 months.
Of 336 diabetics enrolled in the study, 247 patients who attended at least three follow-up appointments and baseline nerve conduction studies were included in the analysis. A statistically significant improvement in DDSPSS total score was found at 12 months. Most objective measures did not show significant improvements. Lycopodium clavatum (n = 132), Phosphorus (n = 27) and Sulphur (n = 26) were the most frequently prescribed homeopathic remedies.
From these results, the authors concluded that: “homeopathic medicines may be effective in managing the symptoms of DPN patients.”
Does this study tell us anything worth knowing? The short answer to this question, I am afraid, is NO.
Its weaknesses are all too obvious:
1) There was no control group.
2) Patients who did not come back to the follow-up appointments – presumably because they were not satisfied – were excluded from the analyses. The average benefit reported is thus likely to be a cherry-picked false positive result.
3) The primary outcome measure was not validated.
4) The observed positive effect on subjective symptoms could be due to several factors which are entirely unrelated to the homeopathic treatments’ e.g. better metabolic control, regression towards the mean, or social desirability.
Anyone who had seen the protocol of this study would have predicted the result; I see no way that such a study does not generate an apparently positive outcome. In other words, conducting the investigation was superfluous, which means that the patients’ participation was in vain; and this, in turn, means that the trial was arguably unethical.
This might sound a bit harsh, but I am entirely serious: deeply flawed research should not happen. It is a waste of scarce resources and patients’ tolerance; crucially, it has a powerful potential to mislead us and to set back our efforts to improve health care. All of this is unethical.
The problem of research which is so poor that it crosses the line into being unethical is, of course, not confined to homeopathy. In my view, it is an important issue in much of alternative medicine and quite possibly in conventional medicine as well. Over the years, several mechanisms have been put in place to prevent or at least minimize the problem, for instance, ethic committees and peer-review. The present study shows, I think, that these mechanisms are fragile and that, sometimes, they fail altogether.
In their article, the authors of the new homeopathic study suggest that more investigations of homeopathy for diabetic polyneuropathy should be done. However, I suggest almost precisely the opposite: unethical research of this nature should be prevented, and the existing mechanisms to achieve this aim must be strengthened.
Acupuncture has remained one of the most controversial topics in the area of alternative medicine. Is it plausible? Is it safe? Is it effective? The arguments have been raging for decades and are by no means settled yet. The June issue of Anesth. Analg. is partly dedicated to this debate; the editor has invited two teams of experts to put forward their contrasting views.
The team of experts arguing in support of acupuncture conclude as follows: “clinical trials support the efficacy of acupuncture in reducing post-operative nausea and vomiting and postoperative pain; however, evidence supporting acupuncture as a treatment for chronic pain conditions is mixed. It should be noted that acupuncture trials in chronic pain have concluded that acupuncture treatment is often superior to standard of care or wait list controls and that acupuncture has minimal side effects and is cost effective. Brain imaging studies have demonstrated that there are different neural correlates between verum and sham acupuncture stimulation. Additionally, all clinical trials and many research studies have assumed that the acupuncture effect is equal to the “needle” effect, failing to recognize that factors in addition to specific effects of needling are also important contributors to the therapeutic effect of acupuncture in the setting of chronic pain.
Last, acupuncture is an ancient medical intervention first developed in an era when there were no laboratory tests, technology, or science of anatomy. The reason that the practice of acupuncture has survived for thousands of years is because it has evolved over time, with changes ranging from the number of acupuncture points to the practice techniques. Instead of criticizing this ancient art with arguments culled from modern medicine and science, physicians and scientists should try to integrate current knowledge into this ancient, yet ever-evolving practice so it may be used to treat conditions for which pharmaceutical interventions are ineffective and/or potentially dangerous. Over the last decade, there has been a growing green movement and eco-sustainability trend as well as an increased awareness that the same medication may not be effective in treating every patient with the same biomedical diagnosis. This “new age-integrative medicine” in Western culture promotes a patient-oriented medical practice that complements the ancient Chinese theory behind acupuncture practice. Overall, acupuncture practice should not be seen as a placebo intervention or merely a needle therapy, but a medical option that not only treats disorders but also fosters a greater awareness of how harmonic interactions between self, family, work, and environment play a role in promoting health and restoring order”.
The two experts arguing against the usefulness of acupuncture draw the following conclusions: “It is clear from meta-analyses that results of acupuncture trials are variable and inconsistent, even for single conditions. After thousands of trials of acupuncture and hundreds of systematic reviews,arguments continue unabated. In 2011, Pain published an editorial that summed up the present situation well.
“Is there really any need for more studies? Ernst et al. point out that the positive studies conclude that acupuncture relieves pain in some conditions but not in other very similar conditions. What would you think if a new pain pill was shown to relieve musculoskeletal pain in the arms but not in the legs? The most parsimonious explanation is that the positive studies are false positives. In his seminal article on why most published research findings are false, Ioannidis points out that when a popular but ineffective treatment is studied, false positive results are common for multiple reason, including bias and low prior probability.”
Since it has proved impossible to find consistent evidence after more than 3000 trials, it is time to give up. It seems very unlikely that the money that it would cost to do another 3000 trials would be well-spent.
A small excess of positive results after thousands of trials is most consistent with an inactive intervention. The small excess is predicted by poor study design and publication bias. Furthermore, Simmons et al. demonstrated that exploitation of “undisclosed flexibility in data collection and analysis” can produce statistically positive results even from a completely nonexistent effect. They say this is “… not driven by a willingness to deceive but by the self-serving interpretation of ambiguity, which enables us to convince ourselves that whichever decisions produced the most publishable outcome must have also been the most appropriate.”
With acupuncture, in particular, there is documented profound bias among proponents. Existing studies are also contaminated by variables other than acupuncture, such as the frequent inclusion of “electroacupuncture” which is essentially transdermal electrical nerve stimulation masquerading as acupuncture.
The best controlled studies show a clear pattern, with acupuncture the outcome does not depend on needle location or even needle insertion. Since these variables are those that define acupuncture, the only sensible conclusion is that acupuncture does not work. Everything else is the expected noise of clinical trials, and this noise seems particularly high with acupuncture research. The most parsimonious conclusion is that with acupuncture there is no signal, only noise.
The interests of medicine would be best-served if we emulated the Chinese Emperor Dao Guang and issued an edict stating that acupuncture and moxibustion should no longer be used in clinical practice.
No doubt acupuncture will continue to exist on the “High Streets” where they can be tolerated as a voluntary self-imposed tax on the gullible (as long as they do not make unjustified claims).”
The readers of this blog will no doubt make up their own mind as to which arguments are stronger, more logical, more convincing, and based on more reliable evidence. I recommend reading the full articles and studying the references.
Personally, I have no hesitation in agreeing with the second, more sceptical view, and I have to admit finding the pro-acupuncture arguments weak as well as full of clichés, fallacies and errors.
I look forward to a lively discussion.
Where I live, some of the old-fashioned, privately-owned shops that used to dominate our high streets have survived the onslaught of the supermarkets. Our bakery is such a quaint remnant from the past. Surprisingly, it also is more holistic and more therapeutic than any alternative health centre I have come across.
The first thing that strikes anyone who enters the premises is the irresistible smell. Customers’ well being hits the ceiling, and the local aromatherapists are in danger of going out of business. The intense stimulation of the customers’ olfactory system relaxes their mind and puts them into a meditative state as they patiently wait to be served. Everyone in the queue has a little word with the baker’s wife, and progress is therefore slow – but we don’t mind: the chat is holistic counselling at its best, and our slow movements towards the counter are healthier than tai chi.
“You are looking well today,” says the baker’s wife, thereby gently arousing me from my aroma-induced meditation and indicating that she is about to focus her shaman healing-energy on me. Her diagnosis is spot on; the alternative therapies I enjoyed while waiting have re-balanced my chakras and got my qi flowing nicely – no wonder I am looking well!
The whole-wheat scones are finely balanced and nutritious; so I order three—one for the walk home and two for tea later. Prices have gone up a bit but, as with all holistic therapies, the more you pay, the more it’s worth. “Here you are,” she says, handing me her dietary delights. As I pay, our hands touch ever so briefly, just long enough for me to experience the instant transfer of healing energy that is so characteristic of Therapeutic Touch.
“Take care now, and God bless”, she says. As I walk out of her aura, I contemplate her words full of empathetic spiritual guidance and ancient wisdom. “That was expensive”, my wife mutters back home. I beg to differ: not only did I get the most wholesome food for my physical body, but I received holistic and patient-centred aromatherapy, counselling, meditation, tai chi and energy healing for my emotional, psychological and spiritual needs.
If only our Health Secretary knew about this traditional, yet integrated and therefore cutting-edge approach to cost-effective health and holistic well-being. We could all have it for free, and it might even save the NHS from its current crisis!
Neck pain is a common problem which is often far from easy to treat. Numerous therapies are being promoted but few are supported by good evidence. Could yoga be the solution?
The aim of a brand-new RCT was to evaluate the effectiveness of Iyengar yoga for chronic non-specific neck pain. Patients were randomly assigned to either yoga or exercise. The yoga group attended a 9-week yoga course, while the exercise group received a self-care manual on home-based exercises for neck pain. The primary outcome measure was neck pain. Secondary outcome measures included functional disability, pain at motion, health-related quality of life, cervical range of motion, proprioceptive acuity, and pressure pain threshold. Fifty-one patients participated in the study: yoga (n = 25), exercise (n = 26). At the end of the treatment phase, patients in the yoga group reported significantly less neck pain compared as well as less disability and better mental quality of life compared with the exercise group. Range of motion and proprioceptive acuity were improved and the pressure pain threshold was elevated in the yoga group.
The authors draw the following conclusion: “Yoga was more effective in relieving chronic nonspecific neck pain than a home-based exercise program. Yoga reduced neck pain intensity and disability and improved health-related quality of life. Moreover, yoga seems to influence the functional status of neck muscles, as indicated by improvement of physiological measures of neck pain.”
I’d love to agree with the authors and would be more than delighted, if an effective treatment for neck pain had been identified. Yoga is fairly safe and inexpensive; it promotes a generally healthy life-style, and is attractive to many patients; it has thus the potential to help thousands of suffering individuals. However, I fear that things might not be quite as rosy as the authors of this trial seem to believe.
The principle of an RCT essentially is that two groups of patients receive two different therapies and that any difference in outcome after the treatment phase is attributable to the therapy in question. Unfortunately, this is not the case here. One does not need to be an expert in critical thinking to realise that, in the present study, the positive outcome might be unrelated to yoga. For instance, it could be that the unsupervised home exercises were carried out wrongly and thus made the neck pain worse. In this case, the difference between the two treatment groups might not have been caused by yoga at all. A second possibility is that the yoga-group benefited not from the yoga itself but from the attention given to these patients which the exercise-group did not have. A third explanation could be that the yoga teachers were very kind to their patients, and that the patients returned their kindness by pretending to have less symptoms or exaggerating their improvements. In my view the most likely cause of the results seen in this study is a complex mixture of all the options just mentioned.
This study thus teaches us two valuable lessons: 1) whenever possible, RCTs should be designed such that a clear attribution of cause and effect is possible, once the results are on the table; 2) if cause and effect cannot be clearly defined, it is unwise to draw conclusions that are definite and have the potential to mislead the public.
A stroke is a condition where brain cells get irreversibly damaged either by a haemorrhage in the brain or by a blood clot cutting off oxygen supply. This process leaves most patients with neurological deficits such as difficulties in moving, speaking, concentrating etc. As other parts of the brain learn to take over, these problems can partly or completely resolve themselves over time, but many patients are left with permanent handicaps. Stroke-rehabilitation can minimise these problems, and there is a long-standing debate as to which measures are most effective. Acupuncture has been discussed as a method to improve the results of stroke-rehabilitation, but the evidence is hotly disputed. This is why a new study in this area is an important contribution to our existing knowledge.
The aim of this randomised trial was to test the effectiveness of acupuncture in promoting the recovery of patients with ischaemic stroke and to determine whether the outcomes of combined physiotherapy and acupuncture are superior to those with physiotherapy alone. The Chinese investigators recruited 120 patients who received one of three daily treatments: 1) acupuncture, 2) physiotherapy, 3) physiotherapy combined with acupuncture. Motor function in the limbs was measured with the Fugl-Meyer assessment (FMA); the modified Barthel index (MBI) was used to rate activities of daily living; both of these measures are validated and well-established. All evaluations were performed by assessors blinded to treatment allocation.
At baseline, FMA and MBI scores did not significantly differ among the treatment groups. Compared with baseline, on day 28 of therapy, the mean FMA scores of the physiotherapy, acupuncture, and combined treatment groups had increased by 65.6%, 57.7%, and 67.2%, respectively; on day 56, FMA scores had increased by 88.1%, 64.5%, and 88.6%, respectively. The respective MBI scores in the three groups had increased by 85.2%, 60.4%, and 63.4% at day 28 and by 108.0%, 71.2%, and 86.2% at day 56, respectively. However, FMA scores did not significantly differ between the three treatment groups on the 28th day. By the day 56, the FMA and MBI scores of the physiotherapy group were 46.1% and 33.2% greater, respectively, than those in the acupuncture group. No significant differences were seen between the combined treatment group and the other groups. The FMA subscores for the upper extremities did not show significant improvements in any group on day 56.
The authors draw the following conclusion: “Acupuncture is less effective for the outcome measures studied than is physiotherapy. Moreover, the therapeutic effect of combining acupuncture with physiotherapy was not superior to that of physiotherapy alone. A larger-scale clinical trial is necessary to confirm these finding.”
Our own study arrived at similarly disappointing conclusions: “Acupuncture is not superior to sham treatment for recovery in activities of daily living and health-related quality of life after stroke, although there may be a limited effect on leg function in more severely affected patients“. Our review of all 10 sham-controlled RCTs in this area is also in line with the results of this new study: “Our meta-analyses of data from rigorous randomized sham-controlled trials did not show a positive effect of acupuncture as a treatment for functional recovery after stroke”
I am quite sure that some acupuncture-enthusiasts will dispute this evidence. They might argue that I am too critical, the trials were not done optimally, that acupuncturists have seen plenty of good results in their clinical practice, that acupuncture is a complex intervention that does not fit into the straight jacket of an RCT, that this or that “prestigious” organisation recommends acupuncture for stroke patients, that it would be wrong not to give acupuncture a try etc. etc. I would counter that the reliable evidence available to date is sufficiently conclusive to stop claiming that acupuncture is effective and thus give false hope to severely suffering, vulnerable patients. Moreover, I would advocate using the sparse available resources to help stroke victims with treatments that demonstrably work.
One of the best-selling supplements in the UK as well as several other countries is evening primrose oil (EPO). It is available via all sorts of outlets (even respectable pharmacies – or is that supposedly respectable?), and is being promoted for a wide range of conditions, including eczema. The NIH website is optimistic about its efficacy: “Evening primrose oil may have modest benefits for eczema.” Our brand-new Cochrane review was aimed at critically assessing the effects of oral EPO or borage oil (BO) on the symptoms of atopic eczema, and it casts considerable doubt on this somewhat uncritical view.
Here is what we did: We searched six databases as well as online trials registers and checked the bibliographies of included studies for further references to relevant trials. We corresponded with trial investigators and pharmaceutical companies to identify unpublished and ongoing trials. We also performed a separate search for adverse effects. All RCTs investigating oral intake of EPO or BO for eczema were included.
Two experts independently applied eligibility criteria, assessed risk of bias, and extracted data. We pooled dichotomous outcomes using risk ratios (RR), and continuous outcomes using the mean difference (MD). Where possible, we pooled study results using random-effects meta-analysis and tested statistical heterogeneity.
And here is what we found: 27 studies with a total of 1596 participants met our inclusion criteria: 19 studies tested EPO, and 8 studies assessed BO. A meta-analysis of results from 7 studies showed that EPO failed to improve global eczema symptoms as reported by participants and doctors. Treatment with BO also failed to improve global eczema symptoms. 67% of the studies had a low risk of bias for random sequence generation; 44%, for allocation concealment; 59%, for blinding; and 37%, for other biases.
Our conclusions were clear: Oral borage oil and evening primrose oil lack effect on eczema; improvement was similar to respective placebos used in trials. Oral BO and EPO are not effective treatments for eczema.
The very wide-spread notion that EPO is effective for eczema and a range of other conditions was originally promoted by the researcher turned entrepreneur, D F Horrobin, who claimed that several human diseases, including eczema, were due to a lack of fatty acid precursors and could thus be effectively treated with EPO. In the 1980s, Horrobin began to sell EPO supplements without having conclusively demonstrated their safety and efficacy; this led to confiscations and felony indictments in the US. As chief executive of Scotia Pharmaceuticals, Horrobin obtained licences for several EPO-preparations which later were withdrawn for lack of efficacy. Charges of mismanagement and fraud led to Horrobin being ousted as CEO by the board of the company. Later, Horrobin published a positive meta-analysis of EPO for eczema where he excluded the negative results of the largest published trial, but included results of 7 of his own unpublished studies. When scientists asked to examine the data, Horrobin’s legal team convinced the journal to refuse the request.
The evidence for EPO is negative not just for eczema. To the best of my knowledge, there is not a single disease or symptom for which it demonstrably works. Our own review of the data concluded ” EPO has not been established as an effective treatment for any condition”
Our new Cochrane review might help to put this long saga to rest. In my view, it is a fascinating tale of a scientist being blinded by creed and ambition. The results of such errors can be dramatic. Horrobin misled all of us: patients, health care professionals, scientists, regulators, decision makers, businessmen. This caused unnecessary expense and set back research efforts in a multitude of areas. I find the tale also fascinating from other perspectives; for instance, it begs the question why so many ‘respectable’ manufacturers and retailers are still allowed to make money on EPO. Is it not time to debunk the EPO-myth and say it as clearly as possible: EPO helps only those who financially profit from misleading the public?
In the UK, we have about 150000 practitioners of Spiritual Healing (SH). They treat all sorts of conditions claiming to channel ‘healing energy’ into the patient’s body which enables him/her to heal itself. The plausibility of SH is very close to zero and, despite numerous trials, its clinical effectiveness remains unproven. A new and, in my view, remarkable study of SH was aimed at investigating whether “SH could support patients with breast cancer”.
Spiritual Healing was provided by 4 healers registered with the National Federation of Spiritual Healers. Twelve patients with breast cancer undergoing long-term hormone treatment and experiencing its adverse-effects as onerous, self-referred themselves and were given ten weekly sessions of approximately 40 minutes each. Data collected included participant’s daily records, direct observations noted by the healers, the researcher’s field diary and a one-to-one semi-structured interview.
The alleged positive effects of SH included alleviation of the physical adverse-effects of their treatment, increased energy levels, enhanced well-being, emotional relaxation, and re-engagement with pre-cancer activities. Although one participant admitted considering a drug holiday prior to joining the study, none of the participants felt tempted to stop their hormonal treatments while receiving SH. The authors concluded that “these qualitative findings indicate that SH has the potential to support patients with breast cancer in the maintenance of their long-term orthodox treatments. Further research is needed to test SH as a cost-effective complementary therapy, for those undergoing long-term cancer treatments.”
As I already mentioned, I think this study is remarkable. Having done quite a bit of research into SH myself, I know how bizarre this intervention truly is. A typical treatment session might be with the patient lying on a couch in a relaxing atmosphere, often accompanied by soothing background music; the healer would talk gently but very little to enable the patient to be comfortable and relax; the SH itself might be performed by the healer moving his/her hands at a distance over the body of the patient; the healer would explain that this may cause the sensation of warmth as the ‘healing energy’ enters the body. Altogether, the experience is exotic to say the least.
It is therefore not surprising that SH generates a host of non-specific effects, including the most enormous placebo-response I have ever witnessed in any clinical trial which I have been involved in. I am mentioning this, of course, to point out that the above-noted effects are entirely compatible with those of placebo. As the study has no control group, there is no way of knowing what the effects of SH per se might have been. The fact that patients self-referred themselves to SH would only amplify this placebo-response. In the discussion of the paper, we find a further interesting pointer regarding patients’ prior experience with conventional health care professionals: “participants felt they were left to cope alone as their side-effects were trivialized.” This seems to suggest that the group of patients were indeed highly selected and all had suffered badly from previous experiences of poorly administered heath care. Thus their expectations of SH were probably high which, in turn, would exaggerate the placebo-response even further.
All of these phenomena might well be fascinating and could provide ample material for relevant research. They deserve to be analysed carefully and discussed openly and critically. Unfortunately none of this happened in the present study. The authors do not even consider the possibility that the observed effects could be related to anything else than their SH. Their stated aim to investigate whether SH supports cancer patients is not even approached; the authors simply assume a cause-effect relationship without demonstrating one. I find this is more than just a missed opportunity; in my view, it is pseudo-science. And this is the reason why I find this study remarkable.