The German Association of Homeopaths (Deutscher Zentralverein Homoeopathischer Aerzte) just issued a press-release explaining that they have recently determined that homeopathy works.
Well, aren’t we relieved!
Otherwise, we would have had to assume they are all quacks.
Their statement is based on what they consider a thorough analysis of the published evidence. As the whole document is about 60 pages long, I will not bother you with all the details. Instead, I will focus on what they say about systematic reviews/meta-analyses in the press-release:
Eine Betrachtung der Meta-Analysen zur Homöopathie zeigt überwiegend statistisch signifikante Ergebnisse gegenüber Placebo, die auf eine spezifische Wirksamkeit potenzierter Arzneien hinweisen. Je nach den verwendeten Selektionskriterien werden hierbei unterschiedliche Studien in die Auswertung eingeschlossen. Diese Befunde werden von den Autoren der jeweiligen Meta-Analysen zum Teil stark relativiert. Die angeführten Vorbehalte entsprechen hierbei nicht immer den üblichen wissenschaftlichen Standards.
Let me translate this for you: An assessment of the meta-analyses of homeopathy shows mostly significant results compared to placebo which indicates a specific effectiveness of potentised remedies. Depending on the selection criteria, various studies are included in the evaluation. These results are relativized by the authors of the respective meta-analyses. The listed caveats do not always reflect the usual scientific standards.
You think my English has deteriorated or my brain gone soft? No, it’s their German! It makes almost no sense at all.
Therefore, I am afraid, we need to briefly go into the hefty document after all. Their chapter on meta-analyses concludes as follows: Insgesamt ergibt sich hinsichtlich der bis dato publizierten maßgeblichen Meta-Analysen zur Homöopathie, dass in vier von fünf Fällen tendenziell eine spezifische Wirksamkeit potenzierter Arzneimittel über Placebo hinaus erkennbar ist. That makes (linguistically) a little more sense: Overall, it emerges that the currently published decisive meta-analyses show, in 4 of 5 cases, that a specific effectiveness of potentised remedies is noticeable.
In other words, it is now proven, homeopathic remedies work beyond placebo!!!
But how can this be?
Did the NHMRC not just do a similar analysis concluding that “the evidence from research in humans does not show that homeopathy is effective for treating the range of health conditions considered… homeopathy should not be used to treat health conditions that are chronic, serious, or could become serious. People who choose homeopathy may put their health at risk if they reject or delay treatments for which there is good evidence for safety and effectiveness. People who are considering whether to use homeopathy should first get advice from a registered health practitioner. Those who use homeopathy should tell their health practitioner and should keep taking any prescribed treatments.
Obviously ‘down under’ they don’t know how to evaluate published data!
Or could it be that the Germans are mistaken? Or are they perhaps joking?
Let’s have a look!
The Germans selected (cherry-picked) 5 meta-analyses which they believed to be ‘decisive’, while the Australian panel of independent experts (funded by government) assessed 57 meta-analyses and systematic reviews (all they found via extensive literature searches).
But the German evaluation was done by homeopaths (and financed by a homeopathic lobby group)! And they understand homeopathy best and would not have a bias or conflict of interest, would they?[FOR A MORE COMPLETE ANALYSIS, SEE HERE (in German)]
Polycystic ovarian syndrome (PCOS) is a common condition characterised by oligo-amenorrhoea, infertility and hirsutism. Conventional treatment of PCOS includes a range of oral pharmacological agents, lifestyle changes and surgical modalities. Some studies have suggested that acupuncture might be helpful but the evidence is often flawed and the results are mixed. What is needed in such a situation is, of course, a systematic review.
The aim of this new Cochrane review was to assess the effectiveness and safety of acupuncture treatment of oligo/anovulatory women with polycystic ovarian syndrome (PCOS). The authors identified relevant studies from databases including the Cochrane Central Register of Controlled Trials (CENTRAL), Ovid MEDLINE, EMBASE, PsycINFO, CNKI and trial registries. The data are current to 19 October 2015.
They included randomised controlled trials (RCTs) that studied the efficacy of acupuncture treatment for oligo/anovulatory women with PCOS. We excluded quasi- or pseudo-RCTs. Primary outcomes were live birth and ovulation (primary outcomes), and secondary outcomes were clinical pregnancy, restoration of menstruation, multiple pregnancy, miscarriage and adverse events. We assessed the quality of the evidence using GRADE methods.
Two review authors independently selected the studies, extracted data and assessed risk of bias. They calculated Mantel-Haenszel odds ratios (ORs) and mean difference (MD) and 95% confidence intervals (CIs).
Five RCTs with 413 women were included. They compared true acupuncture versus sham acupuncture (two RCTs), true acupuncture versus relaxation (one RCT), true acupuncture versus clomiphene (one RCT) and electroacupuncture versus physical exercise (one RCT). Four of the studies were at high risk of bias in at least one domain. No study reported live birth rate. Two studies reported clinical pregnancy and found no evidence of a difference between true acupuncture and sham acupuncture (OR 2.72, 95% CI 0.69 to 10.77, two RCTs, 191 women, very low quality evidence). Three studies reported ovulation. One RCT reported number of women who had three ovulations during three months of treatment but not ovulation rate. One RCT found no evidence of a difference in mean ovulation rate between true and sham acupuncture (MD -0.03, 95% CI -0.14 to 0.08, one RCT, 84 women, very low quality evidence). However, one other RCT reported very low quality evidence to suggest that true acupuncture might be associated with higher ovulation frequency than relaxation (MD 0.35, 95% CI 0.14 to 0.56, one RCT, 28 women). Two studies reported menstrual frequency. One RCT reported true acupuncture reduced days between menstruation more than sham acupuncture (MD 220.35, 95% CI 252.85 to 187.85, 146 women). One RCT reported electroacupuncture increased menstrual frequency more than no intervention (0.37, 95% CI 0.21 to 0.53, 31 women). There was no evidence of a difference between the groups in adverse events. Evidence was very low quality with very wide CIs and very low event rates. Overall evidence was low or very low quality. The main limitations were failure to report important clinical outcomes and very serious imprecision.
The authors concluded that, thus far, only a limited number of RCTs have been reported. At present, there is insufficient evidence to support the use of acupuncture for treatment of ovulation disorders in women with PCOS.
This is, in my view, a rigorous assessment of the evidence leading to a clear conclusion. Foremost, I applaud the authors from the Faculty of Science, University of Technology Sydney for using such clear language. Such clarity seems to be getting a rare event in reviews of alternative medicine. To demonstrated this point, here are the most recent 5 systematic reviews which came up on my screen when I searched today Medline for ‘complementary alternative medicine, systematic review’.
The combination of TGP and LEF in treatment of RA presented the characteristics of notably decreasing the levels of laboratory indexes and higher safety in terms of liver function. However, this conclusion should be further investigated based on a larger sample size.
CHM as an adjunctive therapy is associated with a decreased risk of in-hospital mortality compared with WT in patients with AKI. Further studies with high quality and large sample size are needed to verify our conclusions.
As an important supplementary treatment, TCM may provide benefits in repair of injured spinal cord. With a general consensus that future clinical approaches will be diversified and a combination of multiple strategies, TCM is likely to attract greater attention in SCI treatment.
I think the phenomenon is fairly obvious: authors of such papers are far too often not able or willing to express the bottom line of their work openly. As systematic reviews are supposed to be the ultimate type of evidence, this trend is very worrying, I think. In my view, such conclusions merely display the bias of the authors. If the evidence is not convincingly positive (which it very rarely is), authors have an ethical obligation to clearly say so.
If they don’t do it, journal editors have the duty to correct the error. If neither of these actions happen, funding agencies should make sure that such teams get no further research money until they can demonstrate that they have learnt the lesson.
This may sound a bit drastic but I think such steps would be both necessary and urgent. The problem is now extremely common, and if we do not quickly implement some effective preventative measures, our scientific literature will become contaminated to the point of becoming useless. This surely would be a disaster that affects us all.
There can, of course, be several reasons for the evidence being not positive:
- there can be a paucity of data
- the results might be contradictory
- the trials might be open to bias
- some of the primary data might look suspicious
In all of these cases, the evidence would be not convincingly positive, and it would be wrong and unhelpful not to be frank about it. Beating about the bush, like so many authors nowadays do, is misleading, unhelpful, unethical and borderline fraudulent. Therefore it constitutes a disservice to everyone concerned.
A recent comment to a blog-post about alternative treatments for cancer inspired me to ponder a bit. I think it is noteworthy because it exemplifies so many of the comments I hear in the realm of alternative medicine on an almost daily basis. Here is the comment in question:
“Yes…it appears that the medical establishment have known for years that chemotherapy a lot of the time kills patients faster than if they were untreated…what’s more, it worsens a person’s quality of life in which many die directly of the severe effects on the endocrine, immune system and more…cancers often return in more aggressive forms metastasising with an increased risk of apoptosis. In other words it makes things worse whereas there are many natural remedies which not only do no harm but accumulating evidence points to their capacity to fight cancer…some of it is bullshit whilst some holds some truth!! So turning away from toxic treatments that kill towards natural approaches that are showing more hope with the backing of trials kinda reverses the whole argument of this article.”
The comment first annoyed me a bit, of course, but later it made me think and consider the differences between conspiracy theories, assumptions, opinions, evidence and scientific facts. Let’s tackle each of these in turn.
A conspiracy theory is an explanatory or speculative theory suggesting that two or more persons, or an organization, have conspired to cause or cover up, through secret planning and deliberate action, an event or situation typically regarded as illegal or harmful.
Part of the above comment bears some of the hallmarks of a conspiracy theory: “…the medical establishment have known for years that chemotherapy a lot of the time kills patients faster than if they were untreated…” The assumption here is that the conventional healthcare practitioners are evil enough to knowingly do harm to their patients. Such conspiracy theories abound in the realm of alternative medicine; they include the notions that
- BIG PHARMA is out to kill us all in order to maximize their profits,
- the ‘establishment’ is suppressing any information about the benefits of alternative treatments,
- vaccinations are known to be harmful but nevertheless being forced on to our children,
- drug regulators are in the pocket of the pharmaceutical industry,
- doctors accept bribes for prescribing dangerous drugs
- etc. etc.
In a previous blog-post, I have discussed the fact that the current popularity of alternative medicine is at least partly driven by the conviction that there is a sinister plot by ‘the establishment’ that prevents people from benefitting from the wonders of alternative treatments. It is therefore hardly surprising that conspiracy theories like the above are voiced regularly on this blog and elsewhere.
An assumption is something taken for granted or accepted as true without proof.
The above comment continues stating that “…[chemotherapy] makes things worse whereas there are many natural remedies which not only do no harm but accumulating evidence points to their capacity to fight cancer…” There is not proof for these assertions, yet the author takes them for granted. If one were to look for the known facts, one would find the assumptions to be erroneous: chemotherapy has saved countless lives and there simply are no natural remedies that will cure any form of cancer. In the realm of alternative medicine, this seems to worry few, and assumptions of this or similar nature are being made every day. Sadly the plethora of assumptions or bogus claims eventually endanger public health.
The above comment continues with the opinion that “…turning away from toxic treatments that kill towards natural approaches that are showing more hope with the backing of trials kinda reverses the whole argument of this article.” In general, alternative medicine is based on opinions of this sort. On this blog, we have plenty of examples for that in the comments section. This is perhaps understandable; evidence is usually in short supply, and therefore it often is swiftly replaced with often emotionally loaded opinions. It is even fair to say that much of alternative medicine is, in truth, opinion-based healthcare.
One remarkable feature of the above comment is that it is bar of any evidence. In a previous post, I have tried to explain the nature of evidence regarding the efficacy of medical interventions:
The multifactorial nature of any clinical response requires controlling for all the factors that might determine the outcome other than the treatment per se. Ideally, we would need to create a situation or an experiment where two groups of patients are exposed to the full range of factors (e. g. placebo effects, natural history of the condition, regression towards the mean), and the only difference is that one group does receive the treatment, while the other one does not. And this is precisely the model of a controlled clinical trial.
Such studies are designed to minimise all possible sources of bias and confounding. By definition, they have a control group which means that we can, at the end of the treatment period, compare the effects of the treatment in question with those of another intervention, a placebo or no treatment at all.
Many different variations of the controlled trial exist so that the exact design can be adapted to the requirements of the particular treatment and the specific research question at hand. The over-riding principle is, however, always the same: we want to make sure that we can reliably determine whether or not the treatment was the cause of the clinical outcome.
Causality is the key in all of this; and here lies the crucial difference between clinical experience and scientific evidence. What clinician witness in their routine practice can have a myriad of causes; what scientists observe in a well-designed efficacy trial is, in all likelihood, caused by the treatment. The latter is evidence, while the former is not.
Don’t get me wrong; clinical trials are not perfect. They can have many flaws and have rightly been criticised for a myriad of inherent limitations. But it is important to realise that, despite all their short-comings, they are far superior than any other method for determining the efficacy of medical interventions.
There are lots of reasons why a trial can generate an incorrect, i.e. a false positive or a false negative result. We therefore should avoid relying on the findings of a single study. Independent replications are usually required before we can be reasonably sure.
Unfortunately, the findings of these replications do not always confirm the results of the previous study. Whenever we are faced with conflicting results, it is tempting to cherry-pick those studies which seem to confirm our prior belief – tempting but very wrong. In order to arrive at the most reliable conclusion about the efficacy of any treatment, we need to consider the totality of the reliable evidence. This goal is best achieved by conducting a systematic review.
In a systematic review, we assess the quality and quantity of the available evidence, try to synthesise the findings and arrive at an overall verdict about the efficacy of the treatment in question. Technically speaking, this process minimises selection and random biases. Systematic reviews and meta-analyses [these are systematic reviews that pool the data of individual studies] therefore constitute, according to a consensus of most experts, the best available evidence for or against the efficacy of any treatment.
Some facts related to the subject of alternative medicine have already been mentioned:
- chemotherapy prolongs survival of many cancer patients;
- no alternative therapy has achieved anything remotely similar.
The comment above that motivated me to write this somewhat long-winded post is devoid of facts. This is just one more feature that makes it so typical of the comments by proponents of alternative medicine we see with such embarrassing regularity.
My last post was about a researcher who manages to produce nothing but positive findings with the least promising alternative therapy, homeopathy. Some might think that this is an isolated case or an anomaly – but they would be wrong. I have previously published about researchers who have done very similar things with homeopathy or other unlikely therapies. Examples include:
But there are many more, and I will carry on highlighting their remarkable work. For example, the research of a German group headed by Prof Gustav Dobos, one of the most prolific investigator in alternative medicine at present.
For my evaluation, I conducted a Medline search of the last 10 of Dobos’ published articles and excluded those not assessing the effectiveness of alternative therapies such as surveys, comments, etc. Here they are with their respective conclusions and publication dates:
RCTs with different yoga styles do not differ in their odds of reaching positive conclusions. Given that most RCTs were positive, the choice of an individual yoga style can be based on personal preferences and availability.
Despite methodological drawbacks, yoga can be preliminarily considered a safe and effective intervention to reduce body mass index in overweight or obese individuals.
REVIEW OF INTEGRATIVE MEDICINE IN GYNAECOLOGICAL ONCOLOGY (2016)
…there is published, positive level I evidence for a number of CAM treatment forms.
Mindfulness- and acceptance-based interventions can be recommended as an additional treatment for patients with psychosis.
Cabbage leaf wraps are more effective for knee osteoarthritis than usual care, but not compared with diclofenac gel. Therefore, they might be recommended for patients with osteoarthritis of the knee.
This review found strong evidence for A. paniculata and ivy/primrose/thyme-based preparations and moderate evidence for P. sidoides being significantly superior to placebo in alleviating the frequency and severity of patients’ cough symptoms. Additional research, including other herbal treatments, is needed in this area.
Dietary approaches should mainly be tried to reduce macronutrients and enrich functional food components such as vitamins, flavonoids, and unsaturated fatty acids. People with Metabolic Syndrome will benefit most by combining weight loss and anti-inflammatory nutrients.
In patients with CHD, MBM programs can lessen the occurrence of cardiac events, reduce atherosclerosis, and lower systolic blood pressure, but they do not reduce mortality. They can be used as a complement to conventional rehabilitation programs.
CST was both specifically effective and safe in reducing neck pain intensity and may improve functional disability and the quality of life up to 3 months after intervention.
Study data have shown that therapy- and disease-related side effects can be reduced using the methods of integrative medicine. Reported benefits include improving patients’ wellbeing and quality of life, reducing stress, and improving patients’ mood, sleeping patterns and capacity to cope with disease.
Dobos seems to be an ‘all-rounder’ whose research tackles a wide range of alternative treatments. That is perhaps unremarkable – but what I do find remarkable is the impression that, whatever he researches, the results turn out to be pretty positive. This might imply one of two things, in my view:
- all alternative therapies are effective,
- the ‘Trustworthiness Index’ of Prof Dobos is unusual.
I let my readers chose which possibility they deem to be more likely.
Recently, I came across a good article where someone had assessed 100 websites by UK osteopaths. The findings are impressive:
57% of websites in the survey published the ‘self-healing’ claim
70% publicised the fact they offered cranial therapy;
61% made a claim to treat one or more specific ailments not related to the musculoskeletal system;
48% of practitioners also personally offered another CAM therapy;
71% of all sites surveyed located in a setting where other CAM was immediately available.
In total, 93% of the randomly selected websites checked at least one, often more, of the criteria for pseudoscientific claims. The author concluded that quackery is far from existing only on the fringe of osteopathic practice.
In a previous article, the author had stated that “there’s some (not strong) evidence that manual therapy may have some benefit in the case of lower back pain.” This evidence for the assumption that osteopathy works for back pain seems to rely heavily on one researcher: Licciardone JC. He comes from ‘The Osteopathic Research Center, University of North Texas Health Science Center, Fort Worth‘. which also is the flag-ship of research into osteopathy with plenty of funds and a worldwide reputation.
In 2005, he and his team published a systematic review/meta-analysis of RCTs which concluded that “osteopathic manipulative therapy (OMT) significantly reduces low back pain. The level of pain reduction is greater than expected from placebo effects alone and persists for at least three months. Additional research is warranted to elucidate mechanistically how OMT exerts its effects, to determine if OMT benefits are long lasting, and to assess the cost-effectiveness of OMT as a complementary treatment for low back pain.”
This is the article cited regularly to support the statement that osteopathy is an effective therapy for back pain. As the paper is now over 10 years old, we clearly need a more up-to-date systematic review. Such an assessment of clinical research into osteopathic intervention for chronic non-specific low back pain (CNSLBP) was recently published by an Australian team. A thorough search of the literature in multiple electronic databases was undertaken, and all articles were included that reported clinical trials; had adult participants; tested the effectiveness and/or efficacy of osteopathic manual therapies applied by osteopaths, and had a study condition of CNSLBP. The quality of the trials was assessed using the Cochrane criteria. Initial searches located 809 papers, 772 of which were excluded on the basis of abstract alone. The remaining 37 papers were subjected to a detailed analysis of the full text, which resulted in 35 further articles being excluded. There were thus only two studies assessing the effectiveness of manual therapies applied by osteopaths in adult patients with CNSLBP. The results of one trial suggested that the osteopathic intervention was similar in effect to a sham intervention, and the other implies equivalence of effect between osteopathic intervention, exercise and physiotherapy.
In other words, there seems to be an overt contradiction between the conclusions of Licciardone JC and those of the Australian team. Why? we may well ask. Perhaps the Osteopathic Research Center is not in the best position to be impartial? In order to check them out, I decided to have a closer look at their publications.
This team has published around 80 articles mostly in very low-impact osteopathic journals. They include several RCTs, and I decided to extract the conclusions of the last 10 papers reporting RCTs. Here they are:
RCT No 1 (2016)
Subgrouping according to baseline levels of chronic LBP intensity and back-specific functioning appears to be a simple strategy for identifying sizeable numbers of patients who achieve substantial improvement with OMT and may thereby be less likely to use more costly and invasive interventions.
RCT No 2 (2016)
The OMT regimen was associated with significant and clinically relevant measures for recovery from chronic LBP. A trial of OMT may be useful before progressing to other more costly or invasive interventions in the medical management of patients with chronic LBP.
RCT No 3 (2014)
Overall, 49 (52%) patients in the OMT group attained or maintained a clinical response at week 12 vs. 23 (25%) patients in the sham OMT group (RR, 2.04; 95% CI, 1.36-3.05). The large effect size for short-term efficacy of OMT was driven by stable responders who did not relapse.
RCT No 4 (2014)
These findings suggest that remission of psoas syndrome may be an important and previously unrecognized mechanism explaining clinical improvement in patients with chronic LBP following OMT.
RCT No 5 (2013)
The large effect size for OMT in providing substantial pain reduction in patients with chronic LBP of high severity was associated with clinically important improvement in back-specific functioning. Thus, OMT may be an attractive option in such patients before proceeding to more invasive and costly treatments.
RCT No 6 (2013)
The OMT regimen met or exceeded the Cochrane Back Review Group criterion for a medium effect size in relieving chronic low back pain. It was safe, parsimonious, and well accepted by patients.
RCT No 7 (2012)
This study found associations between IL-1β and IL-6 concentrations and the number of key osteopathic lesions and between IL-6 and LBP severity at baseline. However, only TNF-α concentration changed significantly after 12 weeks in response to OMT. These discordant findings indicate that additional research is needed to elucidate the underlying mechanisms of action of OMT in patients with nonspecific chronic LBP.
RCT No 8 (2010)
Osteopathic manipulative treatment slows or halts the deterioration of back-specific functioning during the third trimester of pregnancy.
RCT No 8 (2004)
The OMT protocol used does not appear to be efficacious in this hospital rehabilitation population.
RCT No 9 (2003)
Osteopathic manipulative treatment and sham manipulation both appear to provide some benefits when used in addition to usual care for the treatment of chronic nonspecific low back pain. It remains unclear whether the benefits of osteopathic manipulative treatment can be attributed to the manipulative techniques themselves or whether they are related to other aspects of osteopathic manipulative treatment, such as range of motion activities or time spent interacting with patients, which may represent placebo effects.
RCT No 10
Sorry, there is no 10th paper reporting an RCT.
Most of the remaining articles listed on Medline are comments and opinion papers. Crucially, it would be erroneous to assume that they conducted a total of 9 RCTs. Several of the above cited articles refer to the same RCT.
However, the most remarkable feature, in my view, is that the conclusions are almost invariably positive. Whenever I find a research team that manages to publish almost nothing but positive findings on one subject which most other experts are sceptical about, my alarm-bells start ringing.
In a previous blog, I have explained this in greater detail. Suffice to say that, according to my theory, the trustworthiness of the ‘Osteopathic Research Center’ is nothing to write home about.
What, I wonder, does that tell us about the reliability of the claim that osteopathy is effective for back pain?
The website of the Brighton and Hove News informs us that the Brighton charity Rockinghorse is paying for a Reiki healer to treat young patients at the Royal Alexandra Children’s Hospital in Kemp Town. They claim that studies suggest that Reiki can relieve symptoms of chronic and acute illness, manage stress levels and aid relaxation and sleep. Rockinghorse has provided funding for an initial three years to therapists from Active LightWorks who have already been treating patients at the Alex as volunteers since 2012. The funding will allow the therapists to double the amount of time that they are able to offer treatments from five hours a week to ten.
One of the HDU patients to receive Reiki therapy is eight-month-old Blake Mlotshwa. He suffered a serious infection when he was 18 days old which led to him having two thirds of his bowel removed. Blake is unable to absorb the food and nutrients that he needed to grow and his condition remains critical. The reiki therapists are working with his doctors and nurses to help keep him as comfortable as possible.
Ali Walters, a Reiki therapist, said: “It is wonderful to be able to give both the children and parents an opportunity to relax and unwind. So often parents tell me they are delighted that during treatment their child drops off to sleep or they see their child become more calm and comfortable. I am delighted that Rockinghorse is now funding our work so we can provide more therapists and treatments to support the critical care that is provided in HDU.”
Kamal Patel, paediatric consultant at the Alex, said: “The reiki treatment has improved sleep, fear, anxiety, distress and pain for children on our Paediatric Critical Care Unit over and above what we can achieve through modern medicine. To have such a fantastic team of people offering reiki really helps our patients get better quicker.”
Yes, we have discussed Reiki several times already on this blog. For instance, I quoted the Cochrane review aimed at evaluating the effectiveness of Reiki for treating anxiety and depression in people aged 16 and over.
Literature searches were conducted in the Cochrane Register of Controlled Trials (CENTRAL – all years), the Cochrane Depression, Anxiety and Neurosis Review Group’s Specialised Register (CCDANCTR – all years), EMBASE, (1974 to November 2014), MEDLINE (1950 to November 2014), PsycINFO (1967 to November 2014) and AMED (1985 to November 2014). Additional searches were carried out on the World Health Organization Trials Portal (ICTRP) together with ClinicalTrials.gov to identify any ongoing or unpublished studies. All searches were up to date as of 4 November 2014.
Randomised trials were considered in adults with anxiety or depression or both, with at least one arm treated with Reiki delivered by a trained Reiki practitioner. The two authors independently decided on inclusion/exclusion of studies and extracted data. A prior analysis plan had been specified.
The researchers found three studies for inclusion in the review. One recruited males with a biopsy-proven diagnosis of non-metastatic prostate cancer who were not receiving chemotherapy and had elected to receive external-beam radiation therapy; the second study recruited community-living participants who were aged 55 years and older; the third study recruited university students. These studies included subgroups with anxiety and depression as defined by symptom scores and provided data separately for those subgroups. As this included only 25 people with anxiety and 17 with depression and 20 more with either anxiety or depression, but which was not specified, the results could only be reported narratively.
The findings did not show any evidence that Reiki is either beneficial or harmful in this population. The risk of bias for the included studies was generally rated as unclear or high for most domains, which reduced the certainty of the evidence.
The authors of this Cochrane review concluded that there is insufficient evidence to say whether or not Reiki is useful for people over 16 years of age with anxiety or depression or both.
On a different blog post, I concluded that “we do not need a trained Reiki master, nor the illusion of some mysterious ‘healing energy’. Simple companionship without woo or make-believe has exactly the same effect without undermining rationality. Or, to put it much more bluntly: REIKI IS NONSENSE ON STILTS.”
Perhaps someone should tell the guys at Rockinghorse that they are funding nonsense?
Perhaps the charity should have been responsible enough to do a quick search on the evidence BEFORE they committed their funds?
Perhaps the consultant pediatrician should be sent to a refresher course in evidence-based medicine?
So many ‘perhapses’ – and only one certainty: THIS CHARITY IS WASTING ITS FUNDS ON OFFENSIVE NONSENSE.
On this blog, I have repeatedly pleaded for a change of the 2010 NICE guidelines for low back pain (LBP). My reason was that it had become quite clear that their recommendation to use spinal manipulation and acupuncture for recurrent LBP was no longer supported by sound evidence.
Two years ago, a systematic review (authored by a chiropractor and published in a chiro-journal) concluded that “there is no conclusive evidence that clearly favours spinal manipulation or exercise as more effective in treatment of CLBP.” A the time, I wrote a blog explaining that “whenever two treatments are equally effective (or, in this case, perhaps equally ineffective?), we must consider other important criteria such as safety and cost. Regular chiropractic care (chiropractors use spinal manipulation on almost every patient, while osteopaths and physiotherapists employ it less frequently) is neither cheap nor free of serious adverse effects such as strokes; regular exercise has none of these disadvantages. In view of these undeniable facts, it is hard not to come up with anything other than the following recommendation: until new and compelling evidence becomes available, exercise ought to be preferred over spinal manipulation as a treatment of chronic LBP – and consequently consulting a chiropractor should not be the first choice for chronic LBP patients.”
Three years ago, a systematic review of acupuncture for LBP (published in a TCM-journal) concluded that the effect of acupuncture “is likely to be produced by the nonspecific effects of manipulation.” At that time I concluded my blog-post with this question: Should NICE be recommending placebo-treatments and have the tax payer foot the bill? Now NICE have provided an answer.
The new draft guideline by NICE recommends various forms of exercise as the first step in managing low back pain. Massage and manipulation by a physiotherapist should only be used alongside exercise; there is not enough evidence to show they are of benefit when used alone. Moreover, patients should be encouraged to continue with normal activities as far as possible. Crucially, the draft guideline no longer recommends acupuncture for treating low back pain.
NICE concluded that the evidence shows that acupuncture is not better than sham treatment. Paracetamol on its own is no longer recommended either, instead non-steroidal anti-inflammatory drugs (NSAIDs) such as ibuprofen or aspirin should be tried first. Talking therapies are recommended in combination with physical therapies for patients who had no improvement on previous treatments or who have significant psychological and social barriers to recovery.
Professor Mark Baker, clinical practice director for NICE, was quoted stating “Regrettably there is a lack of convincing evidence of effectiveness for some widely used treatments. For example acupuncture is no longer recommended for managing low back pain with or without sciatica. This is because there is not enough evidence to show that it is more effective than sham treatment.”
Good news for us all, I would say:
- good news for patients who now hear from an accepted authority what to do when they suffer from LBP,
- good news for society who does no longer need to spend vast amounts of money on questionable therapies,
- good news for responsible clinicians who now have clear guidance which they can show and explain to their patients.
Not so good news, I admit, for acupuncturists, chiropractors and osteopaths who just had a major source of their income scrapped. I have tried to find some first reactions from these groups but, for the moment, they seemed to be stunned into silence – nobody seems to have yet objected to the new guideline. Instead, I found a very recent website where chiropractic is not just recommended for LBP therapy but where patients are instructed that, even in the absence of pain, they need to see their chiropractor regularly: “Maintenance chiropractic care is well supported in studies for controlling chronic LBP.”
NEVER LET THE TRUTH GET IN THE WAY OF YOUR CASH-FLOW…they seem to conclude.
Recently, I came across the ‘Clinical Practice Guidelines on the Use of Integrative Therapies as Supportive Care in Patients Treated for Breast Cancer’ published by the ‘Society for Integrative Oncology (SIO) Guidelines Working Group’. The mission of the SIO is to “advance evidence-based, comprehensive, integrative healthcare to improve the lives of people affected by cancer. The SIO has consistently encouraged rigorous scientific evaluation of both pre-clinical and clinical science, while advocating for the transformation of oncology care to integrate evidence-based complementary approaches. The vision of SIO is to have research inform the true integration of complementary modalities into oncology care, so that evidence-based complementary care is accessible and part of standard cancer care for all patients across the cancer continuum. As an interdisciplinary and inter-professional society, SIO is uniquely poised to lead the “bench to bedside” efforts in integrative cancer care.”
The aim of the ‘Clinical Practice Guidelines’ was to “inform clinicians and patients about the evidence supporting or discouraging the use of specific complementary and integrative therapies for defined outcomes during and beyond breast cancer treatment, including symptom management.”
This sounds like a most laudable aim. Therefore I studied the document carefully and was surprised to read their conclusions: “Specific integrative therapies can be recommended as evidence-based supportive care options during breast cancer treatment.”
How can this be? On this blog, we have repeatedly seen evidence to suggest that integrative medicine is little more than the admission of quackery into evidence-based healthcare. This got me wondering how their conclusion had been reached, and I checked the document even closer.
On the surface, it seemed well-made. A team of researchers first defined the treatments they wanted to look at, then they searched for RCTs, evaluated their quality, extracted their results, combined them into an overall verdict and wrote the whole thing up. In a word, they conducted what seems a proper systematic review.
Based on the findings of their review, they then issued recommendations which I thought were baffling in several respects. Let me just focus on three of the SIO’s recommendations dealing with acupuncture:
- “Acupuncture can be considered for treating anxiety concurrent with ongoing fatigue…” [only RCT (1) cited in support]
- “Acupuncture can be considered for improving depressive symptoms in women suffering from hot flashes…” [RCTs (1 and 2) cited in support]
- “Acupuncture can be considered for treating anxiety concurrent with ongoing fatigue…” [only RCT (1) cited in support]
The actual RCT (1) cited in support of all three recommendations stated that the authors “randomly assigned 75 patients to usual care and 227 patients to acupuncture plus usual care…” As we have discussed often before on this blog and elsewhere, such a ‘A+B versus B study design’ will never generate a negative result, does not control for placebo-effects and is certainly not a valid test for the effectiveness of the treatment in question. Nevertheless, the authors of this study concluded that: “Acupuncture is an effective intervention for managing the symptom of cancer-related fatigue and improving patients’ quality of life.”
RCT (2) cited in support of recommendation number 2 seems to be a citation error; the study in question is not an acupuncture-trial and does not back the statement in question. I suspect they meant to cite their reference number 87 (instead of 88). This trial is an equivalence study where 50 patients were randomly assigned to receive 12 weeks of acupuncture (n = 25) or venlafaxine (n = 25) treatment for cancer-related hot flushes. Its results indicate that the two treatments generated the similar results. As the two therapies could also have been equally ineffective, it is impossible, in my view, to conclude that acupuncture is effective.
Finally, RCT (1) does in no way support recommendation number two. Yet RCT (1) and RCT (2) were both cited in support of this recommendation.
I have not systematically checked any other claims made in this document, but I get the impression that many other recommendations made here are based on similarly ‘liberal’ interpretations of the evidence. How can the ‘Society for Integrative Oncology’ use such dodgy pseudo-science for formulating potentially far-reaching guidelines?
I know none of the authors (Heather Greenlee, Lynda G. Balneaves, Linda E. Carlson, Misha Cohen, Gary Deng, Dawn Hershman, Matthew Mumber, Jane Perlmutter, Dugald Seely, Ananda Sen, Suzanna M. Zick, Debu Tripathy) of the document personally. They made the following collective statement about their conflicts of interest: “There are no financial conflicts of interest to disclose. We note that some authors have conducted/authored some of the studies included in the review.” I am a little puzzled to hear that they have no financial conflicts of interest (do not most of them earn their living by practising integrative medicine? Yes they do! The article informs us that: “A multidisciplinary panel of experts in oncology and integrative medicine was assembled to prepare these clinical practice guidelines. Panel members have expertise in medical oncology, radiation oncology, nursing, psychology, naturopathic medicine, traditional Chinese medicine, acupuncture, epidemiology, biostatistics, and patient advocacy.”). I also suspect they have other, potentially much stronger conflicts of interest. They belong to a group of people who seem to religiously believe in the largely nonsensical concept of integrative medicine. Integrating unproven treatments into healthcare must affect its quality in much the same way as the integration of cow pie into apple pie would affect the taste of the latter.
After considering all this carefully, I cannot help wondering whether these ‘Clinical Practice Guidelines’ by the ‘Society for Integrative Oncology’ are just full of honest errors or whether they amount to fraud and scientific misconduct.
WHATEVER THE ANSWER, THE GUIDELINES MUST BE RETRACTED, IF THIS SOCIETY WANTS TO AVOID LOSING ALL CREDIBILITY.
The current ‘Acupuncture Awareness Week’ is perhaps a good occasion to look beyond acupuncture for humans. The ‘Chi Institute’ is an organisation that teaches TCM for animals. There you can specialise in all sorts of intriguing things that a critical mind would have never thought about. Take acupuncture for horses, for instance; on their website, the Institute informs us that:
The Equine Acupuncture Program…certifies students in veterinary acupuncture with an emphasis on horses. The program begins with an overview of fundamental aspects of Chinese Medicine, including Ying-Yang and Five Elements theory, which serve as a foundation for case diagnosis and treatment presented later in the class. A variety of acupuncture techniques are taught, including electro-acupuncture and moxibustion, in addition to conventional “dry” needling. Students of the program learn acupuncture points on large animals only, and horses are used for practice in the wet labs.
The program is presented in five sessions (two online and three on-site) over a period of six months. Online sessions are composed of lectures that students can stream at their own convenience. Afternoon wet-labs of on-site sessions give students the opportunity to learn acupuncture points on live animals in small lab groups of five to six students per instructor. A spring class and a fall class are held each year. Equine Acupuncture is offered to licensed veterinarians and veterinary school junior/senior students only.
- Traditional Chinese Veterinary Medicine (TCVM) Principles: Five Elements, Yin-Yang, Eight Principles, Zang-Fu Physiology and Pathology, Meridians and Channels
- Scientific Basis of Acupuncture
- 200 Transpositional Equine Acupuncture Points (hands-on, wet-lab demos)
- 70 Classical Equine Acupuncture Points (hands-on, wet-lab demos)
- How to needle acupuncture points in horses
- TCVM Diagnostic Systems, including Tongue and Pulse Diagnosis
- How to integrate acupuncture into your practice
- How to use veterinary acupuncture to diagnose and treat:
- Musculoskeletal conditions, lameness and neurological disorders
- Cardiovascular diseases and respiratory disorders
- Gastrointestinal disorders and behavioral problems
- Dermatological problems and immune-mediated diseases
- Renal & urinary disorders and reproductive disorders
- Dry needle (conventional needling)
- Aqua-acupuncture (point injection)
But is there not something missing, I asked myself when I read this. What about the evidence? What about the question whether there is any proof that any of this works?
As it happens, some time ago, we looked into this by conducting a systematic review. Here is our abstract ( I should mention that the first author of this paper was a vet who was very fond of acupuncture):
Acupuncture is a popular complementary treatment option in human medicine. Increasingly, owners also seek acupuncture for their animals. The aim of the systematic review reported here was to summarize and assess the clinical evidence for or against the effectiveness of acupuncture in veterinary medicine. Systematic searches were conducted on Medline, Embase, Amed, Cinahl, Japana Centra Revuo Medicina and Chikusan Bunken Kensaku. Hand-searches included conference proceedings, bibliographies, and contact with experts and veterinary acupuncture associations. There were no restrictions regarding the language of publication. All controlled clinical trials testing acupuncture in any condition of domestic animals were included. Studies using laboratory animals were excluded. Titles and abstracts of identified articles were read, and hard copies were obtained. Inclusion and exclusion of studies, data extraction, and validation were performed independently by two reviewers. Methodologic quality was evaluated by means of the Jadad score. Fourteen randomized controlled trials and 17 nonrandomized controlled trials met our criteria and were, therefore, included. The methodologic quality of these trials was variable but, on average, was low. For cutaneous pain and diarrhea, encouraging evidence exists that warrants further investigation in rigorous trials. Single studies reported some positive intergroup differences for spinal cord injury, Cushing’s syndrome, lung function, hepatitis, and rumen acidosis. These trials require independent replication. On the basis of the findings of this systematic review, there is no compelling evidence to recommend or reject acupuncture for any condition in domestic animals. Some encouraging data do exist that warrant further investigation in independent rigorous trials.
What a pity that the pupils of the above course are not being told that THERE IS NO COMPELLING EVIDENCE that any of the tings they are about to learn has any value…but that would be bad for business, wouldn’t it? And we cannot have a bit of evidence jeopardize a nice little earner, can we?
Samuel Hahnemann, the founder of homeopathy, gave a lecture on the subject of veterinary homeopathy in the mid-1810s. Ever since, homeopathy has been used for treating animals. Von Boennighausen, a Dutch lawyer and early convert to homeopathy, was one of the first influential proponents of veterinary homeopathy.
However, veterinary medical schools tended to take a very dim view of homoeopathy, and the number of veterinary homeopaths initially remained small. In the 1920ies, veterinary homoeopathy was revived in Germany. Members of the “Studiengemeinschaft für tierärztliche Homöopathie” (Study Group for Veterinary Homoeopathy), which was founded in 1936 and had Nazi support, started to investigate this approach.
Today, veterinary homeopathy is popular, not least because of the general boom in alternative medicine. Prince Charles has become one of its most prominent advocate. In his book HARMONY, he writes:
“…one of the big arguments used against homeopathy is that it does not really work medically. The criticism is that people simply believe they feel they are going to feel better and so they think they are better. They have responded to the so-called ‘placebo effect’. It is for this reason that critics of homeopathy argue that it is a trick of the mind and its remedies are nothing more than sugar pills. What none of those who take this view ever seem to acknowledge is that these remedies also work on animals, which are surely unlikely to be influenced by the placebo effect. I certainly remember that when I started to introduce homeopathic remedies on the Duchy Home Farm, farm staff who had no view either way reported that the health of an animal that had been treated had improved so I wonder what it is that prevents the medical profession from even considering the evidence that now exists of trials of homeopathic treatments carried out on animals? It is not the quackery they claim it to be. Or if it is, then I have some very clever cows in my shed!”[I do love this quote; it so very clearly shows the frightfully muddled thinking of this man.]
In many countries, veterinary homeopaths have their own professional organisations. In other countries, however, veterinarians are banned from practicing homeopathy. In the UK, only veterinarians are allowed to use homeopathy on animals, but ironically anyone regardless of background can use it on human patients. In the US, homeopathic vets are organised in the Academy of Veterinary Homeopathy.
But what do homeopathic vets treat? One website informs us that the conditions frequently treated are: arthritis, lameness, cruciate rupture, chronic diarrhoea, atopy, allergy, autoimmune disorders (auto-immune), periodic ophthalmia (moon blindness, moonblindness, recurrent uveitis, recurrent ophthalmia, ERU), head shaking (headshaking, head-shaking), hip dysplasia, COPD, sweet itch, laminitis, corneal ulcer, elbow dysplasia, RAO, DJD, OCD, bone cysts, pasteurellosis (pasteurella), chlamydia, cryptosporidia, pneumonia, meningitis, mastitis, ringworm, epilepsy, pyoderma, eczema, dermatitis, eosinophilic myositis, eosinophilic granuloma, rodent ulcer, miliary eczema (miliary dermatitis), kidney problems, liver problems (hepatopathy), cystitis.
Now I can almost hear you shout: WHERE IS THE EVIDENCE???
May I refer you to a previous post on the matter?
It discussed a review aimed to assess risk of bias and to quantify the effect size of homeopathic interventions compared with placebo for each eligible peer-reviewed trial. Judgement in 7 assessment domains enabled a trial’s risk of bias to be designated as low, unclear or high. A trial was judged to comprise reliable evidence, if its risk of bias was low or was unclear in specified domains. A trial was considered to be free of vested interest, if it was not funded by a homeopathic pharmacy.
The 18 RCTs found by the researchers were disparate in nature, representing 4 species and 11 different medical conditions. Reliable evidence, free from vested interest, was identified in only two trials:
- homeopathic Coli had a prophylactic effect on porcine diarrhoea (odds ratio 3.89, 95 per cent confidence interval [CI], 1.19 to 12.68, P=0.02);
- individualised homeopathic treatment did not have a more beneficial effect on bovine mastitis than placebo intervention (standardised mean difference -0.31, 95 per cent CI, -0.97 to 0.34, P=0.35).
The authors conclusions are clear: Mixed findings from the only two placebo-controlled RCTs that had suitably reliable evidence precluded generalisable conclusions about the efficacy of any particular homeopathic medicine or the impact of individualised homeopathic intervention on any given medical condition in animals.
…homeopaths…will try to claim that [the review] was a biased piece of research conducted, most likely, by notorious anti-homeopaths who cannot be trusted. So who are the authors of this new publication?
They are RT Mathie from the British Homeopathic Association and J Clausen from one of Germany’s most pro-homeopathic institution, the ‘Karl und Veronica Carstens-Stiftung’.
At this stage, some of my readers are quite angry, I imagine. They might wonder how to protect defenceless animals from homeopathic quacks. But how?
Simple! Just sign the petition to ban veterinary homeopathy! I mean it – please do!!!