In 2004, I published an article rather boldly entitled ‘Ear candles: a triumph of ignorance over science’. Here is its summary:
Ear candles are hollow tubes coated in wax which are inserted into patients’ ears and then lit at the far end. The procedure is used as a complementary therapy for a wide range of conditions. A critical assessment of the evidence shows that its mode of action is implausible and demonstrably wrong. There are no data to suggest that it is effective for any condition. Furthermore, ear candles have been associated with ear injuries. The inescapable conclusion is that ear candles do more harm than good. Their use should be discouraged.
Sadly, since the publication of this paper, ear candles have not become less but more popular. There are about 3 000 000 websites on the subject; most are trying to sell products and make claims which are almost comically misguided; three examples have to suffice:
- The candles work on a chimney principle, drawing any impurities to the surface where they can be gently removed. They equalise the pressure in the head and ears, making them suitable for most conditions.
- These candles are cleansing, soothing and relaxing which helps with chills / colds, feeling of pressure in the ear, tinnitus and everyday noise / sensory overload.
- As it burns, the cone’s ingredients turn to vapour and the airflow creates a vibrational effect. Warmth, vibration and vapour massage the ear canal breaking down any blockages. Wax, toxins and impurities are then drawn out by suction from the heat and vacuum effect of the burning cone. Ear Candling also stimulates the ear’s circulatory system and upper lymph system aiding the body’s natural healing responses.
I said ALMOST comical because such nonsense has, of course a downside. Not only are consumers separated from their cash for no benefit whatsoever, but they are also exposed to danger; again, three examples from the medical literature might explain:
- Otolaryngologists from London described a case of ear candling presenting as hearing loss, and they concluded that this useless therapy can actually cause damage to the ears.
- A 50-year-old woman presented to her GP following an episode of ear candling. After 15 minutes, the person performing the candling burned herself while attempting to remove the candle and spilled candle wax into the patient’s right ear canal. On examination, a piece of candle wax was found in the patient’s ear, and she was referred to the local ear, nose, and throat department. Under general aesthetic, a large mass of solidified yellow candle wax was removed from the deep meatus of the ear. The patient had a small perforation in her right tympanic membrane. Results of a pure tone audiogram showed a mild conductive hearing loss on the right side. At a follow-up appointment 1 month later, the perforation was still there, and the patient’s hearing had not improved.
- A case report of a 4-year-old girl from New Zealand was published. The patient was diagnosed to suffer from otitis media. During the course of the ear examination white deposits were noticed on her eardrum; this was confirmed as being caused by ear candling.
I should stress that we do not know how often such events happen; there is no monitoring system, and one might expect that the vast majority of cases do not get published. Most consumers who experience such problems, I would guess, are far to embarrassed to admit that they have been taken in by this sort of quackery.
It was true 10 yeas ago and it is true today: ear candles are a triumph of ignorance over science. But also they are a victory of gullibility over common sense and the unethical exploitation of naive hope by greedy frauds.
Dodgy science abounds in alternative medicine; this is perhaps particularly true for homeopathy. A brand-new trial seems to confirm this view.
The aim of this study was to test the hypothesis that homeopathy (H) enhances the effects of scaling and root planing (SRP) in patients with chronic periodontitis (CP).
The researchers, dentists from Brazil, randomised 50 patients with CP to one of two treatment groups: SRP (C-G) or SRP + H (H-G). Assessments were made at baseline and after 3 and 12 months of treatment. The local and systemic responses to the treatments were evaluated after one year of follow-up. The results showed that both groups displayed significant improvements, however, the H-G group performed significantly better than C-G group.
The authors concluded that homeopathic medicines, as an adjunctive to SRP, can provide significant local and systemic improvements for CP patients.
Really? I am afraid, I disagree!
Homeopathic medicines might have nothing whatsoever to do with this result. Much more likely is the possibility that the findings are caused by other factors such as:
- patients’ expectations,
- improved compliance with other health-related measures,
- the researchers’ expectations,
- the extra attention given to the patients in the H-G group,
- disappointment of the C-G patients for not receiving the additional care,
- a mixture of all or some of the above.
I should stress that it would not have been difficult to plan the study in such a way that these factors were eliminated as sources of bias or confounding. But this study was conducted according to the A+B versus B design which we have discussed repeatedly on this blog. In such trials, A is the experimental treatment (homeopathy) and B is the standard care (scaling and root planning). Unless A is an overtly harmful therapy, it is simply not conceivable that A+B does not generate better results than B alone. The simplest way to comprehend this argument is to imagine A and B are two different amounts of money: it is impossible that A+B is not more that B!
It is unclear to me what relevant research question such a study design actually does answer (if anyone knows, please tell me). It seems obvious, however, that it cannot test the hypothesis that homeopathy (H) enhances the effects of scaling and root planing (SRP). This does not necessarily mean that the design is necessarily useless. But at the very minimum, one would need an adequate research question (one that matches this design) and adequate conclusions based on the findings.
The fact that the conclusions drawn from a dodgy trial are inadequate and misleading could be seen as merely a mild irritation. The facts that, in homeopathy, such poor science and misleading conclusions emerge all too regularly, and that journals continue to publish such rubbish are not just mildly irritating; they are annoying and worrying – annoying because such pseudo-science constitutes an unethical waste of scarce resources; worrying because it almost inevitably leads to wrong decisions in health care.
If you believe herbalists, the Daily Mail or similarly reliable sources, you come to the conclusion that herbal medicines are entirely safe – after all they are natural, and everything that is natural must be safe. However, there is plenty of evidence that these assumptions are not necessarily correct. In fact, herbal medicines can cause harm in diverse ways, e. g. because:
- one or more ingredients of a plant are toxic,
- they interact with prescribed drugs,
- they are contaminated, for instance, with heavy metals,
- they are adulterated with prescription drugs.
There is no shortage of evidence for any of these 4 scenarios. Here are some very recent and relevant publications:
German authors reviewed recent case reports and case series that provided evidence for herbal hepatotoxicity caused by Chinese herbal mixtures. The implicated remedies were the TCM products Ban Tu Wan, Chai Hu, Du Huo, Huang Qin, Jia Wei Xia Yao San, Jiguja, Kamishoyosan, Long Dan Xie Gan Tang, Lu Cha, Polygonum multiflorum products, Shan Chi, ‘White flood’ containing the herbal TCM Wu Zhu Yu and Qian Ceng Ta, and Xiao Chai Hu Tang. the authors concluded that stringent evaluation of the risk/benefit ratio is essential to protect traditional Chinese medicines users from health hazards including liver injury.
A recent review of Nigerian anti-diabetic herbal remedies suggested hypoglycemic effect of over 100 plants. One-third of them have been studied for their mechanism of action, while isolation of the bioactive constituent(s) has been accomplished for 23 plants. Several plants showed specific organ toxicity, mostly nephrotoxic or hepatotoxic, with direct effects on the levels of some liver function enzymes. Twenty-eight plants have been identified as in vitro modulators of P-glycoprotein and/or one or more of the cytochrome P450 enzymes, while eleven plants altered the levels of phase 2 metabolic enzymes, chiefly glutathione, with the potential to alter the pharmacokinetics of co-administered drugs
US authors published a case of a 44-year-old female who developed subacute liver injury demonstrated on a CT scan and liver biopsy within a month of using black cohosh to resolve her hot flashes. Since the patient was not taking any other drugs, they concluded that the acute liver injury was caused by the use of black cohosh. The authors concluded: we agree with the United States Pharmacopeia recommendations that a cautionary warning about hepatotoxicity should be labeled on the drug package.
Hong Kong toxicologists recently reported five cases of poisoning occurring as a result of inappropriate use of herbs in recipes or general herbal formulae acquired from books. Aconite poisoning due to overdose or inadequate processing accounted for three cases. The other two cases involved the use of herbs containing Strychnos alkaloids and Sophora alkaloids. These cases demonstrated that inappropriate use of Chinese medicine can result in major morbidity, and herbal formulae and recipes containing herbs available in general publications are not always safe.
Finally, Australian emergency doctors just published this case-report: A woman aged 34 years presented to hospital with a history of progressive shortness of breath, palpitations, decreased exercise tolerance and generalised arthralgia over the previous month. A full blood count revealed normochromic normocytic anaemia and a haemoglobin level of 66 g/L. The blood film showed basophilic stippling, prompting measurement of lead levels. Her blood lead level (BLL) was 105 µg/dL. Mercury and arsenic levels were also detected at very low levels. On further questioning, the patient reported that in the past 6 months she had ingested multiple herbal preparations supplied by an overseas Ayurvedic practitioner for enhancement of fertility. She was taking up to 12 different tablets and various pastes and powders daily. Her case was reported to public health authorities and the herbal preparations were sent for analytical testing. Analysis confirmed high levels of lead (4% w/w), mercury (12% w/w), arsenic and chromium. The lead levels were 4000 times the maximum allowable lead level in medications sold or produced in Australia. Following cessation of the herbal preparations, the patient was commenced on oral chelation therapy, iron supplementation and contraception. A 3-week course of oral DMSA (2,3-dimercaptosuccinic acid) was well tolerated; BLL was reduced to 13 µg/dL and haemoglobin increased to 99 g/L. Her symptoms improved over the subsequent 3 months and she remains hopeful about becoming pregnant.
So, how safe are herbal medicines? Unfortunately, the question is unanswerable. Some herbal medicines are quite safe, others are not. But always remember: whenever you administer a treatment you should ask yourself one absolutely crucial question: do the documented benefits outweigh the risks? There are several thousand different herbal medicines, and for less than a dozen of them can the honest answer to this question be YES.
There must be well over 10 000 clinical trials of acupuncture; Medline lists ~5 000, and many more are hidden in the non-Medline listed literature. That should be good news! Sadly, it isn’t.
It should mean that we now have a pretty good idea for what conditions acupuncture is effective and for which illnesses it does not work. But we don’t! Sceptics say it works for nothing, while acupuncturists claim it is a panacea. The main reason for this continued controversy is that the quality of the vast majority of these 10 000 studies is not just poor, it is lousy.
“Where is the evidence for this outraging statement???” – I hear the acupuncture-enthusiasts shout. Well, how about my own experience as editor-in-chief of FACT? No? Far too anecdotal?
How about looking at Cochrane reviews then; they are considered to be the most independent and reliable evidence in existence? There are many such reviews (most, if not all [co-]authored by acupuncturists) and they all agree that the scientific rigor of the primary studies is fairly awful. Here are the crucial bits of just the last three; feel free to look for more:
Or how about providing an example? Good idea! Here is a new trial which could stand for numerous others:
This study was performed to compare the efficacy of acupuncture versus corticosteroid injection for the treatment of Quervain’s tendosynovitis (no, you do not need to look up what condition this is for understanding this post). Thirty patients were treated in two groups. The acupuncture group received 5 acupuncture sessions of 30 minutes duration. The injection group received one methylprednisolone acetate injection in the first dorsal compartment of the wrist. The degree of disability and pain was evaluated by using the Quick Disabilities of the Arm, Shoulder, and Hand (Q-DASH) scale and the Visual Analogue Scale (VAS) at baseline and at 2 weeks and 6 weeks after the start of treatment. The baseline means of the Q-DASH and the VAS scores were 62.8 and 6.9, respectively. At the last follow-up, the mean Q-DASH scores were 9.8 versus 6.2 in the acupuncture and injection groups, respectively, and the mean VAS scores were 2 versus 1.2. Thus there were short-term improvements of pain and function in both groups.
The authors drew the following conclusions: Although the success rate was somewhat higher with corticosteroid injection, acupuncture can be considered as an alternative option for treatment of De Quervain’s tenosynovitis.
The flaws of this study are exemplary and numerous:
- This should have been a study that compares two treatments – the technical term is ‘equivalence trial – and such studies need to be much larger to produce a meaningful result. Small sample sizes in equivalent trials will always make the two treatments look similarly effective, even if one is a pure placebo.
- There is no gold standard treatment for this condition. This means that a comparative trial makes no sense at all. In such a situation, one ought to conduct a placebo-controlled trial.
- There was no blinding of patients; therefore their expectation might have distorted the results.
- The acupuncture group received more treatments than the injection group; therefore the additional attention might have distorted the findings.
- Even if the results were entirely correct, one cannot conclude from them that acupuncture was effective; the notion that it was similarly ineffective as the injections is just as warranted.
These are just some of the most fatal flaws of this study. The sad thing is that similar criticisms can be made for most of the 10 000 trials of acupuncture. But the point here is not to nit-pick nor to quack-bust. My point is a different and more serious one: fatally flawed research is not just a ‘poor show’, it is unethical because it is a waste of scarce resources and, even more importantly, an abuse of patients for meaningless pseudo-science. All it does is it misleads the public into believing that acupuncture might be good for this or that condition and consequently make wrong therapeutic decisions.
In acupuncture (and indeed in most alternative medicine) research, the problem is so extremely wide-spread that it is high time to do something about it. Journal editors, peer-reviewers, ethics committees, universities, funding agencies and all others concerned with such research have to work together so that such flagrant abuse is stopped once and for all.
When someone has completed a scientific project, it is customary to publish it [‘unpublished science is no science’, someone once told me many years ago]. To do so, he needs to write it up and submit it to a scientific journal. The editor of this journal will then submit it to a process called ‘peer review’.
What does ‘peer review’ entail? Well, it means that 2-3 experts are asked to critically assess the paper in question, make suggestions as to how it can be improved and submit a recommendation as to whether or not the article deserves to be published.
Peer review has many pitfalls but, so far, nobody has come up with a solution that is convincingly better. Many scientists are under pressure to publish [‘publish or perish’], and therefore some people resort to cheating. A most spectacular case of fraudulent peer review has been reported recently in this press release:
London, UK (08 July 2014) – SAGE announces the retraction of 60 articles implicated in a peer review and citation ring at the Journal of Vibration and Control (JVC). The full extent of the peer review ring has been uncovered following a 14 month SAGE-led investigation, and centres on the strongly suspected misconduct of Peter Chen, formerly of National Pingtung University of Education, Taiwan (NPUE) and possibly other authors at this institution.
In 2013 the then Editor-in-Chief of JVC, Professor Ali H. Nayfeh,and SAGE became aware of a potential peer review ring involving assumed and fabricated identities used to manipulate the online submission system SAGE Track powered by ScholarOne Manuscripts™. Immediate action was taken to prevent JVC from being exploited further, and a complex investigation throughout 2013 and 2014 was undertaken with the full cooperation of Professor Nayfeh and subsequently NPUE.
In total 60 articles have been retracted from JVC after evidence led to at least one author or reviewer being implicated in the peer review ring. Now that the investigation is complete, and the authors have been notified of the findings, we are in a position to make this statement.
While investigating the JVC papers submitted and reviewed by Peter Chen, it was discovered that the author had created various aliases on SAGE Track, providing different email addresses to set up more than one account. Consequently, SAGE scrutinised further the co-authors of and reviewers selected for Peter Chen’s papers, these names appeared to form part of a peer review ring. The investigation also revealed that on at least one occasion, the author Peter Chen reviewed his own paper under one of the aliases he had created.
Unbelievable? Perhaps, but sadly it is true; some scientists seem to be criminally ingenious when it comes to getting their dodgy articles into peer-reviewed journals.
And what does this have to do with ALTERNATIVE MEDICINE, you may well ask. The Journal of Vibration and Control is not even medical and certainly would never consider publishing articles on alternative medicine. Such papers go to one of the many [I estimate more that 1000] journals that cover either alternative medicine in general or any of the modalities that fall under this wide umbrella. Most of these journals, of course, pride themselves with being peer-reviewed – and, at least nominally, that is correct.
I have been on the editorial board of most of the more important journals in alternative medicine, and I cannot help thinking that their peer review process is not all that dissimilar from the fraudulent scheme set up by Peter Chen and disclosed above. What happens in alternative medicine is roughly as follows:
- a researcher submits a paper for publication,
- the editor sends it out for peer review,
- the peer reviewers are either those suggested by the original author or members of the editorial board of the journal,
- in either case, the reviewers are more than likely to be uncritical and recommend publication,
- in the end, peer review turns out to be a farcical window dressing exercise with no consequence,
- thus even very poor research and pseudo-research are being published abundantly.
The editorial boards of journals of alternative medicine tend to be devoid of experts who are critical about the subject at hand. If you think that I am exaggerating, have a look at the editorial board members of ‘HOMEOPATHY’ (or any other journal of alternative medicine) and tell me who might qualify as a critic of homeopathy. When the editor, Peter Fisher, recently fired me from his board because he felt I had tarnished the image of homeopathy, this panel lost the only person who understood the subject matter and, at the same time, was critical about it (the fact that the website still lists me as an editorial board member is merely a reflection of how slow things are in the world of homeopathy: Fisher fired me more than a year ago).
The point I am trying to make is simple: peer review is never a perfect method but when it is set up to be deliberately uncritical, it cannot possibly fulfil its function to prevent the publication of dodgy research. In this case, the quality of the science will be inadequate and generate false-positive messages that mislead the public.
A remarkable article about homeopathy and immunisation entitled THE IMMUNISATION DILEMMA came to my attention recently. Its abstract promised: “evidence quantifying the effectiveness of vaccination and HP (homeoprophylaxis) will be examined. New international research describing and analysing HP interventions will be reported. An evidence-based conclusion will be reached.”
Sounds interesting? Let’s see what the article really offers. Here is the relevant text:
…evidence does exist to support claims regarding the effectiveness of homeopathic immunisation is undeniable.
I was first invited to visit Cuba in December 2008 to present at an international conference hosted by the Finlay Institute, which is a W. H. O.-accredited vaccine manufacturer. The Cubans described their use of HP to control an outbreak of leptospirosis (Weilʼs syndrome – a potentially fatal, water-born bacterial disease) in 2007 among the residents of the three eastern provinces which were most severely damaged by a severe hurricane – over 2.2 million people . 2008 was an even worse year involving three hurricanes, and the countryʼs food production was only just recovering at the time of the conference. The HP program had been repeated in 2008, but data was not available at the conference regarding that intervention.
I revisited Cuba in 2010 and 2012, each time to work with the leader of the HP interventions, Dr. Bracho, to analyse the data available. Dr. Bracho is not a homeopath; he is a published and internationally recognised expert in the manufacture of vaccine adjuvants. He worked in Australia at Flinders University during 2004 with a team trying to develop an antimalarial vaccine.
In 2012 we accessed the raw leptospirosis surveillance data, comprising weekly reports from 15 provinces over 9 years (2000 to 2008) reporting 21 variables. This yielded a matrix with 147 420 possible entries. This included data concerning possible confounders, such as vaccination and chemoprophylaxis, which allowed a careful examination of possible distorting effects. With the permission of the Cubans, I brought this data back to Australia and it is being examined by mathematicians at an Australian university to see what other information can be extracted. Clearly, there is objective data supporting claims regarding the effectiveness of HP.
The 2008 result was remarkable, and could only be explained by the effectiveness of the HP intervention. Whilst the three hurricanes caused immense damage throughout the country it was again worse in the east, yet the three homeopathically immunised provinces experienced a negligible increase in cases whilst the rest of the country showed significant increases until the dry season in January 2009 .
This is but one example – there are many more. It is cited to show that there is significant data available, and that orthodox scientists and doctors have driven the HP interventions, in the Cuban case. Many people internationally now know this, so once again claims by orthodox authorities that there is no evidence merely serves to show that either the authorities are making uninformed/unscientific statements, or that they are aware but are intentionally withholding information. Either way, confidence is destroyed and leads to groups of people questioning what they are told…
The attacks against homeopathy in general and HP in particular will almost certainly continue. If we can achieve a significant level of agreement then we would be able to answer challenges to HP with a single, cohesive, evidence-based, and generally united response. This would be a significant improvement to the existing situation.
Reference 7 is the following article: Bracho G, Varela E, Fernández R et al. Large-scale application of highly-diluted bacteria for Leptospirosis epidemic control. Homeopathy 2010; 99: 156-166. The crucial bit if this paper are as follows:
A homeoprophylactic formulation was prepared from dilutions of four circulating strains of Leptospirosis. This formulation was administered orally to 2.3 million persons at high risk in an epidemic in a region affected by natural disasters. The data from surveillance were used to measure the impact of the intervention by comparing with historical trends and non-intervention regions.
After the homeoprophylactic intervention a significant decrease of the disease incidence was observed in the intervention regions. No such modifications were observed in non-intervention regions. In the intervention region the incidence of Leptospirosis fell below the historic median. This observation was independent of rainfall.
The homeoprophylactic approach was associated with a large reduction of disease incidence and control of the epidemic. The results suggest the use of HP as a feasible tool for epidemic control, further research is warranted.
The paper thus describes little more than an observational study. It shows that one region was less affected than another. I think it is quite clear that this could have many reasons which are unrelated to the homeopathic immunisation. Even the authors are cautious and speak in their conclusions not of a causal effect but of an “association”.
The 2012 data cited in the text remains unpublished; until it is available for public scrutiny, it is impossible to confirm that it is sound and meaningful.
Reference 8 refers to this article: Golden I, Bracho G. Adaptability of homœoprophylaxis in endemic, epidemic and stable background conditions. Homœopathic Links 2009; 22: 211-213. I have no access to this paper (if someone does, please fill us in) but, judging from both its title and the way it is described in the text, it does not seem to show reliable data about the efficacy of homeopathic immunisation.
So, is it true that “evidence does exist to support claims regarding the effectiveness of homeopathic immunisation”?
I do not think so!
Immunisation is by no means a trivial matter; wrong decisions in this area have the potential to cost the lives of millions. Therefore proofs of efficacy need to be published in peer-reviewed journals of high standing. These findings need then be criticised, replicated and re-criticised and re-replicated. Only when there is a wide consensus about the efficacy/safety or lack of efficacy/safety of a new form of immunisation, can it be generally accepted and implemented into clinical practice.
The current consensus about homeopathic immunisation is that it is nothing less than dangerous phantasy. Those who promote this quackery should be publicly exposed as charlatans of the worst kind.
Dr. Oz, famous through his TV show promoting all types of quackery, recently testified before a US Senate subcommittee hearing on protecting consumers from false and deceptive advertising of weight loss products. This event turned out to be less than flattering for Dr Oz. One journalist commented that he “might as well be a cowardly lion — sent home with his tail between his legs after being accused at a congressional hearing of lying on his show about weight-loss claims.”
“I don’t get why you need to say this stuff, because you know it’s not true,” said Senator Claire McCaskill, who led the commerce subcommittee hearing. “The scientific community is almost monolithically against you in terms of the efficacy of the products you called ‘miracles,’ ” the Democratic senator from Missouri told Oz. “It’s a major problem when people are spending more and more money and they’re gaining more and more weight,” said Senator Amy Klobuchar.“Either you don’t talk about these things at all, or you’re going to have to be more specific because right now . . . this is not working.”
A source close to Dr Oz said he was perplexed: “We were invited down to Washington to testify at a hearing about scams and instead it became all about how much we hate your show.” Oz himself testified that he “heard the message…I do personally believe in the items that I talk about.”
“I intensively study them. I have given my family these products. . . . If you can lose a pound a week more than you would have lost by using them, it jump-starts you and gets you going. I think it makes sense.” “I’m surprised you’re defending this,” McCaskill replied. “It’s something that gives people false hope. I don’t see why you need to go there.”
Another journalist commented that the Senators repeatedly placed him on the defense over his weight loss products: “I know you know how much power you have. I know you know that. You are very powerful and [with] power comes a great deal of responsibility,” Senator Claire McCaskill , who led the Senate’s consumer protection hearing titled “Protecting Consumers from False and Deceptive Advertising of Weight-Loss Products…You are being made an example of today because of the power you have in this space…We didn’t call this hearing to beat up on you but we did call this hearing to talk about a real crisis in consumer protection. You can either be part of the police here or you can be part of the problem.”
Oz insisted he was no huckster but admitted the products promoted on his show don’t always have “the scientific muster” to present their benefits as “fact…I actually do personally believe in the items that I talk about in the show. I passionately studied them. I recognize that oftentimes they don’t have the scientific muster to present as fact but nevertheless I would give my audience the advice I give my family all the time. And I have given my family these products,” he said.
Dr Oz also said that some alternative treatments, such as prayer, cannot be tested scientifically. “I don’t think this ought to be a referendum on the use of alternative medical therapies. Because if that’s the case, listen, I’ve been criticized for having folks coming on my show talking about the power of prayer,” he said. “I can’t prove that prayer helps people survive an illness.”
No, Dr Oz! I know you are mistaken! I have done the research – both on alternative slimming aids and on spiritual healing. The results quite clearly show that these methods are not more effective than a placebo.
Today, there are several dozens of journals publishing articles on alternative medicine. ‘The Journal of Alternative and Complementary Medicine’ is one of the best known, and it has one of the highest impact factors of them all. The current issue holds a few ‘gems’ which might be worthy of a comment or two. Here I have selected three articles reporting clinical studies, and I reproduce their abstracts (almost) in full (in italics) and add my comments (for clarity in bold). All the articles are available electronically, and I have provided the links for those who want to investigate beyond the abstracts.
STUDY No 1
The first ‘pilot study‘ was aimed to demonstrate the potential of auricular acupuncture (AAT) for insomnia in maintenance haemodialysis (MHD) patients and to prepare for a future randomized controlled trial.
Eligible patients were enrolled into this descriptive pilot study and received AAT designed to manage insomnia for 4 weeks. Questionnaires that used the Pittsburgh sleep quality index (PSQI) were completed at baseline, after a 4-week intervention, and 1 month after completion of treatment. Sleep quality and other clinical characteristics, including sleeping pills taken, were statistically compared between different time points.
A total of 22 patients were selected as eligible participants and completed the treatment and questionnaires. The mean global PSQI score was significantly decreased after AAT intervention (p<0.05). Participants reported improved sleep quality (p<0.01), shorter sleep latency (p<0.05), less sleep disturbance (p<0.01), and less daytime dysfunction (p=0.01). They also exhibited less dependency on sleep medications, indicated by the reduction in weekly estazolam consumption from 6.98±4.44 pills to 4.23±2.66 pills (p<0.01). However, these improvements were not preserved 1 month after treatment.
Conclusions: In this single-center pilot study, complementary AAT for MHD patients with severe insomnia was feasible and well tolerated and showed encouraging results for sleep quality.
In alternative medicine research, it has become far too common (almost generally accepted) to call a flimsy trial a ‘pilot study’. The authors give their game away by stating that, by conducting this trial, they want to ‘demonstrate the potential of AAT’. This is not a legitimate aim of research; science is for TESTING hypotheses, not for PROVING them!
The results of this trial show that patients experienced improvements after receiving AAT which, however, did not last. As there was no placebo control group, the most likely explanation for these outcomes would be that AAT generated a short-lasting placebo effect.
A sample size of 22 is, of course, far to small to allow any conclusions about the safety of the intervention. Despite these obvious facts, the authors seem convinced that AAT is both safe and effective.
STUDY No 2
The aim of the second study was to compare the therapeutic effect of Yamamoto new scalp acupuncture (YNSA), a recently developed microcupuncture system, with traditional acupuncture (TCA) for the prophylaxis and treatment of migraine headache.
In a randomized clinical trial, 80 patients with migraine headache were assigned to receive YNSA or TCA. A pain visual analogue scale (VAS) and migraine therapy assessment questionnaire (MTAQ) were completed before treatment, after 6 and 18 sections of treatment, and 1 month after completion of therapy.
All the recruited patients completed the study. Baseline characteristics were similar between the two groups. Frequency and severity of migraine attacks, nausea, the need for rescue treatment, and work absence rate decreased similarly in both groups. Recovery from headache and ability to continue daily activities 2 hours after medical treatment showed similar improvement in both groups (p>0.05).
Conclusions: Classic acupuncture and YNSA are similarly effective in the prophylaxis and treatment of migraine headache and may be considered as alternatives to pharmacotherapy.
This is what is technically called an ‘equivalence trial’, i.e. a study that compares an experimental treatment (YNSA) to one that is (assumed to be) effective. To demonstrate equivalence, such trials need to have large sample sizes, and this study is woefully underpowered. As it stands, the results show nothing meaningful at all; if anything, they suggest that both interventions were similarly useless.
STUDY No 3
The third study determined whether injection with hypertonic dextrose and morrhuate sodium (prolotherapy) using a pragmatic, clinically determined injection schedule for knee osteoarthritis (KOA) results in improved knee pain, function, and stiffness compared to baseline status.
The participants were 38 adults who had at least 3 months of symptomatic KOA and who were in the control groups of a prior prolotherapy randomized controlled trial (RCT) (Prior-Control), were ineligible for the RCT (Prior-Ineligible), or were eligible but declined the RCT (Prior-Declined).
The injection sessions at occurred at 1, 5, and 9 weeks with as-needed treatment at weeks 13 and 17. Extra-articular injections of 15% dextrose and 5% morrhuate sodium were done at peri-articular tendon and ligament insertions. A single intra-articular injection of 6 mL 25% dextrose was performed through an inferomedial approach.
The primary outcome measure was the validated Western Ontario McMaster University Osteoarthritis Index (WOMAC). The secondary outcome measure was the Knee Pain Scale and postprocedure opioid medication use and participant satisfaction.
The Prior-Declined group reported the most severe baseline WOMAC score (p=0.02). Compared to baseline status, participants in the Prior-Control group reported a score change of 12.4±3.5 points (19.5%, p=0.002). Prior-Decline and Prior-Ineligible groups improved by 19.4±7.0 (42.9%, p=0.05) and 17.8±3.9 (28.4%, p=0.008) points, respectively; 55.6% of Prior-Control, 75% of Prior-Decline, and 50% of Prior-Ineligible participants reported score improvement in excess of the 12-point minimal clinical important difference on the WOMAC measure. Postprocedure opioid medication resulted in rapid diminution of prolotherapy injection pain. Satisfaction was high and there were no adverse events.
Conclusions: Prolotherapy using dextrose and morrhuate sodium injections for participants with mild-to-severe KOA resulted in safe, significant, sustained improvement of WOMAC-based knee pain, function, and stiffness scores compared to baseline status.
This study had nothing that one might call a proper control group: all the three groups mentioned were treated with the experimental treatment. No attempt was made to control for even the most obvious biases: the observed effects could have been due to placebo or any other non-specific effects. The authors conclusions imply a causal relationship between the treatment and the outcome which is wrong. The notion that the experimental treatment is ‘safe’ is based on just 38 patients and therefore not reasonable.
All of this might seem rather trivial, and my comments could be viewed as a deliberate and vicious attempt to discredit one of the most respected journals of alternative medicine. Yet, considering that articles of this nature are more the rule than the exception in alternative medicine, I do think that this flagrant lack of scientific rigour is a relevant issue and has important implications.
As long as research in this area continues to be deeply flawed, as long as reviewers turn a blind eye to (or are not smart enough to detect) even the most obvious mistakes, as long as journal editors accept any rubbish in order to fill their pages, there is a great danger that we are being continuously being mislead about the supposed therapeutic value of alternative therapies.
Many who read this blog will, of course, have the capacity to think critically and might therefore not fall into the trap of accepting the conclusions of fatally flawed research. But many other people, including politicians, journalists and consumers, might not have the necessary appraisal skills and will thus not be able to tell that such studies can serve only one purpose: to popularise bogus treatments and thereby render health care less effective and more dangerous. Enthusiasts of alternative medicine are usually fully convinced that such studies amount to evidence and ram this pseudo-information down the throat of health care decision makers – the effects of such lobbying on public health can be disastrous.
And there is another downside to the publication of such dismal drivel: assuming (as I do) that not all of alternative medicine is completely useless, such embarrassingly poor research will inevitably have detrimental effects on the discipline of alternative medicine. After being exposed to a seemingly endless stream of pseudo-research, critics will eventually give up taking any of it seriously and might claim that none of it is worth the bother. In other words, those who conduct, accept or publish such nonsensical papers are not only endangering medical progress in general, they are also harming the very cause they try so desperately hard to advance.
I have often asked myself whether it is right/necessary to scientifically test things which are entirely implausible. Should we, for instance test the effectiveness of treatments which have a very low prior probability of generating a positive effect such as paranormal healing, homeopathy or Bach flower remedies? If you believe in the principles of evidence-based medicine you might focus on the clinical evidence and see biological plausibility as secondary. If you are a basic scientist, you are likely to do the reverse.
A recent article addressed this issue. The author points out that evaluating the absurd is absurd. Specifically, he noted that the empirical evaluation of a therapy would normally assume a plausible rationale regarding the mechanism of action. However, examination of the historical background and underlying principles for reflexology, iridology, acupuncture, auricular acupuncture, and some herbal medicines, reveals a rationale founded on the principle of analogical correspondences, which is a common basis for magical thinking and pseudoscientific beliefs such as astrology and chiromancy. Where this is the case, it is suggested that subjecting these therapies to empirical evaluation may be tantamount to evaluating the absurd.
This makes a lot of sense – but is it really entirely true? Are there no legitimate reasons at all for testing alternative treatments that lack biological plausibility? Ten or twenty years ago, I would have disagreed with the notion that plausibility is an essential prerequisite for scientific testing; today, I have changed my mind a little, but not as much as to agree completely with the assumption. In other words, I still see more than one good reason why evaluating the absurd might be reasonable or even advisable.
- Using plausibility as the only arbiter of scientific ‘evaluability’, assumes that we understand everything about plausibility there is to know. Yet it might just be possible that we mis-categorise something as implausible simply because we are not yet fully aware of all the facts.
- Declaring something as plausible and another thing as implausible are not hard and fast verdicts but judgements which, at least to some degree, are subjective. Sceptics find the axioms of homeopathy utterly implausible, for instance – but ask a homeopath, and you will hear all sorts of explanations which, at least to them, sound plausible.
- If an implausible alternative treatment is in wide-spread use, we arguably have a responsibility to test it scientifically in order to demonstrate the truth about it (to those proponents of that therapy who are willing to accept that rigorous science can find the truth). If we fail to do this, it will be the enthusiasts of that therapy who conduct less than rigorous science and produce false positive results. In turn, this will give the impression that the treatment is effective and mislead consumers, politicians, journalists etc. Seen from this perspective, it might even be unethical to not do the science.
So, I am in two minds about this (which might be a reflection of the fact that, during different periods of my life, I have been a clinician, a basic scientist and a clinical researcher). I realise that plausibility and prior probability are important – much more so than I appreciated years ago. But I think they should not be the only criteria. The clinical evidence should not be pushed aside completely.
I’d be interested to learn your views on this tricky issue.
It has been reported that Belgium has just officially recognised homeopathy. The government had given the green light already in July last year, but the Royal Decree has only now become official. This means that, from now on, Belgian doctors, dentists and midwives can only call themselves homeopaths, if they have attended recognised courses in homeopathy and are officially certified. While much of the new regulation is as yet unclear (at least to me), it seems that, in future, only doctors, dentists and midwives are allowed to practice homeopathy, according to one source.
However, the new law also seems to provide that those clinicians with a Bachelor degree in health care who have already been practicing as homeopaths can continue their activities under a temporary measure.
Moreover, the official recognition as a homeopath does not automatically imply that the services will be refunded from a health insurance.
It is said that, in general, homeopaths are happy with the new regulation; they are delighted to have been up-graded in this way and argue that the changes will result in higher quality standards: “This is a very important step and it can only be to the benefit of the patients’ safety. Patients will know whether or not they are dealing with someone who correctly applies homeopathic medicine”, Leon Schepers of the Unio Homeopathica Belgica was quoted saying.
The delight of homeopaths is in sharp contrast to the dismay of rational thinkers. The NHMRC recently assessed the effectiveness of homeopathy. The evaluation is both comprehensive and independent; it concluded that “the evidence from research in humans does not show that homeopathy is effective for treating the range of health conditions considered.” In other words, homeopathic remedies are implausible, over-priced placebos.
Granting an official status to homeopaths cannot possibly benefit patients. On the contrary, it will only render health care less effective and charlatans more assertive.