The ‘Samueli Institute’ might be known to many readers of this blog; it is a wealthy institution that is almost entirely dedicated to promoting the more implausible fringe of alternative medicine. The official aim is “to create a flourishing society through the scientific exploration of wellness and whole-person healing“. Much of its activity seems to be focused on military medical research. Its co-workers include Harald Walach who recently was awarded a rare distinction for his relentless efforts in introducing esoteric pseudo-science into academia.
Now researchers from the Californian branch of the Samueli Institute have published an articles whic, in my view, is another landmark in nonsense.
Jain and colleagues conducted a randomized controlled trial to determine whether Healing Touch with Guided Imagery [HT+GI] reduced post-traumatic stress disorder (PTSD) compared to treatment as usual (TAU) in “returning combat-exposed active duty military with significant PTSD symptoms“. HT is a popular form of para-normal healing where the therapist channels “energy” into the patient’s body; GI is a self-hypnotic from of relaxation-therapy. While the latter approach might be seen as plausible and, at least to some degree, evidence-based, the former cannot.
123 soldiers were randomized to 6 sessions of HT+GI, while the control group had no such therapies. All patients also received standard conventional therapies, and the treatment period was three weeks. The results showed significant reductions in PTSD symptoms as well as depression for HT+GI compared to controls. HT+GI also showed significant improvements in mental quality of life and cynicism.
The authors concluded that HT+GI resulted in a clinically significant reduction in PTSD and related symptoms, and that further investigations of biofield therapies for mitigating PTSD in military populations are warranted.
The Samueli Institute claims to “support science grounded in observation, investigation, and analysis, and [to have] the courage to ask challenging questions within a framework of systematic, high-quality, research methods and the peer-review process“. I do not think that the above-named paper lives up to these standards.
As discussed in some detail in a previous post, this type of study-design is next to useless for determining whether any intervention does any good at all: A+B is always more than B alone! Moreover, if we test HT+GI as a package, how can we conclude about the effectiveness of one of the two interventions? Thus this trial tells us next to nothing about the effectiveness of HT, nor about the effectiveness of HT+GI.
Previously, I have argued that conducting a trial for which the result is already clear before the first patient has been recruited, is not ethical. Samueli Institute, however, claims that it “acts with the highest respect for the public it serves by ensuring transparency, responsible management and ethical practices from discovery to policy and application“. Am I the only one who senses a contradiction here?
Perhaps other research in this area might be more informative? Even the most superficial Medline-search brings to light a flurry of articles on HT and other biofield therapies that are relevant.
Several trials have indeed produces promissing evidence suggesting positive effects of such treatments on anxiety and other symptoms. But the data are far from uniform, and most investigations are wide open to bias. The more rigorous studies seem to suggest that these interventions are not effective beyond placebo. Our review demonstrated that “the evidence is insufficient” to suggest that reiki, another biofield therapy, is an effective treatment for any condition.
Another study showed that tactile touch led to significantly lower levels of anxiety. Conventional massage may even be better than HT, according to some trials. The conclusion from this body of evidence is, I think, fairly obvious: touch can be helpful (most clinicians knew that anyway) but this has nothing to do with energy, biofields, healing energy or any of the other implausible assumptions these treatments are based on.
I therefore disagree with the authors’ conclusion that “further investigation into biofield therapies… is warranted“. If we really want to help patients, let’s find out more about the benefits of touch and let’s not mislead the public about some mystical energies and implausible quackery. And if we truly want to improve heath care, as the Samueli Institute claims, let’s use our limited resources for research which meaningfully contributes to our knowledge.
On January 27, 1945, the concentration camp in Auschwitz was liberated. By May of the same year, around 20 similar camps had been discovered. What they revealed is so shocking that it is difficult to put it in words.
Today, on ‘HOCOCAUST MEMORIAL DAY’, I quote (shortened and slightly modified) from articles I published many years ago (references can be found in the originals) to remind us of the unspeakable atrocities that occurred during the Nazi period and of the crucial role the German medical profession played in them.
The Nazi’s euthanasia programme, also known as “Action T4″, started in specialized medicinal departments in 1939. Initially, it was aimed at children suffering from “idiocy, Down’s syndrome, hydrocephalus and other abnormalities”. By the end of 1939, the programme was extended to adults “unworthy of living.” We estimate that, when it was stopped, more than 70,000 patients had been killed.
Action T4 (named after its address: Tiergarten Strasse 4) was the Berlin headquarters of the euthanasia programme. It was run by approximately 50 physicians who, amongst other activities, sent questionnaires to (mostly psychiatric) hospitals urging them to return lists of patients for euthanasia. The victims were transported to specialized centers where they were gassed or poisoned. Action T4 was thus responsible for medically supervised, large-scale murder. Its true significance, however, lies elsewhere. Action T4 turned out to be nothing less than a “pilot project” for the extinction of millions of prisoners of the concentration camps.
The T4 units had developed the technology for killing on an industrial scale. It was only with this know-how that the total extinction of all Jews of the Reich could be planned. This truly monstrous task required medical expertise.
Almost without exception, those physicians who had worked for T4 went on to take charge of what the Nazis called the ‘Final Solution’. While action T4 had killed thousands, its offspring would murder millions under the trained instructions of Nazi doctors.
The medical profession’s role in these crimes was critical and essential. German physicians had been involved at all levels and stages. They had created and embraced the pseudo-science of race hygiene. They were instrumental in developing it further into applied racism. They had generated the know-how of mass extinction. Finally, they also performed outrageously cruel and criminal experiments under the guise of scientific inquiry [see below]. German doctors had thus betrayed all the ideals medicine had previously stood for, and had become involved in criminal activities unprecedented in the history of medicine (full details and references on all of this are provided in my article, see link above).
It is well-documented that alternative medicine was strongly supported by the Nazis. The general belief is that this had nothing to do with the sickening atrocities of this period. I believe that this assumption is not entirely correct. In 2001, I published an article which reviews the this subject; I take the liberty of borrowing from it here.
Based on a general movement in favour of all things natural, a powerful trend towards natural ways of healing had developed in the 19(th)century. By 1930, this had led to a situation in Germany where roughly as many lay-practitioners of alternative medicine as conventional doctors were in practice.This had led to considerable tensions between the two camps. To re-unify German medicine under the banner of ‘Neue Deutsche Heilkunde’ (New German Medicine), Nazi officials eventually decided to create the profession of the ‘Heilpraktiker‘ (healing practitioner). Heilpraktiker were not allowed to train students and their profession was thus meant to become extinct within one generation; Goebbels spoke of having created the cradle and the grave of the Heilpraktiker. However, after 1945, this decision was challenged in the courts and eventually over-turned – and this is why Heilpraktiker are still thriving today.
The ‘flag ship’ of the ‘Neue Deutsche Heilkunde’ was the ‘Rudolf Hess Krankenhaus‘ in Dresden (which was re-named into Gerhard Wagner Krankenhaus after Hess’ flight to the UK). It represented a full integration of alternative and orthodox medicine.
An example of systematic research into alternative medicine is the Nazi government’s project to validate homoeopathy. The data of this massive research programme are now lost (some speculate that homeopaths made them disappear) but, according to an eye-witness report, its results were entirely negative (full details and references on alt med in 3rd Reich are in the article cited above).
There is,of course, plenty of literature on the subject of Nazi ‘research’ (actually, it was pseudo-research) and the unspeakable crimes it entailed. By contrast, there is almost no published evidence that these activities included in any way alternative medicine, and the general opinion seems to be that there are no connections whatsoever. I fear that this notion might be erroneous.
As far as I can make out, no systematic study of the subject has so far been published, but I found several hints and indications that the criminal experiments of Nazi doctors also involved alternative medicine (the sources are provided in my articles cited above or in the links provided below). Here are but a few leads:
Dr Wagner, the chief medical officer of the Nazis was a dedicated and most active proponent of alternative medicine.
Doctors in the alternative “Rudolf Hess Krankenhaus” [see above] experimented on speeding up the recovery of wounded soldiers, on curing syphilis with fasting, and on various other projects to help the war effort.
The Dachau concentration camp housed the largest plantation of medicinal herbs in Germany.
Dr Madaus (founder of the still existing company for natural medicines by the same name) experimented on the sterilisation of humans with herbal and homeopathic remedies, a project that was deemed of great importance for controlling the predicted population growth in the East of the expanding Reich.
Dr Grawitz infected Dachau prisoners with various pathogens to test the effectiveness of homeopathic remedies.
Schuessler salts were also tested on concentration camp inmates.
So, why bring all of this up today? Is it not time that we let grass grow over these most disturbing events? I think not! For many years, I actively researched this area (you can find many of my articles on Medline) because I am convinced that the unprecedented horrors of Nazi medicine need to be told and re-told – not just on HOLOCAUST MEMORIAL DAY, but continually. This, I hope, will minimize the risk of such incredible abuses ever happening again.
In my last post, I strongly criticised Prince Charles for his recently published vision of “integrated health and post-modern medicine”. In fact, I wrote that it would lead us back to the dark ages. “That is all very well”, I hear my critics mutter, “but can Ernst offer anything better?” After all, as Prof Michael Baum once remarked, Charles has his authority merely through an accident of birth, whereas I have been to medical school, served as a professor in three different countries and pride myself of being an outspoken proponent of evidence-based medicine. I should thus know better and have something to put against Charles’ odd love affair with the ‘endarkenment’.
I have to admit that I am not exactly what one might call a visionary; all my life I have been slightly weary of people who wear a ‘vision’ on their sleeve for everyone to see. But I could produce some concepts about what might constitute good medicine (apart from the obvious statement that I think EBM is the correct approach). To be truthful, these are not really my concepts either – but, as far as I can see, they simply are ideas held by most responsible health care professionals across the world. So, for what it’s worth, here it is:
In a nut-shell, good medicine consists of two main elements: the science and the ‘art’ of medicine. This division is, of course, somewhat artificial; for instance, the art of medicine does not defy science, and compassion is an empty word, if it is not combined with effective therapy. Yet for clarity it can be helpful to separate the two elements.
Medicine has started to make progress about 150 years ago when we managed to free ourselves from the dogmas and beliefs that had previously dominated heath care. The first major randomised trial was published only in 1948. Since then, progress in both basic and clinical research has advanced at a breath-taking speed. Consequently, enormous improvements in health care have occurred, and the life-expectancy as well as the quality of life of millions have grown to a remarkable degree.
These developments are fairly recent and tend to be frustratingly slow; it is therefore clear that there is still much room for improvement. But improvement is surely being generated every day: the outlook of patients who suffer from MS, AIDS, cancer and many other conditions will be better tomorrow than it is today. Similar advances are being made in the areas of disease prevention, rehabilitation, palliative care etc. All of these improvements is almost exclusively the result of the hard work by thousands of brilliant scientists who tirelessly struggle to improve the status quo.
But the task is, of course, huge and virtually endless. We therefore need to be patient and remind ourselves how very young medicine’s marriage with science still is. To change direction at this stage would be wrong and lead to disastrous consequences. To doubt the power of science in generating progress displays ignorance. To call on “ancient wisdom” for help is ridiculous.
The ‘art of medicine’ seems a somewhat old-fashioned term to use. My reason for employing it anyway is that I do not know any other word that captures all of the following characteristics and attributes:
Time to listen
Good therapeutic relationships
Provision of choice, information, guidance
They are all important features of good medicine – they always have been and always will be. To deny this would be to destroy the basis on which health care stands. To neglect them risks good medicine to deteriorate. To call this “ancient wisdom” is grossly misleading.
Sadly, the system doctors have to work in makes it often difficult to respect all the features listed above. And sadly, not everyone working in health care is naturally gifted in showing compassion, empathy etc. to patients. This is why medical schools do their very best to teach these qualities to students. I do not deny that this endeavour is not always fully successful, and one can only hope that young doctors make career-choices according to their natural abilities. If you cannot produce a placebo-response in your patient, I was taught at medical school, go and train as a pathologist!
Science and art
Let me stress this again: the science and the art of medicine are essential elements of good medicine. In other words, if one is missing, medicine is by definition not optimal. In vast areas of alternative medicine, the science-element is woefully neglected or even totally absent. It follows, that these areas cannot be good medicine. In some areas of conventional medicine, the art-element is weak or neglected. It follows that, in these areas, medicine is not good either.
My rough outline of a ‘vision’ is, of course, rather vague and schematic; it cannot serve as a recipe for creating good medicine nor as a road map towards improving today’s health care. It is also somewhat naive and simplistic: it generalises across the entire, diverse field of medicine which problematic, to say the least.
One challenge for heath care practitioners is to find the optimal balance between the two elements for the situation at hand. A surgeon pulling an in-grown toenail will need a different mix of science and art than a GP treating a patient suffering from chronic depression, for instance.
The essential nature of both the science and the art of medicine also means that a deficit of one element cannot normally be compensated by a surplus of the other. In the absence of an effective treatment, even an over-dose of compassion will not suffice (and it is for this reason that the integration of alt med needs to be seen with great scepticism). Conversely, science alone will do a poor job in many others circumstances (and it is for that reason that we need to remind the medical profession of the importance of the ‘art’).
We cannot expect that the introduction of compassionate quacks will improve health care; it might make it appear more human, while, in fact, it would only become less effective. And is it truly compassionate to pretend that homeopathic placebos, administered by a kind and empathetic homeopath, generate more good than harm? I do not think so. The integration of alternative medicine makes sense only for those modalities which have been scientifically tested and demonstrated to be effective. True compassion must always include the desire to administer those treatments which demonstrably generate more good than harm.
I must admit, I do feel slightly embarrassed to pompously entitle this post “a vision of good medicine”. It really amounts to little more than common sense and is merely a reflection of what many health care professionals believe. Yet it does differ significantly from the ‘integrated health and post-modern medicine’ as proposed by Charles – and perhaps this is one reason why it might not be totally irrelevant.
Since homeopathy was invented by Samuel Hahnemann about 200 years ago, a steadily growing group of critics have raised their voices more and more loudly. Usually they come from doctors or scientists and only rarely from the legal profession.
Yet, there are exceptions: an Australian barrister and professor of law has published an analysis of “a series of criminal, civil, disciplinary and coronial decisions from difference countries in relation to homeopathic medicine where outcomes have been tragic”. He concludes that “there is an urgent need for reflection and response within the health sector generally, consumer protection authorities, and legal policy-makers about the steps that should be taken to provide community protection from dangerous homeopathic practice”.
He also questions whether homeopathy can ever be registered alongside other health care professionals:
“Until such time as homoeopathy can scientifically justify its fundamental tenets,… it cannot be said that its claims for therapeutic efficacy can be justifiable. This leaves the profession not just exposed to criticisms,… but potentially open to consumer protection actions directed toward whether its representations are false, misleading and deceptive, to civil litigation when its promises have not been fulfilled, and especially when persons have died, and to criminal actions in respect of the financial advantage that is obtained by its practitioners from their representations.
The distressing cases referred to here which led to avoidable deaths and the multiple accusations leveled against homoeopathy require of the profession at least a formal repudiation of the practitioners concerned… In addition, they demand an unequivocal response that homoeopathy will discipline its own in a robust and open way. If the profession is to acquire any scientific credibility, which is difficult to conceive of, the deaths to which homoeopathy has contributed…also require that homoeopathy actively generate a defensible research basis that justifies its claims to efficacy of outcome for its patients. It is only then that the claims of the medical establishment that homoeopathy is a dangerous and too often a lethal form of quackery will be able to be contested rationally. In the meantime, it is timely to consider further the status that homoeopathy has within the general and health care communities and whether that status can be scientifically, ethically or legally justified”.
I believe this legal view to be highly significant. The persistent criticism from skeptics, concerned scientists and doctors has rarely been translated into decisions about health care provision. Homeopaths tended to respond to our criticism by producing anecdotes, unconvincing or cherry-picked data or by producing outright lies, for instance in relation to the “Swiss government’s report” on homeopathy.
In this context, it is worth noting that, in some countries, homeopaths who have no medical qualifications have been accused to practice medicine without a licence. The case of Dana Ullman in the US is probably the most spectecular such incident; this is how one pro-homeopathy site describes it:
Dana is perhaps the person who has done the most for homeopathy since his court case in that he pursues the evangelism of homeopathy through the NCH and his mail order company… He prescribed homeopathic medicine and was arrested for practicing medicine without a license. But he won an important settlement in 1977 in the Oakland Municipal Court in which the court allowed his practice under two stipulations:
- that he did not diagnose or treat disease and that he refers to medical doctors for the diagnosis and treatment of disease;
- that he makes contracts with his patients that clearly define his role as a non-medical homeopathic practitioner and the patient’s role in seeking his care.
But such cases are not the only occasions for lawyers to look at homeopathy. Recently there has been a class action against the Boiron, the world’s largest manufacturer of homeopathic preparations. It was alleged that Boiron made bogus claims for one of its remedies, and there was a settlement worth millions of dollars. Similar cases are likely to follow, e.g.:
- Nelsons Homeopathy (Rescue Remedy, Bach Original Flower Remedies, Pure & Clear, Arnileve, H+Care)
- CVS Homeopathic Products (Flu Relief, Cold Relief, Cold Remedy, Ear Pain Relief)
- Nature’s Innovation (Naturasil Skin Tags, Bed Bug Patrol, Naturasil Scabies)
- Boericke & Tafel Cold/Flu
- Homeolab USA (Kids Relief Cough & Cold)
In June 2003, a British High Court Judge ordered two mothers to ensure that their daughters are appropriately vaccinated. The ruling concerned two separate cases brought by fathers who wanted their daughters immunized despite opposition by the girls’ unwed mothers
The fact that, in the UK and other countries, homeopathic placebos are still being sold as “vaccines” for the prevention of serious, life-threatening infections is, in my view nothing short of a scandal. The fact that a leading figure at Ainsworth actively misleads the public about these products is an outrage. It is high time therefore that the legal profession looks seriously at the full range of issues related to homeopathy with a view of stopping the dangerous nonsense.
On the last day of the year, is time to contemplate the achievements and failures of the past 12 months and think about the future. For me, it is also the moment to once again place my tongue in my cheek, empathise with my opponents and think of what they might hope for in the coming year.
Here is a brief yet somewhat ambitious expose of what I came up with: the charlatan’s wish list for 2013.
1 Let the Daily Mail and similar publications continue to promote uncritical thinking and bogus claims for alternative medicine.
2 Make sure that politicians remain blissfully ignorant of all matters related to science.
3 Let the anecdote continue to reign over evidence, for instance, in the popular press.
4 Regulate alternative practitioners such that they benefit from the added status without any obligation to abide by the generally accepted rules of evidence-based practice.
5 Prevent the closure of more homeopathic hospitals.
6 Ensure that the public continues to be mislead about nonsensical scams such as “integrated medicine”.
7 Increase the influence of Prince Charles in the realm of health care.
8 Give Royal status to the ‘College of Medicine’.
9 Appoint Dr Michael Dixon, chair of the ‘NHS-Alliance’ and the above-named “college”, as advisor to the government.
10 Introduce more post-modern thinking into health care; after all, there is more than one way of knowing!
11 Defame all those terrible sceptics who always doubt our claims.
12 Cherish double standards in medicine; they are essential for our survival!
13 Make sure researchers of alternative medicine use science not for testing but for proving the value of alternative therapies.
14 Continue to allow promotion of alternative medicine to masquerade as research.
15 Ensure that all our celebrity clients tell every journalist how young they look thanks to alternative medicine.
16 Let ‘Duchy’s Original detox Tincture’ become a financial success – Charles needs the added income for promoting quackery.
17 Open more woo-institutes in academia to spread the gospel of belief-based medicine.
18 Prevent anyone from finding out that many of us break even the most fundamental rules of medical ethics in our daily practice.
I am aware that the list is probably not nearly complete, and I invite everyone to add items of importance. Happy New Year!
The question whether spinal manipulation is an effective treatment for infant colic has attracted much attention in recent years. The main reason for this is, of course, that a few years ago Simon Singh had disclosed in a comment that the British Chiropractic Association (BCA) was promoting chiropractic treatment for this and several other childhood condition on their website. Simon famously wrote “they (the BCA) happily promote bogus treatments” and was subsequently sued for libel by the BCA. Eventually, the BCA lost the libel action as well as lots of money, and the entire chiropractic profession ended up with enough egg on their faces to cook omelets for all their patients.
At the time, the BCA had taken advice from several medical and legal experts; one of their medical advisers, I was told, was Prof George Lewith. Intriguingly, he and several others have just published a Cochrane review of manipulative therapies for infant colic. Here are the unabbreviated conclusions from their article:
“The studies included in this meta-analysis were generally small and methodologically prone to bias, which makes it impossible to arrive at a definitive conclusion about the effectiveness of manipulative therapies for infantile colic. The majority of the included trials appeared to indicate that the parents of infants receiving manipulative therapies reported fewer hours crying per day than parents whose infants did not, based on contemporaneous crying diaries, and this difference was statistically significant. The trials also indicate that a greater proportion of those parents reported improvements that were clinically significant. However, most studies had a high risk of performance bias due to the fact that the assessors (parents) were not blind to who had received the intervention. When combining only those trials with a low risk of such performance bias, the results did not reach statistical significance. Further research is required where those assessing the treatment outcomes do not know whether or not the infant has received a manipulative therapy. There are inadequate data to reach any definitive conclusions about the safety of these interventions”
Cochrane reviews also carry a “plain language” summary which might be easier to understand for lay people. And here are the conclusions from this section of the review:
The studies involved too few participants and were of insufficient quality to draw confident conclusions about the usefulness and safety of manipulative therapies. Although five of the six trials suggested crying is reduced by treatment with manipulative therapies, there was no evidence of manipulative therapies improving infant colic when we only included studies where the parents did not know if their child had received the treatment or not. No adverse effects were found, but they were only evaluated in one of the six studies.
If we read it carefully, this article seems to confirm that there is no reliable evidence to suggest that manipulative therapies are effective for infant colic. In the analyses, the positive effect disappears, if the parents are properly blinded; thus it is due to expectation or placebo. The studies that seem to show a positive effect are false positive, and spinal manipulation is, in fact, not effective.
The analyses disclose another intriguing aspect: most trials failed to mention adverse effects. This confirms the findings of our own investigation and amounts to a remarkable breach of publication ethics (nobody seems to be astonished by this fact; is it normal that chiropractic researchers ignore generally accepted rules of ethics?). It also reflects badly on the ability of the investigators of the primary studies to be objective. They seem to aim at demonstrating only the positive effects of their intervention; science is, however, not about confirming the researchers’ prejudices, it is about testing hypotheses.
The most remarkable thing about the new Cochrane review is, I think, the in-congruence of the actual results and the authors’ conclusion. To a critical observer, the former are clearly negative but the latter sound almost positive. I think this begs the question about the possibility of reviewer bias.
We have recently discussed on this blog whether reviews by one single author are necessarily biased. The new Cochrane review has 6 authors, and it seems to me that its conclusions are considerably more biased than my single-author review of chiropractic spinal manipulation for infant colic; in 2009, I concluded simply that “the claim [of effectiveness] is not based on convincing data from rigorous clinical trials”.
Which of the two conclusions describe the facts more helpfully and more accurately?
I think, I rest my case.
Would it not be nice to have a world where everything is positive? No negative findings ever! A dream! No, it’s not a dream; it is reality, albeit a reality that exists mostly in the narrow realm of alternative medicine research. Quite a while ago, we have demonstrated that journals of alternative medicine never publish negative results. Meanwhile, my colleagues investigating acupuncture, homeopathy, chiropractic etc. seem to have perfected their strategy of avoiding the embarrassment of a negative finding.
Since several years, researchers in this field have adopted a study-design which is virtually sure to generate nothing but positive results. It is being employed widely by enthusiasts of placebo-therapies, and it is easy to understand why: it allows them to conduct seemingly rigorous trials which can impress decision-makers and invariably suggests even the most useless treatment to work wonders.
One of the latest examples of this type of approach is a trial where acupuncture was tested as a treatment of cancer-related fatigue. Most cancer patients suffer from this symptom which can seriously reduce their quality of life. Unfortunately there is little conventional oncologists can do about it, and therefore alternative practitioners have a field-day claiming that their interventions are effective. It goes without saying that desperate cancer victims fall for this.
In this new study, cancer patients who were suffering from fatigue were randomised to receive usual care or usual care plus regular acupuncture. The researchers then monitored the patients’ experience of fatigue and found that the acupuncture group did better than the control group. The effect was statistically significant, and an editorial in the journal where it was published called this evidence “compelling”.
Due to a cleverly over-stated press-release, news spread fast, and the study was celebrated worldwide as a major breakthrough in cancer-care. Finally, most commentators felt, research has identified an effective therapy for this debilitating symptom which affects so many of the most desperate patients. Few people seemed to realise that this trial tells us next to nothing about what effects acupuncture really has on cancer-related fatigue.
In order to understand my concern, we need to look at the trial-design a little closer. Imagine you have an amount of money A and your friend owns the same sum plus another amount B. Who has more money? Simple, it is, of course your friend: A+B will always be more than A [unless B is a negative amount]. For the same reason, such “pragmatic” trials will always generate positive results [unless the treatment in question does actual harm]. Treatment as usual plus acupuncture is more than treatment as usual, and the former is therefore moer than likely to produce a better result. This will be true, even if acupuncture is no more than a placebo – after all, a placebo is more than nothing, and the placebo effect will impact on the outcome, particularly if we are dealing with a highly subjective symptom such as fatigue.
I can be fairly confident that this is more than a theory because, some time ago, we analysed all acupuncture studies with such an “A+B versus B” design. Our hypothesis was that none of these trials would generate a negative result. I probably do not need to tell you that our hypothesis was confirmed by the findings of our analysis. Theory and fact are in perfect harmony.
You might say that the above-mentioned acupuncture trial does still provide important information. Its authors certainly think so and firmly conclude that “acupuncture is an effective intervention for managing the symptom of cancer-related fatigue and improving patients’ quality of life”. Authors of similarly designed trials will most likely arrive at similar conclusions. But, if they are true, they must be important!
Are they true? Such studies appear to be rigorous – e.g. they are randomised – and thus can fool a lot of people, but they do not allow conclusions about cause and effect; in other words, they fail to show that the therapy in question has led to the observed result.
Acupuncture might be utterly ineffective as a treatment of cancer-related fatigue, and the observed outcome might be due to the extra care, to a placebo-response or to other non-specific effects. And this is much more than a theoretical concern: rolling out acupuncture across all oncology centres at high cost to us all might be entirely the wrong solution. Providing good care and warm sympathy could be much more effective as well as less expensive. Adopting acupuncture on a grand scale would also stop us looking for a treatment that is truly effective beyond a placebo – and that surely would not be in the best interest of the patient.
I have seen far too many of those bogus studies to have much patience left. They do not represent an honest test of anything, simply because we know their result even before the trial has started. They are not science but thinly disguised promotion. They are not just a waste of money, they are dangerous – because they produce misleading results – and they are thus also unethical.