There probably is no area in health care that produces more surveys than alternative medicine. I estimate that about 500 surveys are published every year; this amounts to about two every working day which is substantially more than the number of clinical trials in this field.
I have long been critical of this ‘survey-mania’. The reason is simple: most of these articles are of such poor quality that they tell us nothing of value.
The vast majority of these surveys attempts to evaluate the prevalence of use of alternative medicine, and it is this type of investigation that I intend to discuss here.
For a typical prevalence survey, a team of enthusiastic researchers might put together a few questions and design a questionnaire to find out what percentage of a group of individuals have tried alternative medicine in the past. Subsequently, the investigators might get one or two hundred responses. They then calculate simple descriptive statistics and demonstrate that xy% (let’s assume it is 45%) use alternative medicine. This finding eventually gets published in one of the many alternative medicine journals, and everyone is happy – well, almost everybody.
How can I be such a spoil-sport and claim that this result tells us nothing of value? At the very minimum, some might argue, it shows that enthusiasts of alternative medicine are interested in and capable of conducting research. I beg to differ: this is not research, it is pseudo-research which ignores most of the principles of survey-design.
The typical alternative medicine prevalence survey has none of the features that would render it a scientific investigation:
1) It lacks an accepted definition of what is being surveyed. There is no generally accepted definition of alternative medicine, and even if the researchers address specific therapies, they run into huge problems. Take prayer, for instance – some see this as alternative medicine, while others would, of course, argue that it is a religious pursuit. Or take herbal medicine – many consumers confuse it with homeopathy, some might think that drinking tea is herbal medicine, while others would probably disagree.
2) The questionnaires used for such surveys are almost never validated. Essentially, this means that we cannot be sure they evaluate what we think they evaluate. We all know that the way we formulate a question can determine the answer. There are many potential sources of bias here, and they are rarely taken into consideration.
3) Enthusiastic researchers of alternative medicine usually use a small convenience sample of participants for their surveys. This means they ask a few people who happen to be around to fill their questionnaire. As a consequence, there is no way the survey is representative of the population in question.
4) The typical survey has a low response rate; sometimes the response rate is not even provided or remains unknown even to the investigators. This means we do not know how the majority of patients/consumers who received but did not fill the questionnaire would have answered. Often there is good reason to suspect that those who have a certain attitude did respond, while those with a different opinion did not. This self-selection process is likely to produce misleading findings.
And why I am so sure about all of theses limitations? To my embarrassment, I know about them not least because I have made most these mistakes myself at some time in my career. You might also ask why this is important: what’s the harm in publishing a few flimsy surveys?
In my view, these investigations are regrettably counter-productive because:
they tend to grossly over-estimate the popularity of alternative medicine,
they distract money, manpower and attention from the truly important research questions in this field,
they give a false impression of a buoyant research activity,
and their results are constantly misused.
The last point is probably the most important one. The argument that is all too often spun around such survey data goes roughly as follows: a large percentage of the population uses alternative medicine; people pay out of their own pocket for these treatments; they are satisfied with them (if not, they would not pay for them). BUT THIS IS GROSSLY UNFAIR! Why should only those individuals who are rich enough to afford alternative medicine benefit from it? ALTERNATIVE MEDICINE SHOULD BE MADE AVAILABLE FOR ALL.
I rest my case.
The ‘Samueli Institute’ might be known to many readers of this blog; it is a wealthy institution that is almost entirely dedicated to promoting the more implausible fringe of alternative medicine. The official aim is “to create a flourishing society through the scientific exploration of wellness and whole-person healing“. Much of its activity seems to be focused on military medical research. Its co-workers include Harald Walach who recently was awarded a rare distinction for his relentless efforts in introducing esoteric pseudo-science into academia.
Now researchers from the Californian branch of the Samueli Institute have published an articles whic, in my view, is another landmark in nonsense.
Jain and colleagues conducted a randomized controlled trial to determine whether Healing Touch with Guided Imagery [HT+GI] reduced post-traumatic stress disorder (PTSD) compared to treatment as usual (TAU) in “returning combat-exposed active duty military with significant PTSD symptoms“. HT is a popular form of para-normal healing where the therapist channels “energy” into the patient’s body; GI is a self-hypnotic from of relaxation-therapy. While the latter approach might be seen as plausible and, at least to some degree, evidence-based, the former cannot.
123 soldiers were randomized to 6 sessions of HT+GI, while the control group had no such therapies. All patients also received standard conventional therapies, and the treatment period was three weeks. The results showed significant reductions in PTSD symptoms as well as depression for HT+GI compared to controls. HT+GI also showed significant improvements in mental quality of life and cynicism.
The authors concluded that HT+GI resulted in a clinically significant reduction in PTSD and related symptoms, and that further investigations of biofield therapies for mitigating PTSD in military populations are warranted.
The Samueli Institute claims to “support science grounded in observation, investigation, and analysis, and [to have] the courage to ask challenging questions within a framework of systematic, high-quality, research methods and the peer-review process“. I do not think that the above-named paper lives up to these standards.
As discussed in some detail in a previous post, this type of study-design is next to useless for determining whether any intervention does any good at all: A+B is always more than B alone! Moreover, if we test HT+GI as a package, how can we conclude about the effectiveness of one of the two interventions? Thus this trial tells us next to nothing about the effectiveness of HT, nor about the effectiveness of HT+GI.
Previously, I have argued that conducting a trial for which the result is already clear before the first patient has been recruited, is not ethical. Samueli Institute, however, claims that it “acts with the highest respect for the public it serves by ensuring transparency, responsible management and ethical practices from discovery to policy and application“. Am I the only one who senses a contradiction here?
Perhaps other research in this area might be more informative? Even the most superficial Medline-search brings to light a flurry of articles on HT and other biofield therapies that are relevant.
Several trials have indeed produces promissing evidence suggesting positive effects of such treatments on anxiety and other symptoms. But the data are far from uniform, and most investigations are wide open to bias. The more rigorous studies seem to suggest that these interventions are not effective beyond placebo. Our review demonstrated that “the evidence is insufficient” to suggest that reiki, another biofield therapy, is an effective treatment for any condition.
Another study showed that tactile touch led to significantly lower levels of anxiety. Conventional massage may even be better than HT, according to some trials. The conclusion from this body of evidence is, I think, fairly obvious: touch can be helpful (most clinicians knew that anyway) but this has nothing to do with energy, biofields, healing energy or any of the other implausible assumptions these treatments are based on.
I therefore disagree with the authors’ conclusion that “further investigation into biofield therapies… is warranted“. If we really want to help patients, let’s find out more about the benefits of touch and let’s not mislead the public about some mystical energies and implausible quackery. And if we truly want to improve heath care, as the Samueli Institute claims, let’s use our limited resources for research which meaningfully contributes to our knowledge.
On January 27, 1945, the concentration camp in Auschwitz was liberated. By May of the same year, around 20 similar camps had been discovered. What they revealed is so shocking that it is difficult to put it in words.
Today, on ‘HOCOCAUST MEMORIAL DAY’, I quote (shortened and slightly modified) from articles I published many years ago (references can be found in the originals) to remind us of the unspeakable atrocities that occurred during the Nazi period and of the crucial role the German medical profession played in them.
The Nazi’s euthanasia programme, also known as “Action T4″, started in specialized medicinal departments in 1939. Initially, it was aimed at children suffering from “idiocy, Down’s syndrome, hydrocephalus and other abnormalities”. By the end of 1939, the programme was extended to adults “unworthy of living.” We estimate that, when it was stopped, more than 70,000 patients had been killed.
Action T4 (named after its address: Tiergarten Strasse 4) was the Berlin headquarters of the euthanasia programme. It was run by approximately 50 physicians who, amongst other activities, sent questionnaires to (mostly psychiatric) hospitals urging them to return lists of patients for euthanasia. The victims were transported to specialized centers where they were gassed or poisoned. Action T4 was thus responsible for medically supervised, large-scale murder. Its true significance, however, lies elsewhere. Action T4 turned out to be nothing less than a “pilot project” for the extinction of millions of prisoners of the concentration camps.
The T4 units had developed the technology for killing on an industrial scale. It was only with this know-how that the total extinction of all Jews of the Reich could be planned. This truly monstrous task required medical expertise.
Almost without exception, those physicians who had worked for T4 went on to take charge of what the Nazis called the ‘Final Solution’. While action T4 had killed thousands, its offspring would murder millions under the trained instructions of Nazi doctors.
The medical profession’s role in these crimes was critical and essential. German physicians had been involved at all levels and stages. They had created and embraced the pseudo-science of race hygiene. They were instrumental in developing it further into applied racism. They had generated the know-how of mass extinction. Finally, they also performed outrageously cruel and criminal experiments under the guise of scientific inquiry [see below]. German doctors had thus betrayed all the ideals medicine had previously stood for, and had become involved in criminal activities unprecedented in the history of medicine (full details and references on all of this are provided in my article, see link above).
It is well-documented that alternative medicine was strongly supported by the Nazis. The general belief is that this had nothing to do with the sickening atrocities of this period. I believe that this assumption is not entirely correct. In 2001, I published an article which reviews the this subject; I take the liberty of borrowing from it here.
Based on a general movement in favour of all things natural, a powerful trend towards natural ways of healing had developed in the 19(th)century. By 1930, this had led to a situation in Germany where roughly as many lay-practitioners of alternative medicine as conventional doctors were in practice.This had led to considerable tensions between the two camps. To re-unify German medicine under the banner of ‘Neue Deutsche Heilkunde’ (New German Medicine), Nazi officials eventually decided to create the profession of the ‘Heilpraktiker‘ (healing practitioner). Heilpraktiker were not allowed to train students and their profession was thus meant to become extinct within one generation; Goebbels spoke of having created the cradle and the grave of the Heilpraktiker. However, after 1945, this decision was challenged in the courts and eventually over-turned – and this is why Heilpraktiker are still thriving today.
The ‘flag ship’ of the ‘Neue Deutsche Heilkunde’ was the ‘Rudolf Hess Krankenhaus‘ in Dresden (which was re-named into Gerhard Wagner Krankenhaus after Hess’ flight to the UK). It represented a full integration of alternative and orthodox medicine.
An example of systematic research into alternative medicine is the Nazi government’s project to validate homoeopathy. The data of this massive research programme are now lost (some speculate that homeopaths made them disappear) but, according to an eye-witness report, its results were entirely negative (full details and references on alt med in 3rd Reich are in the article cited above).
There is,of course, plenty of literature on the subject of Nazi ‘research’ (actually, it was pseudo-research) and the unspeakable crimes it entailed. By contrast, there is almost no published evidence that these activities included in any way alternative medicine, and the general opinion seems to be that there are no connections whatsoever. I fear that this notion might be erroneous.
As far as I can make out, no systematic study of the subject has so far been published, but I found several hints and indications that the criminal experiments of Nazi doctors also involved alternative medicine (the sources are provided in my articles cited above or in the links provided below). Here are but a few leads:
Dr Wagner, the chief medical officer of the Nazis was a dedicated and most active proponent of alternative medicine.
Doctors in the alternative “Rudolf Hess Krankenhaus” [see above] experimented on speeding up the recovery of wounded soldiers, on curing syphilis with fasting, and on various other projects to help the war effort.
The Dachau concentration camp housed the largest plantation of medicinal herbs in Germany.
Dr Madaus (founder of the still existing company for natural medicines by the same name) experimented on the sterilisation of humans with herbal and homeopathic remedies, a project that was deemed of great importance for controlling the predicted population growth in the East of the expanding Reich.
Dr Grawitz infected Dachau prisoners with various pathogens to test the effectiveness of homeopathic remedies.
Schuessler salts were also tested on concentration camp inmates.
So, why bring all of this up today? Is it not time that we let grass grow over these most disturbing events? I think not! For many years, I actively researched this area (you can find many of my articles on Medline) because I am convinced that the unprecedented horrors of Nazi medicine need to be told and re-told – not just on HOLOCAUST MEMORIAL DAY, but continually. This, I hope, will minimize the risk of such incredible abuses ever happening again.
As I am drafting this post, I am in a plane flying back from Finland. The in-flight meal reminded me of the fact that no food is so delicious that it cannot be spoilt by the addition of too many capers. In turn, this made me think about the paper I happened to be reading at the time, and I arrived at the following theory: no trial design is so rigorous that it cannot to be turned into something utterly nonsensical by the addition of a few amateur researchers.
The paper I was reading when this idea occurred to me was a randomised, triple-blind, placebo-controlled cross-over trial of homeopathy. Sounds rigorous and top quality? Yes, but wait!
Essentially, the authors recruited 86 volunteers who all claimed to be suffering from “mental fatigue” and treated them with Kali-Phos 6X or placebo for one week (X-potencies signify dilution steps of 1: 10, and 6X therefore means that the salt had been diluted 1: 1000000 ). Subsequently, the volunteers were crossed-over to receive the other treatment for one week.
The results failed to show that the homeopathic medication had any effect (not even homeopaths can be surprised about this!). The authors concluded that Kali-Phos was not effective but cautioned that, because of the possibility of a type-2-error, they might have missed an effect which, in truth, does exist.
In my view, this article provides an almost classic example of how time, money and other resources can be wasted in a pretence of conducting reasonable research. As we all know, clinical trials usually are for testing hypotheses. But what is the hypothesis tested here?
According to the authors, the aim was to “assess the effectiveness of Kali-Phos 6X for attention problems associated with mental fatigue”. In other words, their hyposesis was that this remedy is effective for treating the symptom of mental fatigue. This notion, I would claim, is not a scientific hypothesis, it is a foolish conjecture!
Arguably any hypothesis about the effectiveness of a highly diluted homeopathic remedy is mere wishful thinking. But, if there were at least some promissing data, some might conclude that a trial was justified. By way of justification for the RCT in question, the authors inform us that one previous trial had suggested an effect; however, this study did not employ just Kali-Phos but a combined homeopathic preparation which contained Kalium-Phos as one of several components. Thus the authors’ “hypothesis” does not even amount to a hunch, not even to a slight incling! To me, it is less than a shot in the dark fired by blind optimists – nobody should be surprised that the bullet failed to hit anything.
It could even be that the investigators themselves dimly realised that something is amiss with the basis of their study; this might be the reason why they called it an “exploratory trial”. But an exploratory study is one whithout a hypothesis, and the trial in question does have a hyposis of sorts – only that it is rubbish. And what exactly did the authos meant to explore anyway?
That self-reported mental fatigue in healthy volunteers is a condition that can be mediatised such that it merits treatment?
That the test they used for quantifying its severity is adequate?
That a homeopathic remedy with virtually no active ingredient generates outcomes which are different from placebo?
That Hahnemann’s teaching of homeopathy was nonsense and can thus be discarded (he would have sharply condemned the approach of treating all volunteers with the same remedy, as it contradicts many of his concepts)?
That funding bodies can be fooled to pay for even the most ridiculous trial?
That ethics-committees might pass applications which are pure nonsense and which are thus unethical?
A scientific hypothesis should be more than a vague hunch; at its simplest, it aims to explain an observation or phenomenon, and it ought to have certain features which many alt med researchers seem to have never heard of. If they test nonsense, the result can only be nonsense.
The issue of conducting research that does not make much sense is far from trivial, particularly as so much (I would say most) of alt med research is of such or even worst calibre (if you do not believe me, please go on Medline and see for yourself how many of the recent articles in the category “complementary alternative medicine” truly contribute to knowledge worth knowing). It would be easy therefore to cite more hypothesis-free trials of homeopathy.
One recent example from Germany will have to suffice: in this trial, the only justification for conducting a full-blown RCT was that the manufacturer of the remedy allegedly knew of a few unpublished case-reports which suggested the treatment to work – and, of course, the results of the RCT eventually showed that it didn’t. Anyone with a background in science might have predicied that outcome – which is why such trials are so deplorably wastefull.
Research-funds are increasingly scarce, and they must not be spent on nonsensical projects! The money and time should be invested more fruitfully elsewhere. Participants of clinical trials give their cooperation willingly; but if they learn that their efforts have been wasted unnecessarily, they might think twice next time they are asked. Thus nonsensical research may have knock-on effects with far-reaching consequences.
Being a researcher is at least as serious a profession as most other occupations; perhaps we should stop allowing total amateurs wasting money while playing at being professioal. If someone driving a car does something seriously wrong, we take away his licence; why is there not a similar mechanism for inadequate researchers, funders, ethics-committees which prevents them doing further damage?
At the very minimum, we should critically evaluate the hypothesis that the applicants for research-funds propose to test. Had someone done this properly in relatiom to the two above-named studies, we would have saved about £150,000 per trial (my estimate). But as it stands, the authors will probably claim that they have produced fascinating findings which urgently need further investigation – and we (normally you and I) will have to spend three times the above-named amount (again, my estimate) to finance a “definitive” trial. Nonsense, I am afraid, tends to beget more nonsense.
In these austere and difficult times, it must be my duty, I think, to alert my fellow citizens to a possible source of additional income which almost anyone can plug into: become a charlatan, and chances are that your economic hardship is a memory from the past. To achieve this aim, I [with my tongue firmly lodged in my cheek] suggest a fairly straight forward step by step approach.
1. Find an attractive therapy and give it a fantastic name
Did I just say “straight forward”? Well, the first step isn’t that easy, after all. Most of the really loony ideas turn out to be taken: ear candles, homeopathy, aura massage, energy healing, urine-therapy, chiropractic etc. As a true charlatan, you want your very own quackery. So you will have to think of a new concept.
Something truly ‘far out’ would be ideal, like claiming the ear is a map of the human body which allows you to treat all diseases by doing something odd on specific areas of the ear – oops, this territory is already occupied by the ear acupuncture brigade. How about postulating that you have super-natural powers which enable you to send ‘healing energy’ into patients’ bodies so that they can repair themselves? No good either: Reiki-healers might accuse you of plagiarism.
But you get the gist, I am sure, and will be able to invent something. When you do, give it a memorable name, the name can make or break your new venture.
2. Invent a fascinating history
Having identified your treatment and a fantastic name for it, you now need a good story to explain how it all came about. This task is not all that tough and might even turn out to be fun; you could think of something touching like you cured your moribund little sister at the age of 6 with your intervention, or you received the inspiration in your dreams from an old aunt who had just died, or perhaps you want to create some religious connection [have you ever visited Lourdes?]. There are no limits to your imagination; just make sure the story is gripping – one day, they might make a movie of it.
3. Add a dash of pseudo-science
Like it or not, but we live in an age where we cannot entirely exclude science from our considerations. At the very minimum, I recommend a little smattering of sciency terminology. As you don’t want to be found out, select something that only few experts understand; quantum physics, entanglement, chaos-theory and Nano-technology are all excellent options.
It might also look more convincing to hint at the notion that top scientists adore your concepts, or that whole teams from universities in distant places are working on the underlying mechanisms, or that the Nobel committee has recently been alerted etc. If at all possible, add a bit of high tech to your new invention; some shiny new apparatus with flashing lights and digital displays might be just the ticket. The apparatus can be otherwise empty – as long as it looks impressive, all is fine.
4. Do not forget a dose of ancient wisdom
With all this science – sorry, pseudo-science – you must not forget to remain firmly grounded in tradition. Your treatment ought to be based on ancient wisdom which you have rediscovered, modified and perfected. I recommend mentioning that some of the oldest cultures of the planet have already been aware of the main pillars on which your invention today proudly stands. Anything that is that old has stood the test of time which is to say, your treatment is both effective and safe.
5. Claim to have a panacea
To maximise your income, you want to have as many customers as possible. It would therefore be unwise to focus your endeavours on just one or two conditions. Commercially, it is much better to affirm in no uncertain terms that your treatment is a cure for everything, a panacea. Do not worry about the implausibility of such a claim. In the realm of quackery, it is perfectly acceptable, even common behaviour to be outlandish.
6. Deal with the ‘evidence-problem’ and the nasty sceptics
It is depressing, I know, but even the most exceptionally gifted charlatan is bound to attract doubters. Sceptics will sooner or later ask you for evidence; in fact, they are obsessed by it. But do not panic – this is by no means as threatening as it appears. The obvious solution is to provide testimonial after testimonial.
You need a website where satisfied customers report impressive stories how your treatment saved their lives. In case you do not know such customers, invent them; in the realm of quackery, there is a time-honoured tradition of writing your own testimonials. Nobody will be able to tell!
7. Demonstrate that you master the fine art of cheating with statistics
Some of the sceptics might not be impressed, and when they start criticising your ‘evidence’, you might need to go the extra mile. Providing statistics is a very good way of keeping them at bay, at least for a while. The general consensus amongst charlatans is that about 70% of their patients experience remarkable benefit from whatever placebo they throw at them. So, my advice is to do a little better and cite a case series of at least 5000 patients of whom 76.5 % showed significant improvements.
What? You don’t have such case series? Don’t be daft, be inventive!
8. Score points with Big Pharma
You must be aware who your (future) customers are (will be): they are affluent, had a decent education (evidently without much success), and are middle-aged, gullible and deeply alternative. Think of Prince Charles! Once you have empathised with this mind-set, it is obvious that you can profitably plug into the persecution complex which haunts these people.
An easy way of achieving this is to claim that Big Pharma has got wind of your innovation, is positively frightened of losing millions, and is thus doing all they can to supress it. Not only will this give you street cred with the lunatic fringe of society, it also provides a perfect explanation why your ground-breaking discovery has not been published it the top journals of medicine: the editors are all in the pocket of Big Pharma, of course.
9. Ask for money, much money
I have left the most important bit for the end; remember: your aim is to get rich! So, charge high fees, even extravagantly high ones. If your treatment is a product that you can sell (e.g. via the internet, to escape the regulators), sell it dearly; if it is a hands-on therapy, charge heavy consultation fees and claim exclusivity; if it is a teachable technique, start training other therapists at high fees and ask a franchise-cut of their future earnings.
Over-charging is your best chance of getting famous – or have you ever heard of a charlatan famous for being reasonably priced? It will also get rid of the riff-raff you don’t want to see in your surgery. Poor people might be even ill! No, you don’t want them; you want the ‘worried rich and well’ who can afford to see a real doctor when things should go wrong. But most importantly, high fees will do a lot of good to your bank account.
Now you are all set. However, to prevent you from stumbling at the first hurdle, here are some handy answers to the questions you inevitably will receive from sceptics, this nasty breed that is never happy. The answers are not designed to convince them but, if voiced in public, they will ensure that the general opinion is on your side – and that’s what is paramount in the realm of quackery.
Q: Your treatment can cause considerable harm; do you find that responsible?
A: Harm? Do you know what you are talking about? Obviously not! Every year, hundreds of thousands die because of the medicine they received from mainstream doctors. This is what I call harm!
Q: Experts say that your treatment is not biologically plausible, what is your response?
A: There are many things science does not yet understand and many things that it will never understand. In any case, there are other ways of knowing, and science is but one of them.
Q: Where are the controlled trials to back up your claim?
A: Clinical trials are of very limited value; they are far too small, frequently biased and never depict the real life situation. This is why many experts now argue for better ways of showing the value of medical interventions.
Q: Professor Ernst recently said that your therapy is unproven, is that true?
A: This man cannot be trusted; he is in the pocket of the pharmaceutical industry! He would say that, wouldn’t he?
Anyway, did you know that only 15% of conventional therapies actually are evidence-based?
Q: Why is your treatment so expensive?
A: Years of training, a full research programme, constant audits, compliance with regulations, and a large team of co-workers – do you think that all of this comes free? Personally, I would treat all my patients for free (and often do so) but I have responsibilities to others, you know.
Last Friday, it was announced in Vienna that Prof Harald Walach is the recipient of a prestigious award. The Austrian ‘Society for Critical Thinking’ wanted to officially recognise Walach for his “unique effort to introduce science-free theories into academia“.
Walach is professor at the Europa-Universitaet Viadrina where he investigates alternative medicine as well as much more exotic subjects. During recent months, Walach made headlines because he had published research allegedly showing that, with the use of a “Kozyrev mirror“, one can open channels of time and space and make telepathy a reality.
In the laudatio, it was pointed out that Walach’s claim to fame is his attempt to render bullshit more respectable by pressing it through the channels of his university. The end result, the speaker stressed, is not that bullshit becomes non-bullshit, but that the university stinks.
Most of Walach’s research is in the area of the more implausible end of the alternative medicine spectrum, e.g. homeopathy and spiritual healing. He also is the editor in chief of a journal specialised in alternative medicine which virtually never publishes a negative result and where he frequently promotes his bizarrely irrational concepts.
Crucially, Walach is a member of the scientific advisory board of CAM-media-watch a blog run by Claus Fritzsche and sponsored by the homeopathic manufacturer Heel who also happens to be the donor for Walach’s university chair. Fritzsche and Walach have many things in common, not just the sponsor or the obsession with irrationality but also the fact that they frequently and unfairly attack me and my work.
I would like to take this opportunity to congratulate Walach for this remarkable award — they could not have found a more deserving pseudo-scientist!