The volume of medical research, as listed on Medline, is huge and increases steadily each year. This phenomenon can easily be observed with simple Medline searches. If we use search terms related to conventional medicine, we find near linear increases in the number of articles (here I do not make a distinction between types of articles) published in each area over time, invariably with a peak in 2013, the last year for which Medline listing is currently complete. Three examples will suffice:
PHARMACOTHERAPY 117 414 articles in 2013
PHARMACOLOGY 210 228 articles in 2013
ADVERSE EFFECTS 86 067 articles in 2013
Some of the above subjects are obviously heavily industry-dependent and thus perhaps not typical of the volume of research in health care generally. Let’s therefore look up three fields where there is no such powerful industry to support research:
PSYCHOTHERAPY 7 208 articles in 2013
PHYSIOTHERAPY 7 713 articles in 2013
SURGERY 154 417 articles in 2013
Now, if we conduct similar searches for topics related to alternative medicine, the picture changes in at least three remarkable ways: 1) there is no linear increase of the volume per year; instead the curves look flat and shapeless (the only exception is ‘herbal medicine’ where the increase even looks exponential). 2) The absolute volume does not necessarily peak in 2013 (exceptions are ‘acupuncture’ and ‘herbal medicine’). 3) The number of articles in the year with the most articles (as listed below) is small or even tiny:
ACUPUNCTURE 1 491 articles in 2013
CHIROPRACTIC 283 articles in 2011
HERBAL MEDICINE 2 503 articles in 2013
HOMEOPATHY 233 articles in 2005
NATUROPATHY 69 articles in 2010
You may think: so what? But I find these figures intriguing. They demonstrate that the research output in alternative medicine is minimal compared to that in conventional medicine. Moreover, they imply that this output is not only not increasing steadily, as it is in conventional medicine, but in the case of chiropractic, homeopathy and naturopathy, it has recently been decreasing.
To put this into context, we need to know that:
- there is a plethora of journals dedicated to alternative medicine which are keen to publish all sorts of articles,
- the peer-review process of most of these journals seems farcically poor,
- as a result, the quality of the research into alternative medicine is often dismal, as regularly disclosed on this blog,
- enthusiasts of alternative medicine often see rigorous research into their subject as a dangerous threat: it might disprove their prior beliefs.
In their defence, proponents of alternative medicine would probably claim that the low volume of research is due to a severe and unfair lack of funding. However, I fail to see how this can be the sole or even the main explanation: areas of conventional medicine that do not have industry support seem to manage a much higher output than alternative medicine (and I should stress that I have chosen 5 sections within alternative medicine that are associated with the highest number of articles per year). Research in these areas is usually sponsored by charitable and government sources, and it needs to be stressed that these are open to any researcher who submits good science.
What follows, I think, is simple: in general, alternative medicine advocates have little interest in research and even less expertise to conduct it.
A special issue of Medical Care has just been published; it was sponsored by the Veterans Health Administration’s Office of Patient Centered Care and Cultural Transformation. A press release made the following statement about it:
Complementary and alternative medicine therapies are increasingly available, used, and appreciated by military patients, according to Drs Taylor and Elwy. They cite statistics showing that CAM programs are now offered at nearly 90 percent of VA medical facilities. Use CAM modalities by veterans and active military personnel is as at least as high as in the general population.
If you smell a bit of the old ad populum fallacy here, you may be right. But let’s look at the actual contents of the special issue. The most interesting article is about a study testing acupuncture for posttraumatic stress disorder (PTSD).
Fifty-five service members meeting research diagnostic criteria for PTSD were randomized to usual PTSD care (UPC) plus eight 60-minute sessions of acupuncture conducted twice weekly or to UPC alone. Outcomes were assessed at baseline and 4, 8, and 12 weeks postrandomization. The primary study outcomes were difference in PTSD symptom improvement on the PTSD Checklist (PCL) and the Clinician-administered PTSD Scale (CAPS) from baseline to 12-week follow-up between the two treatment groups. Secondary outcomes were depression, pain severity, and mental and physical health functioning. Mixed model regression and t test analyses were applied to the data.
The results show that the mean improvement in PTSD severity was significantly greater among those receiving acupuncture than in those receiving UPC. Acupuncture was also associated with significantly greater improvements in depression, pain, and physical and mental health functioning. Pre-post effect-sizes for these outcomes were large and robust.
The authors conclude from these data that acupuncture was effective for reducing PTSD symptoms. Limitations included small sample size and inability to parse specific treatment mechanisms. Larger multisite trials with longer follow-up, comparisons to standard PTSD treatments, and assessments of treatment acceptability are needed. Acupuncture is a novel therapeutic option that may help to improve population reach of PTSD treatment.
What shall we make of this?
I know I must sound like a broken record to some, but I have strong reservations that the interpretation provided here is correct. One does not even need to be a ‘devil’s advocate’ to point out that the observed outcomes may have nothing at all to do with acupuncture per se. A much more rational interpretation of the findings would be that the 8 times 60 minutes of TLC and attention have positive effects on the subjective symptoms of soldiers suffering from PTSD. No needles required for this to happen; and no mystical chi, meridians, life forces etc.
It would, of course, have been quite easy to design the study such that the extra attention is controlled for. But the investigators evidently did not want to do that. They seemed to have the desire to conduct a study where the outcome was clear even before the first patient had been recruited. That some if not most experts would call this poor science or even unethical may not have been their primary concern.
The question I ask myself is, why did the authors of this study fail to express the painfully obvious fact that the results are most likely unrelated to acupuncture? Is it because, in military circles, Occam’s razor is not on the curriculum? Is it because critical thinking has gone out of fashion ( – no, it is not even critical thinking to point out something that is more than obvious)? Is it then because, in the present climate, it is ‘politically’ correct to introduce a bit of ‘holistic touchy feely’ stuff into military medicine?
I would love to hear what my readers think.
‘Healing, hype or harm? A critical analysis of complementary or alternative medicine’ is the title of a book that I edited and that was published in 2008. Its publication date coincided with that of ‘Trick or Treatment?’ and therefore the former was almost completely over-shadowed by the latter. Consequently few people know about it. This is a shame, I think, and this post is dedicated to encouraging my readers to have a look at ‘Healing, hype or harm?’
One reviewer commented on Amazon about this book as follows: Vital and informative text that should be read by everyone alongside Ben Goldacre’s ‘Bad Science’ and Singh and Ernt’s ‘Trick or Treatment’. Everyone should be able to made informed choices about the treatments that are peddled to the desperate and gullible. As Tim Minchin famously said ‘What do you call Alternative Medicine that has been proved to work? . . . Medicine!’
This is high praise indeed! But I should not omit the fact that others have commented that they were appalled by our book and found it “disappointing and unsettling”. This does not surprise me in the least; after all, alternative medicine has always been a divisive subject.
The book was written by a total of 17 authors and covers many important aspects of alternative medicine. Some of its most famous contributors are Michael Baum, Gustav Born, David Colquhoun, James Randi and Nick Ross. Some of the most important subjects include:
As already mentioned, our book is already 6 years old; however, this does not mean that it is now out-dated. The subject areas were chosen such that it will be timely for a long time to come. Nor does this book reflect one single point of view; as it was written by over a dozen different experts with vastly different backgrounds, it offers an entire spectrum of views and attitudes. It is, in a word, a book that stimulates critical thinking and thoughtful analysis.
I sincerely think you should have a look at it… and, in case you think I am hoping to maximise my income by telling you all this: all the revenues from this book go to charity.
If you think that homeopathy is risk-free, you should read what this US homeopath proclaims on his website. I have copied several sections from his lengthy article (everything that is in normal print is his writing; mine is in bold). The author first gives a general introduction into homeopathy and why he believes in it; then he continues:
…Now, on the surface, you might think that since there is some common ground between homeopathy and vaccinations, that homeopathic doctors would be, all-in, when it comes to vaccines. The fact is, most homeopaths today are against vaccinations. The main reason for that is not because of the underlying principle, but because the process have been perverted by eugenics. Today, the real purpose of vaccinations is to cause sterilization and early death. Bill Gates spends billions of dollars on global vaccination, admittedly, to reduce the population. All kinds of heavy metals like aluminum, mercury and other poisons and pathogens are put into vaccinations. People, especially children, are given many more times the amount of vaccinations today than they were decades gone by, when it can be argued, vaccinations were effective and were needed.Even cancer viruses have, on record, been put into vaccinations. There is no actual vaccine for cancer. The only reason to put cancer viruses in the mix is to create more cases of cancer. In this day and age, one of the most dangerous things you can do for your health is to get vaccinated…
With homeopathy, you never have to worry about heavy metals, cancer viruses or other poisons being mixed in with the natural ingredients. Even though some of the underlying foundations of homeopathy and vaccinations are similar, there are a number of differences. With vaccinations, the actual disease that they are allegedly trying to build up immunity to is in the injection. In homeopathy, that is not the case, except in rare exception, and due to the dilution process, there is never any risk. Another difference is that homeopathic remedies are taken orally, rather than injected…
Homeopathic remedies have no side effects. That’s a great thing. On the other hand, every drug comes with lots of side effects. And then, you can get in a vicious cycle where you keep taking (or being prescribed) more and more drugs to deal with more and more side effects. In time, this often leads to emergency “live saving” surgery. When they are successful and the patient doesn’t die on the operating table, everyone praises modern medicine for saving those millions of lives, all the while ignoring that the reason those millions of surgeries were needed in the first place, was due to those allegedly wonderful and so-called scientifically proven drugs. Plus, many times, these surgeries aren’t truly needed. If the patient would simply quit taking the drugs, the body could, often, heal itself from life threatening conditions…
Homeopathy is much more well known in Europe and various other nations than it is known in the United States. There is a huge medical conspiracy against the use of homeopathy and other medical modalities that threaten the financial dominance of the current medical industry. The conspiracy extends world-wide, but it is strongest in the USA…This conspiracy is being perpetrated on a conscious level, for going on 200 years. Then, on the heels of that, there is a massive amount of ignorance from ironically, highly educated people, who have been influenced by the conspirators. (Most of these people you might not be able to classify as conspirators, because they believe what they are saying.) Doctors who have never even tried a homeopathic remedy on themselves, or their patients, often say that there is no evidence that homeopathy works. When you point to the innumerable raving fans of homeopathy around the world, each of whom have testimonies of homeopathic remedies working extremely well, the detractors simply call those, anecdotal evidence, not worthy of consideration. When you point out some of the clinical case histories of undeniable healings that have come to patients of homeopathic doctors, the opponents of homeopathy chalk it all up to the placebo effect. They say they want scientific proof and that none exists, but the truth is, numerous studies have shown very positive results, and have outperformed drugs and/or placebo. There are more than 150 placebo controlled clinical studies, most of which have shown positive results, either compared with a placebo or compared with a conventional drug. Moreover, they did so with zero side effects, (unlike drugs, which often have that little side effect known as, death.) And yet, the detractors always have a Rolodex of never ending excuses, why those studies, “don’t count.” They range from, the studies are too small; they are conducted by people who believe in homeopathy – (I’m serious!); the doctors aren’t well known enough; there must have been some breakdown of the scientific procedure that has yet to come out, etc. These people are unable to deal with the conundrum, that homeopathic remedies become more potent, with dilution, instead of less potent, like you would assume. From there, they assume that it can’t work, and no matter how much healing is done with homeopathic remedies, it’s nothing more than mind of matter, (placebo effect.) …The evidence is overwhelming to anyone with an open mind that homeopathy is for real. Does everyone magically become well? Will you not have to die? You know the answers to that, and nobody is suggesting it.
What is undeniable is that the pharmaceutical industry peddles toxic drugs that do more harm than good, by far. Big pharma corporations get caught faking studies, bribing doctors and all kinds of dirty, illegal activity, for which they are fined billions of dollars. To call them purveyors of science is laughable. There are drugs like Vioxx, that have killed anywhere from tens of thousands to more than a million people (depending on whether you go by Merck and the FDA statistics, or outside investigators), which, shockingly, aren’t even pulled from the market by the government. The company finally quits peddling them once the lawsuits make it unprofitable…
I’ve finally come to the conclusion that these people aren’t interested in finding the truth. They only want to protect their status quo, and well as their paradigms of how the world works. They don’t have room for experiential evidence. When these type of people write research papers smearing homeopathy, they are being intellectually dishonest. They consciously obfuscate facts and mold findings to seem to conform to their beliefs – let the evidence be damned…
These medical mafia type of people, don’t even care about logic. They stopped making sense a long, long time ago. When you are done reading these two articles, if you have a modicum of an open mind, you will at the very least, not be able to deny that there really is a very genuine conspiracy against homeopathy…
Such utter nonsense speaks, I think, for itself. Therefore perhaps just this as my comment.
I have said and written it often: the homeopathic remedy might be harmless, however, many homeopaths are clearly not.
In a way, I should be thankful to the author of this truly amazing article enforcing my point.
Twenty years ago, when I started my Exeter job as a full-time researcher of complementary/alternative medicine (CAM), I defined the aim of my unit as applying science to CAM. At the time, this intention upset quite a few CAM-enthusiasts. One of the most prevalent arguments of CAM-proponents against my plan was that the study of CAM with rigorous science was quite simply an impossibility. They claimed that CAM included mind and body practices, holistic therapies, and other complex interventions which cannot not be put into the ‘straight jacket’ of conventional research, e. g. a controlled clinical trial. I spent the next few years showing that this notion was wrong. Gradually and hesitantly CAM researchers seemed to agree with my view – not all, of course, but first a few and then slowly, often reluctantly the majority of them.
What followed was a period during which several research groups started conducting rigorous tests of the hypotheses underlying CAM. All too often, the results turned out to be disappointing, to say the least: not only did most of the therapies in question fail to show efficacy, they were also by no means free of risks. Worst of all, perhaps, much of CAM was disclosed as being biologically implausible. The realization that rigorous scientific scrutiny often generated findings which were not what proponents had hoped for led to a sharp decline in the willingness of CAM-proponents to conduct rigorous tests of their hypotheses. Consequently, many asked whether science was such a good idea after all.
But that, in turn, created a new problem: once they had (at least nominally) committed themselves to science, how could they turn against it? The answer to this dilemma was easier that anticipated: the solution was to appear dedicated to science but, at the same time, to argue that, because CAM is subtle, holistic, complex etc., a different scientific approach was required. At this stage, I felt we had gone ‘full circle’ and had essentially arrived back where we were 20 years ago – except that CAM-proponents no longer rejected the scientific method outright but merely demanded different tools.
A recent article may serve as an example of this new and revised stance of CAM-proponents on science. Here proponents of alternative medicine argue that a challenge for research methodology in CAM/ICH* is the growing recognition that CAM/IHC practice often involves complex combination of novel interventions that include mind and body practices, holistic therapies, and others. Critics argue that the reductionist placebo controlled randomized control trial (RCT) model that works effectively for determining efficacy for most pharmaceutical or placebo trial RCTs may not be the most appropriate for determining effectiveness in clinical practice for either CAM/IHC or many of the interventions used in primary care, including health promotion practices. Therefore the reductionist methodology inherent in efficacy studies, and in particular in RCTs, may not be appropriate to study the outcomes for much of CAM/IHC, such as Traditional Korean Medicine (TKM) or other complex non-CAM/IHC interventions—especially those addressing comorbidities. In fact it can be argued that reductionist methodology may disrupt the very phenomenon, the whole system, that the research is attempting to capture and evaluate (i.e., the whole system in its naturalistic environment). Key issues that surround selection of the most appropriate methodology to evaluate complex interventions are well described in the Kings Fund report on IHC and also in the UK Medical Research Council (MRC) guidelines for evaluating complex interventions—guidelines which have been largely applied to the complexity of conventional primary care and care for patients with substantial comorbidity. These reports offer several potential solutions to the challenges inherent in studying CAM/IHC. [* IHC = integrated health care]
Let’s be clear and disclose what all of this actually means. The sequence of events, as I see it, can be summarized as follows:
- We are foremost ALTERNATIVE! Our treatments are far too unique to be subjected to reductionist research; we therefore reject science and insist on an ALTERNATIVE.
- We (well, some of us) have reconsidered our opposition and are prepared to test our hypotheses scientifically (NOT LEAST BECAUSE WE NEED THE RECOGNITION THAT THIS MIGHT BRING).
- We are dismayed to see that the results are mostly negative; science, it turns out, works against our interests.
- We need to reconsider our position.
- We find it inconceivable that our treatments do not work; all the negative scientific results must therefore be wrong.
- We always said that our treatments are unique; now we realize that they are far too holistic and complex to be submitted to reductionist scientific methods.
- We still believe in science (or at least want people to believe that we do) – but we need a different type of science.
- We insist that RCTs (and all other scientific methods that fail to demonstrate the value of CAM) are not adequate tools for testing complex interventions such as CAM.
- We have determined that reductionist research methods disturb our subtle treatments.
- We need pragmatic trials and similarly ‘soft’ methods that capture ‘real life’ situations, do justice to CAM and rarely produce a negative result.
What all of this really means is that, whenever the findings of research fail to disappoint CAM-proponents, the results are by definition false-negative. The obvious solution to this problem is to employ different (weaker) research methods, preferably those that cannot possibly generate a negative finding. Or, to put it bluntly: in CAM, science is acceptable only as long as it produces the desired results.
In the US, the scope of practice of health care professionals is a matter for each state to decide. Only the one of doctors is regulated nationwide. Other health care professions’ scope of practice can vary considerably within the US. This means that a chiropractor in one state of the US might be allowed to do more (or less) than in the next state. But what exactly are US chiropractors legally allowed to do?
A recent paper was aimed at answering this very question. Its authors assessed the current status of chiropractic practice laws in the US.
A cross-sectional survey of licensure officials from the Federation of Chiropractic Licensing Boards e-mail list was conducted in 2011 requesting information about chiropractic practice laws and 97 diagnostic, evaluation, and management procedures. To evaluate content validity, the survey was distributed in draft form at the fall 2010 Federation of Chiropractic Licensing Boards regional meeting to regulatory board members and feedback was requested. Comments were reviewed and incorporated into the final survey.
Partial or complete responses were received from 96% (n = 51) of the jurisdictions. The states with the highest number of services that could be performed were Missouri (n = 92), New Mexico (n = 91), Kansas (n = 89), Utah (n = 89), Oklahoma (n = 88), Illinois (n = 87), and Alabama (n = 86). The states with the highest number of services that cannot be performed are New Hampshire (n = 49), Hawaii (n = 47), Michigan (n = 42), New Jersey (n = 39), Mississippi (n = 39), and Texas (n = 30).
The authors conclude that the scope of chiropractic practice in the United States has a high degree of variability. Scope of practice is dynamic, and gray areas are subject to interpretation by ever-changing board members. Although statutes may not address specific procedures, upon challenge, there may be a possibility of sanctions depending on interpretation.
For me, the most surprising aspect of this article was to realise how many ‘non-chiropractic’ activities chiropractors are legally permitted in some US states. Here are some of the items that amazed me most:
- birth certificates
- death certificates
- premarital certificates
- recto-vaginal exam
- i.v. injections
- prostatic exam
- genital exam
- ear irrigation
- colonic irrigation
- oral and i.v. chelation therapy
- hyperbaric chamber
I have to admit that I did not even know what a PREMARITAL CERTIFICATE’ is; so I looked it up. The first one I found on the internet was entitled “PURITY COVENANT” and committed the couple “to abstain from fornication and remain sincere to the Lord Jesus Christ and to each other”
I have to further admit that many other of the items on this list leave me equally speechless. For example, how can chiropractors with their training focussed on the musculoskeletal system responsibly complete a death certificate? Why are they allowed in some states to examine the genitalia of their patients?
I suspect the perceived need of chiropractors to do all these things must be closely related to their long-standing ambition to become primary care physicians. Just to be clear: a primary care physician is a physician who provides both the first contact for a person with an undiagnosed health concern as well as continuing care of varied medical conditions, not limited by cause, organ system, or diagnosis. I have always been more than just a bit perplexed how chiropractors, who state that they are musculoskeletal specialists, might even consider being competent primary care providers.
But regardless of common sense, they do! The US ‘Council of Chiropractic Education’ accreditation process, for instance, requires schools to educate and train students to become a “competent doctor of chiropractic who will provide quality patient care and serve as a primary care physician” and the chiro-literature is awash with statements such as this one: “The primary care chiropractic physician is a viable and important part of the primary health care delivery system, with many chiropractic physicians currently prepared to participate effectively and competently in primary care.” Moreover, the phenomenon is by no means limited to the US: “chiropractors in the UK view their role as one of a primary contact healthcare practitioner and that this view is held irrespective of the country in which they were educated or the length of time in practice.”
As far as I am concerned, chiropractors might view their role as whatever they want. The fact is that, even if they add many more items to the list of their ‘services’, they are very far from being competent primary care physicians. Being able to provide the first contact as well as continuous care of medical conditions, not limited by cause, organ system, or diagnosis is not a matter of wishful thinking.
Yesterday, BBC NEWS published the following interesting text about a BBC4 broadcast entitled ‘THE ROYAL ACTIVIST’ aired on the same day:
Prince Charles has been a well-known supporter of complementary medicine. According to a… former Labour cabinet minister, Peter Hain, it was a topic they shared an interest in.
“He had been constantly frustrated at his inability to persuade any health ministers anywhere that that was a good idea, and so he, as he once described it to me, found me unique from this point of view, in being somebody that actually agreed with him on this, and might want to deliver it.”
Mr Hain added: “When I was Secretary of State for Northern Ireland in 2005-7, he was delighted when I told him that since I was running the place I could more or less do what I wanted to do.***
“I was able to introduce a trial for complementary medicine on the NHS, and it had spectacularly good results, that people’s well-being and health was vastly improved.
“And when he learnt about this he was really enthusiastic and tried to persuade the Welsh government to do the same thing and the government in Whitehall to do the same thing for England, but not successfully,” added Mr Hain.
*** obviously there is no homeopathic remedy for megalomania (but that’s a different story)
SPECTACULARLY GOOD RESULTS?
Let’s have a look at the ‘trial’ and its results. An easily accessible report provides the following details about it:
From February 2007 to February 2008, Get Well UK ran the UK’s first government-backed complementary therapy pilot. Sixteen practitioners provided treatments including acupuncture, osteopathy and aromatherapy, to more than 700 patients at two GP practices in Belfast and Derry.
The BBC made an hour long documentary following our trials and tribulations, which was broadcast on BBC1 NI on 5 May 2008.
Aims and Objectives
The aim of the project was to pilot services integrating complementary medicine into existing primary care services in Northern Ireland. Get Well UK provided this pilot project for the Department for Health, Social Services and Public Safety (DHSSPS) during 2007.
The objectives were:
- To measure the health outcomes of the service and monitor health improvements.
- To redress inequalities in access to complementary medicine by providing therapies through the NHS, allowing access regardless of income.
- To contribute to best practise in the field of delivering complementary therapies through primary care.
- To provide work for suitably skilled and qualified practitioners.
- To increase patient satisfaction with quick access to expert care.
- To help patients learn skills to improve and retain their health.
- To free up GP time to work with other patients.
- To deliver the programme for 700 patients.
The results of the pilot were analysed by Social and Market Research, who produced this report.
The findings can be summarised as follows:
Following the pilot, 80% of patients reported an improvement in their symptoms, 64% took less time off work and 55% reduced their use of painkillers.
In the pilot, 713 patients with a range of ages and demographic backgrounds and either physical or mental health conditions were referred to various complementary and alternative medicine (CAM) therapies via nine GP practices in Belfast and Londonderry. Patients assessed their own health and wellbeing pre and post therapy and GPs and CAM practitioners also rated patients’ responses to treatment and the overall effectiveness of the scheme.
• 81% of patients reported an improvement in their physical health
• 79% reported an improvement in their mental health
• 84% of patients linked an improvement in their health and wellbeing directly to their CAM treatment
• In 65% of patient cases, GPs documented a health improvement, correlating closely to patient-reported improvements
• 94% of patients said they would recommend CAM to another patient with their condition
• 87% of patient indicated a desire to continue with their CAM treatment
Painkillers and medication
• Half of GPs reported prescribing less medication and all reported that patients had indicated to them that they needed less
• 62% of patients reported suffering from less pain
• 55% reported using less painkillers following treatment
• Patients using medication reduced from 75% before treatment to 61% after treatment
• 44% of those taking medication before treatment had reduced their use afterwards
Health service and social benefits
• 24% of patients who used health services prior to treatment (i.e. primary and secondary care, accident and emergency) reported using the services less after treatment
• 65% of GPs reported seeing the patient less following the CAM referral
• Half of GPs said the scheme had reduced their workload and 17% reported a financial saving for their practice
• Half of GPs said their patients were using secondary care services less.
Impressed? Well, in case you are, please consider this:
- there was no control group
- therefore it is not possible to attribute any of the outcomes to the alternative therapies offered
- they could have been due to placebo-effects
- or to the natural history of the disease
- or to regression towards the mean
- or to social desirability
- or to many other factors which are unrelated to the alternative treatments provided
- most outcome measures were not objectively verified
- the patients were self-selected
- they would all have had conventional treatments in parallel
- this ‘trial’ was of such poor quality that its findings were never published in a peer-reviewed journal
- this was not a ‘trial’ but a ‘pilot study’
- pilot studies are not normally for measuring outcomes but for testing the feasibility of a proper trial
- the research expertise of the investigators was close to zero
- the scientific community merely had pitiful smiles for this ‘trial’ when it was published
- neither Northern Ireland nor any other region implemented the programme despite its “spectacularly good results”.
So, is the whole ‘trial’ story an utterly irrelevant old hat?
Certainly not! Its true significance does not lie in the fact that a few amateurs are trying to push bogus treatments into the NHS via the flimsiest pseudo-research of the century. The true significance, I think, is that it shows how Prince Charles, once again, oversteps the boundaries of his constitutional role.
Arnold Relman has died aged 91. He was a great personality, served for many years as editor-in-chief of ‘The New England Journal of Medicine’ and was professor of medicine and social medicine at Harvard Medical School. He also was an brilliantly outspoken critic of alternative medicine, and I therefore believe that he deserves to be remembered here. The following excerpts are from an article he wrote in 1998 about Andrew Weil, America’s foremost guru of alternative medicine; I have taken the liberty of extracting a few paragraphs which deal with alternative medicine in general terms.
Until now, alternative medicine has generally been rejected by medical scientists and educators, and by most practicing physicians. The reasons are many, but the most important reason is the difference in mentality between the alternative practitioners and the medical establishment. The leaders of the establishment believe in the scientific method, and in the rule of evidence, and in the laws of physics, chemistry, and biology upon which the modern view of nature is based. Alternative practitioners either do not seem to care about science or explicitly reject its premises. Their methods are often based on notions totally at odds with science, common sense, and modern conceptions of the structure and the function of the human body. In advancing their claims, they do not appear to recognize the need for objective evidence, asserting that the intuitions and the personal beliefs of patients and healers are all that is needed to validate their methods. One might have expected such thinking to alienate most people in a technologically advanced society such as ours; but the alternative medicine movement, and the popularity of gurus such as Weil, are growing rapidly…
That people usually “get better,” that most relatively minor diseases heal spontaneously or seem to improve with simple common remedies, is hardly news. Every physician, indeed every grandmother, knows that. Yet before we accept Weil’s contention that serious illnesses such as “bone cancer,” “Parkinson’s disease,” or “scleroderma” are similarly curable, or respond to alternative healing methods, we need at least to have some convincing medical evidence that the patients whom he reports in these testimonials did indeed suffer from these diseases, and that they were really improved or healed. The perplexity is not that Weil is using “anecdotes” as proof, but that we don’t know whether the anecdotes are true.
Anecdotal evidence is often used in the conventional medical literature to suggest the effectiveness of treatment that has not yet been tested by formal clinical trials. In fact, much of the mainstream professional literature in medicine consists of case reports — “anecdotes,” of a kind. The crucial difference between those case reports and the testimonials that abound in Weil’s books (and throughout the literature of alternative medicine) is that the case reports in the mainstream literature are almost always meticulously documented with objective data to establish the diagnosis and to verify what happened, whereas the testimonials cited by alternative medicine practitioners usually are not. Weil almost never gives any objective data to support his claims. Almost everything is simply hearsay and personal opinion.
To the best of my knowledge, Weil himself has published nothing in the peer-reviewed medical literature to document objectively his personal experiences with allegedly cured patients or to verify his claims for the effectiveness of any of the unorthodox remedies he uses. He is not alone in this respect. Few proponents of alternative medicine have so far published clinical reports that would stand the rigorous scientific scrutiny given to studies of traditional medical treatments published in the serious medical journals. Alternative medicine is still a field rich in undocumented claims and anecdotes and relatively lacking in credible scientific reports…
… Thus Weil can believe in miraculous cures even while claiming to be rational and scientific, because he thinks that quantum theory supports his views.
Yet the leading physicists of our time do not accept such an interpretation of quantum theory. They do not believe quantum theory says anything about the role of human consciousness in the physical world. They see quantum laws as simply a useful mathematical formulation for describing subatomic phenomena that are not adequately handled by classical physical theory, although the latter remains quite satisfactory for the analysis of physical events at the macro-level. Steven Weinberg has observed that “quantum mechanics has been overwhelmingly important to physics, but I cannot find any messages for human life in quantum mechanics that are different in any important way from those of Newtonian physics.” And overriding all discussions of the meaning of quantum physics is the fundamental fact that quantum theory, like all other scientific law, is only valid to the extent that it predicts and accords with the evidence provided by observation and objective measurement. Richard Feynman said it quite simply: “Observation is the ultimate and final judge of the truth of an idea.” Feynman also pointed out that scientific observations need to be objective, reproducible, and, in a sense, public — that is, available to all interested scientists who wish to check the observations for themselves.
Surely almost all scientists would agree with Feynman that, regardless of what theory of nature we wish to espouse, we cannot escape the obligation to support our claims with objective evidence. All theories must conform to the facts or be discarded. So, if Weil cannot produce credible evidence to validate the miraculous cures that he claims for the healing powers of the mind, and if he does not support with objective data the claims he and others make for the effectiveness of alternative healing methods, he cannot presume to wear the mantle of science, and his appeal to quantum theory cannot help him.
Some apologists for alternative medicine have argued that since their healing methods are based on a “paradigm” different from that of traditional medicine, traditional standards of evidence do not apply. Weil sometimes seems to agree with that view, as when he talks about “stoned thinking” and the “ambivalent” nature of reality, but more recently — as he seeks to integrate alternative with allopathic medicine — he seems to acknowledge the need for objective evidence. This, at least, is how I would interpret one of his most recent and ambitious publishing ventures, the editorship of the new quarterly journal Integrative Medicine***.
Integrative Medicine describes itself as a “peer-reviewed journal … committed to gathering evidence for the safety and efficacy of all approaches to health according to the highest standards of scientific research, while remaining open to new paradigms and honoring the healing power of nature.” The Associate Editors and Editorial Board include prominent names in both alternative medicine and allopathic medicine, who presumably support that mission. Yet the first two issues will disappoint those who were looking for original clinical research based on new, objective data. Perhaps subsequent issues will be different, but in any case it is hard to understand the need for Weil’s new journal if he truly intends to hold manuscripts to accepted scientific standards: there already exist many leading peer-reviewed medical journals that will review research studies of alternative healing methods on their merits. During the past decade or so, only a few such studies have passed rigorous review and have been published in first-rate journals. Recently, more studies have been published, but very few of them report significant clinical effects. And that is pretty much where matters now stand. Despite much avowed interest in research on alternative medicine and increased investment in support of such research, the evidentiary underpinnings of unconventional healing methods are still largely lacking…
The alternative medicine movement has been around for a long time, but it was eclipsed during most of this century by the success of medical science. Now there is growing public disenchantment with the cost and the impersonality of modern medical care, as well as concern about medical mistakes and the complications and side-effects of pharmaceuticals and other forms of medical treatment. For their part, physicians have allowed the public to perceive them as uninterested in personal problems, as inaccessible to their patients except when carrying out technical procedures and surgical operations. The “doctor knows best” attitude, which dominated patient-doctor relations during most of the century, has in recent decades given way to a more activist, consumer-oriented view of the patient’s role. Moreover, many other licensed health-care professionals, such as nurse-practitioners, psychotherapists, pharmacists, and chiropractors, are providing services once exclusively reserved to allopathic physicians.
The net result of all these developments has been a weakening of the hegemony that allopathic medicine once exercised over the health care system, and a growing interest by the public in exploring other healing approaches. The authority of allopathic medicine is also being challenged by a swelling current of mysticism and anti-scientism that runs deep through our culture. Even as the number and the complexity of urgent technological and scientific issues facing contemporary society increase, there seems to be a growing public distrust of the scientific outlook and a reawakening of interest in mysticism and spiritualism.
All this obscurantism has given powerful impetus to the alternative medicine movement, with its emphasis on the power of mind over matter. And so consumer demand for alternative remedies is rising, as is public and private financial support for their study and clinical use. It is no wonder that practicing physicians, the academic medical establishment, and the National Institutes of Health are all finding reasons to pay more attention to the alternative medicine movement. Indeed, it is becoming politically incorrect for the movement’s critics to express their skepticism too strongly in public…
There is no doubt that modern medicine as it is now practiced needs to improve its relations with patients, and that some of the criticisms leveled against it by people such as Weil — and by many more within the medical establishment itself — are valid. There also can be no doubt that a few of the “natural” medicines and healing methods now being used by practitioners of alternative medicine will prove, after testing, to be safe and effective. This, after all, has been the way in which many important therapeutic agents and treatments have found their way into standard medical practice in the past. Mainstream medicine should continue to be open to the testing of selected unconventional treatments. In keeping an open mind, however, the medical establishment in this country must not lose its scientific compass or weaken its commitment to rational thought and the rule of evidence.
There are not two kinds of medicine, one conventional and the other unconventional, that can be practiced jointly in a new kind of “integrative medicine.” Nor, as Andrew Weil and his friends also would have us believe, are there two kinds of thinking, or two ways to find out which treatments work and which do not. In the best kind of medical practice, all proposed treatments must be tested objectively. In the end, there will only be treatments that pass that test and those that do not, those that are proven worthwhile and those that are not. Can there be any reasonable “alternative”?
*** the journal only existed for a short period of time
‘THE HINKLEY TIMES’ is not a paper that I read often, I have to admit – but maybe I should! It was there that I found the following remarkable article:
Bosworth MP David Tredinnick has asked questions in the House of Commons about the growing problem of antibiotic resistance within hospitals, suggesting herbal remedies could be answer.
The Tory MP, who has a keen interest in alternative medicine particularly herbal curatives, asked Jeremy Hunt, Secretary of State for Health, whether the problem was being discussed at the very top level.
He said: “Does my right honourable friend agree that a critical problem that A and E units will face in the future is antibiotic resistance? Is he aware that the science and technology committee, of which I am a member, has been looking at this issue and it also interests the health committee, of which I am also a member? Can he assure me that he is talking to the Prime Minister about how to stimulate new antibiotic research, and will he also remember that nature has its own remedies, such as tea tree oil?”
In reply Mr Hunt said: “My honourable friend is right about the seriousness of the issue of antimicrobial resistance. Some 25,000 people die in Europe every year as a result of the failure of antibiotics – more than die in road traffic accidents. I raised the issue at the World Health Assembly and I have discussed it closely with the Prime Minister.”
David Tredinnick is no stranger to strange ideas. Wikipedia (yes I know, many people do not like it as a source) sums it up quite succinctly:
He is a supporter of complementary and alternative medicine (CAM). He has made supportive comments in Parliament on homeopathy, despite continued lack of evidence of its effectiveness. He has supported chiropractic and mentioned the influence of the Moon on blood clotting. In this same debate he characterised scientists as “racially prejudiced”. He has tabled several early day motions in support of homeopathy’s continued funding on the National Health Service.Tredinnick’s views continue to cause amused disbelief in some quarters and a spokesman for the Royal College of Surgeons of England said they would “laugh their heads off” at the suggestion they could not operate at the full moon.
At the 2010 general election, in addition to candidates from the two main parties, Tredinnick was opposed by New Scientist journalist Dr. Michael Brooks who objected to “Tredinnick’s outspoken promotion of complementary and alternative medicine.”During a hustings debate called by Brooks to “highlight the scientific literacy of the UK’s elected representatives” Brooks claimed that Tredinnick regarded homeopathy as a suitable treatment for Malaria and HIV, which Tredinnick did not deny. Tredinnick in turn argued that “alternative treatments are incredibly good value for money” and stated his belief that randomised controlled trials are not effective at evaluating very dilute preparations.
In March 2013 Tredinnick was ridiculed as “nonsensical” by the government’s outgoing chief scientist, Sir John Beddington, who said the MP had fallen for the “Galileo fallacy” (Galileo was laughed at but was right, therefore since I am laughed at I must be right).
In July 2013 Tredinnick sponsored an EDM congratulating a farmer on his decision to use homeopathy with what were claimed to be positive results.The motion was supported by one other MP but the British veterinary association says there is no evidence of any benefit.
Tredinnick is a supporter of astrology especially the use of it in medical practice.In November 2009, he spoke at a meeting organised by the Astrological Association of Great Britain, where he related his personal experience of astrology and illness, advocating that astrology be integrated into the NHS.
Tredinnick’s appointment to the Health committee in June 2010 was criticised in two science reports in the Guardian. Martin Robbins said his appointment was “an extremely disturbing development” even though “Tredinnick is a figure unlikely to be taken seriously by policymakers” whilst Nature‘s Adam Rutherford described Tredinnick as “misinformed about a great many things” and said that “giving [him] influence on medical policy ..is a bad move.”The Telegraph writer Ian Douglas also described it as “a problem.”
His appointment to the Science and technology committee also drew criticism. Andy McSmith in the Independent, cited his views that homeopathy could cure HIV, TB, malaria, urinary infections, diarrhoea, skin eruptions, diabetes, epilepsy, eye infections, intestinal parasites, cancer, and gangrene amongst others and quoted Imran Khan, head of the Campaign for Science and Engineering, as saying that “someone with such incredibly odd views is not helpful”. Tom Whipple in the Times said his appointment caused despair,whilst Elizabeth Gibney in the Times Higher Education quoted the Skeptical Voter website as saying that Tredinnick is “perhaps the worst example of scientific illiteracy in government”…
In 2009 Tredinnick attempted to claim the £125 cost of attending a course on “intimate relationships” through his Parliamentary expenses. He was also found to have used expenses to purchase astrology software, claiming it was for a debate on alternative medicine.
Compared to some of theses bizarre activities, the notion that herbal remedies might provide the solution for antibiotic resistance seems almost reasonable and clever.
Tredinnick does not seem to know that:
- many antibiotics originate from plants or other natural substances,
- several large pharmaceutical companies are feverishly looking for more such substances from plants,
- most plants do actually contain substances which have antibiotic activity,
- however, most cannot be used as medicines, for instance, because they are far too toxic (tea tree oil is a good example for this),
- once a pure compound has been isolated from a plant and is used therapeutically, it ceases to be herbal medicine (which is defined as the use of full plant extracts),
- it is thus unlikely that full plant extracts, i. e. herbal medicine, will ever provide a solution to antibiotic resistance.
I have little doubt that Tredinnick will continue to mislead parliament and the public with his nonsensical views about alternative medicine. And even if it might have no effect whatsoever, I will continue to point out just how nonsensical they are.
Many proponents of chiropractic claim that chiropractic spinal manipulation therapy (SMT) for chronic low back pain (LBP) might save health care cost. As LBP is a hugely expensive condition, this is a mighty important question. The evidence on this issue is, however, flimsy to say the least. Most experts seem to conclude that more reliable data are needed. On this background, it seems relevant to note that a new relevant study has just become available.
The purpose of this analysis was to report the incremental costs and benefits of different doses of SMT in patients with LBP.
The researchers randomized 400 patients with chronic LBP to receive doses of 0, 6, 12, or 18 sessions of SMT. Patients were scheduled for 18 visits for 6 weeks and received SMT or light massage control from a chiropractor. Societal costs in the year after study enrollment were estimated using patient reports of health care use and lost productivity. The main health outcomes were the number of pain-free days and disability-free days.
The results show that costs for treatment and lost productivity ranged from $3398 for 12 SMT sessions to $3815 for 0 SMT sessions with no statistically significant differences between groups. Baseline patient characteristics related to increase in costs were greater age, greater disability, lower quality-adjusted life year scores, and higher costs in the period preceding enrolment. Pain-free and disability-free days were greater for all SMT doses compared with control, but only SMT 12 yielded a statistically significant benefit of 22.9 pain-free days and 19.8 disability-free days. No statistically significant group differences in quality-adjusted life years were noted.
The authors drew the following conclusions from these data: a dose of 12 SMT sessions yielded a modest benefit in pain-free and disability-free days. Care of chronic LBP with SMT did not increase the costs of treatment plus lost productivity.
So, is chiropractic SMT for LBP cost-effective? I leave it to my readers to answer this question.