It has been reported that Belgium has just officially recognised homeopathy. The government had given the green light already in July last year, but the Royal Decree has only now become official. This means that, from now on, Belgian doctors, dentists and midwives can only call themselves homeopaths, if they have attended recognised courses in homeopathy and are officially certified. While much of the new regulation is as yet unclear (at least to me), it seems that, in future, only doctors, dentists and midwives are allowed to practice homeopathy, according to one source.
However, the new law also seems to provide that those clinicians with a Bachelor degree in health care who have already been practicing as homeopaths can continue their activities under a temporary measure.
Moreover, the official recognition as a homeopath does not automatically imply that the services will be refunded from a health insurance.
It is said that, in general, homeopaths are happy with the new regulation; they are delighted to have been up-graded in this way and argue that the changes will result in higher quality standards: “This is a very important step and it can only be to the benefit of the patients’ safety. Patients will know whether or not they are dealing with someone who correctly applies homeopathic medicine”, Leon Schepers of the Unio Homeopathica Belgica was quoted saying.
The delight of homeopaths is in sharp contrast to the dismay of rational thinkers. The NHMRC recently assessed the effectiveness of homeopathy. The evaluation is both comprehensive and independent; it concluded that “the evidence from research in humans does not show that homeopathy is effective for treating the range of health conditions considered.” In other words, homeopathic remedies are implausible, over-priced placebos.
Granting an official status to homeopaths cannot possibly benefit patients. On the contrary, it will only render health care less effective and charlatans more assertive.
Recently, I have been invited by the final year pharmacy students of the ‘SWISS FEDERAL INSTITUTE OF TECHNOLOGY ZURICH‘ to discuss alternative medicine with them. The aspect I was keen to debate was the issue of retail-pharmacists selling medicines which are unproven or even disproven. Using the example of homeopathic remedies, I asked them how many might, when working as retail-pharmacists, sell such products. About half of them admitted that they would do this. In real life, this figure is probably closer to 100%, and this discrepancy may well be a reflection of the idealism of the students, still largely untouched by the realities of retail-pharmacy.
In our discussions, we also explored the reasons why retail-pharmacists might offer unproven or disproven medicines like homeopathic remedies to their customers. The ethical codes of pharmacists across the world quite clearly prohibit this – but, during the discussions, we all realised that the moral high ground is not easily defended against the necessity of making a living. So, what are the possible motivations for pharmacists to sell bogus medicines?
One reason would be that they are convinced of their efficacy. Whenever I talk to pharmacists, I do not get the impression that many of them believe in homeopathy. During their training, they are taught the facts about homeopathy which clearly do not support the notion of efficacy. If some pharmacists nevertheless were convinced of the efficacy of homeopathy, they would obviously not be well informed and thus find themselves in conflict with their duty to practice according to the current best evidence. On reflection therefore, strong positive belief can probably be discarded as a prominent reason for pharmacists selling bogus medicines like homeopathic remedies.
Another common argument is the notion that, because patients want such products, pharmacists must offer them. When considering it, the tension between the ethical duties as a health care professional and the commercial pressures of a shop-keeper becomes painfully obvious. For a shop-keeper, it may be perfectly fine to offer all products which might customers want. For a heath care professional, however, this is not necessarily true. The ethical codes of pharmacists make it perfectly clear that the sale of unproven or disproven medicines is not ethical. Therefore, this often cited notion may well be what pharmacists feel, but it does not seem to be a valid excuse for selling bogus medicines.
A variation of this theme is the argument that, if patients were unable to buy homeopathic remedies for self-limiting conditions which do not really require treatment at all, they would only obtain more harmful drugs. The notion here is that it might be better to sell harmless homeopathic placebos in order to avoid the side-effects of real but non-indicated medicines. In my view, this argument does not hold water: if no (drug) treatment is indicated, professionals have a duty to explain this to their patients. In this sector of health care, a smaller evil cannot easily be justified by avoiding a bigger one; on the contrary, we should always thrive for the optimal course of action, and if this means reassurance that no medical treatment is needed, so be it.
An all too obvious reason for selling bogus medicines is the undeniable fact that pharmacists earn money by doing so. There clearly is a conflict of interest here, whether pharmacists want to admit it or not – and mostly they fail to do so or play down this motivation in their decision to sell bogus medicines.
Often I hear from pharmacists working in large chain pharmacies like Boots that they have no influence whatsoever over the range of products on sale. This perception mat well be true. But equally true is the fact that no health care professional can be forced to do things which violate their code of ethics. If Boots insists on selling bogus medicines, it is up to individual pharmacists and their professional organisations to change this situation by protesting against such unethical malpractice. In my view, the argument is therefore not convincing and certainly does not provide an excuse in the long-term.
While discussing with the Swiss pharmacy students, I was made aware of yet another reason for selling bogus medicines in pharmacies. Some pharmacists might feel that stocking such products provides an opportunity for talking to patients and informing them about the evidence related to the remedy they were about to buy. This might dissuade them from purchasing it and could persuade them to get something that is effective instead. In this case, the pharmacist would merely offer the bogus medicine in order to advise customers against employing it. This strategy might well be an ethical way out of the dilemma; however, I doubt that this strategy is common practice with many pharmacists today.
With all this, we should keep in mind that there are many shades of grey between the black and white of the two extreme attitudes towards bogus medicines. There is clearly a difference whether pharmacists actively encourage their customers to buy bogus treatments (in the way it often happens in France, for instance), or whether they merely stock such products and, where possible, offer responsible, evidence-based advise to people who are tempted to buy them.
At the end of the lively but fruitful discussion with the Swiss students I felt optimistic: perhaps the days when pharmacists were the snake-oil salesmen of the modern era are counted?
There is much debate about the usefulness of chiropractic. Specifically, many people doubt that their chiropractic spinal manipulations generate more good than harm, particularly for conditions which are not related to the spine. But do chiropractors treat such conditions frequently and, if yes, what techniques do they employ?
This investigation was aimed at describing the clinical practices of chiropractors in Victoria, Australia. It was a cross-sectional survey of 180 chiropractors in active clinical practice in Victoria who had been randomly selected from the list of 1298 chiropractors registered on Chiropractors Registration Board of Victoria. Twenty-four chiropractors were ineligible, 72 agreed to participate, and 52 completed the study.
Each participating chiropractor documented encounters with up to 100 consecutive patients. For each chiropractor-patient encounter, information collected included patient health profile, patient reasons for encounter, problems and diagnoses, and chiropractic care.
Data were collected on 4464 chiropractor-patient encounters between 11 December 2010 and 28 September 2012. In most (71%) cases, patients were aged 25-64 years; 1% of encounters were with infants. Musculoskeletal reasons for the consultation were described by patients at a rate of 60 per 100 encounters, while maintenance and wellness or check-up reasons were described at a rate of 39 per 100 encounters. Back problems were managed at a rate of 62 per 100 encounters.
The most frequent care provided by the chiropractors was spinal manipulative therapy and massage. The table shows the precise conditions treated
|Problem group||No. (%) of recorded diagnoses* (n = 5985)||Rate per 100 encounters (n = 4417)||95% CI||ICC|
|Back problem||2757 (46.07%)||62.42||(55.24–70.53)||0.312|
|Neck problem||683 (11.41%)||15.46||(11.23–21.30)||0.233|
|Muscle problem||434 (7.25%)||9.83||(6.64–14.55)||0.207|
|Health maintenance or preventive care||254 (4.24%)||5.75||(3.24–10.22)||0.251|
|Back syndrome with radiating pain||215 (3.59%)||4.87||(2.91–8.14)||0.165|
|Musculoskeletal symptom or complaint, or other||219 (3.66%)||4.96||(2.39–10.28)||0.350|
|Sprain or strain of joint||167 (2.79%)||3.78||(2.30–6.22)||0.115|
|Shoulder problem||87 (1.45%)||1.97||(1.37–2.83)||0.022|
|Nerve-related problem||62 (1.04%)||1.40||(0.72–2.75)||0.072|
|General symptom or complaint, other||51 (0.85%)||1.15||(0.22–6.06)||0.407|
|Bursitis, tendinitis or synovitis||47 (0.79%)||1.06||(0.71–1.60)||0.011|
|Kyphosis and scoliosis||47 (0.79%)||1.06||(0.65–1.75)||0.023|
|Foot or toe symptom or complaint||48 (0.80%)||1.09||(0.41–2.87)||0.123|
|Ankle problem||46 (0.77%)||1.04||(0.40–2.69)||0.112|
|Osteoarthrosis, other (not spine)||39 (0.65%)||0.88||(0.51–1.53)||0.023|
|Hip symptom or complaint||35 (0.58%)||0.79||(0.53–1.19)||0.006|
|Leg or thigh symptom or complaint||35 (0.58%)||0.79||(0.49–1.28)||0.012|
|Musculoskeletal injury||33 (0.55%)||0.75||(0.45–1.24)||0.013|
These findings are impressive in that they suggest that most Australian chiropractors treat non-spinal conditions for which there is no evidence that the most frequently used interventions are effective. The treatments employed are depicted in this graph:
Distribution of techniques and care provided by chiropractors, with 95% CI
[Activator = hand-held spring-loaded device that delivers an impulse to the spine. Drop piece = chiropractic treatment table with a segmented drop system which quickly lowers the section of the patient’s body corresponding with the spinal region being treated. Blocks = wedge-shaped blocks placed under the pelvis.
Chiro system = chiropractic system of care, eg, Applied Kinesiology, Sacro-Occipital Technique, Neuroemotional Technique. Flexion distraction = chiropractic treatment table that flexes in the middle to provide traction and mobilisation to the lumbar spine.]
There is no good evidence I know of demonstrating these techniques to be effective for the majority of the conditions listed in the above table.
A similar bone of contention is the frequent use of ‘maintenance’ and ‘wellness’ care. The authors of the article comment: The common use of maintenance and wellness-related terms reflects current debate in the chiropractic profession. “Chiropractic wellness care” is considered by an indeterminate proportion of the profession as an integral part of chiropractic practice, with the belief that regular chiropractic care may have value in maintaining and promoting health, as well as preventing disease. The definition of wellness chiropractic care is controversial, with some chiropractors promoting only spine care as a form of wellness, and others promoting evidence-based health promotion, eg, smoking cessation and weight reduction, alongside spine care. A 2011 consensus process in the chiropractic profession in the United States emphasised that wellness practice must include health promotion and education, and active strategies to foster positive changes in health behaviours. My own systematic review of regular chiropractic care, however, shows that the claimed effects are totally unproven.
One does not need to be overly critical to conclude from all this that the chiropractors surveyed in this investigation earn their daily bread mostly by being economical with the truth regarding the lack of evidence for their actions.
These days, there is so much hype about alternative cancer treatments that it is hard to find a cancer patient who is not tempted to try this or that alternative medicine. Often it is employed without the knowledge of the oncology team, solely on the advice of non-medically qualified practitioners (NMPs). But is that wise? The aim of this survey was to find out.
Members of several German NMP-associations were invited to complete an online questionnaire. The questionnaire explored areas such as the diagnosis and treatment, goals for using complementary/alternative medicine (CAM), communication with the oncologist, and sources of information.
Of a total of 1,500 members of the NMP associations, 299 took part in this survey. The results show that the treatments employed by NMPs were heterogeneous. Homeopathy was used by 45% of the NMPs, and 10% believed it to be a treatment directly against cancer. Herbal therapy, vitamins, orthomolecular medicine, ordinal therapy, mistletoe preparations, acupuncture, and cancer diets were used by more than 10% of the NMPs. None of the treatments were discussed with the respective physician on a regular basis.
The authors concluded from these findings that many therapies provided by NMPs are biologically based and therefore may interfere with conventional cancer therapy. Thus, patients are at risk of interactions, especially as most NMPs do not adjust their therapies to those of the oncologist. Moreover, risks may arise from these CAM methods as NMPs partly believe them to be useful anticancer treatments. This may lead to the delay or even omission of effective therapies.
Anyone faced with a diagnosis of CANCER is understandably keen to leave no stone unturned to bring about a cure of the disease. Many patients thus go on to the Internet and look what alternative options are on offer. There they find virtually millions of sites advertising thousands of bogus cancer ‘cures’. Others consult their alternative practitioners and seek help. This new survey shows yet again that the advice they receive is dangerous. In fact, it might well be even more dangerous than the results imply: the response rate of the survey was dismal, and I fear that the less responsible NMPs tended not to reply.
None of the treatments listed above can cure cancer. For instance, homeopathy, the most popular alternative cancer treatment in Germany, will have no effect whatsoever on the natural history of the disease. To claim otherwise is criminally irresponsible.
But far too many patients are unaware of the evidence and of the dangers of being misled by bogus claims. What we need, I think, is a major campaign to get the word out. It would be a campaign that saves lives!
Indian researchers published a survey aimed at determining the practice of prescription by homeopathic undergraduate students. A cross-sectional study was carried out involving all the students from 4 government homeopathic schools of West Bengal, India. Data were collected using self-administered questionnaires.
A total of 328 forms were completed. 80.5% of all homeopathic undergraduate students admitted prescribing homeopathic medicines independently and 40.5% said that they did this 2-3 times a year. The most common reasons for this activity were ‘urgency of the problem’ (35.2%), ‘previous experience with same kind of illness’ (31.8%), and ‘the problem too trivial to go to a doctor’ (25.8%). About 63.4% of the students thought that it was alright to independently diagnose an illness, while 51.2% thought that it was alright for them to prescribe medicines to others. Common conditions encountered were fever, indigestion, and injury. Prescription by students gradually increased with academic years of homeopathic schools. Many students thought it was alright for students to diagnose and treat illnesses.
The authors conclude that prescription of medicines by homeopathic undergraduate students is quite rampant and corrective measures are warranted.
It’s hard to know whether to laugh or cry about these findings:
- If you are a homeopath, you ought to be upset to hear that students who are obviously neither fully trained, qualified or licensed already prescribe medicines.
- If you are aware of the fact that homeopathic remedies are pure placebos, you might laugh about all this thinking “who cares?”
- If you are into public health, you will worry that homeopaths are obviously being taught that homeopathic remedies can treat conditions which are considered to be urgent.
- If you are someone who believes that sick people need evidence-based treatments, you might want to change the authors’ conclusion into something like: prescription of medicines by homeopaths is quite rampant and, in the interest of patients, corrective measures are required to stop them.
Informed consent is generally considered to be an essential precondition for any health care practice. It requires the clinician giving the patient full information about the condition and the possible treatments. Amongst other things, the following information may be needed:
- the nature and prognosis of the condition,
- the evidence regarding the efficacy and risks of the proposed treatment,
- the evidence regarding alternative options.
Depending on the precise circumstances of the clinical situation, patient’s consent can be given either in writing or orally. Not obtaining any form of informed consent is a violation of the most fundamental ethics of health care.
In alternative medicine, informed consent seems often to be woefully neglected. This may have more than one reason:
- practitioners have frequently no adequate training in medical ethics,
- there is no adequate regulation and control of alternative practitioners,
- practitioners have conflicts of interest and might view informed consent as commercially counter-productive
In order to render this discussion less theoretical, I will outline several scenarios from the realm of chiropractic. Specifically, I will discuss the virtual case of an asthma patient consulting a chiropractor for alleviation of his symptoms. I should stress that I have chosen chiropractic merely as an example – the issues outlines below apply to chiropractic as much as they apply to most other forms of alternative medicine.
Our patient has experienced breathing problems and has heard that chiropractors are able to help this kind of condition. He consults a ‘straight’ chiropractor who adheres to Palmer’s gospel of ‘subluxation’. She explains to the patient that chiropractors use a holistic approach. By adjusting subluxations in the spine, she is confident to stimulate healing which will naturally ease the patient’s breathing problems. No conventional diagnosis is discussed, nor is there any mention of the prognosis, likelihood of benefit, risks of treatment and alternative therapeutic options.
Our patient consults a chiropractor who does not fully believe in the ‘subluxation’ theory of chiropractic. She conducts a thorough examination of our patient’s spine and diagnoses several spinal segments that are blocked. She tells our patient that he might be suffering from asthma and that spinal manipulation might remove the blockages and thus increase the mobility of the spine which, in turn, would alleviate his breathing problems. She does not mention risks of the proposed interventions nor other therapeutic options.
Our patient visits a chiropractor who considers herself a back pain specialist. She takes a medical history and conducts a physical examination. Subsequently she informs the patient that her breathing problems could be due to asthma and that she is neither qualified nor equipped to ascertain this diagnosis. She tells out patient that chiropractic is not an effective treatment for asthma but that his GP would be able to firstly make a proper diagnosis and secondly prescribe the optimal treatment for her condition. She writes a short note summarizing her thoughts and hands it to our patient to give it to his GP.
One could think of many more scenarios but the three above seem to cover a realistic spectrum of what a patient might encounter in real life. It seems clear, that the chiropractor in scenario 1 and 2 failed dismally regarding informed consent. In other words, only scenario 3 describes a behaviour that is ethically acceptable.
But how likely is scenario 3? I fear that it is an extremely rare turn of events. Even if well-versed in both medical ethics and scientific evidence, a chiropractor might think twice about providing all the information required for informed consent – because, as scenario 3 demonstrates, full informed consent in chiropractic essentially discourages a patient from agreeing to be treated. In other words, chiropractors have a powerful conflict of interest which prevents them to adhere to the rules of informed consent.
AND, AS POINTED OUT ALREADY, THAT DOES NOT JUST APPLY TO CHIROPRACTIC, IT APPLIES TO MOST OF ALTERNATIVE MEDICINE! IT SEEMS TO FOLLOW, I FEAR, THAT MUCH OF ALTERNATIVE MEDICINE IS UNETHICAL.
Dutch neurologists recently described the case of a 63-year-old female patient presented at their outpatient clinic with a five-week history of severe postural headache, tinnitus and nausea. The onset of these symptoms was concurrent with chiropractic manipulation of the cervical spine which she had tried because of cervical pain.
Cranial MRI showed findings characteristic for intracranial hypotension syndrome. Cervical MRI revealed a large posterior dural tear at the level of C1-2. Following unsuccessful conservative therapy, the patient underwent a lumbar epidural blood patch after which she recovered rapidly.
The authors conclude that manipulation of the cervical spine can cause a dural tear and subsequently an intracranial hypotension syndrome. Postural headaches directly after spinal manipulation should therefore be a reason to suspect this complication. If conservative management fails, an epidural blood patch may be performed.
Quite obviously, this is sound advice that can save lives. The trouble, however, is that the chiropractic profession is, by and large, still in denial. A recent systematic review by a chiropractor included eight cases of intracranial hypotension (IH) and concluded that case reports on IH and spinal manipulative therapy (SMT) have very limited clinical details and therefore cannot exclude other theories or plausible alternatives to explain the IH. To date, the evidence that cervical SMT is not a cause of IH is inconclusive. Further research is required before making any conclusions that cervical SMT is a cause of IH. Chiropractors and other health practitioners should be vigilant in recording established risk factors for IH in all cases. It is possible that the published cases of cervical SMT and IH may have missed important confounding risk factors (e.g. a new headache, or minor neck trauma in young or middle-aged adults).
Instead of distracting us from the fact that chiropractic can lead to serious adverse events, chiropractors would be well-advised to face the music, admit that their treatments are not risk-free and conduct rigorous research with a view of minimizing the harm.
The purpose of this paper by Canadian chiropractors was to expand practitioners’ knowledge on areas of liability when treating low back pain patients. Six cases where chiropractors in Canada were sued for allegedly causing or aggravating lumbar disc herniation after spinal manipulative therapy were retrieved using the CANLII database.
The patients were 4 men and 2 women with an average age of 37 years. Trial courts’ decisions were rendered between 2000 and 2011. The following conclusions from Canadian courts were noted:
- informed consent is an on-going process that cannot be entirely delegated to office personnel;
- when the patient’s history reveals risk factors for lumbar disc herniation the chiropractor has the duty to rule out disc pathology as an aetiology for the symptoms presented by the patients before beginning anything but conservative palliative treatment;
- lumbar disc herniation may be triggered by spinal manipulative therapy on vertebral segments distant from the involved herniated disc such as the thoracic spine.
The fact that this article was published by chiropractors seems like a step into the right direction. Disc herniations after chiropractic have been reported regularly and since many years. It is not often that I hear chiropractors admit that their spinal manipulations carry serious risks.
And it is not often that chiropractors consider the issue of informed consent. One the one hand, one hardly can blame them for it: if they ever did take informed consent seriously and informed their patients fully about the evidence and risks of their treatments as well as those of other therapeutic options, they would probably be out of business for ever. One the other hand, chiropractors should not be allowed to continue excluding themselves from the generally accepted ethical standards of modern health care.
Do you think that chiropractic is effective for asthma? I don’t – in fact, I know it isn’t because, in 2009, I have published a systematic review of the available RCTs which showed quite clearly that the best evidence suggested chiropractic was ineffective for that condition.
But this is clearly not true, might some enthusiasts reply. What is more, they can even refer to a 2010 systematic review which indicates that chiropractic is effective; its conclusions speak a very clear language: …the eight retrieved studies indicated that chiropractic care showed improvements in subjective measures and, to a lesser degree objective measures… How on earth can this be?
I would not be surprised, if chiropractors claimed the discrepancy is due to the fact that Prof Ernst is biased. Others might point out that the more recent review includes more studies and thus ought to be more reliable. The newer review does, in fact, have about twice the number of studies than mine.
How come? Were plenty of new RCTs published during the 12 months that lay between the two publications? The answer is NO. But why then the discrepant conclusions?
The answer is much less puzzling than you might think. The ‘alchemists of alternative medicine’ regularly succeed in smuggling non-evidence into such reviews in order to beautify the overall picture and confirm their wishful thinking. The case of chiropractic for asthma does by no means stand alone, but it is a classic example of how we are being misled by charlatans.
Anyone who reads the full text of the two reviews mentioned above will find that they do, in fact, include exactly the same amount of RCTs. The reason why they arrive at different conclusions is simple: the enthusiasts’ review added NON-EVIDENCE to the existing RCTs. To be precise, the authors included one case series, one case study, one survey, two randomized controlled trials (RCTs), one randomized patient and observer blinded cross-over trial, one single blind cross study design, and one self-reported impairment questionnaire.
Now, there is nothing wrong with case reports, case series, or surveys – except THEY TELL US NOTHING ABOUT EFFECTIVENESS. I would bet my last shirt that the authors know all of that; yet they make fairly firm and positive conclusions about effectiveness. As the RCT-results collectively happen to be negative, they even pretend that case reports etc. outweigh the findings of RCTs.
And why do they do that? Because they are interested in the truth, or because they don’t mind using alchemy in order to mislead us? Your guess is as good as mine.
Systematic reviews are widely considered to be the most reliable type of evidence for judging the effectiveness of therapeutic interventions. Such reviews should be focused on a well-defined research question and identify, critically appraise and synthesize the totality of the high quality research evidence relevant to that question. Often it is possible to pool the data from individual studies and thus create a new numerical result of the existing evidence; in this case, we speak of a meta-analysis, a sub-category of systematic reviews.
One strength of systematic review is that they minimise selection and random biases by considering at the totality of the evidence of a pre-defined nature and quality. A crucial precondition, however, is that the quality of the primary studies is critically assessed. If this is done well, the researchers will usually be able to determine how robust any given result is, and whether high quality trials generate similar findings as those of lower quality. If there is a discrepancy between findings from rigorous and flimsy studies, it is obviously advisable to trust the former and discard the latter.
And this is where systematic reviews of alternative treatments can run into difficulties. For any given research question in this area we usually have a paucity of primary studies. Equally important is the fact that many of the available trials tend to be of low quality. Consequently, there often is a lack of high quality studies, and this makes it all the more important to include a robust critical evaluation of the primary data. Not doing so would render the overall result of the review less than reliable – in fact, such a paper would not qualify as a systematic review at all; it would be a pseudo-systematic review, i.e. a review which pretends to be systematic but, in fact, is not. Such papers are a menace in that they can seriously mislead us, particularly if we are not familiar with the essential requirements for a reliable review.
This is precisely where some promoters of bogus treatments seem to see their opportunity of making their unproven therapy look as though it was evidence-based. Pseudo-systematic reviews can be manipulated to yield a desired outcome. In my last post, I have shown that this can be done by including treatments which are effective so that an ineffective therapy appears effective (“chiropractic is so much more than just spinal manipulation”). An even simpler method is to exclude some of the studies that contradict one’s belief from the review. Obviously, the review would then not comprise the totality of the available evidence. But, unless the reader bothers to do a considerable amount of research, he/she would be highly unlikely to notice. All one needs to do is to smuggle the paper past the peer-review process – hardly a difficult task, given the plethora of alternative medicine journals that bend over backwards to publish any rubbish as long as it promotes alternative medicine.
Alternatively (or in addition) one can save oneself a lot of work and omit the process of critically evaluating the primary studies. This method is increasingly popular in alternative medicine. It is a fool-proof method of generating a false-positive overall result. As poor quality trials have a tendency to deliver false-positive results, it is obvious that a predominance of flimsy studies must create a false-positive result.
A particularly notorious example of a pseudo-systematic review that used this as well as most of the other tricks for misleading the reader is the famous ‘systematic’ review by Bronfort et al. It was commissioned by the UK GENERAL CHIROPRACTIC COUNCIL after the chiropractic profession got into trouble and was keen to defend those bogus treatments disclosed by Simon Singh. Bronfort and his colleagues thus swiftly published (of course, in a chiro-journal) an all-encompassing review attempting to show that, at least for some conditions, chiropractic was effective. Its lengthy conclusions seemed encouraging: Spinal manipulation/mobilization is effective in adults for: acute, subacute, and chronic low back pain; migraine and cervicogenic headache; cervicogenic dizziness; manipulation/mobilization is effective for several extremity joint conditions; and thoracic manipulation/mobilization is effective for acute/subacute neck pain. The evidence is inconclusive for cervical manipulation/mobilization alone for neck pain of any duration, and for manipulation/mobilization for mid back pain, sciatica, tension-type headache, coccydynia, temporomandibular joint disorders, fibromyalgia, premenstrual syndrome, and pneumonia in older adults. Spinal manipulation is not effective for asthma and dysmenorrhea when compared to sham manipulation, or for Stage 1 hypertension when added to an antihypertensive diet. In children, the evidence is inconclusive regarding the effectiveness for otitis media and enuresis, and it is not effective for infantile colic and asthma when compared to sham manipulation. Massage is effective in adults for chronic low back pain and chronic neck pain. The evidence is inconclusive for knee osteoarthritis, fibromyalgia, myofascial pain syndrome, migraine headache, and premenstrual syndrome. In children, the evidence is inconclusive for asthma and infantile colic.
Chiropractors across the world cite this paper as evidence that chiropractic has at least some evidence base. What they omit to tell us (perhaps because they do not appreciate it themselves) is the fact that Bronfort et al
- failed to formulate a focussed research question,
- invented his own categories of inconclusive findings,
- included all sorts of studies which had nothing to do with chiropractic,
- and did not to make an assessment of the quality of the included primary studies they included in their review.
If, for a certain condition, three trials were included, for instance, two of which were positive but of poor quality and one was negative but of good quality, the authors would conclude that, overall, there is sound evidence.
Bronfort himself is, of course, more than likely to know all that (he has learnt his trade with an excellent Dutch research team and published several high quality reviews) – but his readers mostly don’t. And for chiropractors, this ‘systematic’ review is now considered to be the most reliable evidence in their field.