MD, PhD, FMedSci, FRSB, FRCP, FRCPEd.

bias

1 2 3 49

I was recently struck by a short notice by the FACULTY OF HOMEOPATHY (FoH):

Following the publicity we got after the announcement of our royal patronage, it seems like a good time to  remind all members of our media policy. If you are contacted by the media, please contact the faculty and get some advice rather than agreeing immediately. We can then decide together if it is something to get involved in and who would be the most suitable person to participate.

The text was an uncomfortable reminder of the moment when, years ago, I received similar instructions. This must have been around 2005 when my relationship with my Exeter peers were beginning to sour. I received an email from the dean of my medical school informing me that, in future, I was no longer permitted to speak directly to the press; all such contacts had to first get cleared by him. I was more than a little surprised. I had never contacted a journalist, but they were phoning me at a rate of 2-3 per week. Invariably, I did my best to provide them with the information they were looking for. Telling them to first clear an interview would, in my view, have been not practical, degrading and a violation of academic freedom and my right to free expression.

Freedom of speech is the principle that supports the right of an individual or a community to articulate their opinions and ideas without fear of retaliation, censorship, or legal sanction. It is a recognised human right. I explained all this to my dean – we had been on very friendly terms until then – but he insisted on his instructions. Crucially, he could not give me an acceptable reason why my freedom of speech should be curtailed in the way he proposed. I tried my best to reason with him, but it was to no avail. In the end, I told him that I would carry on as before, and if he felt like it, he was welcome to discipline me. Eventually, I carried on as before, and my dean took no action.

So, when the FoH tells its members this – If you are contacted by the media, please contact the faculty and get some advice rather than agreeing immediately. We can then decide together if it is something to get involved in and who would be the most suitable person to participate – does it amount to a limitation of their freedom of speech? I certainly think so. Crucially, the FoH fails to provide an acceptable reason for its action. People imposing the restrictions (whether they are governments, employers or anyone else) must be able to demonstrate the need for them, and they must be proportionate.

There simply is no conceivable reason for the FoH to impose or suggest such a restriction!

What are they afraid of?

Perhaps that someone tells a slanderous lie?

Perhaps something as bad as what the FoH’s ‘Simile’ newsletter recently published about me?

A prepublication draft [of the Smallwood report] was circulated for comment with prominent warnings that it was confidential and not to be shared more widely (I can personally vouch for this, since I was one of those asked to comment). Regrettably, Prof Ernst did precisely this, leaking it to The Times who used it as the basis of their lead story. The editor of The Lancet, Richard Horton, certainly no friend of homeopathy, promptly denounced Ernst for having “broken every professional code of scientific behaviour”.

Sir Michael Peat, the Prince of Wales’ Principal Private Secretary, wrote to the vice chancellor of Exeter University protesting at the leak, and the university conducted an investigation. Ernst’s position became untenable, funding for his department dried up and he took early retirement. Thirteen years later he remains sore; in his latest book More Harm than Good? he attacks the Prince of Wales as “foolish and immoral”.

Huuuuuuh, that would be gross!

Yes, they did (had to) publish a full retraction:

In his editorial in the February 2018 issue of simile , Dr Peter Fisher stated that Prof Edzard Ernst leaked a confidential pre-publication draft of the 2005 Smallwood Report to the The Times . The Faculty of Homeopathy accepts that an investigation by Exeter University found no evidence Prof Ernst was responsible for this breach of confidentiality. The Faculty of Homeopathy and Dr Peter Fisher apologise unreservedly to Prof Ernst for this inaccuracy and for any embarrassment it may have caused him and his family.

Given this background and history, I find the note of the FoH to its members bizarre, unjustified and in breach of their right to free expression.

Guys, you are dealing with homeopathy.

There is nothing in it.

It’s not nuclear physics or high diplomacy.

Get real!

Allow your members to say what they think.

Dilute your remedies if you must, but please leave human rights alone.

Traditional Chinese Medicine (TCM) is a term created by Mao lumping together various modalities in an attempt to pretend that healthcare in the People’s Republic of China (PRC) was being provided despite the most severe shortages of conventional doctors, drugs and facilities. Since then, TCM seems to have conquered the West, and, in the PRC, the supply of conventional medicine has hugely increased. Today therefore, TCM and conventional medicine peacefully co-exist side by side in the PRC on an equal footing.

At least this is what we are being told – but is it true?

I have visited the PRC twice. The first time, in 1980, I was the doctor of a university football team playing several games in the PRC, including one against their national team. The second time, in 1991, I co-chaired a scientific meeting in Shanghai. On both occasions, I was invited to visit TCM facilities and discuss with colleagues issues related to TCM in the PRC. All the official discussions were monitored by official ‘minders’, and therefore fee speech and an uninhibited exchange of ideas are not truly how I would describe them. Yet, on both visits, there were occasions when the ‘minders’ were absent and a more liberal discussion could ensue. Whenever this was the case, I did not at all get the impression that TCM and conventional medicine were peacefully co-existing. The impression that I did get was that their co-existence resembled more a ‘shot-gun marriage’.

During my time running the SCAM research unit at Exeter, I had the opportunity to welcome several visiting researchers from the PRC. This experience seemed to confirm my impression that TCM in the PRC was less than free. As an example, I might cite one acupuncture project I was once working on with a scientist from the PRC. When it was nearing its conclusion and I mentioned that we should now think about writing it up to publish the findings, my Chinese colleague said that being a co-author was unfortunately not an option. Knowing how important publications in Western journals are for researchers from the PRC, I was most surprised by this revelation. The reason, it turned out, was that our findings failed to be favourable for TCM. My friend explained that such a paper would not advance but hinder an academic career, once back in the PRC.

Suspecting that the notion of a peaceful co-existence of TCM and conventional medicine in the PRC was far from true, I have always been puzzled how the myth could survive for so many years. Now, finally, it seems to crumble. This is from a recent journalistic article entitled ‘Chinese Activists Protest the Use of Traditional Treatments – They Want Medical Science’ which states that thousands of science activists in the PRC protest that the state neglects its duty to treat its citizens with evidence-based medicine (here is the scientific article this is based on):

Over a number of years, Chinese researcher Qiaoyan Zhu, who has been affiliated with the University of Copenhagen’s Department of Communication, has collected data on the many thousand science activists in China through observations in Internet forums, on social media and during physical meetings. She has also interviewed hundreds of activists. Together with Professor Maja Horst, who has specialized in research communication, she has analyzed the many data on the activists and their protests in an article that has just been published in the journal Public Understanding of Science:

“The activists are better educated and wealthier than the average Chinese population, and a large majority of them keep up-to-date with scientific developments. The protests do not reflect a broad popular movement, but the activists make an impact with their communication at several different levels,” Maja Horst explained and added: “Many of them are protesting individually by writing directly to family, friends and colleagues who have been treated with – and in some cases taken ill from – Traditional Chinese Medicine. Some have also hung posters in hospitals and other official institutions to draw attention to the dangers of traditional treatments. But most of the activism takes place online, on social media and blogs.

Activists operating in a regime like the Chinese are obviously not given the same leeway as activists in an open democratic society — there are limits to what the authorities are willing to accept in the public sphere in particular. However, there is still ample opportunity to organize and plan actions online.

“In addition to smaller groups and individual activists that have profiles on social media, larger online groups are also being formed, in some cases gaining a high degree of visibility. The card game with 52 criticisms about Traditional Chinese Medicine that a group of activists produced in 37,000 copies and distributed to family, friends and local poker clubs is a good example. Poker is a highly popular pastime in rural China so the critical deck of cards is a creative way of reaching a large audience,” Maja Horst said.

Maja Horst and Qiaoyan Zhu have also found examples of more direct action methods, where local activist groups contact school authorities to complain that traditional Chinese medicine is part of the syllabus in schools. Or that activists help patients refuse treatment if they are offered treatment with Traditional Chinese Medicine.

________________________________________________________________

I am relieved to see that, even in a system like the PRC, sound science and compelling evidence cannot be suppressed forever. It has taken a mighty long time, and the process may only be in its infancy. But there is hope – perhaps even hope that the TCM enthusiasts outside the PRC might realise that much of what came out of China has led them up the garden path!?

 

systematic review of the evidence for effectiveness and harms of specific spinal manipulation therapy (SMT) techniques for infants, children and adolescents has been published by Dutch researchers. I find it important to stress from the outset that the authors are not affiliated with chiropractic institutions and thus free from such conflicts of interest.

They searched electronic databases up to December 2017. Controlled studies, describing primary SMT treatment in infants (<1 year) and children/adolescents (1–18 years), were included to determine effectiveness. Controlled and observational studies and case reports were included to examine harms. One author screened titles and abstracts and two authors independently screened the full text of potentially eligible studies for inclusion. Two authors assessed risk of bias of included studies and quality of the body of evidence using the GRADE methodology. Data were described according to PRISMA guidelines and CONSORT and TIDieR checklists. If appropriate, random-effects meta-analysis was performed.

Of the 1,236 identified studies, 26 studies were eligible. In all but 3 studies, the therapists were chiropractors. Infants and children/adolescents were treated for various (non-)musculoskeletal indications, hypothesized to be related to spinal joint dysfunction. Studies examining the same population, indication and treatment comparison were scarce. Due to very low quality evidence, it is uncertain whether gentle, low-velocity mobilizations reduce complaints in infants with colic or torticollis, and whether high-velocity, low-amplitude manipulations reduce complaints in children/adolescents with autism, asthma, nocturnal enuresis, headache or idiopathic scoliosis. Five case reports described severe harms after HVLA manipulations in 4 infants and one child. Mild, transient harms were reported after gentle spinal mobilizations in infants and children, and could be interpreted as side effect of treatment.

The authors concluded that, based on GRADE methodology, we found the evidence was of very low quality; this prevented us from drawing conclusions about the effectiveness of specific SMT techniques in infants, children and adolescents. Outcomes in the included studies were mostly parent or patient-reported; studies did not report on intermediate outcomes to assess the effectiveness of SMT techniques in relation to the hypothesized spinal dysfunction. Severe harms were relatively scarce, poorly described and likely to be associated with underlying missed pathology. Gentle, low-velocity spinal mobilizations seem to be a safe treatment technique in infants, children and adolescents. We encourage future research to describe effectiveness and safety of specific SMT techniques instead of SMT as a general treatment approach.

We have often noted that, in chiropractic trials, harms are often not mentioned (a fact that constitutes a violation of research ethics). This was again confirmed in the present review; only 4 of the controlled clinical trials reported such information. This means harms cannot be evaluated by reviewing such studies. One important strength of this review is that the authors realised this problem and thus included other research papers for assessing the risks of SMT. Consequently, they found considerable potential for harm and stress that under-reporting remains a serious issue.

Another problem with SMT papers is their often very poor methodological quality. The authors of the new review make this point very clearly and call for more rigorous research. On this blog, I have repeatedly shown that research by chiropractors resembles more a promotional exercise than science. If this field wants to ever go anywhere, if needs to adopt rigorous science and forget about its determination to advance the business of chiropractors.

I feel it is important to point out that all of this has been known for at least one decade (even though it has never been documented so scholarly as in this new review). In fact, when in 2008, my friend and co-author Simon Singh, published that chiropractors ‘happily promote bogus treatments’ for children, he was sued for libel. Since then, I have been legally challenged twice by chiropractors for my continued critical stance on chiropractic. So, essentially nothing has changed; I certainly do not see the will of leading chiropractic bodies to bring their house in order.

May I therefore once again suggest that chiropractors (and other spinal manipulators) across the world, instead of aggressing their critics, finally get their act together. Until we have conclusive data showing that SMT does more good than harm to kids, the right thing to do is this: BEHAVE LIKE ETHICAL HEALTHCARE PROFESSIONALS: BE HONEST ABOUT THE EVIDENCE, STOP MISLEADING PARENTS AND STOP TREATING THEIR CHILDREN!

Acupuncture is often recommended for relieving symptoms of fibromyalgia syndrome (FMS). The aim of this systematic review was to ascertain whether verum acupuncture is more effective than sham acupuncture in FMS.

Ten RCTs with a total of 690 participants were eligible, and 8 RCTs were eventually included in the meta-analysis. Its results showed a sizable effect of verum acupuncture compared with sham acupuncture on pain relief, improving sleep quality and reforming general status. Its effect on fatigue was insignificant. When compared with a combination of simulation and improper location of needling, the effect of verum acupuncture for pain relief was the most obvious.

The authors concluded that verum acupuncture is more effective than sham acupuncture for pain relief, improving sleep quality, and reforming general status in FMS posttreatment. However, evidence that it reduces fatigue was not found.

I have a much more plausible conclusion for these findings: in (de-randomised) trials comparing real and sham acupuncture, patients are regularly de-blinded and therapists are invariably not blind. The resulting bias and not the alleged effectiveness of acupuncture explains the outcome.

And why do I think that this conclusion is much more plausible?

Firstly, because of Occam’s Razor.

Secondly, because this is roughly what my own systematic review of the subject found (The notion that acupuncture is an effective symptomatic treatment for fibromyaligia is not supported by the results from rigorous clinical trials. On the basis of this evidence, acupuncture cannot be recommended for fibromyalgia). This view is also shared by other critical reviews of the evidence (Current literature does not support the routine use of acupuncture for improving pain or quality of life in FM). Perhaps more crucially, the current Cochrane review seems to concur: There is low to moderate-level evidence that compared with no treatment and standard therapy, acupuncture improves pain and stiffness in people with fibromyalgia. There is moderate-level evidence that the effect of acupuncture does not differ from sham acupuncture in reducing pain or fatigue, or improving sleep or global well-being. EA is probably better than MA for pain and stiffness reduction and improvement of global well-being, sleep and fatigue. The effect lasts up to one month, but is not maintained at six months follow-up. MA probably does not improve pain or physical functioning. Acupuncture appears safe. People with fibromyalgia may consider using EA alone or with exercise and medication. The small sample size, scarcity of studies for each comparison, lack of an ideal sham acupuncture weaken the level of evidence and its clinical implications. Larger studies are warranted.

I live (most of my time) in the UK, a country where the media interest in so-called alternative medicine (SCAM) is considerable. Years ago, the UK press used to be very much in favour of SCAM. In 2000, we showed that the level of interest was huge and the reporting was biased. Here is our short BMJ paper on the subject:

The media strongly influences the public’s view of medical matters. Thus, we sought to determine the frequency and tone of reporting on medical topics in daily newspapers in the United Kingdom and Germany. The following eight newspapers were scanned for medical articles on eight randomly chosen working days in the summer of 1999: the Times, the Independent, the Daily Telegraph, and the Guardian in the United Kingdom, and Frankfurter Allgemeine Zeitung, Süddeutsche Zeitung, Frankfurter Rundschau, and Die Welt in Germany. All articles relating to medical topics were extracted and categorised according to subject, length, and tone of article (critical, positive, or neutral).

A total of 256 newspaper articles were evaluated. The results of our analysis are summarised in the table. We identified 80 articles in the German newspapers and 176 in the British; thus, British newspapers seem to report on medical topics more than twice as often as German broadsheets. Articles in German papers are on average considerably longer and take a positive attitude more often than British ones. Drug treatment was the medical topic most frequently discussed in both countries (51 articles (64%) in German newspapers and 97 (55%) in British). Surgery was the second most commonly discussed medical topic in the UK newspapers (32 articles; 18%). In Germany professional politics was the second most commonly discussed topic (11 articles; 14%); this category included articles about the standing of the medical profession, health care, and social and economic systems—that is, issues not strictly about treating patients.

Because our particular interest is in complementary medicine, we also calculated the number of articles on this subject. We identified four articles in the German newspapers and 26 in the UK newspapers. In the United Kingdom the tone of these articles was unanimously positive (100%) whereas most (3; 75%) of the German articles on complementary medicine were critical.

This analysis is, of course, limited by its small sample size, the short observation period, and the subjectivity of some of the end points. Yet it does suggest that, compared with German newspapers, British newspapers report more frequently on medical matters and generally have a more critical attitude (table). German newspapers frequently discuss medical professional politics, a subject that is almost totally absent from newspapers in the United Kingdom.

The proportion of articles about complementary medicine seems to be considerably larger in the United Kingdom (15% v 5%), and, in contrast to articles on medical matters in general, reporting on complementary medicine in the United Kingdom is overwhelmingly positive. In view of the fact that both healthcare professionals and the general public gain their knowledge of complementary medicine predominantly from the media, these findings may be important.2,3

Table

Reporting on medical topics by daily newspapers in the United Kingdom and Germany, 1999

Country

United Kingdom (n=176) Germany (n=80)
Mean No articles/day 5.5 2.5
Mean (SD) No words/article 130 (26) 325 (41)
Ratio of positive articles to critical articles* 1.0 3.2

Even though I have no new data on this, my impression is that things have since changed. It seems that the UK press has become more objective and are now reporting more critical comments on SCAM. While this is most welcome, of course, one feature is still deplorable, in my view: journalists’ obsession with ‘balance’.

A recent example might explain this best. The ‘i’ newspaper published an article about homeopathy which was well-written and thoroughly researched. It explained the current best evidence on the subject and made it quite clear why homeopathy is not a reasonable therapy for any condition. But then, towards the end of the article, the journalist added this section:

Dr Lise Hansen, a veterinary homeopath based in London and author of a forthcoming book, The Complete Book of Cat and Dog Health, argues that scientists have shown how homeopathy works. She cites a paper by Luc Montagnier, the French virologist who won a Nobel Prize in 2008 for his role in discovering HIV. The following year, he published evidence of his discovery of “electromagnet signals that are produced by nanostructures derived from bacterial DNA at high aqueous dilutions”. “Mainstream medicine is about chemistry, homeopathy is physics and scientists have only recently begun to study these nanostructures,” Hansen says.

Basically, the reader is left with the impression that homeopathy might be fine after all, and that science will soon be able to catch up with it. In the interest of balance, the journalist thus confused her readers and misled the public.

Why?

Journalists are obviously taught to always cover ‘both sides’ of their stories, and they adhere to this dogma no matter what. In most instances, this works out well, because in most cases there are two sides.

But not always!

When there is a strong consensus supported by facts, science and reproducible findings, the other side ceases to have a reasonable point. There simply is no reasonable ‘other side’ when we consider global warming, evolution, the Holocaust, and many other subjects. Of course, one can always find some loon who claims the earth is flat, or that cancer is a Jewish plot against public health. But these arguments lack reason and integrity – to dish them out without anything remotely resembling a ‘fact check’ is not just annoying but harmful.

Journalists should, in my view, be more responsible, check the facts, and avoid false balance. I know this will often entail much more work, but they owe it to their readers and to the reputation of their profession.

I am not usually a vulgar person, and I do apologise for the title of this post. But, in view of todays’ subject, some vulgarity seems almost unavoidable. This post is about homeopathic provings. In my book, I explain them in some detail:

The term ‘proving’ is a mis-translation of Hahnemann’s term ‘Pruefung’ which means ‘a test’. The English term wrongly implies that some fact is being proven. According to the International Dictionary of Homeopathy, provings (also known as ‘homeopathic pathogenetic trials’ or ‘Arzneimittelpruefung’ as Hahnemann called them), are defined as the process of determining the medicinal properties of a substance; testing in material dose, mother tincture or potency, by administration to healthy volunteers, to elicit effects from which the therapeutic potential, or material medica of the substance may be derived.

In order to individualise their treatment according to the ‘like cures like’ principle, homeopaths need to know what symptoms, or ‘artificial disease’, can be caused by the substances they prescribe. If they treat a patient who suffers from running eyes and nose, for instance, they would be looking for a substance that causes runny eyes and nose in healthy individuals. This is why remedies based on onion might be used to treat conditions like the common cold or hay fever.

But most patients’ complaints are usually a lot more complex. For instance, a person might suffer from frequently runny eyes and nose together with a whole host of other symptoms, many of which might seem trivial or irrelevant to conventional doctors but, for a homeopath, all complaints and patient characteristics are potentially important.

The first proving in the history of homeopathy was Hahnemann’s quinine experiment, which convinced him that he had discovered that this malaria cure causes the symptoms of malaria when taken by a healthy individual. From this observation he deduced that any substance causing symptoms in a healthy person could be used to cure these same symptoms when they occur in a patient.

Provings are normally conducted by administering a mother tincture or a low potency to healthy volunteers who subsequently note in minute detail all sensations, symptoms, emotions and thoughts that occur to them while taking it. These are then carefully registered and eventually form the ‘drug picture’ of that substance.

As a day goes by, we all experience, of course, all sorts of sensations without apparent reason, whether we have taken a medicine or not. Therefore, simple provings are not reliable and might not describe the specific symptoms caused by the substance in question. Realising this problem, most homeopaths now advocate conducting provings in a placebo-controlled manner hoping that this method might generate only symptoms which are specific to the tested substance.

Today thousands of provings have been carried out; most of them are of very low methodological quality. Their results have been published in reference books called ‘repertories’. Homeopaths, once they have noted the full range of characteristics of a patient, can look up the optimal remedy for each individual case. To ease this process even further, sophisticated computer programs are available.

So, essentially, homeopathic provings are experiments where homeopaths give a (often highly diluted/potentised) substance to healthy volunteers and ask them to monitor all sensations that follow. These symptoms are then recorded and eventually form the ‘drug picture’ of a homeopathic remedy. When prescribing a remedy, homeopaths essentially try to match the patient’s symptoms with the drug picture. This is why provings and drug pictures are so very important to classical homeopaths.

Now, imagine that you have just swallowed a substance and start paying attention to all the sensations you feel. As I am writing these lines, I would note all of the following:

  • mild mental irritation,
  • impatience,
  • neck pain,
  • back pain,
  • heavy feet,
  • hot feet,
  • slight ringing in right ear,
  • pressure on abdomen,
  • tickling nose,
  • sweaty hands,
  • acid taste in mouth,
  • need to pass urine,
  • feeling of need to wash hands,
  • itchy scalp,
  • acidity in stomach,
  • itch over right eyebrow.

These are just some of the sensations that come and go with everyday life; they are devoid of any medical meaning or importance. In homeopathy, however, they are elevated to something of fundamental relevance. As I have just had a cup of coffee, the above list could even be seen as a proving of coffea and a contribution to its drug picture. In turn, this would then determine how homeopaths prescribe homeopathic coffea. If others generated similar symptoms after coffee, some of the symptoms listed above might become the part of the accepted drug picture of coffea.

Many of the homeopathic provings are indeed based on little more than that. Modern provings are often conducted a little more rigorously, but there are tens of thousands of different remedies and the drug pictures of many are hardly different from my above-described proving of coffea. If you find this hard to believe, see what two homeopaths noted during a homeopathic proving of another remedy:

Domination and abuse are so intense that they lead to total suppression of oneself. The person develops intense hatred towards  the dominant person, as though they are being tortured. The intensity of the suppressed emotions produces other emotional, mental and physical symptoms: suicidal thoughts, aversion to company, panic attacks with lot of anxiety, low self confidence, arrested mental development, heart palpitations with anxiety, indisposed to talk, aversion to work, compulsive disorder of work, etc.

Low self-esteem and low self-confidence are associated with dependency and fear of failure.There is intense fear of failure and inadequacy, which leads to complete helplessness. This remedy also has aversion to self and a low self image. In this remedy, there are dreams/ thoughts of toilets.

Other symptoms include:

  • Ailments from sexual abuse and rape
  • Mind; colors; charmed by; golden/ colors; desires; golden
  • Delusion or image that body parts/ arms/ legs are smaller, and shortened
  • Dreams lascivious/ seduction/ necked people/ prostitution/ violent sex; Dreams; lascivious, voluptuous; partner, frequent change of/ voluptuous; perverse; girls, about little)
  • Dreams of dogs/ cats, felines
  • Fastidious; appearance, about; personal
  • Music; desires; drums

Believe it or not, the above text is taken from a published proving of excrementum canium – yes: dog shit!

This leads me to conclude that homeopathic provings (and, as provings are the basis for all homeopathy, with it the entire field of homeopathy) are BS.

The World Federation of Chiropractic (WFC) claim to have been at the forefront of the global development of chiropractic. Representing the interests of the profession in over 90 countries worldwide, the WFC has advocated, defended and promoted the profession across its 7 world regions. Now, the WFC have formulated 20 principles setting out who they are, what they stand for, and how chiropractic as a global health profession can, in their view, impact on nations so that populations can thrive and reach their full potential. Here are the 20 principles (in italics followed by some brief comments by me in normal print):

1. We envision a world where people of all ages, in all countries, can access the benefits of chiropractic.

That means babies and infants! What about the evidence?

2. We are driven by our mission to advance awareness, utilization and integration of chiropractic internationally.

One could almost suspect that the drive is motivated by misleading the public about the risks and benefits of spinal manipulation for financial gain.

3. We believe that science and research should inform care and policy decisions and support calls for wider access to chiropractic.

If science and research truly did inform care, it would soon be chiropractic-free.

4. We maintain that chiropractic extends beyond the care of patients to the promotion of better health and the wellbeing of our communities.

The best example to show that this statement is a politically correct platitude is the fact that so many chiropractors are (educated to become) convinced that vaccinations are undesirable or harmful.

5. We champion the rights of chiropractors to practice according to their training and expertise.

I am not sure what this means. Could it mean that they must practice according to their training and expertise, even if both fly in the face of the evidence?

6. We promote evidence-based practice: integrating individual clinical expertise, the best available evidence from clinical research, and the values and preferences of patients.

So far, I have seen little to convince me that chiropractors care a hoot about the best available evidence and plenty to fear that they supress it, if it does not enhance their business.

7. We are committed to supporting our member national associations through advocacy and sharing best practices for the benefit of patients and society.

Much more likely for the benefit of chiropractors, I suspect.

8. We acknowledge the role of chiropractic care, including the chiropractic adjustment, to enhance function, improve mobility, relieve pain and optimize wellbeing.

Of course, you have to pretend that chiropractic adjustments (of subluxations) are useful. However, evidence would be better than pretence.

9. We support research that investigates the methods, mechanisms, and outcomes of chiropractic care for the benefit of patients, and the translation of research outcomes into clinical practice.

And if it turns out to be to the detriment of the patient? It seems to me that you seem to know the result of the research before you started it. That does not bode well for its reliability.

10. We believe that chiropractors are important members of a patient’s healthcare team and that interprofessional approaches best facilitate optimum outcomes.

Of course you do believe that. Why don’t you show us some evidence that your belief is true?

11. We believe that chiropractors should be responsible public health advocates to improve the wellbeing of the communities they serve.

Of course you do believe that. But, in fact, many chiropractors are actively undermining the most important public health measure, vaccination.

12. We celebrate individual and professional diversity and equality of opportunity and represent these values throughout our Board and committees.

What you should be celebrating is critical assessment of all chiropractic concepts. This is the only way to make progress and safeguard the interests of the patient.

13. We believe that patients have a fundamental right to ethical, professional care and the protection of enforceable regulation in upholding good conduct and practice.

The truth is that many chiropractors violate medical ethics on a daily basis, for instance, by not obtaining fully informed consent.

14. We serve the global profession by promoting collaboration between and amongst organizations and individuals who support the vision, mission, values and objectives of the WFC.

Yes, those who support your vision, mission, values and objectives are your friends; those who dare criticising them are your enemies. It seems far from you to realise that criticism generates progress, perhaps not for the WFC, but for the patient.

15. We support high standards of chiropractic education that empower graduates to serve their patients and communities as high value, trusted health professionals.

For instance, by educating students to become anti-vaxxers or by teaching them obsolete concepts such as adjustment of subluxation?

16. We believe in nurturing, supporting, mentoring and empowering students and early career chiropractors.

You are surpassing yourself in the formulation of platitudes.

17. We are committed to the delivery of congresses and events that inspire, challenge, educate, inform and grow the profession through respectful discourse and positive professional development.

You are surpassing yourself in the formulation of platitudes.

18. We believe in continuously improving our understanding of the biomechanical, neurophysiological, psychosocial and general health effects of chiropractic care.

Even if there are no health effects?!?

19. We advocate for public statements and claims of effectiveness for chiropractic care that are honest, legal, decent and truthful.

Advocating claims of effectiveness in the absence of proof of effectiveness is neither honest, legal, decent or truthful, in my view.

20. We commit to an EPIC future for chiropractic: evidence-based, people-centered, interprofessional and collaborative.

And what do you propose to do with the increasing mountain of evidence suggesting that your spinal adjustments are not evidence-based as well as harmful to the health and wallets of your patients?

________________________________________________________________

What do I take out of all this? Not a lot!

Perhaps mainly this: the WFC is correct when stating that, in the interests of the profession in over 90 countries worldwide, the WFC has advocated, defended and promoted the profession across its 7 world regions. What is missing here is a small but important addition to the sentence: in the interests of the profession and against the interest of patients, consumers or public health in over 90 countries worldwide, the WFC has advocated, defended and promoted the profession across its 7 world regions.

Controlled clinical trials are methods for testing whether a treatment works better than whatever the control group is treated with (placebo, a standard therapy, or nothing at all). In order to minimise bias, they ought to be randomised. This means that the allocation of patients to the experimental and the control group must not be by choice but by chance. In the simplest case, a coin might be thrown – heads would signal one, tails the other group.

In so-called alternative medicine (SCAM) where preferences and expectations tend to be powerful, randomisation is particularly important. Without randomisation, the preference of patients for one or the other group would have considerable influence on the result. An ineffective therapy might thus appear to be effective in a biased study. The randomised clinical trial (RCT) is therefore seen as a ‘gold standard’ test of effectiveness, and most researchers of SCAM have realised that they ought to produce such evidence, if they want to be taken seriously.

But, knowingly or not, they often fool the system. There are many ways to conduct RCTs that are only seemingly rigorous but, in fact, are mere tricks to make an ineffective SCAM look effective. On this blog, I have often mentioned the A+B versus B study design which can achieve exactly that. Today, I want to discuss another way in which SCAM researchers can fool us (and even themselves) with seemingly rigorous studies: the de-randomised clinical trial (dRCT).

The trick is to use random allocation to the two study groups as described above; this means the researcher can proudly and honestly present his study as an RCT with all the kudos these three letters seem to afford. And subsequent to this randomisation process, the SCAM researcher simply de-randomises the two groups.

To understand how this is done, we need first to be clear about the purpose of randomisation. If done well, it generates two groups of patients that are similar in all factors that might impact on the results of the study. Perhaps the most obvious factor is disease severity; one could easily use other methods to make sure that both groups of an RCT are equally severely ill. But there are many other factors which we cannot always quantify or even know about. By using randomisation, we make sure that there is an similar distribution of ALL of them in the two study groups, even those factors we are not even aware of.

De-randomisation is thus a process whereby the two previously similar groups are made to differ in terms of any factor that impacts on the results of the trial. In SCAM, this is often surprisingly simple.

Let’s use a concrete example. For our study of spiritual healing, the 5 healers had opted during the planning period of the study to treat both the experimental group and the control group. In the experimental group, they wanted to use their full healing power, while in the control group they would not employ it (switch it off, so to speak). It was clear to me that this was likely to lead to de-randomisation: the healers would have (inadvertently or deliberately) behaved differently towards the two groups of patients. Before and during the therapy, they would have raised the expectation of the verum group (via verbal and non-verbal communication), while sending out the opposite signals to the control group. Thus the two previously equal groups would have become unequal in terms of their expectation. And who can deny that expectation is a major determinant of the outcome? Or who can deny that experienced clinicians can manipulate their patients’ expectation?

For our healing study, we therefore chose a different design and did all we could to keep the two groups comparable. Its findings thus turned out to show that healing is not more effective than placebo (It was concluded that a specific effect of face-to-face or distant healing on chronic pain could not be demonstrated over eight treatment sessions in these patients.). Had we not taken these precautions, I am sure the results would have been very different.

In RCTs of some SCAMs, this de-randomisation is difficult to avoid. Think of acupuncture, for instance. Even when using sham needles that do not penetrate the skin, the therapist is aware of the group allocation. Hoping to prove that his beloved acupuncture can be proven to work, acupuncturists will almost automatically de-randomise their patients before and during the therapy in the way described above. This is, I think, the main reason why some of the acupuncture RCTs using non-penetrating sham devices or similar sham-acupuncture methods suggest that acupuncture is more than a placebo therapy. Similar arguments also apply to many other SCAMs, including for instance chiropractic.

There are several ways of minimising this de-randomisation phenomenon. But the only sure way to avoid this de-randomisation is to blind not just the patient but also the therapists (and to check whether both remained blind throughout the study). And that is often not possible or exceedingly difficult in trials of SCAM. Therefore, I suggest we should always keep de-randomisation in mind. Whenever we are confronted with an RCT that suggest a result that is less than plausible, de-randomisation might be a possible explanation.

 

I recently saw a tweet by a German homeopath stating that ‘homeopathy is 100% experienced based medicine’. It made me think and realise that there is not just one EBM, there are, in fact, at least three EBMs!

  1. Experience based medicine
  2. Eminence based medicine
  3. Evidence based medicine

I will start with the type which I encountered first when studying medicine all those years ago.

EMINENCE BASED MEDICINE

German healthcare was at the time – 1970s – deeply steeped in this variety of EBM. What the professor said was right, and there was no discussion about it. I don’t even know how my teachers would have reacted, if we had challenged their wisdom, because nobody ever did; it just did not occur to us.

Personally, I never got along too well with this type of EBM. I found it stifling, and this feeling might have contributed to my first ‘escape’ to England in 1979. In the UK, I felt, things were refreshingly different (see also my recent obituary of my former boss).

EXPERIENCE BASED MEDICINE

So-called alternative medicine (SCAM) is almost entirely based on this type of EBM. Practitioners of SCAM pride themselves of their experience and are convinced that it outweighs evidence any time. They rarely miss an occasion to stress that their treatment as stood the test of time. And as such it does not require evidence; if SCAM did not work, it would not have survived all these years.

Little do they know that the appeal to tradition is a logical fallacy. And little do they care that the long tradition of their SCAMs might just signal how obsolete their treatments truly are. Hundreds (homeopathy) or thousands (acupuncture) of years ago, we had little knowledge about physiology, pathology, etc., and clinicians had to make do with the little that got. Seen in this light, experience based medicine is a negative label that indicates the fact that the treatments are likely to be obsolete and out-dated.

EVIDENCE BASED MEDICINE

Providers of SCAM have a deeply rooted dislike for the word evidence. The reason is simple: their SCAMs are usually very shy on evidence; little wonder that they like to focus on experience instead. Yet, try to explain the concept of evidence to someone neutral like a barman, for instance – whenever I made this attempt, I was interrupted by him saying: ‘Hold on, are you saying that before EBM you did not depend on evidence? This is frightening! What on earth did you rely on then?’

It is indeed not logical to rely on eminence or on experience, in my view. And therefore, I have stopped explaining EBM to people who have common sense, like my barman. Let’s try something else instead: imagine you are seriously ill and are able to chose between three clinician who are each the leading head in their type of EMB.

THE EMINENCE IS A PROFESSOR MANY TIMES OVER AND SIMPLY KNOWS THAT HE IS ALWAYS RIGHT

Personally, I would run a mile. I have seen too many of those blundering through the wards of university hospitals. He never makes a mistake, except that things do go wrong quite often; and when they do, it is the fault of some underling, of course.

THE EXPERIENCED CLINICIAN WITH YEARS OF PRACTICE WHO HAS SEEN IT ALL AND HAS ALL THE ANSWERS

With a bit of bad luck, he might be a homeopath. He will tell you endlessly of cases that were similar to yours. Occasionally, there was an aggravation (which, of course, is a good sign in his view), but in the end he cured them all with his treatments that had stood the test of time. He has excellent bedside manners, a lot of charisma, and is a good listener. Who was it that said: “the three most dangerous words in medicine are IN MY EXPERIENCE”?

Yes, you guessed it: run and don’t turn back!

THE CLINICIAN WHO KNOWS WHAT THE CURRENT BEST EVIDENCE HAS TO OFFER

He might not be all that charismatic, perhaps he even is a bit abrupt. But he will know the latest developments and weigh the risks of all therapeutic options against their benefits.

But hold on, my barman would interrupt at this point, this is not either or. One can have both experience and evidence!

I told you my barman was clever. The definition of evidence based medicine is not healthcare based on up-to date knowledge, it is the integration of best research evidence with clinical expertise and patient values. It thus rests on three pillars: external evidence, ideally from systematic reviews, the clinician’s experience, and the patient’s preferences.

Therefore, my barman and I agree that eminence based medicine is highly questionable, experience based medicine can be outright dangerous, and evidence based medicine is the only EBM version that does make sense.

 

 

“There is a ton of chiropractor journals. If you want evidence then read some.”

This was the comment by a defender of chiropractic to a recent post of mine. And it’s true, of course: there are quite a few chiro journals, but are they a reliable source of information?

One way of quantifying the reliability of medical journals is to calculate what percentage of its published articles arrive at negative conclusion. In the extreme instance of a journal publishing nothing but positive results, we cannot assume that it is a credible publication. In this case, it would be not a scientific journal at all, but it would be akin to a promotional rag.

Back in 1997, we published our first analysis of journals of so-called alternative medicine (SCAM). It showed that just 1% of the papers published in SCAM journals reported findings that were not positive. In the years that followed, we confirmed this deplorable state of affairs repeatedly, and on this blog I have shown that the relatively new EBCAM journal is similarly dubious.

But these were not journals focussing specifically on chiropractic. Therefore, the question whether chiro journals are any different from the rest of SCAM is as yet unanswered. Enough reason for me to bite the bullet and test this hypothesis. I thus went on Medline and assessed all the articles published in 2018 in two of the leading chiro journals.

  1. JOURNAL OF CHIROPRACTIC MEDICINE (JCM)
  2. CHIROPRACTIC AND MANUAL THERAPY (CMT)

I evaluated them according to

  1. TYPE OF ARTICLE
  2. DIRECTION OF CONCLUSION

The results of my analysis are as follows:

  1. The JCM published 39 Medline-listed papers in 2018.
  2. The CMT published 50 such papers in 2018.
  3. Together, the 2 journals published:
  • 18 surveys,
  • 17 case reports,
  • 10 reviews,
  • 8 diagnostic papers,
  • 7 pilot studies,
  • 4 protocols,
  • 2 RCTs,
  • 2 non-randomised trials,
  • 2 case-series,
  • the rest are miscellaneous types of articles.

4. None of these papers arrived at a conclusion that is negative or contrary to chiropractors’ current belief in chiropractic care. The percentage of publishing negative findings is thus exactly 0%, a figure that is almost identical to the 1% we found for SCAM journals in 1997.

I conclude: these results suggest that the hypothesis of chiro journals publishing reliable information is not based on sound evidence.

1 2 3 49
Recent Comments

Note that comments can be edited for up to five minutes after they are first submitted but you must tick the box: “Save my name, email, and website in this browser for the next time I comment.”

The most recent comments from all posts can be seen here.

Archives
Categories