MD, PhD, MAE, FMedSci, FRSB, FRCP, FRCPEd.

scientific misconduct

Yesterday, we discussed a paper concluding (amongst other things) that there are insufficient high‐quality RCTs to judge the efficacy of acupuncture for cancer‐related pain. Today, we are looking at one that overtly contradicts this verdict.

This systematic review (published in JAMA Oncology) evaluated the existing randomized clinical trials (RCTs) for evidence of the association of acupuncture and acupressure with reduction in cancer pain. Randomized clinical trials that compared acupuncture and acupressure with a sham control, analgesic therapy, or usual care for managing cancer pain were included. The primary outcome was pain intensity measured by the Brief Pain Inventory, Numerical Rating Scale, Visual Analog Scale, or Verbal Rating Scale.

A total of 17 RCTs (with 1111 patients) were included, and data from 14 RCTs (with 920 patients) were used in the meta-analysis. Seven sham-controlled RCTs (35%) were notable for their high quality, being judged to have a low risk of bias for all of their domains, and showed that real (compared with sham) acupuncture was associated with reduced pain intensity. A favourable association was also seen when acupuncture and acupressure were combined with analgesic therapy in 6 RCTs for reducing pain intensity and in 2 RCTs for reducing opioid dose. The evidence grade was moderate because of the substantial heterogeneity among studies.

The authors concluded that this systematic review and meta-analysis found that acupuncture and/or acupressure was significantly associated with reduced cancer pain and decreased use of analgesics, although the evidence level was moderate. This finding suggests that more rigorous trials are needed to identify the association of acupuncture and acupressure with specific types of cancer pain and to integrate such evidence into clinical care to reduce opioid use.

So, which of the two conclusions should we trust?

Personally, I find the JAMA paper unimpressive to the point of being suspect. Here are some of my reasons:

  • About half of the primary studies are Chinese; and we have seen repeatedly that they are unreliable and report only positive results.
  • Many of the trials are published in Chinese and can thus not be checked by non-Chinese readers (nor, presumably, by the experts who acted as peer-reviewers for JAMA Oncology).
  • I have my doubts about the rigor of the peer-review of some of the journals that published the primary studies included in the review.
  • One paper included in the review is even a mere doctoral thesis which usually is not peer-reviewed in the usual sense.
  • The authors state that they included only clinical trials that compared acupuncture and acupressure with a sham control, analgesic therapy, or usual care. However, this is evidently not true; many of the studies had the infamous A+B versus B design comparing acupuncture plus a conventional therapy against the conventional therapy. As we have discussed ad nauseam on this blog, such trials cannot produce a negative finding even if ‘A’ is a placebo.
  • Contrary to what the authors claim, the quality of most of the included studies was extremely poor, as far as I can see.
  • One included paper which I cannot access is entitled ‘Clinical observation on 30 cases of moderate and severe cancer pain of bone metastasis treated by auricular acupressure‘. Are the review authors seriously claiming that this is an RCT?

The more I study the details of the JAMA Oncology paper, the more I feel it might be worth a complaint to the editor with a view of initiating a thorough investigation and a possible retraction.

 

Many patients with chronic pain (CP) are prescribed opioids, a situation which has led to the much-discussed opioid crisis. Integrative medicine (IM), which combines pharmacological and so-called alternative medicine (SCAM), has been proposed as a solution. Yet, the role of SCAM therapies in reducing opioid use remains unclear.

This systematic review explored the effectiveness of the IM approach or any of the SCAM therapies to reduce or cease opioid use in CP patients. Electronic searches yielded 5,200 citations. Twenty-three studies were selected. Eight studies were randomized controlled trials, seven were retrospective studies, four studies were prospective observational, three were cross-sectional, and one was quasi-experimental. The majority of the studies showed that opioid use was reduced significantly after using IM/SCAM. Cannabinoids were among the most commonly investigated approaches in reducing opioid use, followed by multidisciplinary approaches, cognitive-behavioral therapy, and acupuncture. The majority of the studies had limitations related to sample size, duration, and study design.

The authors concluded that there is a small but defined body of literature demonstrating positive preliminary evidence that the IM approach including SCAM therapies can help in reducing opioid use. As the opioid crisis continues to grow, it is vital that clinicians and patients be adequately informed regarding the evidence and opportunities for IM/SCAM therapies for CP.

I am unimpressed by this review.

And here is why:

  1. Because of their design, most of the included studies do not allow any conclusions about cause and effect.
  2. The 8 RCTs that would allow such conclusions are mostly of poor quality.
  3. Some of the 8 RCTs are not even what the review authors claim to be. Here is just one example:

Background: Current levels and dangers of opioid use in the U.S. warrant the investigation of harm-reducing treatment alternatives.

Purpose: A preliminary, historical, cohort study was used to examine the association between enrollment in the New Mexico Medical Cannabis Program (MCP) and opioid prescription use.

Methods: Thirty-seven habitual opioid using, chronic pain patients (mean age = 54 years; 54% male; 86% chronic back pain) enrolled in the MCP between 4/1/2010 and 10/3/2015 were compared to 29 non-enrolled patients (mean age = 60 years; 69% male; 100% chronic back pain). We used Prescription Monitoring Program opioid records over a 21 month period (first three months prior to enrollment for the MCP patients) to measure cessation (defined as the absence of opioid prescriptions activity during the last three months of observation) and reduction (calculated in average daily intravenous [IV] morphine dosages). MCP patient-reported benefits and side effects of using cannabis one year after enrollment were also collected.

Results: By the end of the 21 month observation period, MCP enrollment was associated with 17.27 higher age- and gender-adjusted odds of ceasing opioid prescriptions (CI 1.89 to 157.36, p = 0.012), 5.12 higher odds of reducing daily prescription opioid dosages (CI 1.56 to 16.88, p = 0.007), and a 47 percentage point reduction in daily opioid dosages relative to a mean change of positive 10.4 percentage points in the comparison group (CI -90.68 to -3.59, p = 0.034). The monthly trend in opioid prescriptions over time was negative among MCP patients (-0.64mg IV morphine, CI -1.10 to -0.18, p = 0.008), but not statistically different from zero in the comparison group (0.18mg IV morphine, CI -0.02 to 0.39, p = 0.081). Survey responses indicated improvements in pain reduction, quality of life, social life, activity levels, and concentration, and few side effects from using cannabis one year after enrollment in the MCP (ps<0.001).

Conclusions: The clinically and statistically significant evidence of an association between MCP enrollment and opioid prescription cessation and reductions and improved quality of life warrants further investigations on cannabis as a potential alternative to prescription opioids for treating chronic pain.

This study is evidently NOT an RCT!

Most of the 8 RCTs investigate whether SCAM is useful for weaning opioid-dependent patients off their drug. To equate this with the question whether IM/SCAM can reduce or cease opioid use in CP patients is, I think, wrong. The way to reduce opioid use in CP patients is to prescribe less opioids. And for prescribing less opioids, we need no SCAM but we need to remember what we learned in medical school: opioids are not for routine treatment of CP!

So, why do the authors of this review try to mislead us?

Could it have something to do with some of their affiliations and the bias that goes with it?

  • Canadian College of Naturopathic Medicine, North York, Ontario, Canada.
  • Australian Research Centre in Complementary and Integrative Medicine, University of Technology Sydney, Ultimo, Australia.
  • Pacific College of Oriental Medicine, San Diego, California, USA.

What do you think?

The UK-based homeopathic pharmacy AINSWORTH has attracted my attention several times already. Amongst other things, Tony Pinkus, the director of the firm, once accused me of having faked my research and I suspected him of violating the basic principles of research ethics in his study of homeopathy for autism.

Today, THE DAILY MAIL reports about AINSWORTH’s scandalous promotion of the most dangerous quackery.

Tony Pinkus, director of AINSWORTH

Tony Pinkus, director of AINSWORTH

In a big article, the Mail informs the reader that:

  • AINSWORTH sell a guide (entitled ‘The Mother & And Child Remedy Prescriber’ and decorated with the codes of arms of both the Queen and Prince Charles) informing young mothers that homeopathy ‘will strengthen a child’s immune system more ably than any vaccine’.
  • The guide also claims that infections like mumps and measles can be treated homeopathically.
  • AINSWORTH sells homeopathic remedies used as vaccines against serious infections such as polio, measles, meningitis, etc.
  • AINSWORTH’s guide claim that homeopathy ‘offers the clearest answer as to how to deal with the prevention of disease’.
  • The guide claims furthermore that homeopathy is ‘a complete alternative to vaccination’.
  • It even lists 7 homeopathic remedies for measles.
  • AINSWORTH claim that homeopathy provides ‘natural immunity’.
  • AINSWORTH sell products called ‘polio nosode’, and ‘meningeoma nosode’.

The Mail quotes several experts – including myself – who do not mince their words in condemning AINSWORTH for jeopardising public health. The paper also calls for AINSWORTH’s two royal warrants to be removed.

AINSWORTH, Buckingham Palace, and Clarence House all declined to comment.

I just came across the most amazing cancer cure: it’s called VIDATOX 30C, and it is a true wonder.

Well, on second thought, I might take that this back.

Is it really true?

Or is it perhaps a most despicable health fraud?

The Vidatox website makes the following claims for VIDATOX:

  • it is based on 5 proteins from scorpion venom;
  • it is a 30C potency, which means that it is diluted by a factor of 1:1000000000000000000000000000000000000000000000000000000000000
  • it selectively acts on diseased cells without harming healthy ones;
  • it is angiogenic;
  • it stimulates the immune system;
  • it attacks growing tumours;
  • it is anti-metastatic;
  • it blocks tumour angiogenesis;
  • it has anti-inflammatory effects;
  • it has prolonged analgesic effects;
  • it enhances the effects of chemo- and radiation therapies;
  • it reduces the side-effects of chemo- and radiation therapies;
  • it is not addictive;
  • it is a therapeutic alternative for human cancers;
  • it is in general use in oncology;
  • it has a powerful detoxification effect;
  • it has no side-effects;
  • it improves the well-being of patients;
  • its efficiency in tumour treatment is proven;
  • the medication ‘passed all the clinical trials’;
  • it increases survival;
  • it is a ‘certified product’;
  • it should be kept away from electromagnetic fields.

With all these claims and all ths splendid science mentioned on the website, one would expect to find plenty of papers on Vidatox. A Medline search resulted in 1 (one!) paper on the subject. Here is the abstract:

Complementary and alternative medicine (CAM) is the term used to describe many kinds of products, practices, and systems that are not part of conventional medicine. Cancer patients usually do everything they can to combat the disease, manage its symptoms, and cope with the side effects of treatment. Unfortunately, patients who use CAM underestimate the risk of interaction with cancer therapy or worse they omit conventional therapy thus reducing the possibility of cancer remission. Herein we analyzed the effects of Vidatox 30 CH (venom extracted from the Junceus Rhopalurus scorpion) on hepatocellular carcinoma (HCC), the second leading cause of cancer-related deaths. We found out that Vidatox increases HCC proliferation and invasion whereas it does not seem to interact with sorafenib, the orally active multikinase inhibitor approved for the treatment of advanced hepatocellular carcinoma. Our results suggest that the concentration of Vidatox used in the present study has not anti-neoplastic effects and care must be taken in hiring Vidatox in patients with HCC.

The authors of this paper also make the following comment:

According to Gonzalez, Vidatox was tested on more than 10,000 cancer patients with “positive results” ranging from an “improved quality of life” to a “slowing of tumor growth” (http://vidatoxromania.ro/en/what-is-vidatox/) (http://www.bt.com.bn/science-technology/2010/10/29/cuba-release-new-cancer-drug). There are no data from controlled clinical studies neither for Escozul nor for Vidatox 30-CH in refereed journals. The available information derived from interviews with patients involved or provided within the sites of alternative therapies. Essentially, scientific evidences about the biological activity of Vidatox in cancer cells are missing.

So, is Vidatox homeopathy’s answer to cancer or is it simply a disgusting fraud?

What do you think?

Professor Anthony Pelosi just published an intriguing paper. Here is the abstract:

During the 1980s and 1990s, Hans J Eysenck conducted a programme of research into the causes, prevention and treatment of fatal diseases in collaboration with one of his protégés, Ronald Grossarth-Maticek. This led to what must be the most astonishing series of findings ever published in the peer-reviewed scientific literature with effect sizes that have never otherwise been encounterered in biomedical research. This article outlines just some of these reported findings and signposts readers to extremely serious scientific and ethical criticisms that were published almost three decades ago. Confidential internal documents that have become available as a result of litigation against tobacco companies provide additional insights into this work. It is suggested that this research programme has led to one of the worst scientific scandals of all time. A call is made for a long overdue formal inquiry.

The Guardian reported further details on this story sating that the work of one of the most famous and influential British psychologists of all time, Hans Eysenck, is under a cloud following an investigation by King’s College London, which has found 26 of his published papers “unsafe”.

In relation to so-called alternative medicine (SCAM), it is foremost this claim of Eysenck that is relevant:

It is argued that there is now suficient evidence to regard psychosocial variables, in
particular personality and stress, as important risk factors for cancer and coronary heart
disease (CHD), equal in importance to smoking, heredity, cholesterol level, blood pressure,
and other physical variables. Furthermore, it is now clear that both types of factors act
synergistically; that is, each by itself is relatively benign, but their effects multiply to produce
high levels of disease…

The claim (which Eysenck published many times over, for instance here) was picked up and promoted by many believers in SCAM. This might have been helped by Eysenck’s bizarre openness to all things paranormal. Today his belief of a link between personality/stress and cancer is deeply engrained in SCAM.

King’s College says the results and conclusions of the papers “were not considered scientifically rigorous” by its committee of inquiry. Prof Sir Robert Lechler, the provost at King’s, has contacted the editors of the 11 journals where the papers appeared, recommending they should be retracted.

Prof Anthony Pelosi, consultant psychiatrist at the Priory Hospital, Glasgow, whose own investigation prompted the inquiry by King’s, said their work “led to what must be the most astonishing series of findings ever published in the peer-reviewed scientific literature, with effect sizes that have never otherwise been encountered in biomedical research”.

Among more than 3,000 people in the studies, Eysenck and his colleague claimed people with a “cancer-prone” personality were 121 times more likely to die of the disease than those without. Cancer-prone personalities were described as generally passive in the face of stress from outside.

Eysenck and Grossarth-Maticek apparently even had a cure for cancer. In one study, they gave 600 “cancer-prone” individuals a leaflet on how to be more “autonomous” and take control of their destiny. It contained such advice as: “Your aim should always be to produce conditions which make it possible for you to lead a happy and contented life.” It appeared to deliver miracles. Over 13 years, the 600 people randomly assigned to bibliotherapy, as it was called, had all-cause mortality of 32%, compared with 82% of 600 people not fortunate enough to receive a leaflet.

“I honestly believe, having read it so carefully and tried to find alternative interpretations, that this is fraudulent work,” said Pelosi, who is concerned Eysenck’s ideas still have a following. “His acolytes always bragged he was the most cited psychologist of all time… In the social sciences citation index, he was number three. Number two was Freud. Number one was Karl Marx. He was hugely prolific, widely cited and very influential… Many fringe medical practitioners hold the same conviction.”

Traditional Chinese Medicine (TCM) is a term created by Mao lumping together various modalities in an attempt to pretend that healthcare in the People’s Republic of China (PRC) was being provided despite the most severe shortages of conventional doctors, drugs and facilities. Since then, TCM seems to have conquered the West, and, in the PRC, the supply of conventional medicine has hugely increased. Today therefore, TCM and conventional medicine peacefully co-exist side by side in the PRC on an equal footing.

At least this is what we are being told – but is it true?

I have visited the PRC twice. The first time, in 1980, I was the doctor of a university football team playing several games in the PRC, including one against their national team. The second time, in 1991, I co-chaired a scientific meeting in Shanghai. On both occasions, I was invited to visit TCM facilities and discuss with colleagues issues related to TCM in the PRC. All the official discussions were monitored by official ‘minders’, and therefore fee speech and an uninhibited exchange of ideas are not truly how I would describe them. Yet, on both visits, there were occasions when the ‘minders’ were absent and a more liberal discussion could ensue. Whenever this was the case, I did not at all get the impression that TCM and conventional medicine were peacefully co-existing. The impression that I did get was that their co-existence resembled more a ‘shot-gun marriage’.

During my time running the SCAM research unit at Exeter, I had the opportunity to welcome several visiting researchers from the PRC. This experience seemed to confirm my impression that TCM in the PRC was less than free. As an example, I might cite one acupuncture project I was once working on with a scientist from the PRC. When it was nearing its conclusion and I mentioned that we should now think about writing it up to publish the findings, my Chinese colleague said that being a co-author was unfortunately not an option. Knowing how important publications in Western journals are for researchers from the PRC, I was most surprised by this revelation. The reason, it turned out, was that our findings failed to be favourable for TCM. My friend explained that such a paper would not advance but hinder an academic career, once back in the PRC.

Suspecting that the notion of a peaceful co-existence of TCM and conventional medicine in the PRC was far from true, I have always been puzzled how the myth could survive for so many years. Now, finally, it seems to crumble. This is from a recent journalistic article entitled ‘Chinese Activists Protest the Use of Traditional Treatments – They Want Medical Science’ which states that thousands of science activists in the PRC protest that the state neglects its duty to treat its citizens with evidence-based medicine (here is the scientific article this is based on):

Over a number of years, Chinese researcher Qiaoyan Zhu, who has been affiliated with the University of Copenhagen’s Department of Communication, has collected data on the many thousand science activists in China through observations in Internet forums, on social media and during physical meetings. She has also interviewed hundreds of activists. Together with Professor Maja Horst, who has specialized in research communication, she has analyzed the many data on the activists and their protests in an article that has just been published in the journal Public Understanding of Science:

“The activists are better educated and wealthier than the average Chinese population, and a large majority of them keep up-to-date with scientific developments. The protests do not reflect a broad popular movement, but the activists make an impact with their communication at several different levels,” Maja Horst explained and added: “Many of them are protesting individually by writing directly to family, friends and colleagues who have been treated with – and in some cases taken ill from – Traditional Chinese Medicine. Some have also hung posters in hospitals and other official institutions to draw attention to the dangers of traditional treatments. But most of the activism takes place online, on social media and blogs.

Activists operating in a regime like the Chinese are obviously not given the same leeway as activists in an open democratic society — there are limits to what the authorities are willing to accept in the public sphere in particular. However, there is still ample opportunity to organize and plan actions online.

“In addition to smaller groups and individual activists that have profiles on social media, larger online groups are also being formed, in some cases gaining a high degree of visibility. The card game with 52 criticisms about Traditional Chinese Medicine that a group of activists produced in 37,000 copies and distributed to family, friends and local poker clubs is a good example. Poker is a highly popular pastime in rural China so the critical deck of cards is a creative way of reaching a large audience,” Maja Horst said.

Maja Horst and Qiaoyan Zhu have also found examples of more direct action methods, where local activist groups contact school authorities to complain that traditional Chinese medicine is part of the syllabus in schools. Or that activists help patients refuse treatment if they are offered treatment with Traditional Chinese Medicine.

________________________________________________________________

I am relieved to see that, even in a system like the PRC, sound science and compelling evidence cannot be suppressed forever. It has taken a mighty long time, and the process may only be in its infancy. But there is hope – perhaps even hope that the TCM enthusiasts outside the PRC might realise that much of what came out of China has led them up the garden path!?

 

systematic review of the evidence for effectiveness and harms of specific spinal manipulation therapy (SMT) techniques for infants, children and adolescents has been published by Dutch researchers. I find it important to stress from the outset that the authors are not affiliated with chiropractic institutions and thus free from such conflicts of interest.

They searched electronic databases up to December 2017. Controlled studies, describing primary SMT treatment in infants (<1 year) and children/adolescents (1–18 years), were included to determine effectiveness. Controlled and observational studies and case reports were included to examine harms. One author screened titles and abstracts and two authors independently screened the full text of potentially eligible studies for inclusion. Two authors assessed risk of bias of included studies and quality of the body of evidence using the GRADE methodology. Data were described according to PRISMA guidelines and CONSORT and TIDieR checklists. If appropriate, random-effects meta-analysis was performed.

Of the 1,236 identified studies, 26 studies were eligible. In all but 3 studies, the therapists were chiropractors. Infants and children/adolescents were treated for various (non-)musculoskeletal indications, hypothesized to be related to spinal joint dysfunction. Studies examining the same population, indication and treatment comparison were scarce. Due to very low quality evidence, it is uncertain whether gentle, low-velocity mobilizations reduce complaints in infants with colic or torticollis, and whether high-velocity, low-amplitude manipulations reduce complaints in children/adolescents with autism, asthma, nocturnal enuresis, headache or idiopathic scoliosis. Five case reports described severe harms after HVLA manipulations in 4 infants and one child. Mild, transient harms were reported after gentle spinal mobilizations in infants and children, and could be interpreted as side effect of treatment.

The authors concluded that, based on GRADE methodology, we found the evidence was of very low quality; this prevented us from drawing conclusions about the effectiveness of specific SMT techniques in infants, children and adolescents. Outcomes in the included studies were mostly parent or patient-reported; studies did not report on intermediate outcomes to assess the effectiveness of SMT techniques in relation to the hypothesized spinal dysfunction. Severe harms were relatively scarce, poorly described and likely to be associated with underlying missed pathology. Gentle, low-velocity spinal mobilizations seem to be a safe treatment technique in infants, children and adolescents. We encourage future research to describe effectiveness and safety of specific SMT techniques instead of SMT as a general treatment approach.

We have often noted that, in chiropractic trials, harms are often not mentioned (a fact that constitutes a violation of research ethics). This was again confirmed in the present review; only 4 of the controlled clinical trials reported such information. This means harms cannot be evaluated by reviewing such studies. One important strength of this review is that the authors realised this problem and thus included other research papers for assessing the risks of SMT. Consequently, they found considerable potential for harm and stress that under-reporting remains a serious issue.

Another problem with SMT papers is their often very poor methodological quality. The authors of the new review make this point very clearly and call for more rigorous research. On this blog, I have repeatedly shown that research by chiropractors resembles more a promotional exercise than science. If this field wants to ever go anywhere, if needs to adopt rigorous science and forget about its determination to advance the business of chiropractors.

I feel it is important to point out that all of this has been known for at least one decade (even though it has never been documented so scholarly as in this new review). In fact, when in 2008, my friend and co-author Simon Singh, published that chiropractors ‘happily promote bogus treatments’ for children, he was sued for libel. Since then, I have been legally challenged twice by chiropractors for my continued critical stance on chiropractic. So, essentially nothing has changed; I certainly do not see the will of leading chiropractic bodies to bring their house in order.

May I therefore once again suggest that chiropractors (and other spinal manipulators) across the world, instead of aggressing their critics, finally get their act together. Until we have conclusive data showing that SMT does more good than harm to kids, the right thing to do is this: BEHAVE LIKE ETHICAL HEALTHCARE PROFESSIONALS: BE HONEST ABOUT THE EVIDENCE, STOP MISLEADING PARENTS AND STOP TREATING THEIR CHILDREN!

On Twitter, I recently found this remarkable advertisement:

Naturally, it interested me. The implication seemed to be that we can boost our immune system and thus protect ourselves from colds, the flu and other infections by using this supplement. With the flu season approaching, this might be important. On the other hand, the supplement might be unsafe for many other patients. As I had done a bit of research in this area, I needed to know more.

According to the manufacturer’s information sheet, Viracid

  • Provides Support for Immune Challenges
  • Strengthens Immune Function
  • Maintains Normal Inflammatory Balance

The manufacurer furthermore states the following:

Our body’s immune system is a complex and dynamic defense system that comes to our rescue at the first sign of exposure to an outside invader. The dynamic nature of the immune system means that all factors that affect health need to be addressed in order for it to function at peak performance. The immune system is very sensitive to nutrient deficiencies. While vitamin deficiencies can compromise the immune system, consuming immune enhancing nutrients and botanicals can support and strengthen your body’s immune response. Viracid’s synergistic formula significantly boosts immune cell function including antibody response, natural killer (NK) cell activity, thymus hormone secretions, and T-cell activation. Viracid also helps soothe throat irritations and nasal secretions, and maintains normal inflammatory balance by increasing antioxidant levels throughout the body.

This sounds impressive. Viracid could thus play an important role in keeping us healthy. It could also be contra-indicated to lots of patients who suffer from autoimmune and other conditions. In any case, it is worth having a closer look at this dietary supplement. The ingredients of the product include:

  • Vitamin A,
  • Vitamin C,
  • Vitamin B12,
  • Pantothenic Acid,
  • Zinc,
  • L-Lysine Hydrochloride,
  • Echinacea purpurea Extract,
  • Acerola Fruit,
  • Andrographis paniculata,
  • European Elder,
  • Berry Extract,
  • Astragalus membranaceus Root Extract

Next, I conducted several literature searches. Here is what I did NOT find:

  • any clinical trial of Viracid,
  • any indication that its ingredients work synergistically,
  • any proof of Viracid inducing an antibody response,
  • or enhancing natural killer (NK) cell activity,
  • or thymus hormone secretions,
  • or T-cell activation,
  • or soothing throat irritations,
  • or controlling nasal secretions,
  • or maintaining normal inflammatory balance,
  • any mention of contra-indications,
  • any reliable information about the risks of taking Viracid.

There are, of course, two explanations for this void of information. Either I did not search well enough, or the claims that are being made for Viracid by the manufacturer are unsubstantiated and therefore bogus.

Which of the two explanations apply?

Please, someone – preferably the manufacturer – tell me.

“There is a ton of chiropractor journals. If you want evidence then read some.”

This was the comment by a defender of chiropractic to a recent post of mine. And it’s true, of course: there are quite a few chiro journals, but are they a reliable source of information?

One way of quantifying the reliability of medical journals is to calculate what percentage of its published articles arrive at negative conclusion. In the extreme instance of a journal publishing nothing but positive results, we cannot assume that it is a credible publication. In this case, it would be not a scientific journal at all, but it would be akin to a promotional rag.

Back in 1997, we published our first analysis of journals of so-called alternative medicine (SCAM). It showed that just 1% of the papers published in SCAM journals reported findings that were not positive. In the years that followed, we confirmed this deplorable state of affairs repeatedly, and on this blog I have shown that the relatively new EBCAM journal is similarly dubious.

But these were not journals focussing specifically on chiropractic. Therefore, the question whether chiro journals are any different from the rest of SCAM is as yet unanswered. Enough reason for me to bite the bullet and test this hypothesis. I thus went on Medline and assessed all the articles published in 2018 in two of the leading chiro journals.

  1. JOURNAL OF CHIROPRACTIC MEDICINE (JCM)
  2. CHIROPRACTIC AND MANUAL THERAPY (CMT)

I evaluated them according to

  1. TYPE OF ARTICLE
  2. DIRECTION OF CONCLUSION

The results of my analysis are as follows:

  1. The JCM published 39 Medline-listed papers in 2018.
  2. The CMT published 50 such papers in 2018.
  3. Together, the 2 journals published:
  • 18 surveys,
  • 17 case reports,
  • 10 reviews,
  • 8 diagnostic papers,
  • 7 pilot studies,
  • 4 protocols,
  • 2 RCTs,
  • 2 non-randomised trials,
  • 2 case-series,
  • the rest are miscellaneous types of articles.

4. None of these papers arrived at a conclusion that is negative or contrary to chiropractors’ current belief in chiropractic care. The percentage of publishing negative findings is thus exactly 0%, a figure that is almost identical to the 1% we found for SCAM journals in 1997.

I conclude: these results suggest that the hypothesis of chiro journals publishing reliable information is not based on sound evidence.

On this blog, we have often noted that (almost) all TCM trials from China report positive results. Essentially, this means we might as well discard them, because we simply cannot trust their findings. While being asked to comment on a related issue, it occurred to me that this might be not so much different with Korean acupuncture studies. So, I tried to test the hypothesis by running a quick Medline search for Korean acupuncture RCTs. What I found surprised me and eventually turned into a reminder of the importance of critical thinking.

Even though I found pleanty of articles on acupuncture coming out of Korea, my search generated merely 3 RCTs. Here are their conclusions:

RCT No1

The results of this study show that moxibustion (3 sessions/week for 4 weeks) might lower blood pressure in patients with prehypertension or stage I hypertension and treatment frequency might affect effectiveness of moxibustion in BP regulation. Further randomized controlled trials with a large sample size on prehypertension and hypertension should be conducted.

RCT No2

The results of this study show that acupuncture might lower blood pressure in prehypertension and stage I hypertension, and further RCT need 97 participants in each group. The effect of acupuncture on prehypertension and mild hypertension should be confirmed in larger studies.

RCT No3

Bee venom acupuncture combined with physiotherapy remains clinically effective 1 year after treatment and may help improve long-term quality of life in patients with AC of the shoulder.

So yes, according to this mini-analysis, 100% of the acupuncture RCTs from Korea are positive. But the sample size is tiny and I many not have located all RCTs with my ‘rough and ready’ search.

But what are all the other Korean acupuncture articles about?

Many are protocols for RCTs which is puzzling because some of them are now so old that the RCT itself should long have emerged. Could it be that some Korean researchers publish protocols without ever publishing the trial? If so, why? But most are systematic reviews of RCTs of acupuncture. There must be about one order of magnitude more systematic reviews than RCTs!

Why so many?

Perhaps I can contribute to the answer of this question; perhaps I am even guilty of the bonanza.

In the period between 2008 and 2010, I had several Korean co-workers on my team at Exeter, and we regularly conducted systematic reviews of acupuncture for various indications. In fact, the first 6 systematic reviews include my name. This research seems to have created a trend with Korean acupuncture researchers, because ever since they seem unable to stop themselves publishing such articles.

So far so good, a plethora of systematic reviews is not necessarily a bad thing. But looking at the conclusions of these systematic reviews, I seem to notice a worrying trend: while our reviews from the 2008-2010 period arrived at adequately cautious conclusions, the new reviews are distinctly more positive in their conclusions and uncritical in their tone.

Let me explain this by citing the conclusions of the very first (includes me as senior author) and the very last review (does not include me) currently listed in Medline:

1st review

penetrating or non-penetrating sham-controlled RCTs failed to show specific effects of acupuncture for pain control in patients with rheumatoid arthritis. More rigorous research seems to be warranted.

Last review

Electroacupuncture was an effective treatment for MCI [mild cognitive impairment] patients by improving cognitive function. However, the included studies presented a low methodological quality and no adverse effects were reported. Thus, further comprehensive studies with a design in depth are needed to derive significant results.

Now, you might claim that the evidence for acupuncture has overall become more positive over time, and that this phenomenon is the cause for the observed shift. Yet, I don’t see that at all. I very much fear that there is something else going on, something that could be called the suspension of critical thinking.

Whenever I have asked a Chinese researcher why they only publish positive conclusions, the answer was that, in China, it would be most impolite to publish anything that contradicts the views of the researchers’ peers. Therefore, no Chinese researcher would dream of doing it, and consequently, critical thinking is dangerously thin on the ground.

I think that a similar phenomenon might be at the heart of what I observe in the Korean acupuncture literature: while I always tried to make sure that the conclusions were adequately based on the data, the systematic reviews were ok. When my influence disappeared and the reviews were done exclusively by Korean researchers, the pressure of pleasing the Korean peers (and funders) became dominant. I suggest that this is why conclusions now tend to first state that the evidence is positive and subsequently (almost as an after-thought) add that the primary trials were flimsy. The results of this phenomenon could be serious:

  • progress is being stifled,
  • the public is being misled,
  • funds are being wasted,
  • the reputation of science is being tarnished.

Of course, the only right way to express this situation goes something like this:

BECAUSE THE QUALITY OF THE PRIMARY TRIALS IS INADEQUATE, THE EFFECTIVENESS OF ACUPUNCTURE REMAINS UNPROVEN.

 

 

Subscribe via email

Enter your email address to receive notifications of new blog posts by email.

Recent Comments

Note that comments can be edited for up to five minutes after they are first submitted but you must tick the box: “Save my name, email, and website in this browser for the next time I comment.”

The most recent comments from all posts can be seen here.

Archives
Categories