The systematic review assessed the evidence of Craniosacral Therapy (CST) for the treatment of chronic pain. Randomized clinical trials (RCTs) assessing the effects of CST in chronic pain patients were eligible. Pain intensity and functional disability were the primary outcomes. Risk of bias was assessed using the Cochrane tool.
Ten RCTs with a total of 681 patients suffering from neck and back pain, migraine, headache, fibromyalgia, epicondylitis, and pelvic girdle pain were included.
Compared to treatment as usual, CST showed greater post intervention effects on:
- pain intensity (SMD=-0.32, 95%CI=[−0.61,-0.02])
- disability (SMD=-0.58, 95%CI=[−0.92,-0.24]).
Compared to manual/non-manual sham, CST showed greater post intervention effects on:
- pain intensity (SMD=-0.63, 95%CI=[−0.90,-0.37])
- disability (SMD=-0.54, 95%CI=[−0.81,-0.28]) ;
Compared to active manual treatments, CST showed greater post intervention effects on:
- pain intensity (SMD=-0.53, 95%CI=[−0.89,-0.16])
- disability (SMD=-0.58, 95%CI=[−0.95,-0.21]) .
At six months, CST showed greater effects on pain intensity (SMD=-0.59, 95%CI=[−0.99,-0.19]) and disability (SMD=-0.53, 95%CI=[−0.87,-0.19]) versus sham. Secondary outcomes were all significantly more improved in CST patients than in other groups, except for six-month mental quality of life versus sham. Sensitivity analyses revealed robust effects of CST against most risk of bias domains. Five of the 10 RCTs reported safety data. No serious adverse events occurred. Minor adverse events were equally distributed between the groups.
The authors concluded that, in patients with chronic pain, this meta-analysis suggests significant and robust effects of CST on pain and function lasting up to six months. More RCTs strictly following CONSORT are needed to further corroborate the effects and safety of CST on chronic pain.
Robust effects! This looks almost convincing, particularly to an uncritical proponent of so-called alternative medicine (SCAM). However, a bit of critical thinking quickly discloses numerous problems, not with this (technically well-made) review, but with the interpretation of its results and the conclusions. Let me mention a few that spring into my mind:
- The literature searches were concluded in August 2018; why publish the paper only in 2020? Meanwhile, there might have been further studies which would render the review outdated even on the day it was published. (I know that there are many reasons for such a delay, but a responsible journal editor must insist on an update of the searches before publication.)
- Comparisons to ‘treatment as usual’ do not control for the potentially important placebo effects of CST and thus tell us nothing about the effectiveness of CST per se.
- The same applies to comparisons to ‘active’ manual treatments and ‘non-manual’ sham (the purpose of a sham is to blind patients; a non-manual sham defies this purpose).
- This leaves us with exactly two trials employing a sham that might have been sufficiently credible to be able to fool patients into believing that they were receiving the verum.
- One of these trials (ref 44) is far too flimsy to be taken seriously: it was tiny (n=23), did not adequately blind patients, and failed to mention adverse effects (thus violating research ethics [I cannot take such trials seriously]).
- The other trial (ref 41) is by the same research group as the review, and the authors award themselves a higher quality score than any other of the primary studies (perhaps even correctly, because the other trials are even worse). Yet, their study has considerable weaknesses which they fail to discuss: it was small (n=54), there was no check to see whether patient-blinding was successful, and – as with all the CST studies – the therapist was, of course, no blind. The latter point is crucial, I think, because patients can easily be influenced by the therapists via verbal or non-verbal communication to report the findings favoured by the therapist. This means that the small effects seen in such studies are likely to be due to this residual bias and thus have nothing to do with the intervention per se.
- Despite the fact that the review findings depend critically on their own primary study, the authors of the review declared that they have no conflict of interest.
Considering all this plus the rather important fact that CST completely lacks biological plausibility, I do not think that the conclusions of the review are warranted. I much prefer the ones from my own systematic review of 2012. It included 6 RCTs (all of which were burdened with a high risk of bias) and concluded that the notion that CST is associated with more than non‐specific effects is not based on evidence from rigorous RCTs.
So, why do the review authors first go to the trouble of conducting a technically sound systematic review and meta-analysis and then fail utterly to interpret its findings critically? I might have an answer to this question. Back in 2016, I included the head of this research group, Gustav Dobos, into my ‘hall of fame’ because he is one of the many SCAM researchers who never seem to publish a negative result. This is what I then wrote about him:
Dobos seems to be an ‘all-rounder’ whose research tackles a wide range of alternative treatments. That is perhaps unremarkable – but what I do find remarkable is the impression that, whatever he researches, the results turn out to be pretty positive. This might imply one of two things, in my view:
- all alternative therapies are effective,
- the ‘Trustworthiness Index’ of Prof Dobos is unusual.
I let my readers chose which possibility they deem to be more likely.
Radiation-induced xerostomia (RIX) is a common, often debilitating, adverse effect of radiation therapy among patients with head and neck cancer. Quality of life can be severely affected, and current treatments have limited benefit. Acupuncture is often recommended, but does it work? This study was aimed at finding out whether acupuncture can prevent RIX in patients with head and neck cancer undergoing radiation therapy.
The 2-center, phase 3, randomized clinical trial compared a standard care control (SCC) with true acupuncture (TA) and sham acupuncture (SA) among patients with oropharyngeal or nasopharyngeal carcinoma who were undergoing radiation therapy in comprehensive cancer centres in the United States and China. Patients were enrolled between December 16, 2011, and July 7, 2015. Final follow-up was August 15, 2016. Analyses were conducted February 1 through 28, 2019. Either TA or SA using a validated acupuncture placebo device were performed 3 times per week during a 6- to 7-week course of radiation therapy. The primary end point was RIX, as determined by the Xerostomia Questionnaire in which a higher score indicates worse RIX, for combined institutions 1 year after radiation therapy ended. Secondary outcomes included incidence of clinically significant xerostomia (score >30), salivary flow, quality of life, salivary constituents, and role of baseline expectancy related to acupuncture on outcomes.
Of 399 patients randomized, 339 were included in the final analysis, including 112 patients in the TA group, 115 patients in the SA group, and 112 patients in the SCC group. For the primary aim, the adjusted least square mean (SD) xerostomia score in the TA group (26.6 [17.7]) was significantly lower than in the SCC group (34.8 [18.7]) (P = .001; effect size = -0.44) and marginally lower but not statistically significant different from the SA group (31.3 [18.6]) (P = .06; effect size = -0.26). Incidence of clinically significant xerostomia 1 year after radiation therapy ended followed a similar pattern, with 38 patients in the TA group (34.6%), 54 patients in the SA group (47.8%), and 60 patients in the SCC group (55.1%) experiencing clinically significant xerostomia (P = .009). Post hoc comparisons revealed a significant difference between the TA and SCC groups at both institutions, but TA was significantly different from SA only at Fudan University Cancer Center, Shanghai, China (estimated difference [SE]: TA vs SCC, -9.9 [2.5]; P < .001; SA vs SCC, -1.7 [2.5]; P = .50; TA vs SA, -8.2 [2.5]; P = .001), and SA was significantly different from SCC only at the University of Texas MD Anderson Cancer Center, Houston, Texas (estimated difference [SE]: TA vs SCC, -8.1 [3.4]; P = .016; SA vs SCC, -10.5 [3.3]; P = .002; TA vs SA, 2.4 [3.2]; P = .45).
The authors concluded that this randomized clinical trial found that TA resulted in significantly fewer and less severe RIX symptoms 1 year after treatment vs SCC. However, further studies are needed to confirm clinical relevance and generalizability of this finding and to evaluate inconsistencies in response to sham acupuncture between patients in the United States and China.
In essence this two-centre study shows that:
- real acupuncture is better than usual care, but the effect size is small and of doubtful clinical relevance;
- real acupuncture is not significantly better than sham acupuncture;
- the findings differ remarkably between the US and the Chinese centre.
I find the last point the most interesting one. We know from previous research that acupuncture studies from China are notoriously unreliable; they never report a negative result and there is evidence that data fabrication is rife in China. The new findings seems to throw more light on this notion. In the US centre, real and sham acupuncture generated practically identical results. By contrast, in the Chinese centre, real acupuncture generated significantly better results than sham. The authors offer several hypotheses to explain this remarkable phenomenon. Yet, in my view, the most likely one is that Chinese researchers are determined to show that acupuncture is effective. Thus all sorts of unconscious or even conscious biases might get introduced into such studies.
In essence, trial therefore confirms that acupuncture is little more than a theatrical placebo, particularly if we consider the US data which, in my opinion, are more trustworthy.
Lorenzo Cohen, Professor of Palliative, Rehabilitation, and Integrative Medicine and director of the Integrative Medicine Program as well as senior author of the paper unsurprisingly disagrees. He was quoted saying: “The evidence is to a point where patients should incorporate acupuncture alongside radiation treatment as a way to prevent the severity of dry mouth symptoms. I think with this study we can add acupuncture to the list for the prevention and treatment of xerostomia, and the guidelines for the use of acupuncture in the oncology setting should be revised to include this important chronic condition.”
Who do you think is closer to the truth?
The U.S. Food and Drug Administration (FDA) issued another warning about homeopathy. Here are some of the most relevant excerpts:
… Homeopathic products … are marketed without FDA review and may not meet modern standards for safety, effectiveness, quality and labeling. FDA uses a risk-based approach to monitor these products and to evaluate reports of adverse effects.
… Homeopathic drug products are made from a wide range of substances, including ingredients derived from plants, healthy or diseased animal or human sources, minerals and chemicals, including known poisons. These products have the potential to cause significant and even permanent harm if they are poorly manufactured, since that could lead to contaminated products or products that have potentially toxic ingredients at higher levels than are labeled and/or safe, or if they are marketed as substitute treatments for serious or life-threatening diseases and conditions, or to vulnerable populations. In addition, some products may be labeled as homeopathic that do not conform to traditional homeopathic principles.
As the homeopathy industry continues to grow at a rapid pace, we want to clarify for both consumers and industry how we assess the potential safety risks of these products. That’s why in 2017, the FDA issued a draft guidance discussing our, risk-based enforcement approach to drug products labeled as homeopathic. Today, we are taking two new steps toward clarifying this approach.
First, we have revised the 2017 draft guidanceExternal Link Disclaimer to provide further information around our approach and are asking for public input on the revised draft. The draft guidance details a risk-based enforcement policy prioritizing certain categories of homeopathic products that could pose a higher risk to public health, including products with particular ingredients and routes of administration, products for vulnerable populations, and products with significant quality issues. We encourage the public to review this revised draft guidance and comment before it is finalized. We will consider feedback gathered through this new public comment period, the more than 4,500 comments interested stakeholders submitted on the original 2017 draft guidance, and information gleaned from a 2015 public hearing on the current use of homeopathic drug products. When finalized, this guidance will help provide transparency regarding the categories of homeopathic drug products that we intend to prioritize under our risk-based enforcement approach.
Second, the agency is withdrawingExternal Link Disclaimer the Compliance Policy Guide (CPG) 400.400, entitled “Conditions Under Which Homeopathic Drugs May be Marketed.” Risk is an important driver of the FDA’s regulatory and enforcement actions for all drug products, including homeopathic drug products. Since the issuance of CPG 400.400 in 1988, the FDA has encountered multiple situations in which homeopathic drug products posed a significant risk to patients, even though the products, as labeled, appeared to meet the conditions described in CPG 400.400. However, CPG 400.400 is inconsistent with our risk-based approach to regulatory and enforcement action generally and therefore does not reflect our current thinking. Therefore, it is appropriate to withdraw CPG 400.400 at this time.
… the FDA has issued warning letters to companies who produce homeopathic drug products for significant violations of current good manufacturing practice (CGMP) regulations and various other violations. So far in 2019, we’ve issued more than 10 warning letters to companies for violations concerning homeopathic products. Recently, we issued warning letters to Kadesh Inc., U.S. Continental Marketing, Inc., Fill It Pack It Inc. and Bershtel Enterprises LLC dba WePackItAll, which had jointly manufactured and packaged eye drops produced in non-sterile conditions which could result in serious eye infections. These warning letters should alert all companies that homeopathic drug products must be manufactured and labeled in accordance with the requirements of the Federal Food, Drug, and Cosmetic Act and agency regulations…
If you ask me, ‘homeopathic drug products’ is a misleading name. A drug is defined as a medicine or other substance which has a physiological effect when ingested or otherwise introduced into the body. But highly diluted homeopathics do not contain a substance that has physiological effects.
They should be called
- homeopathic pseudo-drugs,
- homeopathic placebos,
- or fake drugs.
And their labels should make it clear that:
- these products contain no active ingredients,
- and have not been shown to work beyond placebo.
That would be the type of honest and transparent information which consumers deserve and have a right to.
Spinal manipulation is a treatment employed by several professions, including physiotherapists and osteopaths; for chiropractors, it is the hallmark therapy.
- They use it for (almost) every patient.
- They use it for (almost) every condition.
- They have developed most of the techniques.
- Spinal manipulation is the focus of their education and training.
- All textbooks of chiropractic focus on spinal manipulation.
- Chiropractors are responsible for most of the research on spinal manipulation.
- Chiropractors are responsible for most of the adverse effects of spinal manipulation.
Spinal manipulation has traditionally involved an element of targeting the technique to a level of the spine where the proposed movement dysfunction is sited. This study evaluated the effects of a targeted manipulative thrust versus a thrust applied generally to the lumbar region.
Sixty patients with low back pain were randomly allocated to two groups: one group received a targeted manipulative thrust (n=29) and the other a general manipulation thrust (GT) (n=31) to the lumbar spine. Thrust was either localised to a clinician-defined symptomatic spinal level or an equal force was applied through the whole lumbosacral region. The investigators measured pressure-pain thresholds (PPTs) using algometry and muscle activity (magnitude of stretch reflex) via surface electromyography. Numerical ratings of pain and Oswestry Disability Index scores were collected.
Repeated measures of analysis of covariance revealed no between-group differences in self-reported pain or PPT for any of the muscles studied. The authors concluded that a GT procedure—applied without any specific targeting—was as effective in reducing participants’ pain scores as targeted approaches.
The authors point out that their data are similar to findings from a study undertaken with a younger, military sample, showing no significant difference in pain response to a general versus specific rotation, manipulation technique. They furthermore discuss that, if ‘targeted’ manipulation proves to be no better than ‘general’ manipulation (when there has been further research, more studies), it would challenge the need for some current training courses that involve comprehensive manual skill training and teaching of specific techniques. If simple SM interventions could be delivered with less training, than the targeted approach currently requires, it would mean a greater proportion of the population who have back pain could access those general manipulation techniques.
Assuming that the GT used in this trial was equivalent to a placebo control, another interpretation of these results is that the effects of spinal manipulation are largely or even entirely due to a placebo response. If this were confirmed in further studies, it would be yet one more point to argue that spinal manipulation is not a treatment of choice for back pain or any other condition.
I have often discussed the fact that many proponents of so-called alternative medicine (SCAM) have in recent years adopted the following argument: even if our SCAM were just a placebo, it would still be useful. After all, placebo effects are real and increasingly backed by sound science. The argument is deeply flawed, yet it convinces many lay people.
A recent article by Fabrizio Benedetti, the leading researcher in the area of placebo, is addressing exactly this issue. I feel that it is sufficiently important to quote it extensively here:
… a number of biochemical pathways, such as endogenous opioids and cannabinoids,5,6 and brain regions, like the prefrontal cortex, have been found to be involved in placebo analgesia. Likewise, dopamine and the basal ganglia circuitry have been found to mediate placebo responses in Parkinson’s disease. Although this is wonderful news for science, this may not be the case for society. The number of nonmedical organizations and healers that rely on this hard science, and actually justify their odd and bizarre procedures, has increased over the past few years. The main claim is that any procedure boosting patients’ expectations, which represent the main mediator of placebo effects, is acceptable because it can activate the same biochemical pathways and neural networks that have been made credible by hard science…
The crucial point here is that when hard science started investigating placebo effects, it unconsciously produced a shift in quackery thinking. In fact, charlatans are becoming more and more aware that their bizarre interventions could work through a placebo effect. Indeed, whereas hard science has so far denied any scientific basis for nonconventional therapies, now the very same hard science certifies that the placebo effect has scientific grounds. Therefore, quacks are no longer interested in showing that their pseudo-interventions work; rather, they justify their use on the basis of the possibility that these bizarre interventions may induce strong placebo effects…
… A first point that should be emphasized is that placebos do not cure, but rather, they may sometimes improve quality of life. There is plenty of confusion on this point, and unfortunately, many claim that they can cure virtually all illnesses with placebos. Hard science tells us that placebos can reduce symptoms such as pain and muscle rigidity in Parkinson’s disease, yet the progression of the disease is not affected; for example, in Parkinson’s disease, neurons keep degenerating even though some symptoms can be reduced for a short time.4 The second point is related to the first. The type of disease is crucial, and we need to make people understand that pain is different from cancer and that anxiety differs from infectious diseases. The psychological component of some illnesses can indeed be modulated by placebos, but placebos cannot stop cancer growth, nor can they kill the bacteria of pneumonia. The third point is related to the difference between real placebo effects and spontaneous remissions. So far, hard science has studied the placebo effect within a time span of hours/days, thereby limiting our knowledge to short-lasting effects. Consequently, long-lasting effects can be often attributed to spontaneous remissions.
In addition to these three important points, we should also make patients understand that a diagnosis is required before any sort of therapy. An apparently trivial pain may conceal a danger; thus, it must never be treated unless a diagnosis has been made before, and this can be made only by physicians. Moreover, not only should we discuss and consider the positive effects of placebos and the impact they may have in clinical trials and medical practice, but we should also pay much of our attention to the negative counterpart, that is, the misuse and abuse by quacks, charlatans, shamans, and nonmedical organizations. Thus, we need to inform the whole society that the benefits following a nonconventional healing procedure are attributable to a placebo effect in most of the cases. Last but not least, we need to be more honest on the real efficacy of many pharmacological and nonpharmacological treatments, acknowledging that some of them are useful whereas some others are not: This will boost patients’ trust and confidence in medicine further, which I believe are the best foes of quackery…
…Unfortunately, quackery has today one more weapon on its side, which is paradoxically represented by the hard science–supported placebo mechanisms. This new “scientific quackery” can do a lot of damage; thus, we must be very cautious and vigilant as to how the findings of hard science are exploited. The study of the biology of these vulnerable aspects of mankind may unravel new mechanisms of how our brain works, but it may have a profound negative impact on our society as well. We cannot accept a world where expectations can be enhanced with any means and by anybody. This is a perspective that would surely be worrisome and dangerous. I believe that some reflections are necessary in order to avoid a regression of medicine to past times, in which quackery and shamanism were dominant. Unfortunately, the new knowledge about placebos by hard science is now backfiring on it. What we need to do is to stop for a while and reflect on what we are doing and how we want to move forward. A crucial question to answer is, Does placebo research boost pseudoscience?
I am immensely thankful to Prof Benedetti to make such clear and long-overdue statements. They will be most helpful in refuting the myth that homeopathy, para-normal healing, reflexology, acupuncture, chiropractic, etc., etc. are legitimate and uselful therapies, even if they are not better than a placebo. Using placebo therapies in routine care is not in the best interest of either the patient or progress.
An abstract from the recent ‘2nd OFFICIAL SIPS CONFERENCE ON PLACEBO STUDIES’ caught my attention. It is not available on-line; therefore let me reproduce it here in full:
The role of placebo effects in mindfulness-based analgesia 1. Jonathan Davies. University of Sydney, Sydney, NSW, Australia. 2. Louise Sharpe. University of Sydney, Sydney, NSW, Australia. 3. Melissa Day. University of Queensland, Brisbane, QLD, Australia. 4. Ben Colagiuri. University of Sydney, Sydney, NSW, Australia.
Background: Mindfulness meditation can reduce pain both in experimental and clinical settings, though it is not known to what extent mindfulness-specific vs placebo-like expectancy effects account for these changes. This study aimed to: 1. establish whether placebo effects contribute to mindfulness-mediated analgesia; and 2. identify putative cognitive mechanisms responsible for placebo- vs mindfulness-mediated analgesia. Methods: We compared the effects of focussed-attention mindfulness training (6 x 20 min), sham mindfulness, and a no-treatment in a double-blind RCT for experimental heat pain. Sham mindfulness instructions lacked the ‘active ingredients’ of the real training but were matched on all other contextual factors. Results: Both real and sham mindfulness training led to greater pain tolerance relative to no treatment, but there was no difference between the real and sham training. This was accompanied by increased expectancy, beliefs, and pain-related cognitive processes in the two mindfulness groups relative to no treatment, but again there were no differences between real and sham training on these outcomes. There were no effects on pain intensity, pleasantness or threshold. Conclusion: These findings suggest that mindfulness training – at least those involving focused-attention – may lead to improved pain tolerance via the placebo effect rather than any specific mindfulness-related mechanisms. Potential mediators of these effects will be discussed.
I find this study remarkable in two ways:
- It shows that, with a bit of fantasy, ingenuity and will, one can design and use sham procedures even in clinical trials of mind/body therapies.
- Its results suggest that, if one does control for placebo effects, these treatments may not prove to be more than a placebo therapy.
What implications might this have for clinical practice?
Mindfulness is currently hugely popular. It would not be surprising, if the news that it might rely purely on placebo effects would calm down the enthusiasm about this treatment. Many might ask, does it matter? As long as patients benefit, the mechanism of action seems irrelevant. This, of course, is an interesting debate which we have had on this blog many times before.
What do you think?
Cupping is a so-called alternative medicine (SCAM) that has existed in several ancient cultures. It recently became popular when US Olympic athletes displayed cupping marks on their bodies, and it was claimed that cupping is used for enhancing their physical performance. There are two distinct forms: dry and wet cupping.
Wet cupping involves scarring the skin with a sharp instrument and then applying a cup with a vacuum to suck blood from the wound. It can thus be seen (and was traditionally used) as a form of blood-letting. Wet cupping is being recommended by enthusiasts for a wide range of conditions. But does it work?
This study compared the effects of wet-cupping therapy with conventional therapy on persistent nonspecific low back pain (PNSLBP). In this randomized clinical trial, 180 participants with the mean age of 45±10 years old, who had been suffering from PNSLBP were randomly assigned to wet-cupping or conventional treatment. The wet-cupping group was treated with two separate sessions (4 weeks in total) on the inter-scapular and sacrum area. In the conventional treatment group, patients were conservatively treated using rest (6 weeks) and oral medications (3 weeks). The primary and the secondary outcome were the quantity of disability using Oswestry Disability Index (ODI), and pain intensity using Visual Analogue Scale (VAS), respectively.
The results show that there was no significant difference in demographic characteristics (age, gender, and body mass index) between the two groups. Therapeutic effect of wet-cupping therapy was comparable to conventional treatment in the 1st month follow-up visits. The functional outcomes of wet-cupping at the 3rd and 6th month visits were significantly superior compared to the conventional treatment group. The final ODI scores in the wet-cupping and conventional groups were 16.7 ± 5.7 and 22.3 ± 4.5, respectively (P<0.01).
The authors concluded that wet-cupping may be a proper method to decrease PNSLBP without any conventional treatment. The therapeutic effects of wet-cupping can be longer lasting than conventional therapy.
Perhaps the authors were joking? In any case, their conclusions cannot be taken seriously. Why? There are several reasons, but the most obvious ones are:
- There was no adequate control of the presumably substantial placebo effects of wet cupping.
- The control group received a treatment that is known to be ineffective or even detrimental.
For people with acute low back pain, advice to rest in bed is less effective than advice to stay active. Thus comparing wet cupping to a control group treated with bed rest is bound to generate a false-positive outcome for wet cupping.
My final point is perhaps the most important: wet cupping can lead to serious complication, and I therefore do not recommend it to anyone – other than masochists, perhaps.
Spinal manipulation is an umbrella term for numerous manoeuvres chiropractors, osteopaths, physiotherapists and other clinicians apply to their patients’ vertebral columns. Spinal manipulations are said to be effective for a wide range of conditions. But how do they work? What is their mode of action? A new article tries to address these questions. here is its abstract:
Spinal manipulation has been an effective intervention for the management of various musculoskeletal disorders. However, the mechanisms underlying the pain modulatory effects of spinal manipulation remain elusive. Although both biomechanical and neurophysiological phenomena have been thought to play a role in the observed clinical effects of spinal manipulation, a growing number of recent studies have indicated peripheral, spinal and supraspinal mechanisms of manipulation and suggested that the improved clinical outcomes are largely of neurophysiological origin. In this article, we reviewed the relevance of various neurophysiological theories with respect to the findings of mechanistic studies that demonstrated neural responses following spinal manipulation. This article also discussed whether these neural responses are associated with the possible neurophysiological mechanisms of spinal manipulation. The body of literature reviewed herein suggested some clear neurophysiological changes following spinal manipulation, which include neural plastic changes, alteration in motor neuron excitability, increase in cortical drive and many more. However, the clinical relevance of these changes in relation to the mechanisms that underlie the effectiveness of spinal manipulation is still unclear. In addition, there were some major methodological flaws in many of the reviewed studies. Future mechanistic studies should have an appropriate study design and methodology and should plan for a long-term follow-up in order to determine the clinical significance of the neural responses evoked following spinal manipulation.
I have to admit, this made me laugh. Any article that starts with the claim spinal manipulation is an effective intervention and speaks about its observed clinical effects without critically assessing the evidence for it must be ridiculous. The truth is that, so far, it is unclear whether spinal manipulations cause any therapeutic effects at all. To take them as a given, therefore discloses a bias that can only be a hindrance to any objective evaluation.
Yet, perhaps unwittingly, the paper raises an important question: do we need to search for a mode of action of treatments that are unproven? It is a question, of course, that is relevant to all or at least much of SCAM.
Do we need to research the mode of action of acupuncture?
Do we need to research the mode of action of energy healing?
Do we need to research the mode of action of reflexology?
Do we need to research the mode of action of homeopathy?
Do we need to research the mode of action of Bach flower remedies?
Do we need to research the mode of action of cupping?
Do we need to research the mode of action of qigong?
In the absence of compelling evidence that a mode of action (other than the placebo response) exists, I would say: no, we don’t. Such research might turn out to be wasteful and carries the risk of attributing credibility to treatments that do not deserve it.
What do you think?
Spinal manipulative therapy (SMT), especially hyperextension and rotation. have often been associated with cervical artery dissection (CAD), a tear in the internal carotid or the vertebral artery resulting in an intramural haematoma and/or an aneurysmal dilatation. But is the association causal? This question is often the subject of fierce discussions between chiropractors and the real doctors.
The lack of established causality relates to the chicken and egg discussion, i.e., whether the CAD symptoms lead the patient to seek cervical SMT or whether the cervical SMT provokes CAD along with the non-CAD presenting headache and/or neck complaint.
The aim of a new review was to provide an updated step-by-step risk-benefit assessment strategy regarding manual therapy and to provide tools for clinicians to exclude cervical artery dissection.
In light of the evidence provided, the reality, according to the review-authors, is:
- a) that there is no firm scientific basis for direct causality between cervical SMT and CAD;
- b) that the internal carotid artery (ICA) moves freely within the cervical pathway, while 74% of cervical SMTs are conducted in the lower cervical spine where the vertebral artery (VA) also moves freely;
- c) that active daily life consists of multiple cervical movements including rotations that do not trigger CAD, as is true for a range of physical activities;
- d) that a cervical manipulation and/or grade C cervical mobilization goes beyond the physiological limit but remains within the anatomical range, which theoretically means that the artery should not exceed failure strain.
These factors underscore the fact that no serious adverse event (AE) was reported in a large prospective national survey conducted in the UK that assessed all AEs in 28,807 chiropractic treatment consultations, which included 50,276 cervical spine manipulations.
The figure outlines a risk-benefit assessment strategy that should provide additional knowledge and improve the vigilance of all clinicians to enable them to exclude CAD, refer patients with suspected CAD to appropriate care, and consequently prevent CAD from progressing.
It has been argued that most patients present with at least two physical symptoms. The clinical characteristics and recommendations in the figure follow this assumption. This figure is intended to function as a knowledge base that should be implemented in preliminary screening and be part of good clinical practice. This knowledge base will likely contribute to sharpening the attention of the clinicians and alert them as to whether the presenting complaint, combined with a collection of warning signs listed in the figure, deviates from what he or she considers to be a usual musculoskeletal presentation.
Even though this is a seemingly thoughtful analysis, I think it omits at least two important points:
- The large prospective UK survey which included 50,276 cervical spine manipulations might be less convincing that it seems. It recorded about one order of magnitude less minor adverse effects of spinal manipulation than a multitude of previously published prospective surveys. The self-selected, relatively small group of participating chiropractors (32% of the total sample) were both experienced (67% been in practice for 5 or more years) and may not always have adhered to the protocol of the survey. Thus they may have employed their experience to intuitively select low-risk patients rather than including all consecutive cases, as the protocol prescribed. This hypothesis would ﬁrstly account for the unusually low rate of minor adverse effects, and secondly, it would explain why no serious complications occurred at all. Given that about 700 such complications are on record, the low incidence of serious adverse events could well be a gross underestimate.
- The effect of chiropractic spinal manipulative therapy is probably due to a placebo response. This means that it should probably not be done in the first place.
A new update of the current Cochrane review assessed the benefits and harms of spinal manipulative therapy (SMT) for the treatment of chronic low back pain. The authors included all randomised controlled trials (RCTs) examining the effect of spinal manipulation or mobilisation in adults (≥18 years) with chronic low back pain with or without referred pain. Studies that exclusively examined sciatica were excluded.
The effect of SMT was compared with recommended therapies, non-recommended therapies, sham (placebo) SMT, and SMT as an adjuvant therapy. Main outcomes were pain and back specific functional status, examined as mean differences and standardised mean differences (SMD), respectively. Outcomes were examined at 1, 6, and 12 months.
Forty-seven RCTs including a total of 9211 participants were identified. Most trials compared SMT with recommended therapies. In 16 RCTs, the therapists were chiropractors, in 14 they were physiotherapists, and in 5 they were osteopaths. They used high velocity manipulations in 18 RCTs, low velocity manipulations in 12 studies and a combination of the two in 20 trials.
Moderate quality evidence suggested that SMT has similar effects to other recommended therapies for short term pain relief and a small, clinically better improvement in function. High quality evidence suggested that, compared with non-recommended therapies, SMT results in small, not clinically better effects for short term pain relief and small to moderate clinically better improvement in function.
In general, these results were similar for the intermediate and long term outcomes as were the effects of SMT as an adjuvant therapy.
Low quality evidence suggested that SMT does not result in a statistically better effect than sham SMT at one month. Additionally, very low quality evidence suggested that SMT does not result in a statistically better effect than sham SMT at six and 12 months. Low quality evidence suggested that SMT results in a moderate to strong statistically significant and clinically better effect than sham SMT at one month. Additionally, very low quality evidence suggested that SMT does not result in a statistically significant better effect than sham SMT at six and 12 months.
(Mean difference in reduction of pain at 1, 3, 6, and 12 months (0-100; 0=no pain, 100 maximum pain) for spinal manipulative therapy (SMT) versus recommended therapies in review of the effects of SMT for chronic low back pain. Pooled mean differences calculated by DerSimonian-Laird random effects model.)
About half of the studies examined adverse and serious adverse events, but in most of these it was unclear how and whether these events were registered systematically. Most of the observed adverse events were musculoskeletal related, transient in nature, and of mild to moderate severity. One study with a low risk of selection bias and powered to examine risk (n=183) found no increased risk of an adverse event or duration of the event compared with sham SMT. In one study, the Data Safety Monitoring Board judged one serious adverse event to be possibly related to SMT.
The authors concluded that SMT produces similar effects to recommended therapies for chronic low back pain, whereas SMT seems to be better than non-recommended interventions for improvement in function in the short term. Clinicians should inform their patients of the potential risks of adverse events associated with SMT.
This paper is currently being celebrated (mostly) by chiropractors who think that it vindicates their treatments as being both effective and safe. However, I am not sure that this is entirely true. Here are a few reasons for my scepticism:
- SMT is as good as other recommended treatments for back problems – this may be so but, as no good treatment for back pain has yet been found, this really means is that SMT is as BAD as other recommended therapies.
- If we have a handful of equally good/bad treatments, it stand to reason that we must use other criteria to identify the one that is best suited – criteria like safety and cost. If we do that, it becomes very clear that SMT cannot be named as the treatment of choice.
- Less than half the RCTs reported adverse effects. This means that these studies were violating ethical standards of publication. I do not see how we can trust such deeply flawed trials.
- Any adverse effects of SMT were minor, restricted to the short term and mainly centred on musculoskeletal effects such as soreness and stiffness – this is how some naïve chiro-promoters already comment on the findings of this review. In view of the fact that more than half the studies ‘forgot’ to report adverse events and that two serious adverse events did occur, this is a misleading and potentially dangerous statement and a good example how, in the world of chiropractic, research is often mistaken for marketing.
- Less than half of the studies (45% (n=21/47)) used both an adequate sequence generation and an adequate allocation procedure.
- Only 5 studies (10% (n=5/47)) attempted to blind patients to the assigned intervention by providing a sham treatment, while in one study it was unclear.
- Only about half of the studies (57% (n=27/47)) provided an adequate overview of withdrawals or drop-outs and kept these to a minimum.
- Crucially, this review produced no good evidence to show that SMT has effects beyond placebo. This means the modest effects emerging from some trials can be explained by being due to placebo.
- The lead author of this review (SMR), a chiropractor, does not seem to be free of important conflicts of interest: SMR received personal grants from the European Chiropractors’ Union (ECU), the European Centre for Chiropractic Research Excellence (ECCRE), the Belgian Chiropractic Association (BVC) and the Netherlands Chiropractic Association (NCA) for his position at the Vrije Universiteit Amsterdam. He also received funding for a research project on chiropractic care for the elderly from the European Centre for Chiropractic Research and Excellence (ECCRE).
- The second author (AdeZ) who also is a chiropractor received a grant from the European Chiropractors’ Union (ECU), for an independent study on the effects of SMT.
After carefully considering the new review, my conclusion is the same as stated often before: SMT is not supported by convincing evidence for back (or other) problems and does not qualify as the treatment of choice.