Systematic reviews are aimed at summarising and critically evaluating the evidence on a specific research question. They are the highest level of evidence and are more reliable than anything else we have. Therefore, they represent a most useful tool for both clinicians and researchers.
But there are, of course, exceptions. Take, for instance, this recent systematic review by researchers from the
- Texas Chiropractic College, Pasadena, the Palmer Center for Chiropractic Research, Palmer College of Chiropractic, Davenport,
- Department of Planning, Policy and Design, University of California, Irvine,
- VA Puget Sound Health Care System, Tacoma,
- New York Chiropractic College, Seneca Falls,
- Logan University College of Chiropractic, Chesterfield,
- University of Western States, Portland.
The new guidelines by the American College of Physicians entitled ‘Noninvasive Treatments for Acute, Subacute, and Chronic Low Back Pain: A Clinical Practice Guideline From the American College of Physicians’ have already been the subject of the previous post. Today, I want to have a closer look at a small section of these guidelines which, I think, is crucial. It is entitled ‘HARMS OF NONPHARMACOLOGIC THERAPIES’. I have taken the liberty of copying it below:
“Evidence on adverse events from the included RCTs and systematic reviews was limited, and the quality of evidence for all available harms data is low. Harms were poorly reported (if they were reported at all) for most of the interventions.
Low-quality evidence showed no reported harms or serious adverse events associated with tai chi, psychological interventions, multidisciplinary rehabilitation, ultrasound, acupuncture, lumbar support, or traction (9,95,150,170–174). Low-quality evidence showed that when harms were reported for exercise, they were often related to muscle soreness and increased pain, and no serious harms were reported. All reported harms associated with yoga were mild to moderate (119). Low-quality evidence showed that none of the RCTs reported any serious adverse events with massage, although 2 RCTs reported soreness during or after massage therapy (175,176). Adverse events associated with spinal manipulation included muscle soreness or transient increases in pain (134). There were few adverse events reported and no clear differences between MCE and controls. Transcutaneous electrical nerve stimulation was associated with an increased risk for skin site reaction but not serious adverse events (177). Two RCTs (178,179) showed an increased risk for skin flushing with heat compared with no heat or placebo, and no serious adverse events were reported. There were no data on cold therapy. Evidence was insufficient to determine harms of electrical muscle stimulation, LLLT, percutaneous electrical nerve stimulation, interferential therapy, short-wave diathermy, and taping.”
The first thing that strikes me is the brevity of the section. Surely, guidelines of this nature must include a full discussion of the risks of the treatments in question!
The second thing that is noteworthy is the fact that the authors confirm the fact I have been banging on about for years: clinical trials of alternative therapies far too often fail to mention adverse effects. I have often pointed out that the failure to report adverse effects in clinical trials is an unacceptable violation of medical ethics. By contrast, the guideline authors seem not to feel strongly about this omission.
The third thing that is noteworthy is that the guidelines evaluate the harms of the treatments purely on the basis of the adverse effects reported in the clinical trials and systematic reviews included in their efficacy assessments. This is nonsensical for at least two reasons:
- The guideline authors themselves are aware that the trials very often fail to mention adverse effects.
- For any assessment of harm, one has to go far beyond the evidence of clinical trials, because trials tend to be too small to pick up rare adverse effects, and because they are always conducted under optimally controlled conditions where adverse effects are less likely to occur than in real life.
Together, these features of the assessment of harms explain why the guideline authors arrive at conclusions which are oddly misguided; I would even feel that they resemble a white-wash. Here are two of the most overt misjudgements:
- no harms associated with acupuncture,
- only trivial harm associated with spinal manipulations.
The best evidence we have today shows that acupuncture leads to mild adverse effects in about 10% of all cases and is also associated with very severe complications (e.g. pneumothorax, cardiac tamponade, infections, deaths) in an unknown number of patients. More details can be found for instance here, here, here and here.
And the best evidence available shows that spinal manipulation leads to moderately severe adverse effects in ~50% of all cases. In addition, we know of hundreds of cases of very severe complications resulting in stroke, permanent neurological deficits or deaths. More details can be found for instance here, here, here and here.
In the introduction, I stated that this small section of the guidelines is crucial.
The reason is simple: any responsible therapeutic decision has to be based not just on the efficacy of the treatment in question but on its risk/benefit balance. The evidence shows that the risks of some alternative therapies can be considerable, a fact that is almost totally neglected in the guidelines. Therefore, the recommendations of the new guidelines by the American College of Physicians entitled ‘Noninvasive Treatments for Acute, Subacute, and Chronic Low Back Pain: A Clinical Practice Guideline From the American College of Physicians’ are in several aspects not entirely correct and need to be reconsidered.
The question whether spinal manipulative therapy (SMT) is effective for acute low back pain is still discussed controversially. Chiropractors (they use SMT more regularly than other professionals) try everything to make us believe it does work, while the evidence is far less certain. Therefore, it is worth considering the best and most up-to-date data.
The aim of this paper was to systematically review studies of the effectiveness and harms of SMT for acute (≤6 weeks) low back pain. The research question was straight forward: Is the use of SMT in the management of acute (≤6 weeks) low back pain associated with improvements in pain or function?
A through literature search was conducted to locate all relevant papers. Study quality was assessed using the Cochrane Back and Neck (CBN) Risk of Bias tool. The evidence was assessed using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) criteria. The main outcome measures were pain (measured by either the 100-mm visual analog scale, 11-point numeric rating scale, or other numeric pain scale), function (measured by the 24-point Roland Morris Disability Questionnaire or Oswestry Disability Index [range, 0-100]), or any harms measured within 6 weeks.
Of 26 eligible RCTs identified, 15 RCTs (1711 patients) provided moderate-quality evidence that SMT has a statistically significant association with improvements in pain (pooled mean improvement in the 100-mm visual analog pain scale, −9.95 [95% CI, −15.6 to −4.3]). Twelve RCTs (1381 patients) produced moderate-quality evidence that SMT has a statistically significant association with improvements in function (pooled mean effect size, −0.39 [95% CI, −0.71 to −0.07]). Heterogeneity was not explained by type of clinician performing SMT, type of manipulation, study quality, or whether SMT was given alone or as part of a package of therapies. No RCT reported any serious adverse event. Minor transient adverse events such as increased pain, muscle stiffness, and headache were reported 50% to 67% of the time in large case series of patients treated with SMT.
The authors concluded that among patients with acute low back pain, spinal manipulative therapy was associated with modest improvements in pain and function at up to 6 weeks, with transient minor musculoskeletal harms. However, heterogeneity in study results was large.
This meta-analysis has been celebrated by chiropractors around the world as a triumph for their hallmark therapy, SMT. But there have also been more cautionary voices – not least from the lead author of the paper. Patients undergoing spinal manipulation experienced a decline of 1 point in their pain rating, says Dr. Paul Shekelle, an internist with the West Los Angeles Veterans Affairs Medical Center and the Rand Corporation who headed the study. That’s about the same amount of pain relief as from NSAIDs, over-the-counter nonsteroidal anti-inflammatory medication, such as ibuprofen. The study also found spinal manipulation modestly improved function. On average, patients reported greater ease and comfort engaging in two day-to-day activities — such as finding they could walk more quickly, were having less difficulty turning over in bed or were sleeping more soundly.
It’s not clear exactly how spinal manipulation relieves back pain. But it may reposition the small joints in the spine in a way that causes less pain, according to Dr. Richard Deyo, an internist and professor of evidence-based medicine at the Oregon Health and Science University. Deyo wrote an editorial published along with the study. Another possibility, Deyo says, is that spinal manipulation may restore some material in the disk between the vertebrae, or it may simply relax muscles, which could be important. There may also be mind-body interaction that comes from the “laying of hands” or a trusting relationship between patients and their health care provider, he says.
Deyo notes that there are many possible treatments for lower back pain, including oral medicine, injected medicine, corsets, traction, surgery, acupuncture and massage therapy. But of about 200 treatment options, “no single treatment is clearly superior,” he says.
In another comment by Paul Ingraham the critical tone was much clearer: “Claiming it as a victory is one of the best examples I’ve ever seen of making lemonade out of science lemons! But I can understand the mistake, because the review itself does seem positive at first glance: the benefits of SMT are disingenuously summarized as “statistically significant” in the abstract, with no mention of clinical significance (effect size; see Statistical Significance Abuse). So the abstract sounds like good news to anyone but the most wary readers, while deep in the main text the same results are eventually conceded to be “clinically modest.” But even even that seems excessively generous: personally, I need at least a 2-point improvement in pain on a scale of 10 to consider it a “modest” improvement! This is not a clearly positive review: it shows weak evidence of minor efficacy, based on “significant unexplained heterogeneity” in the results. That is, the results were all over the place — but without any impressive benefits reported by any study — and the mixture can’t be explained by any obvious, measurable factor. This probably means there’s just a lot of noise in the data, too many things that are at least as influential as the treatment itself. Or — more optimistically — it could mean that SMT is “just” disappointingly mediocre on average, but might have more potent benefits in a minority of cases (that no one seems to be able to reliably identify). Far from being good news, this review continues a strong trend (eg Rubinstein 2012) of damning SMT with faint praise, and also adds evidence of backfiring to mix. Although fortunately “no RCT reported any serious adverse event,” it seems that minor harms were legion: “increased pain, muscle stiffness, and headache were reported 50% to 67% of the time in large case series of patients treated with SMT.” That’s a lot of undesirable outcomes. So the average patient has a roughly fifty-fifty chance of up to roughly maybe a 20% improvement… or feeling worse to some unknown degree! That does not sound like a good deal to me. It certainly doesn’t sound like good medicine.”
END OF QUOTE
As I have made clear in many previous posts, I do fully agree with these latter statements and would add just three points:
- We know that many of the SMT studies completely neglect reporting adverse effects. Therefore it is hardly surprising that no serious complications were on record. Yet, we know that they do occur with sad regularity.
- None of the studies controlled for placebo effects. It is therefore possible – I would say even likely – that a large chunk of the observed benefit is not due to SMT per se but to a placebo response.
- It seems more than questionable whether the benefits of SMT outweigh its risks.
Is spinal manipulative therapy (SMT) dangerous? This question has kept us on this blog busy for quite some time now. To me, there is little doubt that SMT can cause adverse effects some of which are serious. But many chiropractors seem totally unconvinced. Perhaps this new overview of reviews might help to clarify the issue. Its aim was to elucidate and quantify the risk of serious adverse events (SAEs) associated with SMT.
The authors searched five electronic databases from inception to December 8, 2015 and included reviews on any type of studies, patients, and SMT technique. The primary outcome was SAEs. The quality of the included reviews was assessed using a measurement tool to assess systematic reviews (AMSTAR). Since there were insufficient data for calculating incidence rates of SAEs, they used an alternative approach; the conclusions regarding safety of SMT were extracted for each review, and the communicated opinion were judged by two reviewers independently as safe, harmful, or neutral/unclear. Risk ratios (RRs) of a review communicating that SMT is safe and meeting the requirements for each AMSTAR item, were calculated.
A total of 283 eligible reviews were identified, but only 118 provided data for synthesis. The most frequently described adverse events (AEs) were stroke, headache, and vertebral artery dissection. Fifty-four reviews (46%) expressed that SMT is safe, 15 (13%) expressed that SMT is harmful, and 49 reviews (42%) were neutral or unclear. Thirteen reviews reported incidence estimates for SAEs, roughly ranging from 1 in 20,000 to 1 in 250,000,000 manipulations. Low methodological quality was present, with a median of 4 of 11 AMSTAR items met (interquartile range, 3 to 6). Reviews meeting the requirements for each of the AMSTAR items (i.e. good internal validity) had a higher chance of expressing that SMT is safe.
The authors concluded that it is currently not possible to provide an overall conclusion about the safety of SMT; however, the types of SAEs reported can indeed be significant, sustaining that some risk is present. High quality research and consistent reporting of AEs and SAEs are needed.
This article is valuable, if only for the wealth of information one can extract from it. There are, however, numerous problems. One is that the overview included mostly reviews of the effectiveness of SMT for various conditions. We know that studies of SMT often do not even mention AEs. If such studies are then pooled in a review, they inevitably generate an impression of safety. But this would, of course, be a false-positive result!
The authors of the overview are aware of this problem and address it in the following paragraph: “When only considering the subset of reviews, where the objective was to investigate AEs (37 reviews), then 8 reviews (22%) expressed that SMT is safe, 13 reviews (35%) expressed that SMT is harmful and 16 reviews (43%) were neutral or unclear regarding the safety of SMT. Hence, there is a tendency that a bigger proportion of these reviews are expressing that SMT is harmful compared to the full sample of reviews…”
To my surprise, I found several of my own reviews in the ‘neutral or unclear’ category. Here are the verbatim conclusions of three of them:
- It is concluded that serious cerebrovascular complications of spinal manipulation continue to be reported.
- The most common serious adverse events are vertebrobasilar accidents, disk herniation, and cauda equina syndrome.
- These data indicate that mild and transient adverse events seem to be frequent. Serious adverse events are probably rare but their incidence can only be estimated at present.
I find it puzzling how this could be classified as neutral or unclear. The solution of the puzzle might lie in the methodology used: “we appraised the communicated opinions of each review concerning the safety of SMT based on their conclusions regarding the AEs and SAEs. This was done by two reviewers independently (SMN, LK), who judged the communicated opinions as either ‘safe’, ‘neutral/unclear’ or ‘harmful’, based on the qualitative impression the reviewers had when reading the conclusions. The reviewers had no opinion about the safety/harmfulness of SMT before commencing the judgements. Cohen’s weighted Kappa was calculated for the agreement between the reviewers, with a value of 0.40–0.59 indicating ‘fair agreement’, 0.60–0.74 indicating ‘good agreement’ and ≥0.75 indicating ‘excellent agreement’. Disagreements were resolved by a third reviewer (MH).”
In other words, the categorisation was done on the basis of subjective judgements of two researchers. It seems obvious that, if their attitude was favourable towards SMT, their judgements would be influenced. The three examples from my own work cited above indicates to me that their verdicts were indeed far from objective.
So what is the main message here? In my view, it can be summarized in the following quote from the overview: “a bigger proportion of these reviews are expressing that SMT is harmful …”
Yes, yes, yes – I know that, if you are a chiropractor (or other practitioner using mostly SMT), you are unlikely to agree with this!
Perhaps you can agree with this statement then:
As long as there is reasonable doubt about the safety of SMT, and as long as we cannot be sure that SMT generates more good than harm, we should be very cautious using it for routine healthcare and do rigorous research to determine the truth (it’s called the precautionary principle and applies to all types of healthcare).
We have discussed the risks of (chiropractic) spinal manipulation more often than I care to remember. The reason for this is simple: it is an important subject; making sure that as many consumers know about it will save lives, I am sure. Therefore, any new paper on the subject is likely to be reported on this blog.
Objective of this review was to identify characteristics of 1) patients, 2) practitioners, 3) treatment process and 4) adverse events (AE) occurring after cervical spinal manipulation (CSM) or cervical mobilization. Systematic searches were performed in 6 electronic databases. Of the initial 1043 studies, 144 studies were included.
They reported 227 cases. 117 cases described male patients with a mean age of 45 (SD 12) and a mean age of 39 (SD 11) for females. Most patients were treated by chiropractors (66%) followed by non-clinicians (5%), osteopaths (5%), physiotherapists (3%) and other medical professions. Manipulation was reported in 95% of the cases (mobilisations only in 1.7%), and neck pain was the most frequent indication.
Cervical arterial dissection (CAD) was reported in 57% of the cases and 46% had immediate onset symptoms; in 2% onset of symptoms took for more than two weeks. Other complications were disc rupture, spinal cord swelling and thrombus. The most frequently reported symptoms included disturbance of voluntary control of movement, pain, paresis and visual disturbances.
In most of the reports, patient characteristics were described poorly. No clear patient profile, related to the risk of AE after CSM, could be extracted. However, women seem more at risk for CAD.
The authors concluded that there seems to be under-reporting of cases. Further research should focus on a more uniform and complete registration of AE using standardized terminology.
I do not want to repeat what I have stated in previous posts on this subject. So,let me just ask this simple question: IF THERE WERE A DRUG MARKTED FOR NECK PAIN BUT NOT SUPPORTED BY GOOD EVIDENCE FOR EFFICACY, DO YOU THINK IT WOULD BE ON THE MARKET AFTER 227 CASES OF SEVERE ADVERSE EFFECTS HAD BEEN DESCRIBED?
I think the answer is NO!
If we then consider the huge degree of under-reporting in this area which might bring the true figure up by one or even two dimensions, we must ask: WHY IS CERVICAL MANIPULATION STILL USED?
As has been discussed on this blog many times before, the chiropractic profession seems to be in a bit of a crisis (my attempt at a British understatement). The Australian chiropractor, Bruce Walker, thinks that, with the adoption of his ten point plan, “the chiropractic profession has an opportunity to turn things around within a generation. Importantly, it has an obligation to the public and to successive generations of chiropractors ahead of it. By embracing this plan the profession can be set on a new path, a new beginning and a new direction. This plan should be known as the new chiropractic.”
And now you are. of course, dying to hear this 10 point plan – well, here it is [heavily abbreviated, I am afraid (the footnotes [ ] and the comments referring to them are mine)]:
- There is a need to improve pre professional education for chiropractors.
Universities or private colleges?
Chiropractic education should where possible be conducted at universities  and this does not mean small single purpose institutions that are deemed universities in name only. Why is this recommended? Primarily because unlike some private colleges, government funded universities insist on intellectual evidence based rigour  in their learning and teaching and importantly require staff to be research active. Chiropractic courses need to have an underpinning pedagogy that insists that content  is taught in the context of the evidence  and that students obtain the necessary training to question and critically appraise …
Underpinning chiropractic education is program accreditation and this is also in need of review particularly where vitalistic subluxation  based courses have been legitimised by the accreditation process…
Chiropractic education should also involve specifically relevant hospital access or work experience such as hospital rounds so that students can observe patients that are truly unwell and observe the signs and symptoms taught in their theory classes. Hospital rounds would also allow chiropractic students to interact with other health providers and increase the likelihood of legitimate partnership and respect between health professions .
Who should teach chiropractic students?…
- There is a need to establish a progressive identity.
Chiropractors need to become solely musculoskeletal practitioners with a special emphasis on spinal pain . If the profession becomes the world’s experts in this area it will command the respect deserved . Importantly it will not be seen as a collective of alternative medicine practitioners with a strange belief system …
- The profession should develop a generalised special interest.
…Chiropractic as a profession should also develop a special interest area in the health sciences that can make a worldwide contribution to other related health sciences. This could be either research based or clinically based or indeed both. Some possibilities are: the further development and refinement of evidence based practice , improved posture through motor control, musculoskeletal care for the aged and elderly, improving bone density or the very important area of translating research into practice via implementation science. Whatever chosen we need to develop a special interest that sets us apart as experts in a distinctive area .
- Marginalisation of the nonsensical elements within the profession.
As professionals chiropractors should not tolerate colleagues or leadership in the profession who demonstrate aberrant ideas. If colleagues transgress the boundaries or professionalism they should be reported to authorities and this should be followed up with action by those authorities …
- The profession and individual practitioners should be pro public health.
It is important to speak up openly in favour of evidence-based public health measures and to join public health associations and agencies … For example, chiropractors promoting anti-vaccination views need to be countered …
- Support legitimate organised elements of the profession.
Practitioners should support and become involved in chiropractic organisations that are clearly ethical and evidence based  and add value to them…
…Regular collective professional advertising of the benefits of chiropractic for back pain, for example, is a worthy undertaking but the advertisements or media offerings must be evidence based .
- The profession should strive to improve clinical practice.
Chiropractors contribute to the public health by the aggregated benefit of positive outcomes to health from their clinical practices … Where restrictive practice laws relating to chiropractors prescribing medication exist the profession should seek to overturn them …
- The profession should embrace evidence based practice.
EBP is the amalgam of best scientific evidence plus clinical expertise plus patient values and circumstances. So what could be missing from this equation? It is clear that in the opinion of a sizable minority of the profession the elements that are missing are “practitioner ideology” and “practitioner values and circumstances”. These additional self- serving and dangerous notions should not be entertained. The adoption of evidence based practice is critical to the future of chiropractic and yet there is resistance by elements within the profession. Soft resistance occurs with attempts to change the name of “Evidence-based practice” (EBP) to “Evidence-informed practice” (EIP). It is worth noting that currently there are over 13,000 articles listed in PUBMED on EBP but less than 100 listed on EIP. So why are some of our profession so keen to use this alternate and weaker term?
Hard resistance against EBP occurs where it is stated that the best evidence is that based on practice experience and not research. This apparently is known as Practice Based Evidence (PBE) and has a band of followers …
- The profession must support research.Research needs to become the number one aspiration of the profession. Research informs both practice and teaching. Without research the profession will not progress. Sadly, the research contribution by the chiropractic profession can only be described as seed like. Figure 1 is a comparison of articles published in the past 45 years by decade using the key words “Physiotherapy” or “Physical Therapy” versus “Chiropractic” (source PUBMED). The Y axis is the number of articles published and the X axis is the decade, the red represents physiotherapy articles, the blue chiropractic. The difference is stark and needs urgent change .If the profession at large ignores research whether in its conduct, administration or its results the profession will wither on the vine …
- Individual chiropractors need to show personal leadership to effect change.
Change within the profession will likely only occur if individual chiropractors show personal leadership….
As part of this personal leadership it will be critical to speak out within the profession. Speak out and become a mentor to less experienced colleagues …
Anyone you thinks that with such a strategy “the chiropractic profession has an opportunity to turn things around within a generation” is, in my view, naïve and deluded. The 10 points are not realistic and woefully incomplete. The most embarrassing omission is a clear statement that chiropractors are fully dedicated to making sure that they serve the best interest of their patients by doing more good than harm.
It has long been argued that chiropractic spinal manipulations are mere placebo interventions. Yet few controlled trials have assessed the efficacy of spinal manipulative therapy (SMT). No high quality trials have been performed to test the efficacy and effectiveness of Graston Technique® (GT), an instrument-assisted soft tissue therapy.
The objective of this trial was to determine the efficacy of SMT and GT compared to sham therapy for the treatment of non-specific thoracic spine pain.
People with non-specific thoracic pain were randomly allocated to one of three groups: SMT, GT, or a placebo (de-tuned ultrasound). GT is a popular soft-tissue technique in the United States and becoming more popular in other developed countries. GT is an instrument-assisted soft-tissue therapy involving the use of hand-held stainless steel instruments. The promoters of the GT claim that the instruments resonate in the clinician’s hands allowing the clinician to isolate soft-tissue “adhesions and restrictions”, and treat them precisely. Each participant received up to 10 supervised treatment sessions at Murdoch University chiropractic student clinic over a 4 week period.
The two outcome measures were self-administered instruments. Participants were given blank questionnaires in a package by a research assistant following their first treatment. Participants were instructed to complete the instruments at each assessment time point. After completion of the forms the participant posted them back to the Murdoch University Chiropractic Clinic. Research assistants remained blind to the outcome data for the entire study period. The participants and treatment providers were not blinded to the treatment allocation as it was clear that the groups were receiving different treatments. Participants in the placebo group were blinded to their placebo allocation until follow-up was complete at 12 months. Participants were surveyed for the adequacy of the placebo blinding at the end of the study.
Treatment outcomes were measured at baseline, 1 week, and at one, three, six and 12 months. Primary outcome measures included a modified Oswestry Disability Index, and the Visual Analogue Scale (VAS). Treatment effects were estimated with intention to treat analysis and linear mixed models.
One hundred and forty three participants were randomly allocated to the three groups (SMT = 36, GT = 63 and Placebo = 44). Baseline data for the three groups did not show any meaningful differences. Results of the intention to treat analyses revealed no time by group interactions, indicating no statistically significant between-group differences in pain or disability at 1 week, 1 month, 3 months, 6 months, or 12 months. There were significant main effects of time (p < 0.01) indicating improvements in pain and disability from baseline among all participants regardless of intervention. No significant adverse events were reported.
The authors concluded that this study indicates that there is no difference in outcome at any time point for pain or disability when comparing SMT, Graston Technique® or sham therapy for thoracic spine pain, however all groups improved with time. These results constitute the first from a fully powered randomised controlled trial comparing SMT, Graston technique® and a placebo.
Some people claim that there is little wrong with placebo therapy, as long as it helps patients. This is not what I think, but even the proponents of this argument would agree that the placebo used in this way has to be safe. As SMT is by no means free of adverse effects, the argument cannot be applied here.
Other people will argue that this is about SMT and not chiropractic implying that I am conducting a vendetta against the poor chiropractors. I would disagree: we have just learnt that 93% of chiropractors consider SMT as their primary treatment. Yes, osteopaths and physiotherapists also use SMT but certainly not to this extent. Thus this discussion is mostly about chiropractic, and the onus is on chiropractors to demonstrate beyond doubt that SMT does more good than harm.
The true significance of this study is, I think, that the chiropractic profession now must convince us that spinal manipulation has any usefulness at all. They will have to conduct rigorous trials along the lines of this study to test for which condition these interventions generate outcomes that are significantly better than those achievable by sham.
Until such data are available, it would be wise, I think, to consider all therapeutic claims made for chiropractic unproven and bogus.
WATCH THIS SPACE!
Amidst the current controversy of chiropractic spinal manipulation for new-born babies, the previous director of Chiropractor’s Association of Australia NSW, Alex Fielding, published an interesting article. In it, he declared:
- I do not condone the chiropractic treatment of children for non-musculoskeletal conditions it is simply not our place. There is little to no evidence for it and it should not be done. If a chiro is report them to AHPRA.
- There is no evidence for “subluxation” it simply has not been shown to exist by any credible source.
- Chiropractic does not equal spinal manipulative therapy (SMT) or adjustment. We are trained to assess and treat musculoskeletal conditions, use exercise rehab, various forms of manual therapy including SMT, give sound evidence based advice and refer to better suited health professionals in the appropriate circumstance. To say there is no evidence for chiropractic is an ill informed politically charged statement, if you mean SMT, say SMT.
Here I only want to comment on his last point. I think it is important, not least because we hear it ad nauseam. As soon as there emerges new evidence to show that SMT does little for back or neck pain or is ineffective for non-spinal conditions, chiropractors insist that they do so much more than just SMT, and therefore any such findings do not ever lend themselves to a verdict about chiropractic care.
In my view, this argument is a bit like ‘wanting the cake and eat it’ (chiros want to be different from physios by adhering to SMT, but they don’t want to be judged by the uselessness of SMT). It begs the following questions:
- What other modalities do chiros use?
- For which conditions do they use them?
- What is the evidence for or against them?
- In what percentage of patients do chiros use SMT?
The last question may be the most important one. I am not aware of data from ‘down under’ but, in the UK, the percentage is close to 100%. This is why I often call SMT the ‘hallmark therapy of chiropractors’. No other profession employ it more frequently. It is the treatment that defines the chiropractic profession.
If the evidence for SMT is flimsy or negative or non-existent, it seems not unreasonable to voice doubts about the profession that uses it most. The fact that chiropractors also administer other modalities – most of which, by the way, have a shaky evidence-base too – is simply a smoke-screen used to mislead us.
An example might make this a bit clearer. Imagine a surgeon who takes out the tonsils of every patient he sees, regardless of any tonsillitis or other tonsil-related condition (historically, this fad once existed; tonsillectomy was even used to treat depression). This surgeon also does all sorts of other things: he prescribes pain-killers, gives antibiotics, orders bed-rest, gives life-style advice etc. etc. Yet he is a charlatan because his hallmark intervention is not effective and even puts patients at unnecessary risks.
I know, the analogy is not perfect, but it makes the point: chiropractors refuse to be judged by the uselessness of SMT. Yet it is what defines them and they continue using SMT pretty much regardless of the evidence. Fielding pleads: To say there is no evidence for chiropractic is an ill informed politically charged statement, if you mean SMT, say SMT. I’d say there is no good evidence for SMT nor for chiropractic care that includes SMT.
My advice for chiropractors therefore is: abandon SMT and become physiotherapists. This will make you a bit better grounded in evidence, but at least you would have rid yourself of the Palmer-cult with all the BS that comes with it.
On this blog, I have repeatedly pleaded for a change of the 2010 NICE guidelines for low back pain (LBP). My reason was that it had become quite clear that their recommendation to use spinal manipulation and acupuncture for recurrent LBP was no longer supported by sound evidence.
Two years ago, a systematic review (authored by a chiropractor and published in a chiro-journal) concluded that “there is no conclusive evidence that clearly favours spinal manipulation or exercise as more effective in treatment of CLBP.” A the time, I wrote a blog explaining that “whenever two treatments are equally effective (or, in this case, perhaps equally ineffective?), we must consider other important criteria such as safety and cost. Regular chiropractic care (chiropractors use spinal manipulation on almost every patient, while osteopaths and physiotherapists employ it less frequently) is neither cheap nor free of serious adverse effects such as strokes; regular exercise has none of these disadvantages. In view of these undeniable facts, it is hard not to come up with anything other than the following recommendation: until new and compelling evidence becomes available, exercise ought to be preferred over spinal manipulation as a treatment of chronic LBP – and consequently consulting a chiropractor should not be the first choice for chronic LBP patients.”
Three years ago, a systematic review of acupuncture for LBP (published in a TCM-journal) concluded that the effect of acupuncture “is likely to be produced by the nonspecific effects of manipulation.” At that time I concluded my blog-post with this question: Should NICE be recommending placebo-treatments and have the tax payer foot the bill? Now NICE have provided an answer.
The new draft guideline by NICE recommends various forms of exercise as the first step in managing low back pain. Massage and manipulation by a physiotherapist should only be used alongside exercise; there is not enough evidence to show they are of benefit when used alone. Moreover, patients should be encouraged to continue with normal activities as far as possible. Crucially, the draft guideline no longer recommends acupuncture for treating low back pain.
NICE concluded that the evidence shows that acupuncture is not better than sham treatment. Paracetamol on its own is no longer recommended either, instead non-steroidal anti-inflammatory drugs (NSAIDs) such as ibuprofen or aspirin should be tried first. Talking therapies are recommended in combination with physical therapies for patients who had no improvement on previous treatments or who have significant psychological and social barriers to recovery.
Professor Mark Baker, clinical practice director for NICE, was quoted stating “Regrettably there is a lack of convincing evidence of effectiveness for some widely used treatments. For example acupuncture is no longer recommended for managing low back pain with or without sciatica. This is because there is not enough evidence to show that it is more effective than sham treatment.”
Good news for us all, I would say:
- good news for patients who now hear from an accepted authority what to do when they suffer from LBP,
- good news for society who does no longer need to spend vast amounts of money on questionable therapies,
- good news for responsible clinicians who now have clear guidance which they can show and explain to their patients.
Not so good news, I admit, for acupuncturists, chiropractors and osteopaths who just had a major source of their income scrapped. I have tried to find some first reactions from these groups but, for the moment, they seemed to be stunned into silence – nobody seems to have yet objected to the new guideline. Instead, I found a very recent website where chiropractic is not just recommended for LBP therapy but where patients are instructed that, even in the absence of pain, they need to see their chiropractor regularly: “Maintenance chiropractic care is well supported in studies for controlling chronic LBP.”
NEVER LET THE TRUTH GET IN THE WAY OF YOUR CASH-FLOW…they seem to conclude.
Chiropractors and osteopaths have long tried to convince us that spinal manipulation and mobilisation are the best we can do when suffering from neck pain. But is this claim based on good evidence?
This recent update of a Cochrane review was aimed at assessing the effects of manipulation or mobilisation alone compared with those of an inactive control or another active treatment on pain, function, disability, patient satisfaction, quality of life and global perceived effect in adults experiencing neck pain with or without radicular symptoms and cervicogenic headache (CGH) at immediate- to long-term follow-up, and when appropriate, to assess the influence of treatment characteristics (i.e. technique, dosage), methodological quality, symptom duration and subtypes of neck disorder on treatment outcomes.
Review authors searched the following computerised databases to November 2014 to identify additional studies: the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, EMBASE and the Cumulative Index to Nursing and Allied Health Literature (CINAHL). They also searched ClinicalTrials.gov, checked references, searched citations and contacted study authors to find relevant studies.
Randomised controlled trials (RCTs) undertaken to assess whether manipulation or mobilisation improves clinical outcomes for adults with acute/subacute/chronic neck pain were included in this assessment.
Two review authors independently selected studies, abstracted data, assessed risk of bias and applied Grades of Recommendation, Assessment, Development and Evaluation (GRADE) methods (very low, low, moderate, high quality). The authors calculated pooled risk ratios (RRs) and standardised mean differences (SMDs).
Fifty-one trials with a total of 2920 participants could be included. The findings are diverse. Cervical manipulation versus inactive control: For subacute and chronic neck pain, a single manipulation (three trials, no meta-analysis, 154 participants, ranged from very low to low quality) relieved pain at immediate- but not short-term follow-up. Cervical manipulation versus another active treatment: For acute and chronic neck pain, multiple sessions of cervical manipulation (two trials, 446 participants, ranged from moderate to high quality) produced similar changes in pain, function, quality of life (QoL), global perceived effect (GPE) and patient satisfaction when compared with multiple sessions of cervical mobilisation at immediate-, short- and intermediate-term follow-up. For acute and subacute neck pain, multiple sessions of cervical manipulation were more effective than certain medications in improving pain and function at immediate- (one trial, 182 participants, moderate quality) and long-term follow-up (one trial, 181 participants, moderate quality). These findings are consistent for function at intermediate-term follow-up (one trial, 182 participants, moderate quality). For chronic CGH, multiple sessions of cervical manipulation (two trials, 125 participants, low quality) may be more effective than massage in improving pain and function at short/intermediate-term follow-up. Multiple sessions of cervical manipulation (one trial, 65 participants, very low quality) may be favoured over transcutaneous electrical nerve stimulation (TENS) for pain reduction at short-term follow-up. For acute neck pain, multiple sessions of cervical manipulation (one trial, 20 participants, very low quality) may be more effective than thoracic manipulation in improving pain and function at short/intermediate-term follow-up. Thoracic manipulation versus inactive control: Three trials (150 participants) using a single session were assessed at immediate-, short- and intermediate-term follow-up. At short-term follow-up, manipulation improved pain in participants with acute and subacute neck pain (five trials, 346 participants, moderate quality, pooled SMD -1.26, 95% confidence interval (CI) -1.86 to -0.66) and improved function (four trials, 258 participants, moderate quality, pooled SMD -1.40, 95% CI -2.24 to -0.55) in participants with acute and chronic neck pain. A funnel plot of these data suggests publication bias. These findings were consistent at intermediate follow-up for pain/function/quality of life (one trial, 111 participants, low quality). Thoracic manipulation versus another active treatment: No studies provided sufficient data for statistical analyses. A single session of thoracic manipulation (one trial, 100 participants, moderate quality) was comparable with thoracic mobilisation for pain relief at immediate-term follow-up for chronic neck pain. Mobilisation versus inactive control: Mobilisation as a stand-alone intervention (two trials, 57 participants, ranged from very low to low quality) may not reduce pain more than an inactive control. Mobilisation versus another active treatment: For acute and subacute neck pain, anterior-posterior mobilisation (one trial, 95 participants, very low quality) may favour pain reduction over rotatory or transverse mobilisations at immediate-term follow-up. For chronic CGH with temporomandibular joint (TMJ) dysfunction, multiple sessions of TMJ manual therapy (one trial, 38 participants, very low quality) may be more effective than cervical mobilisation in improving pain/function at immediate- and intermediate-term follow-up. For subacute and chronic neck pain, cervical mobilisation alone (four trials, 165 participants, ranged from low to very low quality) may not be different from ultrasound, TENS, acupuncture and massage in improving pain, function, QoL and participant satisfaction at immediate- and intermediate-term follow-up. Additionally, combining laser with manipulation may be superior to using manipulation or laser alone (one trial, 56 participants, very low quality).
Confused? So am I!
In my view, these analyses show that the quality of most studies is wanting and the evidence is weak – much weaker than chiropractors and osteopaths try to make us believe. It seems to me that no truly effective treatments for neck pain have been discovered and that therefore manipulation/mobilisation techniques are as good or as bad as most other options.
In such a situation, it might be prudent to first investigate the causes of neck pain in greater detail and subsequently determine the optimal therapies for each of them. Neck pain is a SYMPTOM, not a disease! And it is always best to treat the cause of a symptom rather than pretending we know the cause as chiropractors and osteopaths often do.
The authors of the Cochrane review seem to agree with this view at least to some extent. They conclude that although support can be found for use of thoracic manipulation versus control for neck pain, function and QoL, results for cervical manipulation and mobilisation versus control are few and diverse. Publication bias cannot be ruled out. Research designed to protect against various biases is needed. Findings suggest that manipulation and mobilisation present similar results for every outcome at immediate/short/intermediate-term follow-up. Multiple cervical manipulation sessions may provide better pain relief and functional improvement than certain medications at immediate/intermediate/long-term follow-up. Since the risk of rare but serious adverse events for manipulation exists, further high-quality research focusing on mobilisation and comparing mobilisation or manipulation versus other treatment options is needed to guide clinicians in their optimal treatment choices.
The call for further research is, of course, of no help for patients who are suffering from neck pain today. What would I recommend to them?
My advice is to be cautious:
- Consult your doctor and try to get a detailed diagnosis.
- See a physiotherapist and ask to be shown exercises aimed at reducing the pain and preventing future episodes.
- Do these exercises regularly, even when you have no pain.
- Make sure you do whatever else might be needed in terms of life-style changes (ergonomic work place, correct sleeping arrangements, etc.).
- If you are keen on seeing an alternative practitioner for manual therapy, consult a osteopath rather than a chiropractor; the former tend to employ techniques which are less risky than the latter.
- Avoid both chiropractors and long-term medication for neck pain.