This overview by researchers from that Arthritis Research UK Primary Care Centre, Research Institute for Primary Care & Health Sciences, Keele University, UK, was aimed at summarising the current best evidence on treatment options for 5 common musculoskeletal pain presentations: back, neck, shoulder, knee and multi-site pain. Reviews and studies of treatments were considered of the following therapeutic options: self-management advice and education, exercise therapy, manual therapy, pharmacological interventions (oral and topical analgesics, local injections), aids and devices, other treatments (ultrasound, TENS, laser, acupuncture, ice / hot packs) and psychosocial interventions (such as cognitive-behavioural therapy and pain-coping skills).
Here are the findings for those treatments most relevant in alternative medicine (it is interesting that most alternative medicines were not even considered because of lack of evidence and that the team of researchers can hardly be accused of an anti-alternative medicine bias, since its senior author has a track record of publishing results favourable to alternative medicine):
Current evidence shows significant positive effects in favour of exercise on pain, function, quality of life and work related outcomes in the short and long-term for all the musculoskeletal pain presentations (compared to no exercise or other control) but the evidence regarding optimal content or delivery of exercise in each case is inconclusive.
The evidence from a good quality individual patient data meta-analysis suggests that acupuncture may be effective for short-term relief of back pain and knee pain with medium summary effect sizes respectively compared with usual care or no acupuncture. However, effects on function were reported to be minimal and not maintained at longer-term follow-up. Similarly for neck and shoulder pain, acupuncture was only found to be effective for short-term (immediately post-treatment and at short-term follow-up) symptom relief compared to placebo.
Current evidence regarding manual therapy is beset by heterogeneity. Due to paucity of high quality evidence, it is uncertain whether the efficacy of manual therapy might be different for different patient subgroups or influenced by the type and experience of professional delivering the therapy. On the whole, the available evidence suggests that manual therapy may offer some beneficial effects on pain and function, but it may not be superior to other non-pharmacological treatments (e.g. exercise) for patients with acute or chronic musculoskeletal pain.
Overall. the authors concluded that the best available evidence shows that patients with musculoskeletal pain problems in primary care can be managed effectively with non-pharmacological treatments such as self-management advice, exercise therapy, and psychosocial interventions. Pharmacological interventions such as corticosteroid injections (for knee and shoulder pain) were shown to be effective treatment options for the short-term relief of musculoskeletal pain and may be used in addition to non-pharmacological treatments. NSAIDs and opioids also offer short-term benefit for musculoskeletal pain, but the potential for adverse effects must be considered. Furthermore, the optimal treatment intensity, methods of application, amount of clinical contact, and type of provider or setting, are unclear for most treatment options.
These findings confirm what we have pointed out many times before on this blog. There is very little that alternative therapies have to offer for musculoskeletal pain. Whenever it is possible, I would recommend exercise therapy initiated by a physiotherapist; it is inexpensive, safe, and at least as effective as acupuncture or chiropractic or osteopathy.
Practitioners of alternative medicine will, of course, not like this solution.
Acupuncturists may not be that bothered by such evidence: their focus is not necessarily on musculoskeletal but on a range of other conditions (with usually little evidence, I hasten to add).
But for chiropractors and osteopaths, this is much more serious, in my view. Of course, some of them also claim to be able to treat a plethora of non-musculoskeletal conditions (but there the evidence is even worse than for musculoskeletal pain, and therefore this type of practice is clearly unethical). And those who see themselves as musculoskeletal specialists have to either accept the evidence that shows little benefit and considerable risk of spinal manipulation, or go in a state of denial.
In the former case, the logical conclusion is to look for another job.
In the latter case, the only conclusion is that their practice is not ethical.
This is a fascinating new review of upper neck manipulation. It raises many concerns that we, on this blog, have been struggling with for years. I take the liberty of quoting a few passages which I feel are important and encourage everyone to study the report in full:
The Minister of Health, Seniors and Active Living gave direction to the Health Professions Advisory Council (“the Council”) to undertake a review related to high neck manipulation.
Specifically, the Minister directed the Council to undertake:
1) A review of the status of the reserved act in other Canadian jurisdictions,
2) A literature review related to the benefits to patients and risks to patient safety associated with the procedure, and
3) A jurisprudence review or a review into the legal issues that have arisen in Canada with respect to the performance of the procedure that touch upon the risk of harm to a patient.
In addition, the Minister requested the Council to seek written input on the issue from:
- Manitoba Chiropractic Stroke Survivors
- Manitoba Chiropractic Association
- College of Physiotherapists of Manitoba
- Manitoba Naturopathic Association
- College of Physicians and Surgeons of Manitoba
- other relevant interested parties as determined by the Council
… The review indicated that further research is required to:
- strengthen evidence for the efficacy of cervical spinal manipulations (CSM) as a treatment for neck pain and headache, “as well as for other indications where evidence currently does not exist (i.e., upper back and should/arm pain, high blood pressure, etc.)”
- establish safety and efficacy of CSM in infants and children
- assess the risk versus benefit in consideration of using HVLA cervical spine manipulation, which also involve cost-benefit analyses that compare CSM to other standard treatments.
… the performance of “high neck manipulation” or cervical spine manipulation does present a risk of harm to patients. This risk of harm must be understood by both the patient and the practitioner.
Both the jurisprudence review and the research literature review point to the need for the following actions to mitigate the risk of harm associated with the performance of cervical spine manipulation:
- Action One: Ensure that the patient provides written informed consent prior to initiating treatment which includes a discussion about the risk associated with cervical spine manipulation.
- Action Two: Provide patients with information to assist in the early recognition of a serious adverse event.
Chiropractic is hugely popular, we are often told. The fallacious implication is, of course, that popularity can serve as a surrogate measure for effectiveness. In the United States, chiropractors provided 18.6 million clinical services under Medicare in 2015, and overall spending for chiropractic services was estimated at USD $12.5 billion. Elsewhere, chiropractic seems to be less commonly used, and the global situation has not recently been outlined. The authors of this ‘global overview‘ might fill this gap by summarizing the current literature on the utilization of chiropractic services, reasons for seeking care, patient profiles, and assessment and treatment provided.
Systematic searches were conducted in MEDLINE, CINAHL, and Index to Chiropractic Literature from database inception to January 2016. Eligible articles
1) were published in English or French (not all that global then!);
2) were case series, descriptive, cross-sectional, or cohort studies;
3) described patients receiving chiropractic services;
4) reported on the following theme(s): utilization rates of chiropractic services; reasons for attending chiropractic care; profiles of chiropractic patients; or, types of chiropractic services provided.
The literature searches retrieved 328 studies (reported in 337 articles) that reported on chiropractic utilization (245 studies), reason for attending chiropractic care (85 studies), patient demographics (130 studies), and assessment and treatment provided (34 studies).
Globally, the median 12-month utilization of chiropractic services was 9.1% (interquartile range (IQR): 6.7%-13.1%) and remained stable between 1980 and 2015. Most patients consulting chiropractors were female (57.0%, IQR: 53.2%-60.0%) with a median age of 43.4 years (IQR: 39.6-48.0), and were employed.
The most common reported reasons for people attending chiropractic care were (median) low back pain (49.7%, IQR: 43.0%-60.2%), neck pain (22.5%, IQR: 16.3%-24.5%), and extremity problems (10.0%, IQR: 4.3%-22.0%). The most common treatment provided by chiropractors included (median) spinal manipulation (79.3%, IQR: 55.4%-91.3%), soft-tissue therapy (35.1%, IQR: 16.5%-52.0%), and formal patient education (31.3%, IQR: 22.6%-65.0%).
The authors concluded that this comprehensive overview on the world-wide state of the chiropractic profession documented trends in the literature over the last four decades. The findings support the diverse nature of chiropractic practice, although common trends emerged.
My interpretation of the data presented is somewhat different from that of the authors. For instance, I fail to share the notion that utilization remained stable over time.
The figure might not be totally conclusive, but I seem to detect a peak in 2005, followed by a decline. Also, as the vast majority of studies originate from the US, I find it difficult to conclude anything about global trends in utilization.
Some of the more remarkable findings of this paper include the fact that 3.1% (IQR: 1.6%-6.1%) of the general population sought chiropractic care for visceral/non-musculoskeletal conditions. Some of the reasons for attending chiropractic care reported by the paediatric population are equally noteworthy: 7% for infections, 5% for asthma, and 5% for stomach problems. Globally, 5% of all consultations were for wellness/maintenance. None of these indications is even remotely evidence-based, of course.
Remarkably, 35% of chiropractors used X-ray diagnostics, and only 31% did a full history of their patients. Spinal manipulation was used by 79%, 31% sold nutritional supplements to their patients, and 10% used applied kinesiology.
In general, this is an informative paper. However, it suffers from a distinct lack of critical input. It seems to skip over almost all areas that might be less than favourable for chiropractors. The reason for this becomes clear, I think, when we read the source of funding for the research: PJHB, AEB, SAM and SDF have received research funding from the Canadian national and provincial chiropractic organizations, either as salary support or for research project funding. JJW received research project funding from the Ontario Chiropractic Association, outside the submitted work. SDF is Deputy Editor-in-Chief for Chiropractic and Manual Therapies; however, he did not have any involvement in the editorial process for this manuscript and was blinded from the editorial system for this paper from submission to decision.
Chiropractors are often proud of offering drugless treatments to their patients. Many even have an outright aversion against drugs which goes back to their founding father, DD Palmer, who disapproved of pharmaceuticals. On this background it seems surprising that, today, some chiropractors lobby hard to get prescription rights.
A recent article explains:
A legislative proposal that would allow Wisconsin chiropractors to prescribe narcotics has divided those in the profession and pitted those of them who support the idea against medical doctors. At a hearing on the bill Tuesday, representatives form the Wisconsin Chiropractic Association said back pain is a common reason people go see a medical doctor, but they argue that chiropractors with additional training could be helping those patients instead. Under the bill, chiropractors would be able to write prescriptions for painkillers and administer anesthesia under the direction of a physician.
Expanding the scope of practice, the WCA said, would give patients with pain faster relief when primary care physicians are busy. The Wisconsin Medical Society, though, has come out against the proposal. “This expands to something not seen anywhere else in the country,” said Don Dexter, chief medical officer for WMS.
Meanwhile, another chiropractic group, the Chiropractic Society of Wisconsin, is also skeptical. “We contend there is no public need or demand … to allow chiropractors to prescribe drugs,” said Dean Shepherd, the group’s president.
Opponents also pointed out that the changes could increase access to opioids at a time the state is trying to reduce abuse. “As you know, based on legislation passed in the last two sessions, we’re already dealing with an epidemic of opioid overuse,” Dexter said. “We don’t need new providers prescribing those medications.”
However, some practicing chiropractors like Jason Mackey, with Leutke Storm Mackey Chiropractic in Madison, argue that medical fields evolve: “We have always had change throughout the course of our professsion.” Mackey said there has been pushback with previous changes, like using X-ray or certain therapies and recommending vitamins.
END OF QUOTE
On this blog, we discussed the issue of chiropractic prescribing before. At the time, I argued against such a move and gave the following reasons:
- Patients might be put at risk by chiropractors who are less than competent in prescribing medicines.
- More unnecessary NAISDs would be prescribed.
- The vast majority of the drugs in question is already available OTC.
- Healthcare costs would increase.
- Prescribing rights would give more legitimacy to a profession that arguably does not deserve it.
- Chiropractors would then continue their lobby work and soon demand the prescription rights to be extended to other classes of drugs.
Considering the chiropractors’ arguments for prescribing rights stated in the above article, I see little reason to change my mind.
During Voltaire’s time, this famous quote was largely correct. But today, things are very different, and I often think this ‘bon mot’ ought to be re-phrased into ‘The art of alternative medicine consists in amusing the patient, while medics cure the disease’.
To illustrate this point, I shall schematically outline the story of a patient seeking care from a range of clinicians. The story is invented but nevertheless based on many real experiences of a similar nature.
Tom is in his mid 50s, happily married, mildly over-weight and under plenty of stress. In addition to holding a demanding job, he has recently moved home and, as a consequence of lots of heavy lifting, his whole body aches. He had previous episodes of back trouble and re-starts the exercises a physio once taught him. A few days later, the back-pain has improved and most other pains have subsided as well. Yet a dull and nagging pain around his left shoulder and arm persists.
He is tempted to see his GP, but his wife is fiercely alternative. She was also the one who dissuaded Tom from taking Statins for his high cholesterol and put him on Garlic pills instead. Now she gives Tom a bottle of her Rescue Remedy, but after a week of taking it Tom’s condition is unchanged. His wife therefore persuades him to consult alternative practitioners for his ‘shoulder problem’. Thus he sees a succession of her favourite clinicians.
THE CHIROPRACTOR examines Tom’s spine and diagnoses subluxations to be the root cause of his problem. Tom thus receives a series of spinal manipulations and feels a little improved each time. But he is disappointed that the pain in the left shoulder and arm returns. His wife therefore makes another appointment for him.
THE ENERGY HEALER diagnoses a problem with Tom’s vital energy as the root cause of his persistent pain. Tom thus receives a series of healing sessions and feels a little improved each time. But he is disappointed that the pain in the left shoulder and arm returns. His wife therefore makes another appointment for him.
THE REFLEXOLOGIST examines Tom’s foot and diagnoses knots on the sole of his foot to cause energy blockages which are the root cause of his problem. Tom thus receives a series of most agreeable foot massages and feels a little improved each time. But he is disappointed that the pain in the left shoulder and arm returns. His wife therefore makes another appointment for him.
THE ACUPUNCTURIST examines Tom’s pulse and tongue and diagnoses a chi deficiency to be the root cause of his problem. Tom thus receives a series of acupuncture treatments and feels a little improved each time. But he is disappointed that the pain in the left shoulder and arm returns. His wife therefore makes another appointment for him.
THE NATUROPATH examines Tom and diagnoses some form of auto-intoxication as the root cause of his problem. Tom thus receives a full program of detox and feels a little improved each time. But he is disappointed that the pain in the left shoulder and arm returns. His wife therefore makes another appointment for him.
THE HOMEOPATH takes a long and detailed history and diagnoses a problem with Tom’s vital force to be the root cause of his pain. Tom thus receives a homeopathic remedy tailor-made for his needs and feels a little improved after taking it for a few days. But he is disappointed that the pain in the left shoulder and arm returns. His wife therefore tries to make another appointment for him.
But this time, Tom had enough. His pain has not really improved and he is increasingly feeling unwell.
At the risk of a marital dispute, he consults his GP. The doctor looks up Tom’s history, asks a few questions, conducts a brief physical examination, and arranges for Tom to see a specialist. A cardiologist diagnoses Tom to suffer from coronary heart disease due to a stenosis in one of his coronary arteries. She explains that Tom’s dull pain in the left shoulder and arm is a rather typical symptom of this condition.
Tom has to have a stent put into the affected coronary artery, receives several medications to lower his cholesterol and blood pressure, and is told to take up regular exercise, lose weight and make several other changes to his stressful life-style. Tom’s wife is told in no uncertain terms to stop dissuading her husband from taking his prescribed medicines, and the couple are both sent to see a dietician who offers advice and recommends a course on healthy cooking. Nobody leaves any doubt that not following this complex (holistic!) package of treatments and advice would be a serious risk to Tom’s life.
It has taken a while, but finally Tom is pain-free. More importantly, his prognosis has dramatically improved. The team who now look after him have no doubt that a major heart attack had been imminent, and Tom could easily have died had he continued to listen to the advice of multiple non-medically trained clinicians.
The root cause of his condition was misdiagnosed by all of them. In fact, the root cause was the atherosclerotic degeneration in his arteries. This may not be fully reversible, but even if the atherosclerotic process cannot be halted completely, it can be significantly slowed down such that he can live a full life.
My advice based on this invented and many real stories of a very similar nature is this:
- alternative practitioners are often good at pampering their patients;
- this may contribute to some perceived clinical improvements;
- in turn, this perceived benefit can motivate patients to continue their treatment despite residual symptoms;
- alternative practitioner’s claims about ‘root causes’ and holistic care are usually pure nonsense;
- their pampering may be agreeable, but it can undoubtedly cost lives.
This is the question asked by the American Chiropractic Association. And this is their answer [the numbers in square brackets were inserted by me and refer to my comments below]:
Chiropractic is widely recognized  as one of the safest drug-free, non-invasive therapies available for the treatment of neuromusculoskeletal complaints . Although chiropractic has an excellent safety record , no health treatment is completely free of potential adverse effects. The risks associated with chiropractic, however, are very small . Many patients feel immediate relief following chiropractic treatment , but some may experience mild soreness, stiffness or aching, just as they do after some forms of exercise . Current research shows that minor discomfort or soreness following spinal manipulation typically fades within 24 hours …
Some reports have associated high-velocity upper neck manipulation with a certain rare kind of stroke, or vertebral artery dissection . However, evidence suggests that this type of arterial injury often takes place spontaneously in patients who have pre-existing arterial disease . These dissections have been associated with everyday activities such as turning the head while driving, swimming, or having a shampoo in a hair salon . Patients with this condition may experience neck pain and headache that leads them to seek professional care—often at the office of a doctor of chiropractic or family physician—but that care is not the cause of the injury. The best evidence indicates that the incidence of artery injuries associated with high-velocity upper neck manipulation is extremely rare—about one to three cases in 100,000 patients who get treated with a course of care . This is similar to the incidence of this type of stroke among the general population …
When discussing the risks of any health care procedure, it is important to look at that risk in comparison to other treatments available for the same condition . In this regard, the risks of serious complications from spinal manipulation for conditions such as neck pain and headache compare very favorably with even the most conservative care options. For example, the risks associated with some of the most common treatments for musculoskeletal pain—over-the-counter or prescription nonsteroidal anti-inflammatory drugs (NSAIDS) and prescription painkillers—are significantly greater than those of chiropractic manipulation …
Doctors of chiropractic are well trained professionals who provide patients with safe, effective care for a variety of common conditions. Their extensive education has prepared them to identify patients who have special risk factors  and to get those patients the most appropriate care, even if that requires referral to a medical specialist .
END OF QUOTE
- Appeal to tradition = fallacy
- …and every other condition that brings in cash.
- Not true.
- Probably not true.
- The plural of anecdote is anecdotes, not evidence.
- Not true, the adverse effects of spinal manipulation are different and more severe.
- Not true, they last 1-3 days.
- Not just ‘some reports’ but a few hundred.
- Which does not mean that spinal manipulation cannot provoke such events.
- True, but this does not mean that spinal manipulation cannot provoke such events.
- There are other estimates that gives much higher figures; without a proper monitoring system, nobody can provide an accurate incidence figure.
- Not true, see above.
- ‘Available’ is meaningless – ‘effective’ is what we need here.
- The difference between different treatments is not merely their safety but also their effectiveness; in the end it is the risk/benefit balance that determines their value.
- Not true, there are no good predictors to identify at-risk populations.
- Chiropractors are notoriously bad at referring to other healthcare professionals; they have a huge conflict of interest in keeping up their cash-flow.
So, is chiropractic a safe treatment?
My advice here is not to ask chiropractors but independent experts.
The new guidelines by the American College of Physicians entitled ‘Noninvasive Treatments for Acute, Subacute, and Chronic Low Back Pain: A Clinical Practice Guideline From the American College of Physicians’ have already been the subject of the previous post. Today, I want to have a closer look at a small section of these guidelines which, I think, is crucial. It is entitled ‘HARMS OF NONPHARMACOLOGIC THERAPIES’. I have taken the liberty of copying it below:
“Evidence on adverse events from the included RCTs and systematic reviews was limited, and the quality of evidence for all available harms data is low. Harms were poorly reported (if they were reported at all) for most of the interventions.
Low-quality evidence showed no reported harms or serious adverse events associated with tai chi, psychological interventions, multidisciplinary rehabilitation, ultrasound, acupuncture, lumbar support, or traction (9,95,150,170–174). Low-quality evidence showed that when harms were reported for exercise, they were often related to muscle soreness and increased pain, and no serious harms were reported. All reported harms associated with yoga were mild to moderate (119). Low-quality evidence showed that none of the RCTs reported any serious adverse events with massage, although 2 RCTs reported soreness during or after massage therapy (175,176). Adverse events associated with spinal manipulation included muscle soreness or transient increases in pain (134). There were few adverse events reported and no clear differences between MCE and controls. Transcutaneous electrical nerve stimulation was associated with an increased risk for skin site reaction but not serious adverse events (177). Two RCTs (178,179) showed an increased risk for skin flushing with heat compared with no heat or placebo, and no serious adverse events were reported. There were no data on cold therapy. Evidence was insufficient to determine harms of electrical muscle stimulation, LLLT, percutaneous electrical nerve stimulation, interferential therapy, short-wave diathermy, and taping.”
The first thing that strikes me is the brevity of the section. Surely, guidelines of this nature must include a full discussion of the risks of the treatments in question!
The second thing that is noteworthy is the fact that the authors confirm the fact I have been banging on about for years: clinical trials of alternative therapies far too often fail to mention adverse effects. I have often pointed out that the failure to report adverse effects in clinical trials is an unacceptable violation of medical ethics. By contrast, the guideline authors seem not to feel strongly about this omission.
The third thing that is noteworthy is that the guidelines evaluate the harms of the treatments purely on the basis of the adverse effects reported in the clinical trials and systematic reviews included in their efficacy assessments. This is nonsensical for at least two reasons:
- The guideline authors themselves are aware that the trials very often fail to mention adverse effects.
- For any assessment of harm, one has to go far beyond the evidence of clinical trials, because trials tend to be too small to pick up rare adverse effects, and because they are always conducted under optimally controlled conditions where adverse effects are less likely to occur than in real life.
Together, these features of the assessment of harms explain why the guideline authors arrive at conclusions which are oddly misguided; I would even feel that they resemble a white-wash. Here are two of the most overt misjudgements:
- no harms associated with acupuncture,
- only trivial harm associated with spinal manipulations.
The best evidence we have today shows that acupuncture leads to mild adverse effects in about 10% of all cases and is also associated with very severe complications (e.g. pneumothorax, cardiac tamponade, infections, deaths) in an unknown number of patients. More details can be found for instance here, here, here and here.
And the best evidence available shows that spinal manipulation leads to moderately severe adverse effects in ~50% of all cases. In addition, we know of hundreds of cases of very severe complications resulting in stroke, permanent neurological deficits or deaths. More details can be found for instance here, here, here and here.
In the introduction, I stated that this small section of the guidelines is crucial.
The reason is simple: any responsible therapeutic decision has to be based not just on the efficacy of the treatment in question but on its risk/benefit balance. The evidence shows that the risks of some alternative therapies can be considerable, a fact that is almost totally neglected in the guidelines. Therefore, the recommendations of the new guidelines by the American College of Physicians entitled ‘Noninvasive Treatments for Acute, Subacute, and Chronic Low Back Pain: A Clinical Practice Guideline From the American College of Physicians’ are in several aspects not entirely correct and need to be reconsidered.
Concerned about the new ACP guidelines on ‘Noninvasive Treatments for Acute, Subacute, and Chronic Low Back Pain: A Clinical Practice Guideline From the American College of Physicians’, Andrea MacGregor asked me to publish her ‘open letter’:
I am a student about to graduate and register as a massage therapist in Canada, and I am writing to express my concern with your recommendation of the use of acupuncture in your new guideline for low-back pain management.
Leading medical and health research experts from around the world, including many who are highly familiar with the use of complementary and alternative therapies, have contributed to a highly informed commentary (attached) assembled by the Friends of Science in Medicine association (Aus.), which supports a strong conclusion that acupuncture is not effective for any specific condition, and that the evidence for it being an effective intervention for low-back pain is not convincing. Another review of acupuncture by FSM concluding that there is a lack of evidence of a therapeutic effect has been endorsed by the Royal Australian and New Zealand College of Obstetricians and Gynaecologists. Respected American medical science writers also maintain that claims of acupuncture’s efficacy are not science-based (examples here and here).
Additionally, previous acupuncture recommendations are being reconsidered by prominent institutions in other parts of the world. The National Institute for Health and Care Excellence guideline for NHS patients in the United Kingdom now recommends against the use of acupuncture for low-back pain, following a high-quality review that critically examined the existing evidence regarding the use of acupuncture and found it to be no more effective than a placebo. The Toronto Hospital for Sick Children has also recently removed references on their website that suggested the efficacy of acupuncture in managing specific chronic pain conditions. The World Health Organization has done the same, no longer suggesting that acupuncture is effective for low-back pain and sciatica.
As someone about to enter a field that is frequently associated with, or considered a part of, complementary healthcare, I know how tempting it can be for us, as professionals and as researchers, to exaggerate claims of efficacy and pin some very high hopes on “new possibilities” in physical therapies.
I also know first-hand how misguided and overblown some of these claims and hopes can be. Many of my own peers and instructors are proponents of acupuncture, and it is common for Canadian massage therapists to become licensed acupuncturists (a similar connection between massage and acupuncture communities, of course, also exists in the United States). I have often seen my own mentors and comrades pushing for the use of acupuncture treatments for many chronic and serious conditions for which there is no basis of evidence at all of acupuncture’s efficacy, including systemic, neurological, and developmental conditions. When questioned, they will usually refer to authorities perceived as “legitimate”, including the American College of Physicians, to say that claims of acupuncture “working” are backed by experts— whether their claims are even pain-related or not.
We see a similar situation with advertisers and media using the guise of “expert-backed” legitimization to recommend acupuncture in misleading ways, often to vulnerable people who could be making better-informed and more effective treatment and management choices for their conditions. Many of these advertising and media entities specifically mention the American College of Physicians as lending credence to their claims, sometimes somewhat out of context.
As someone with a chronic neurological disorder, I find it troubling to see untrue or exaggerated claims of benefit for incurable or serious conditions when we could be focusing on more accurate ideas and having more honest, realistic discussions of our options. This is also important when it comes to deciding how to best allocate our limited health funding resources. Quite a lot of our insurance and out-of-pocket funds are spent on alternative therapies, and it’s important to see things going to use in a way that’s proportionate and appropriate to the evidence we have.
I hope that you will reconsider your recommendation of a practice that is simply not supported by the majority of the research evidence that exists to date. Patients with complex conditions, including low-back pain, deserve accurate and realistic information regarding their treatment options, especially from such trusted and reputable sources as the American College of Physicians. Thank you for your time and attention.
Below are informed conclusions on acupuncture from 28 international experts from 10 countries, including Australia, Canada, Denmark, France, Greece, Italy, Netherlands, New Zealand, United Kingdom and United States of America.
– Sir Richard John Roberts, English biochemist and molecular biologist, 1993 Nobel Prize in Physiology or Medicine – Prof Nikolai Bogduk AM, Emeritus Professor of Pain Medicine, University of Newcastle, Australia – Prof Timothy Caulfield, LLM, FRSC, FCAHS, Canada Research Chair in Health Law & Policy, Trudeau Fellow & Professor, Faculty of Law and School of Public Health, Research Director, Health Law Institute, University of Alberta, Canada – Prof. Assimakis Kanellopoulos, PhD MSc.Prof. Applied Physiotherapy, TEI Lamia, Greece – Prof Lesley Campbell AM, MBBS, FRACP FRCP(UK), Senior Endocrinologist, Diabetes Services, St Vincent’s Hospital, Professor of Medicine, UNSW. Laboratory Co-Head, Clinical Diabetes, Appetite and Metabolism, Garvan Institute of Medical Research, SVH, NSW, Australia – Emeritus Prof Donald M. Marcus, MD, Professor of Medicine and Immunology, Emeritus, Baylor College of Medicine, Houston, United States of America (USA) – Dr Michael Vagg, MBBS(Hons) FAFRM(RACP) FFPMANZCA, Consultant in Rehabilitation and Pain Medicine, Barwon Health. Clinical Senior Lecturer, Deakin University School of Medicine. Fellow, Institute for Science in Medicine, Victoria, Australia – Prof Bernie Garrett, The University of British Columbia, School of Nursing, Vancouver, BC, Canada – A/Prof David H Gorski, MD PhD FACS, surgical oncologist, Barbara Ann Karmanos Cancer Institute, Team Leader, Breast Cancer Multidisciplinary Team, Co-Leader, Breast Cancer Biology Program, Co-Director, Alexander J Walt Comprehensive Breast Center, Chief, Section of Breast Surgery, A/Professor, Surgery, Wayne State University School of Medicine, , and Professor (Honorary) Hanoi Medical University, USA – Prof Carl Bartecchi, MD, MACP, Distinguished Professor of Clinical Medicine, University of Colorado School of Medicine, USA – Prof David Colquhoun, FRS, Dept of Pharmacology, UCL United Kingdom (UK) – Prof Edzard Ernst, MD PhD FMEdSci FSB FRCP FRCP(Edin), Complementary Medicine, Peninsula Medical School, UK – Prof Marcello Costa FAAS. Matthew Flinders Distinguished Professor and Professor of Neurophysiology (2012), Professor of Neurophysiology, Flinders University, Australia. – Emeritus Prof Alastair H MacLennan AO MB CHb MD FRCOG FRANZCOG. The Robinson Research Institute, The University of Adelaide, Australia – Prof John M Dwyer AO PhD FRACP FRCPI Doc Uni(Hon) ACU. Emeritus Professor of Medicine, University of New South Wales. Founder of the Australian Health Care Reform Alliance. Clinical consultant to the NSW Government’s Inter-Agency committee on Health Care Fraud, Australia – A/Prof Steven M Novella, clinical neurologist Yale University School of Medicine, Connecticut, USA – Prof William M London, EdD, MPH, Department of Public Health, California State University, Los Angeles, USA – Dr Steven Barrett, MD, retired psychiatrist, author, co-founder of the National Council Against Health Fraud (NCAHF), USA – Prof. Steven L. Salzberg, Ph.D., Bloomberg Distinguished Professor of Biomedical Engineering, Computer Science, and Biostatistics, Johns Hopkins University School of Medicine, USA – Prof Christopher C French, Head of the Anomalistic Psychology Research Unit, Department of Psychology, Goldsmiths, University of London, UK – Dr Cees Renckens MD PhD, gynaecologist, past president of the Dutch Society against Quackery, Netherlands – Dr Alain Braillon. MD PhD. Senior consultant. University hospital, France – Dr John McLennan, MBBS FRACP, Paediatrician, Vic – Prof Shaun Holt, BPharm(hons), MBChB(hons), Medical Researcher, Victoria University of Wellington, New Zealand – Dr Lloyd B Oppel, MD, MHSc, Canada – Professor Asbjørn Hróbjartsson, Centre for Evidence-Based Medicine, University of Southern Denmark & Odense University Hospital, Denmark – Prof Maurizio Pandolfi MD, Florence, former Professor of Clinical Ophthalmology, The University of Lund, Sweden, Italy – Professor Mark Baker, Centre for Clinical Practice Director, National Institute for Health and Care Excellence (NICE), UK
According to Sir Richard: “From everything I have read about acupuncture I have to conclude that the evidence for efficacy is just not there. I can believe it has a very strong and effective placebo effect, but if it really worked as advertised why are the numbers of successful outcomes so small when compared to treatments such as drugs that really do work. As a scientist, who likes to see proper experiments carried out so that the results can be judged with a rational analysis, the experiments I have read about just don’t meet even a low bar of acceptability. I certainly do not believe it should be endorsed as an effective treatment by any professional scientific or medical body that values its reputation.”
According to Professor Bogduk: “Although studies have shown that acupuncture “works”, the definition of “works” is generous. Most studies show minimal to no effect greater than that of sham therapy. Needles do not need to be placed at specific points; so, learning about meridians is not required. Effectiveness is marginally greater in those patients who believe in acupuncture or expect it to work. However, no studies have shown that acupuncture stops pain, while also restoring normal function and removing the need for other health care.”
According to Professor Caulfield: “In popular culture, acupuncture is often portrayed as being effective for a range of conditions. It is held up as an alternative medicine success story. In fact, the relevant data are, at best, equivocal. The most rigorous studies, such as those that are well controlled and use sham comparators, have found that in most situations acupuncture is little better than placebo. More importantly, the supernatural foundations of the practice – that illness can be attributed to an imbalance in a life force energy – has absolutely no scientific basis. Given this reality, public representations of acupuncture that present it as science-based and effective can be deeply misleading. Policies are needed to counter this noise, including, inter alia, the more aggressive deployment of truth-in-advertising regulations, the enforcement of a conceptually consistent science-based informed consent standard, and the oversight of healthcare professionals by the relevant regulatory entities.”
According to Professor Kanellopoulos: “According to the systematic reviews in the field of acupuncture, the benefits of the method, if any, are nothing more than a temporary placebo effect. From a scientific point of view, acupuncture is based on a theory, which has nothing to do with modern physiology and medicine. From a researcher’s point of view, any presented acupuncture effectiveness is due to methodological errors, data manipulation, statistical artefacts and (purposely?) poorly designed clinical trials in general. Finally, regarding the patient, any symptom’s relief comes from despair and post hoc fallacy. After decades of research and over 3000 clinical trials, any continuation of practicing, advertising, and research in the field of acupuncture is a waste of resources and puts the patients at risk, raising ethical issues for both science and society.”
According to Professor Campbell: “Acupuncture holds great theatrical appeal through its dramatic and historical aspects, particularly to those who feel that conventional medicine has failed to offer pain relief or sufficient improvement in symptoms. However an extensive body of data now exists from rigorous approaches to testing the validity of its claims of benefit actually related to the placement of the needles and not to placebo effect. For example, most recently the beneficial effect achieved in relieving fatigue in Parkinsons Disease (and there was one) was identical in a randomised controlled trial to that of placebo.”
According to Professor Donald M. Marcus: “When trials of acupuncture for relief of pain of osteoarthritis of the knee or back pain include a sham acupuncture control, there is no clinically relevant difference in efficacy between the conventional and sham procedures. A number of sham procedures have been used, including toothpicks in a plastic guide tube in a study of back pain. It’s evident that relief of pain, and probably other complaints, by acupuncture is mediated by a placebo mechanism. Since there is no scientific evidence supporting its efficacy, medical insurance should not pay for acupuncture treatments. Moreover, it is unethical to deceive patients by providing a placebo treatment without disclosure.”
According to pain specialist Dr Vagg: “Due to the lack of a scientifically plausible mechanism, and the poor quality of the bulk of the research concerning acupuncture in its many and varied forms, no credible body of pain medicine researchers or clinicians has endorsed any type of acupuncture as a recommended treatment for any identifiable group of patients with persistent pain. Moreover, there is no reason to suppose that further research of high quality will change this conclusion, given that high-quality, randomized and double-blinded studies have uniformly shown that any form of acupuncture is indistinguishable from placebo, making further research unwarranted.”
According to Professor Garrett: “Current levels of evidence on acupuncture as a therapeutic intervention for any condition is very poor. Most studies reported are of very poor quality and are not reliable. Unfortunately, there is a strong element of propaganda in the dissemination of support for acupuncture in China, as it is a part of the Traditional Chinese Medicine supported by the government there. As such, much research has been demonstrated to involve data fabrication and extreme levels of confirmation bias. There are also strong ethical concerns about research involving acupuncture in China for anesthesia or other conditions where there is no established clinical theoretical basis for its use, and far better established therapeutics are available. Overall the current state of evidence on acupuncture is that the effectiveness of acupuncture as a treatment of any health condition remains unproven, and the only good quality trials have identified it has no better outcomes than placebo. Therefore, any claims of efficacy made against specific medical conditions are deceptive.”
According to Professor Gorski: “Acupuncture seems to garner more belief because it seems more plausible. The reason is that, unlike many other alternative therapies, acupuncture actually involves a physical act, namely inserting needles into the skin. However, it is also the case that the more acupuncture has been studied, the more it has become clear that it is, as David Colquhoun and Steve Novella put it, nothing more than a theatrical placebo. Indeed, as acupuncture is more rigorously studied in randomized clinical trials with proper controls and proper blinding, the more its seeming effects disappear, so that it becomes indistinguishable from placebo. Nor is it without risk, either. Recommending acupuncture to treat any condition is, from an ethical and scientific view, indefensible.”
According to Professor Bartecchi: “Acupuncture has no medical value other than that of a placebo. Acupuncture as viewed by many of us in academic medicine is merely an elaborate, theatrical placebo, a pre-scientific superstition which lacks a plausible mechanism. It really fits the bill as an alternative medicine hoax.”
According to Professor Colquhoun: “After over 3000 trials, some of them very well designed, there is still argument about the effectiveness of acupuncture. If that were the case for a new drug, it would long since have been abandoned. The literature suggests that acupuncture has only a small and variable placebo effect: too small to be of noticeable benefit to patients. Most of its apparent effects result from a statistical artefact, regression to the mean. The continued use of acupuncture probably arises from the lack of effective treatments for conditions like non-specific low back pain. That cannot be justified, Neither is it worth spending yet more money on further research. The research has been done and it failed to produce convincing evidence.”
According to Professor Ernst: “The current evidence on acupuncture is mixed. Many trials are less than rigorous and thus not reliable. Much of the research comes from China where data fabrication has been disclosed to be at epidemic levels; it would therefore be a mistake to rely on studies from China which almost invariably report positive results. If we account for such caveats and critically review the literature, we arrive at the following conclusions: – Acupuncture is clearly not free of risks, some of which are serious; – The effectiveness of acupuncture as a treatment of any condition remains unproven, and – The current research in this area is mostly pseudo-research aimed at promoting rather than testing acupuncture”.
According to Professor Costa: “Acupuncture as a part of Traditional Chinese Medicine is not based on science simply because, as for all pre-scientific medicines, whether Greco-Roman-European, Indian or any other, none are founded on any evidence. As a Neuroscientist, I teach medical and non medical students the very foundations of how the nervous system works and how sensory stimulation affects the brain. There simply is no evidence that twigging the skin with needles or, for that matter with toothpicks, does any more than create an expectation to feel better. This is the well-known placebo effect. Selling placebos under the disguise of medicine is totally unethical.”
According to Professor MacLennan: “Acupuncture is elaborate quackery and like many placebos sold by those without responsibility for or knowledge of the wide range of health disorders and disease it can be dangerous. Dangerous because acupuncture may delay correct diagnosis and therapy, dangerous because it may delay possible evidence-based therapies and allow progression of disorders present and dangerous because it sucks limited health resources from the community. Acupuncturists derive their income from elaborate subterfuge, taking advantage of the gullible unwell who are desperate, uneducated and seek a magic cure. If there is a placebo effect it is usually temporary, and eventually disappointment from lack of long term effect may lead to secondary depression in the patient. According to Professor Dwyer: “Modern understanding of human anatomy and the distribution and function of the components of the human nervous system make a nonsense of theories that suggest there are invisible meridians criss-crossing the body wherein there are trigger spots which, when stimulated, can produce an array of benefits remote from that site. Scientists however, while dismissing the prescientific explanations offered by traditional Chinese medicine, have sought other reasons why acupuncture might provide clinical benefits particularly the relief of pain. Numerous theories have been addressed by numerous studies with many being conducted using disciplined scientific methods. The conclusions leave us with no doubt that acupuncture provides the scenario for a superb theatrical placebo; no more.”
According to Dr Novella: “Pain is a big problem. If you read about pain management centers, you might think it had been solved. It has not. And when no effective treatment exists for a medical problem, it leads to a tendency to clutch at straws. Research has shown that acupuncture is little more than such a straw. It is clear from meta-analyses that results of acupuncture trials are variable and inconsistent, even for single conditions. After thousands of trials of acupuncture and hundreds of systematic reviews, arguments continue unabated. In 2011, Pain published an editorial that summed up the present situation well.”
According to Professor London & Dr Barrett: “The optimistic article by Vickers et al did not consider an important point. Research studies may not reflect what takes place in most acupuncturist offices. Most acupuncturists are graduates of “oriental medical schools,” where they learn about 5element theory, “energy” flow through meridians, and other fanciful traditional Chinese medicine (TCM) concepts that do not correspond with scientific knowledge of anatomy, physiology, or pathology. Practitioners of TCM typically rely on inappropriate diagnostic procedures (pulse and tongue diagnosis) and prescribe herbal mixtures that have not been sufficiently studied. Diagnoses based on TCM such as “Qi stagnation,” “blood stagnation,” “kidney Qi deficiency,” and “yin deficiency” may not jeopardize patients who are treated in an academic setting, where they have received a medical diagnosed before entering the study. But what about people with conditions that TCM-trained acupuncturists are not qualified or inclined to diagnose? Real-world evaluations of acupuncture should also consider the cost of unnecessary treatment.”
According to Professor Salzberg: “Acupuncture is a pre-scientific practice that persists only because of relentless and often very clever marketing by its proponents. The claimed mechanisms by which acupuncture works are clearly and obviously false: modern physiology, neurology, cell biology, and other scientific disciplines explain how pain signals are transmitted in the body, and none of them support the supposed “qi” or energy fields flowing along “meridians,” as acupuncturists describe them. Hundreds of scientific studies have shown that acupuncture doesn’t work for any medical condition. Acupuncture proponents ignore the evidence and persist, primarily because they profit from their practices. There are also documented risks of complications from acupuncture, ranging from infections to punctured lungs. For these and other reasons, recommending acupuncture for any patient is simply unethical. Acupuncturists make profits by putting patients at risk.”
According to Professor French: “Acupuncture has been extensively evaluated with respect to its possible therapeutic effectiveness for a wide range of disorders. The overall conclusion from meta-analyses of such studies is that any beneficial effects reported are small in terms of effect size and probably best accounted for in terms of statistical artefacts and placebo effects, etc. In general, the higher the quality of the study, the less likely are any beneficial effects to be reported. In light of this, it would be unwise and unethical to recommend acupuncture as the treatment of choice for any condition.”
According to Dr Renckens: “In 1683 the Dutch physician Willem ten Rhijne published the first book in the western world in which the word ‘acupuncture’ was mentioned, which referred to – as the Dutch title of the book was – ‘The Chinese and Japanese way of curing all diseases and especially the podagra by burning moxa and stabbing the Golden Needle’. This exotic treatment did not gain any popularity in the Netherlands and was mainly ridiculed. This heavenly situation remained unchanged until Nixon’s trip to China (1972) and the ‘successful’ acupuncture-treatment of the journalist James Reston of the New York Times. His story in that influential newspaper caused worldwide interest in acupunctures possible benefits. Also in the Netherlands and as early as 1989 a series of systematic reviews on the efficacy of acupuncture in a number of diseases was published in the Huisarts & Wetenschap, a journal of GP’s in the Dutch language (Ter Riet et al. H&W,1989;32:308-312).Their final conclusion was: ‘the main achievement of Chinese acupuncture is to have discovered a number of spots on the human body into which needles can be safely inserted’. The huge amount of scientific research into acupuncture has since been unable to undermine this right conclusion.”
According to Dr Braillon: “No discrimination! The US Federal Trade Commission announced that homeopathic drugs should “be held to the same truthin-advertising standards as other products claiming health benefits”; very soon, homeopathic products will include statements indicating: “There is no scientific evidence backing homeopathic health claims” and “Homeopathic claims are based only on theories from the 1700s that are not accepted by modern medical experts.” In Australia, the Royal Australian College of General Practitioners formally recommended GPs to ban homeopathic products from their prescriptions and pharmacists to ban them from their shelves. The same should be required for acupuncture.”
According to Dr McLennon: “Despite claims for effectiveness, there have been very few studies of acupuncture on children that have confirmed significant benefits. Conditions such as headache, abdominal pain, bed wetting and fibromyalgia and behaviour problems such as ADHD have been investigated. More trials with better structure have universally been recommended. A double blinded trial on the treatment of headaches with laser acupuncture illustrates the problems. The number of patients was quite small (21 in each arm), the diagnoses were reasonable medically but required rediagnosis to fit Traditional Chinese Medicine criteria and treatments were individualised based on these diagnoses. It was not made clear whether the patients were completely blinded i.e. unaware they received active treatment or placebo. Until blinding can be guaranteed, trials of acupuncture will remain inconclusive.”
According to Professor Holt: “Unlike some alternative therapies, acupuncture has been extensively studied for many medical conditions and a summary would be that the higher the quality of the study, the less likely it is that a benefit other than a placebo effect is found. Studies have shown conclusively that a key aspect of acupuncture, putting needles into energy lines for medical benefits, is not true, and the same effect is elicited wherever the needles are placed. Acupuncture is not a science-based practice, can cause side effects and is not recommended for any medical condition.”
According to Dr Oppel: “It is extremely concerning that there remains no plausible rationale for a mechanism of action of acupuncture. It is noteworthy that different schools of acupuncture offer contradictory patterns of treatment. It should not go without notice that acupuncture has been so well-researched that there are hundreds , if not thousands, of clinical trials now available Unfortunately, although there is no compelling evidence of effectiveness for any of the myriad of conditions where acupuncture is claimed to be of benefit, poor quality unreplicated trials continue to be put forward by proponents as proof of acupuncture’s effectiveness. Critical thinkers will also take note that while the large majority of acupuncture trials are positive, the vast majority of properly controlled trials are not. We are in a situation now where we have excellent evidence that acupuncture is not effective.”
According to Professor Hróbjartsson: “While there have been many trials done with acupuncture, most of them are small pilot studies and large scale high quality trials are rare. Some studies have reported measurable effects, but the mechanism is not yet understood, the size of the effect is small and it is possible that a large part of the effect or all of the effect is placebo. It is obvious that you would see a physiological effect when you stick a needle into your body, the question is whether that has a measurable clinical effect. There is insufficient evidence to say that electro acupuncture is any more or any less effective.”
According to Professor Pandolfi: “With a rationale completely disconnected from the basic principles of science acupuncture cannot be considered as belonging to modern evidence–based medicine.”
According to Professor Baker: “Millions of people are affected every year by these often debilitating and distressing conditions. For most their symptoms improve in days or weeks. However for some, the pain can be distressing and persist for a long time. Regrettably there is a lack of convincing evidence of effectiveness for some widely used treatments. For example acupuncture is no longer recommended for managing low back pain with or without sciatica. This is because there is not enough evidence to show that it is more effective than sham treatment.”
The question whether spinal manipulative therapy (SMT) is effective for acute low back pain is still discussed controversially. Chiropractors (they use SMT more regularly than other professionals) try everything to make us believe it does work, while the evidence is far less certain. Therefore, it is worth considering the best and most up-to-date data.
The aim of this paper was to systematically review studies of the effectiveness and harms of SMT for acute (≤6 weeks) low back pain. The research question was straight forward: Is the use of SMT in the management of acute (≤6 weeks) low back pain associated with improvements in pain or function?
A through literature search was conducted to locate all relevant papers. Study quality was assessed using the Cochrane Back and Neck (CBN) Risk of Bias tool. The evidence was assessed using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) criteria. The main outcome measures were pain (measured by either the 100-mm visual analog scale, 11-point numeric rating scale, or other numeric pain scale), function (measured by the 24-point Roland Morris Disability Questionnaire or Oswestry Disability Index [range, 0-100]), or any harms measured within 6 weeks.
Of 26 eligible RCTs identified, 15 RCTs (1711 patients) provided moderate-quality evidence that SMT has a statistically significant association with improvements in pain (pooled mean improvement in the 100-mm visual analog pain scale, −9.95 [95% CI, −15.6 to −4.3]). Twelve RCTs (1381 patients) produced moderate-quality evidence that SMT has a statistically significant association with improvements in function (pooled mean effect size, −0.39 [95% CI, −0.71 to −0.07]). Heterogeneity was not explained by type of clinician performing SMT, type of manipulation, study quality, or whether SMT was given alone or as part of a package of therapies. No RCT reported any serious adverse event. Minor transient adverse events such as increased pain, muscle stiffness, and headache were reported 50% to 67% of the time in large case series of patients treated with SMT.
The authors concluded that among patients with acute low back pain, spinal manipulative therapy was associated with modest improvements in pain and function at up to 6 weeks, with transient minor musculoskeletal harms. However, heterogeneity in study results was large.
This meta-analysis has been celebrated by chiropractors around the world as a triumph for their hallmark therapy, SMT. But there have also been more cautionary voices – not least from the lead author of the paper. Patients undergoing spinal manipulation experienced a decline of 1 point in their pain rating, says Dr. Paul Shekelle, an internist with the West Los Angeles Veterans Affairs Medical Center and the Rand Corporation who headed the study. That’s about the same amount of pain relief as from NSAIDs, over-the-counter nonsteroidal anti-inflammatory medication, such as ibuprofen. The study also found spinal manipulation modestly improved function. On average, patients reported greater ease and comfort engaging in two day-to-day activities — such as finding they could walk more quickly, were having less difficulty turning over in bed or were sleeping more soundly.
It’s not clear exactly how spinal manipulation relieves back pain. But it may reposition the small joints in the spine in a way that causes less pain, according to Dr. Richard Deyo, an internist and professor of evidence-based medicine at the Oregon Health and Science University. Deyo wrote an editorial published along with the study. Another possibility, Deyo says, is that spinal manipulation may restore some material in the disk between the vertebrae, or it may simply relax muscles, which could be important. There may also be mind-body interaction that comes from the “laying of hands” or a trusting relationship between patients and their health care provider, he says.
Deyo notes that there are many possible treatments for lower back pain, including oral medicine, injected medicine, corsets, traction, surgery, acupuncture and massage therapy. But of about 200 treatment options, “no single treatment is clearly superior,” he says.
In another comment by Paul Ingraham the critical tone was much clearer: “Claiming it as a victory is one of the best examples I’ve ever seen of making lemonade out of science lemons! But I can understand the mistake, because the review itself does seem positive at first glance: the benefits of SMT are disingenuously summarized as “statistically significant” in the abstract, with no mention of clinical significance (effect size; see Statistical Significance Abuse). So the abstract sounds like good news to anyone but the most wary readers, while deep in the main text the same results are eventually conceded to be “clinically modest.” But even even that seems excessively generous: personally, I need at least a 2-point improvement in pain on a scale of 10 to consider it a “modest” improvement! This is not a clearly positive review: it shows weak evidence of minor efficacy, based on “significant unexplained heterogeneity” in the results. That is, the results were all over the place — but without any impressive benefits reported by any study — and the mixture can’t be explained by any obvious, measurable factor. This probably means there’s just a lot of noise in the data, too many things that are at least as influential as the treatment itself. Or — more optimistically — it could mean that SMT is “just” disappointingly mediocre on average, but might have more potent benefits in a minority of cases (that no one seems to be able to reliably identify). Far from being good news, this review continues a strong trend (eg Rubinstein 2012) of damning SMT with faint praise, and also adds evidence of backfiring to mix. Although fortunately “no RCT reported any serious adverse event,” it seems that minor harms were legion: “increased pain, muscle stiffness, and headache were reported 50% to 67% of the time in large case series of patients treated with SMT.” That’s a lot of undesirable outcomes. So the average patient has a roughly fifty-fifty chance of up to roughly maybe a 20% improvement… or feeling worse to some unknown degree! That does not sound like a good deal to me. It certainly doesn’t sound like good medicine.”
END OF QUOTE
As I have made clear in many previous posts, I do fully agree with these latter statements and would add just three points:
- We know that many of the SMT studies completely neglect reporting adverse effects. Therefore it is hardly surprising that no serious complications were on record. Yet, we know that they do occur with sad regularity.
- None of the studies controlled for placebo effects. It is therefore possible – I would say even likely – that a large chunk of the observed benefit is not due to SMT per se but to a placebo response.
- It seems more than questionable whether the benefits of SMT outweigh its risks.
CBC news (Canada) reported yesterday that, more than a decade ago, the Manitoba Chiropractic Health Care Commission had been tasked to review the cost effectiveness of chiropractic services. It therefore prepared a report in 2004 for the Manitoba province and the Manitoba Chiropractors Association. Since then, this report has been kept secret. The report makes 37 recommendations, including:
- Manitoba Health should limit its funding to “chiropractic treatment of acute lower back pain.”
- Manitoba Health should provide “limited coverage of the treatment of neck pain.” The report called the literature around the efficacy of chiropractic care for neck pain “ambiguous or at best weakly supportive” and noted such treatment carried a “not insignificant safety risk.”
- Manitoba Health should not fund chiropractic treatment anyone under 18 “as the literature does not unequivocally justify” the “efficacy or safety” of such treatment.
A Manitoba Ombudsman’s Office report from 2012 might shed some light on why the Manitoba Chiropractic Health Care Commission’s report was never made public. Someone had attempted to get a copy of the report, but large parts of it were redacted. “Access to this record was refused on the basis that disclosure would be harmful to a third party’s business interest,” the ombudsman report notes, “and harm the economic or financial interests or negotiating position of a public body.”
The report also challenged claims that chiropractic treatments can be address a wide variety of medical conditions. It stated that there was not enough evidence to conclude chiropractic treatments are effective in treating muscle tension, migraines, HIV, carpal tunnel syndrome, gastrointestinal problems, infertility or cancer, or as a preventive care treatment. It also said there was not enough evidence to conclude chiropractic treatments are effective for children.
The report urged Manitoba Health to establish a monitoring system to keep a closer eye on “the advertising practices of the Manitoba Chiropractors Association and its members to ensure claims regarding treatments are restricted to those for which proof of efficacy and safety exist.” It suggested the government should have regulatory powers over chiropractic ads.
A recent CBC I-Team investigation found Manitoba chiropractors advertising treatment for a wide range of conditions including Alzheimer’s, autism and pediatric services. The commission report contained sharp criticisms of previous reports that suggested funding chiropractic care could save the health-care system money. Dr. Pranlal Manga authored two widely cited reports which claim that by offering publicly funded chiropractic care, provinces can cut health-care costs. “The Manga study on Manitoba must be rejected as a guide to public policy,” the commission report states, “because its assumptions, methodology and costing of recommendations are all deeply flawed.” The reports states, “What limited evidence the Commission has suggests he [Manga] grossly exaggerates possible medical savings.” Dr. Manga did not respond to CBC’s repeated attempts to contact him.
The commission report also made recommendations around the use of X-ray machines by chiropractors. It suggested chiropractors not own and operate X-ray machines “Given the restrictive conditions under which X-rays are advisable, their poor correlation with low-back problems, their apparent limitation as a guide to appropriate treatment …[and] the apparent complete lack of monitoring [of] the use of X-ray by chiropractors.” Instead, it recommended consulting with radiologists when imaging is deemed necessary. “The Commission is of the view that the public interest, and even chiropractic itself, would be better served if chiropractors had access to radiologists for this service, rather than perform it themselves,” the report said.
All three report authors declined comment. Calls to Dave Chomiak, who was health minister at the time the report was prepared, were not returned. In an email to CBC, Manitoba Chiropractors Association president Perry Taylor said, “I personally have never seen this 13-year-old document and [it] pre-dates my time as President. As such I have no comment on this.” The CBC I-Team offered to go through the report with Taylor but he did not respond.
This report seems to confirm much of what we have discussed repeatedly on this blog: Chiropractic is not nearly as effective and safe as chiropractors try to make us believe. To hide this fact is certainly dishonest and unethical, but it is in some ways understandable: this knowledge would directly threaten the income of most chiropractors.
Yesterday I commented on another post: “the conflict of interest seems obvious: if homeopaths speak the truth, they are out of business. therefore, they are taught untruths from the first day of their training and eventually end up believing them. there is only one solution, as far as I can see: regulators must prevent them from making false claims. if not, this will go on for another 200 years and damage many patients’ health”. In the light of the above report, I will now re-phrase this: the conflict of interest seems obvious: if chiropractors allowed the truth to be known, they would soon be out of business. Therefore, they are taught untruths from the first day of their training and many end up believing them. There is only one solution, as far as I can see: regulators must prevent chiropractors from making false claims. If not, this abuse will go on for another 120 years and damage many patients’ health.