MD, PhD, MAE, FMedSci, FRSB, FRCP, FRCPEd.

Is acupuncture an effective treatment for pain? This is a question which has attracted decades of debate and controversy. Proponents usually argue that it is supported by good clinical evidence, millennia of tradition and a sound understanding of the mechanisms involved. Sceptics, however, tend to be unimpressed and point out that the clinical evidence of proponents often is cherry-picked, that a long history of usage is fairly meaningless, and that the alleged mechanisms are tentative at best.

This discrepancy of opinions is confusing, particularly for lay people who might be tempted to try acupuncture. But it might vanish in the light of a new, comprehensive and unique evaluation of the clinical evidence.

An international team of acupuncture trialists published a meta-analysed of individual patient data to determine the analgesic effect of acupuncture compared to sham or non-acupuncture control for the following 4 chronic pain conditions: back and neck pain, osteoarthritis, headache, and shoulder pain. Data from 29 RCTs, with an impressive total of 17 922 patients, were included.

The results of this new evaluation suggest that acupuncture is superior to both sham and no-acupuncture controls for each of these conditions. Patients receiving acupuncture had less pain, with scores that were 0.23 (95% CI, 0.13-0.33), 0.16 (95% CI, 0.07-0.25), and 0.15 (95% CI, 0.07-0.24) SDs lower than those of sham controls for back and neck pain, osteoarthritis, and chronic headache, respectively; the effect sizes in comparison to no-acupuncture controls were 0.55 (95% CI, 0.51-0.58), 0.57 (95% CI, 0.50-0.64), and 0.42 (95% CI, 0.37-0.46) SDs.

Based on these findings, the authors reached the conclusion that “acupuncture is effective for the treatment of chronic pain and is therefore a reasonable referral option. Significant differences between true and sham acupuncture indicate that acupuncture is more than a placebo. However, these differences are relatively modest, suggesting that factors in addition to the specific effects of needling are important contributors to the therapeutic effects of acupuncture”.

Only hours after its publication, this new meta-analysis was celebrated by believers in acupuncture as the strongest evidence yet on the topic currently available. Much of the lay press followed in the same, disappointingly uncritical vein.The authors of the meta-analysis, most of whom are known enthusiasts of acupuncture, seem entirely sure that they have provided the most compelling proof to date for the effectiveness of acupuncture. But are they correct or are they perhaps the victims of their own devotion to this therapy?

Perhaps, a more sceptical view would be helpful – after all, even the enthusiastic authors of this article admit that, when compared to sham, the effect size of real acupuncture is too small to be clinically relevant. Therefore one might argue that this meta-analysis confirms what critics have suggested all along: acupuncture is not a useful treatment for clinical routine.

Unsurprisingly, the authors of the meta-analysis do their very best to play down this aspect. They reason that, for clinical routine, the comparison between acupuncture and non-acupuncture controls is more relevant than the one between acupuncture and sham. But this comparison, of course, includes placebo- and other non-specific effects masquerading as effects of acupuncture – and with this little trick ( which, by the way is very popular in alternative medicine), we can, of course, show that even sugar pills are effective.

I do not doubt that context effects are important in patient care; yet I do doubt that we need a placebo treatment for generating such benefit in our patients. If we administer treatments which are effective beyond placebo with kindness, time, compassion and empathy, our patients will benefit from both specific and non-specific effects. In other words, purely generating non-specific effects with acupuncture is far from optimal and certainly not in the interest of our patients. In my view, it cannot be regarded as not good medicine, and the authors’ conclusion referring to a “reasonable referral option” is more than a little surprising in my view.

Acupuncture-fans might argue that, at the very minimum, the new meta-analysis does demonstrate acupuncture to be statistically significantly better than a placebo. Yet I am not convinced that this notion holds water: the small residual effect-size in the comparison of acupuncture with sham might not be the result of a specific effect of acupuncture; it could be (and most likely is) due to residual bias in the analysed studies.

The meta-analysis is strongly driven by the large German trials which, for good reasons, were heavily and frequently criticised when first published. One of the most important potential drawbacks was that many participating patients were almost certainly de-blinded through the significant media coverage of the study while it was being conducted. Moreover, in none of these trials was the therapist blinded (the often-voiced notion that therapist-blinding is impossible is demonstrably false). Thus it is likely that patient-unblinding and the absence of therapist-blinding importantly influenced the clinical outcome of these trials thus generating false positive findings. As the German studies constitute by far the largest volume of patients in the meta-analysis, any of their flaws would strongly impact on the overall result of the meta-analysis.

So, has this new meta-analysis finally solved the decades-old question about the effectiveness of acupuncture? It might not have solved it, but we have certainly moved closer to a solution, particularly if we employ our faculties of critical thinking. In my view, this meta-analysis is the most compelling evidence yet to demonstrate the ineffectiveness of acupuncture for chronic pain.

41 Responses to Acupuncture for chronic pain? Almost certainly not!

  • Edzard, can you explain “the often-voiced notion that therapist-blinding is impossible is demonstrably false”?

    Many acupuncturists would consider that an important component of adequate peripheral nerve/muscle stimulation involves a needle insertion of some depth with strong rotation of muscle fibres around the needle (and not for mystical purposes related to “qi”). That requires a good amount of manual dexterity.

    How would you propose that somebody could administer this sufficiently and be blinded to the process?

    • As we are acupuncturists your point is correct. There are two arms for at least acupuncture working :manual dexterity and manipulate needling. To blind acupuncturist manual dexterity for clinical trial is to disable real benefit from acupuncture. That is designed bias to increase placebo effect. Everyday we practice acupuncture we have been required our own motion and health at the good position. Otherwise it reduces efficiency. For instance if I was sick due to headache I would not do acupuncture on my patient

  • Blinding the therapist: an acupuncturist diagnosis and marks the correct points in group A and non-acupuncture points in group B. the patient then sees a technichian who has been taught the technique of needling without knowing anything about acupuncture. A blinded evaluator assesses the clinical outcome.

    • Acupuncture is complex and no one really knows how it works. Perhaps it is just like hypnotherapy or perhaps it is transferred kinetic energy via needling from therapist”s chemical energy or transferring bioinformatics or stimulating specific tissues…Before it be definded the arguments whether there is acuponits or whether there is special channels are irrelevant consideration for control factors. Professor, pls correct me if it is wrong logical. To use your designed Group A and Group B as placebo based on the selected acupoints are wrong from wrong logical thinking. That is similar logical wrong for using different cloth weard to defind sex. In fact it is common agreement there is no specific acupoints but there is specific function across the whole body which means regardless where the points are located.

      Prof perhaps what you learnt acupuncture is different what we have learnt .

  • Wouldn’t that just tell you whether a non acupuncturist gets different results from needling at acupuncture points or not? If there’s no such thing as an acupuncture point as they were traditionally conceived of, I’m not sure what needling at ‘non’ acupuncture sites would tell you?

    If we were going to reliably assess acupuncture, how could we do that with acupuncture delivered by people that don’t know anything about it? (I’m aware of the desire and the purpose of blinding in trials)

  • @James: If needling “acupuncture points” and “non acupuncture points” yields the same results on a large number of patients, that clearly means that there is no such thing as “acupuncture points”. Which in turn at least puts into question the underlying concept of “qyi” or “energy flows” and “energy points” etc. If you can needle any one at or in any point of his or her body and get the same results no matter what that means that there’s nothing specific to acupuncture.
    Hypothetically there could still be something to needling in general other than placebo (and certainly having nothing to do with the concepty underlying acupuncture) but I am sure that there is a number of scientific trials to follow up on that question.
    For some “critics”, i.e. fans of acupuncture, that will not be enough evidence. They will probably point out the same thing you do: after all, the needling has not been done by an acupuncturist but “just” by a technician – who is as good at needling as any of them. But to me that’s just admitting that acupuncture is not about needling or qyi at all (as the technician hit all the “correct point” in the same manner they did) but actually about the attention and empathy a patient is given. Which would make it a classic placebo.

  • @ Christoph

    Yes, that’s the point I’m making. If there are no such things as acupuncture points, ‘off point’ needling is not a valid placebo control, off point needling is a control for traditional acupuncture point theory, which indeed shows points do not exist in the way once thought. In short, it’s all peripheral nerve stimulation, and the quality and way in which it’s administered may well be significant.

    We need to separate theoretical models from the physicality of the practice, of course “Qi” is an old culture’s erroneous explanation of what’s taking place.

    Saying there is no such thing as an acupuncture point is not the equivalent to saying the needling area is irrelevant, because it’s likely that needling produces local effects through minor muscle lesions/trauma/nerve stimulation + segmental analgesic effects via action potentials up nerve pathways to associated segments of the spine + more central regulatory effects via hypothalamic stimulation/neuropeptide release. The central regulatory effects would be less related to specific needling sites. The combination of these factors plus an undoubtedly strong non specific effect likely contributes to the total acupuncture response a patient experiences. The specifics of how all of that is delivered optimally to individual patients is complex, and once again not for mystical reasons but pragmatic ones.

    While as you say fans of acupuncture may take issue with aspects of trial design and use it to confirm their own bias, critics also need to not treat very valid questions about trial methodology as ‘just another excuse’. Bias exists on both sides.

    My point in my first post is just that trials of acupuncture do need to be advised upon and conducted by people with experience with acupuncture, which is quite reasonable.

    • yes that is reasonable but, in my trial design, there would of course be acupuncture-wizzards overseeing the trial

      • And of course the needling technicians could also be randomised between real and sham needling, which would remove the possibility of acupuncturists claiming that the entire body responds to needling in some special and unique way.

        The fact is, though, that the better we zero in on the fact that it’s a placebo response, the more determinedly they will try to design trials that prove acupuncture. And that’s the critical weakness with all CAM: every single trial I have ever encountered which is conducted by CAM proponents sets out to prove an effect, not test whether the effect is there. That’s why rational discussion of every single such trial immediately dissolves into a slanging match about people always picking holes in the trial methodology – the possibility of fixing crap methodologies is never really considered for fear of producing the “wrong” result.

  • The most interesting aspect of these comments is the fact that no acupuncture fan has yet denied that the new evidence shows the ineffectiveness of acupuncture. Is it possible that they all agree with me?

  • I don’t have time to fully comment, as I am too busy scamming my patients for lots of money with a treatment that only appears to make them feel better – they don’t realise they do not actually feel better. How stupid are they, and how crafty am I?

  • Prickly: well done! now you have understood sarcasm, you only need to understand which factors can contribute to a perceived therapeutic response!

  • What do you think of Swedish professor Robert Hahn ?? He he he

  • I Will start à new therapy. Called placebo ing. Good results. And no side effekts. Can it be better ???

  • @ Edzard

    I would think it unlikely acupuncturists would agree with your claim for its ineffectiveness because as you note the study does demonstrate acupuncture above placebo and of its benefits to patients (even if you do suspect that effect is due to residual bias).

    There is a difference between these questions at the level of academia and at the level of patient outcomes. Patients in pain are unlikely to lose sleep at night over questions of whether the benefits they received from acupuncture were possibly connected to residual bias. They likely want to know what will improve their quality of life. The choice they have with regard to acupuncture is to have it or not, and the effects of those two options are the ones that are meaningful to them, more so when the pharmaceutical alternatives can produce intolerable side effects or addiction. If acupuncture facilitated less pain killer use and gave chronic pain patients some relief I don’t see why it’s not considered a reasonable referral option.

  • I would be interested to read your analysis of studies showing that many antidepressants work only slightly better than placebo. Could this be another type of treatment that is used because doctors and drug companies and patients want to believe it helps, not because it actually does help?

  • DG: you might be right there; I cannot comment with authority because it is not my area of expertise.

  • I find myself in a scientific dilemma over acupuncture. I do not “believe” there is anything mystic or magical about acupuncture, nor do I think it can “cure” diseases, etc, BUT I do have a condition which causes very severe chronic pain for which I am prescribed morphine. There have been times when my condition has worsened to a point where I was almost suicidal. On one occasion, reluctant to consume even more morphine [side effects of which are unpleasant] as it wasn’t working, I was [even more reluctantly] persuaded to try acupuncture.

    The therapist [State Registered Physiotherapist] could confirm that I was the most awkward, difficult and skeptical patient she had ever met and only “submitted” to rule the treatment out. However, over a few sessions, I did get some relief. Nothing “magical” or dramatic but it did help to reduce my pain level to a point where I could cope better without resorting to more drugs.

    This is a life long problem; I have occasionally experienced similar reduction in pain after treatment with acupuncture. I would have put this effect down to placebo IF I had approached it with any positive expectation in the first place, but I did not – quite the opposite.

    Mike

  • I tried to different acupuncturists within a year for Polycystic ovarian syndrome; which due to urology birth defects, birth control makes me very ill. Had I only tried the first acupuncturist, I would say it was highly expensive, a lack of passion, and pseudoscience. Fortunately, upon moving I tried a different acupuncturist who was affiliated with a well-respected hospital. Upon meeting with her, I knew instantly that she not only legitimately cared about her patients but also believed she could help me with this female disorder. She also said she could help me with my kidney issues. Her prices were fair, after a week session for 6 weeks I had my first monthly in 18 months. Her needles were painless, she spent a great deal of time explaining the points she was hitting…. my foot area was highly inflamed due to my condition. She also helped me significantly with my kidney issues using herbs she mixed specifically for me. She told me what she could and could not do. I never tried acupuncture for pain; but for women disorders or polynephyritis I know real acupuncture works well. I have never suffered PCOS ever again.

    • @Sophia
      Unfortunately you have given us no evidence that the acupuncture itself did anything for you. The empathic attention of the second acupuncturist gave you comfort and reassurance of coursed, but that’s it.
      You have only told us that at the same time you got acupuncture you got better. There is no clue in your story that it was the acupuncture that had any effect on your condition(s). We do not even know if it really was PCOS that was giving you trouble. It might have been a wrongly diagnosed, it often is. Most ovarian cysts are not PCOS. It is very likely that whatever was ailing you improved spontaneously over time. Very many health conditions do.
      If it really was PCOS it may have improved, especially if you attended to your lifestyle. PCOS usually improves by improved diet and exercise and weight loss.
      We do not know either, whether you got any other treatment for your pyelonephritis? Even without treatment such problems may improve with time.
      So your story most probably represent one of the hundreds of millions of anecdotes from people who did not realise that if you take a herb or stick a needle, any effect that comes along is not necessarily caused by this action.
      Before science evolved and medicine with it, a wise man once said : “The role of the physician is to entertain the patient while nature takes its course” or something to that effect.
      This is exactly what acupuncturists and many other practitioners of make-believe medicine do. They wave their hands, make magic bruises or stick their needles and tell the patient tall stories. That is showmanship.
      The patients who improve and believe it was beneficial come back for more and make the practitioner think he did a great job. The ones who do not improve give up and go to a real physician and seldom complain about the mistake they made.

  • and here is the 2017 update of this meta-analysis (https://www.ncbi.nlm.nih.gov/pubmed/29198932):
    Despite wide use in clinical practice, acupuncture remains a controversial treatment for chronic pain. Our objective was to update an individual patient data meta-analysis to determine the effect size of acupuncture for four chronic pain conditions.We searched MEDLINE and the Cochrane Central Registry of Controlled Trials randomized trials published up until December 31, 2015. We included randomized trials of acupuncture needling versus either sham acupuncture or no acupuncture control for non-specific musculoskeletal pain, osteoarthritis, chronic headache, or shoulder pain. Trials were only included if allocation concealment was unambiguously determined to be adequate. Raw data were obtained from study authors and entered into an individual patient data meta-analysis. The main outcome measures were pain and function. An additional 13 trials were identified, with data received for a total of 20,827 patients from 39 trials. Acupuncture was superior to both sham and no acupuncture control for each pain condition (all p<0.001) with differences between groups close to 0.5 standard deviations (SD) for comparison with no acupuncture control and close to 0.2 SDs in comparison with sham. We also found clear evidence that the effects of acupuncture persist over time with only a small decrease, approximately 15%, in treatment effect at one year. In secondary analyses, we found no obvious association between trial outcome and characteristics of acupuncture treatment, but effect sizes of acupuncture were associated with the type of control group, with smaller effects sizes for sham controlled trials that used a penetrating needle for sham, and for trials that had high intensity of intervention in the control arm.We conclude that acupuncture is effective for the treatment of chronic pain, with treatment effects persisting over time. While factors in addition to the specific effects of needling at correct acupuncture point locations are important contributors to the treatment effect, decreases in pain following acupuncture cannot be explained solely in terms of placebo effects. Variations in the effect size of acupuncture in different trials are driven predominately by differences in treatments received by the control group rather than by differences in the characteristics of acupuncture treatment.
    PERSPECTIVE:
    Acupuncture is effective for the treatment of chronic musculosketal, headache and osteoarthritis pain. Treatment effects of acupuncture persist over time and cannot be explained solely in terms of placebo effects. Referral for a course of acupuncture treatment is a reasonable option for a patient with chronic pain.

    • We look forward to your critique of this paper, EE!

    • I just read patient records for someone who had a chronic neuropathic pain and was referred for acupuncture by his doctor, as a last resort. It made it much worse.

      • After reading your comment, I pulled up 3 patient records from patients who had chronic neuropathic pain and were referred for acupuncture by their doctors, as a last resort. It made it much better. (I stopped at 3. Oh, and one of them was a surgeon. 🙂 )

        • My button is bigger than yours 🙂

          • You certainly are the biggest promoter of anecdote on this site – just thought you’d appreciate a few more, for balance. 🙂 Sometimes in the natural course of a disease, things get better. Sometimes they get worse. Such is the way of things.

          • Balanced anecdotes is the ultimate hint that, with acupuncture, it’s always the natural course of the disease (except for cases of recklessness leading to potential additional infections).

          • James –

            Sorry, but the correct answer was “I just read patient records for someone who had a chronic neuropathic pain and was referred for acupuncture by his doctor, as a last resort. There was absolutely no change.”

            You were too late anyway. Bjorn played Trump.

          • Do you have a point with deliberately misquoting me, dear “jm”? Or do you have problems with dyslexia??

          • Wow – double Trump!

          • Give a bit of hmmm to me…

Leave a Reply to edzard Cancel reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Subscribe via email

Enter your email address to receive notifications of new blog posts by email.

Recent Comments

Note that comments can be edited for up to five minutes after they are first submitted but you must tick the box: “Save my name, email, and website in this browser for the next time I comment.”

The most recent comments from all posts can be seen here.

Archives
Categories