MD, PhD, FMedSci, FRSB, FRCP, FRCPEd

clinical trial

I find it always nice to see that people appreciate my work. Yet sometimes I am a little surprised to realise what some commercially interested firms make of it. Recently I came across a website that proudly used my research for advertising the use of magnetic bracelets against pain. Here is the text in question:

The extra strong magnets make this magnetic bracelet the fastest acting pain reliever. While wearing this magnetic bracelet customers with wrist and hand pain report significant pain relief….

What is a magnetic bracelet and what are the benefits? Magnetic bracelets are a piece of jewelry, worn for the therapeutic benefits of the magnetic field. Magnetic bracelets has been used successfully by many people for pain relief of inflammatory conditions such as arthritis, tendinitis and bursitis.

A randomized, placebo controlled trial with three parallel groups, came to the conclusion : Pain from osteoarthritis of the hip and knee decreases when wearing magnetic bracelets. It is uncertain whether this response is due to specific or non-specific (placebo) effects. Tim Harlow, general practitioner, Colin Greaves, research fellow, Adrian White, senior research fellow, Liz Brown, research assistant, Anna Hart, statistician, Edzard Ernst, professor of complementary medicine.

The entrepreneurs seem to have forgotten a few things which we tried to make clear in our paper:

  • this article was published in the Christmas issue of the BMJ which specialises in publishing unusual and odd findings with a high entertainment value,
  • in our paper, we point out that “the contamination of group B with stronger magnets prevented a more objective estimation of any-placebo effect”,
  • and stressed that “there were problems with the weak magnets”,
  • and that “a per-specification analysis suggested (but could not confirm) a specific effect of magnetic bracelets over and above placebo”.

Most importantly, this was just one trial, and surely one swallow does not make a summer! We should always consider the totality of the reliable evidence. Being conscientious researchers, at the time, we did exactly that and conducted a systematic review. Here is the abstract in its full beauty:

BACKGROUND:

Static magnets are marketed with claims of effectiveness for reducing pain, although evidence of scientific principles or biological mechanisms to support such claims is limited. We performed a systematic review and meta-analysis to assess the clinical evidence from randomized trials of static magnets for treating pain.

METHODS:

Systematic literature searches were conducted from inception to March 2007 for the following data sources: MEDLINE, EMBASE, AMED (Allied and Complementary Medicine Database), CINAHL, Scopus, the Cochrane Library and the UK National Research Register. All randomized clinical trials of static magnets for treating pain from any cause were considered. Trials were included only if they involved a placebo control or a weak magnet as the control, with pain as an outcome measure. The mean change in pain, as measured on a 100-mm visual analogue scale, was defined as the primary outcome and was used to assess the difference between static magnets and placebo.

RESULTS:

Twenty-nine potentially relevant trials were identified. Nine randomized placebo-controlled trials assessing pain with a visual analogue scale were included in the main meta-analysis; analysis of these trials suggested no significant difference in pain reduction (weighted mean difference [on a 100-mm visual analogue scale] 2.1 mm, 95% confidence interval -1.8 to 5.9 mm, p = 0.29). This result was corroborated by sensitivity analyses excluding trials of acute effects and conditions other than musculoskeletal conditions. Analysis of trials that assessed pain with different scales suggested significant heterogeneity among the trials, which means that pooling these data is unreliable.

INTERPRETATION:

The evidence does not support the use of static magnets for pain relief, and therefore magnets cannot be recommended as an effective treatment. For osteoarthritis, the evidence is insufficient to exclude a clinically important benefit, which creates an opportunity for further investigation.

So, would I, on the basis of the current best evidence, recommend magnetic bracelets to people who suffer from pain? No! In my view, only charlatans would do such a thing.

Auricular acupuncture (AA), according to the ‘COLLEGE OF AURICULAR ACUPUNCTURE’, has its origins in Modern Europe. In 1957 Dr. Paul Nogier, a neurologist from Lyons in France, observed a locum doctor treating sciatica by cauterizing an area of the ear. This prompted extensive research culminating in the development of the somatopic correspondence of specific parts of the body to the ear based upon the concept of an inverted foetus. Dr. Nogier believed that pain and other symptoms in the body could be alleviated by needling, massaging or electronically stimulating the corresponding region of the ear. Auricular Acupuncture is a specialized complementary therapy where acupuncture points on the outer ear are treated, using either needles or acupunctoscopes (electrical location and stimulation machines) to help relieve many chronic complaints. There are over 200 acupuncture points on the ear, each point named after an area of our anatomy. The outer ear acts like a switchboard to the brain. Each acupuncture point being treated, triggers electrical impulses from the ear via the brain, to the specific part of the body being treated.

Sounds odd? Well, that’s because it is odd!

But just because something is odd does not mean it is ineffective – so, what does the reliable evidence tell us? Here are some conclusions from systematic reviews:

The evidence that auricular acupuncture reduces postoperative pain is promising but not compelling.

The evidence for the effectiveness of AA for the symptomatic treatment of insomnia is limited.

The benefit of ear-acupressure for symptomatic relief of allergic rhinitis is unknown…

All of these analyses point out that the quality of the studies is usually very poor, and stress that more and better research is required. It is therefore interesting to note that a new study has just been published. Perhaps it could settle the question about the effectiveness of AA?

The aim of this study was 1) to evaluate whether auricular acupuncture effective for reducing health care provider stress and anxiety and 2) to determine, if auricular acupuncture impacts provider capacity for developing caring relationships with patients. Pre-intervention and post-intervention surveys were evaluated to see, if auricular acupuncture was associated with changes in State-Trait Anxiety Inventory (STAI), Professional Quality of Life, and Caring Ability Inventory scores. The results indicate that, compared with baseline, participants had a significant reduction in state anxiety (STAI), trait anxiety (STAI), burnout, and secondary traumatic stress scores (Professional Quality of Life). Significant increases were noted in courage and patience, two dimensions of the Caring Ability Inventory.

From these findings, the authors conclude that auricular acupuncture is an effective intervention for the relief of stress/anxiety in providers and supports heightened capacity for caring.

Sounds odd again? Yes, because it is odd!

I would argue that a study of any controversial therapy that has already been tested repeatedly in poor quality trials must have sufficient scientific rigor to advance the field of inquiry. If it does not fulfil this criterion, it is quite simply not ethical. The new study does not even have a control group; we can therefore not begin to tell whether the observed outcomes were due to non-specific effects, the natural history of the condition or regression towards the mean (to mention but a few of the possible sources of bias). To conclude that AA is ‘an effective intervention’ is therefore utterly barmy.

All of this could be entirely trivial and inconsequential. I am afraid, however, that it is not. Alternative medicine is littered with such unethically flawed research conducted by naïve and clueless pseudo-scientists who arrive at outrageous conclusions. This relentless flow of false-positive findings misleads consumers, health care professionals, decision makers and everyone else to draw the wrong conclusions about bogus therapies. And, in the end, this sort of thing even does a grave disfavour to any branch of alternative medicine that might have some degree of respectability.

IT IS HIGH TIME THAT THIS NONSENSE STOPS! IT BORDERS ON SCIENTIFIC MISCONDUCT.

One alternative therapy that I have so far neglected on this blog is the Alexander Technique (AT). Actually, it was not really meant to become an alternative therapy when it was first discovered.

F.M. Alexander (1869-1955), an Australian actor, often experienced chronic laryngitis while performing. As his doctors could not help him, he developed a solution on his own. He found that excess muscular tension in his neck and body were causing his problems, and began to experiment on new ways to speak and move with greater ease. His health improved to such an extent that he decided to teach others what he had learned. Over a career span of more than fifty years, he refined his methods. After teaching for over 35 years, he began to train teachers of the ‘Alexander Technique’.

As used in alternative medicine, AT is an educational method aimed at increased sensory awareness and kinesthetic control to modify postural and movement patterns which might be associated with musculoskeletal problems. Proponents claim AT works for a range of conditions, including:

It has been suggested that AT is effective for chronic low back pain; however, so far only one recent study has determined its effects on chronic non-specific neck pain.

In this randomized controlled trial, patients were randomly allocated to either 5 weekly sessions of AT, heat pack application (HEAT) or guided imagery (GI). The primary outcome measure  was the neck pain intensity on a 100-mm visual analogue scale at week 5. Secondary outcomes included neck disability, quality of life, satisfaction and adverse effects. Analyses of covariance were applied on an intention-to-treat population testing ordered hypotheses AT vs. HEAT and AT vs. GI.

A total of 72 patients were included, and 52 of them received all 5 interventions. No significant group difference was found for neck pain intensity when AT was compared to HEAT. However, an exploratory analysis revealed superiority of AT over GI. Significant group differences were also found for physical quality of life in favor of AT vs. HEAT or GI. Adverse events mainly related to slightly increased pain and muscle soreness. AT patients reported increased body awareness and control over the body, relaxing or stimulating effects and mood changes after the sessions.

The authors conclude that 5 sessions of AT were no better than a heat pack application for relieving chronic non-specific neck pain. Therefore it cannot be recommended as routine intervention at this time. Since exploratory analysis revealed some improvements of AT further trials are warranted for conclusive judgment.

One of the most irritating things with alternative medicine research, in my view, is the phenomenon that researchers tend to be quasi-religious advocates of the treatment they investigate. This seems to compel them all too often to extrapolate beyond reason and to drawing conclusions which are way too optimistic, frequently to an extend that borders on scientific misconduct. It is therefore a real pleasure to find an article that does not fall into this trap. I commend the authors for reporting this RCT and for their wisdom of being adequately cautious when formulating their conclusions.

I only wished it would happen more often!

Imagine an area of therapeutics where 100% of all findings of hypothesis-testing research is positive, i.e. comes to the conclusion that the treatment in question is effective. Theoretically, this could mean that the therapy is a miracle cure which is useful for every single condition in every single setting. But sadly, there are no miracle cures. Therefore something must be badly and worryingly amiss with the research in an area that generates 100% positive results.

Acupuncture is such an area; we and others have shown that Chinese trials of acupuncture hardly ever produce a negative finding. In other words, one does not need to read the paper, one already knows that it is positive – even more extreme: one does not need to conduct the study, one already knows the result before the research has started. But you might not believe my research nor that of others. We might be chauvinist bastards who want to discredit Chinese science. In this case, you might perhaps believe Chinese researchers.

In this systematic review, all randomized controlled trials (RCTs) of acupuncture published in Chinese journals were identified by a team of Chinese scientists. A total of 840 RCTs were found, including 727 RCTs comparing acupuncture with conventional treatment, 51 RCTs with no treatment controls, and 62 RCTs with sham-acupuncture controls. Among theses 840 RCTs, 838 studies (99.8%) reported positive results from primary outcomes and two trials (0.2%) reported negative results. The percentages of RCTs concealment of the information on withdraws or sample size calculations were 43.7%, 5.9%, 4.9%, 9.9%, and 1.7% respectively.

The authors concluded that publication bias might be major issue in RCTs on acupuncture published in Chinese journals reported, which is related to high risk of bias. We suggest that all trials should be prospectively registered in international trial registry in future.

I applaud the authors’ courageous efforts to conduct this analysis, but I do not agree with their conclusion. The question why all Chinese acupuncture trials are positive has puzzled me since many years, and I have quizzed numerous Chinese colleagues why this might be so. The answer I received was uniformly that it would be very offensive for Chinese researchers to conceive a study that does not confirm the views held by their peers. In other words, acupuncture research in China is conducted to confirm the prior assumption that this treatment is effective. It seems obvious that this is an abuse of science which must cause confusion.

Whatever the reasons for the phenomenon, and we can only speculate about them, the fact has been independently confirmed several times and is now quite undeniable: acupuncture trials from China – and these constitute the majority of the evidence-base in this area – cannot be trusted. The only way to adequately deal with this problem that I can think of is to discard them outright.

Today, there are several dozens of journals publishing articles on alternative medicine. ‘The Journal of Alternative and Complementary Medicine’ is one of the best known, and it has one of the highest impact factors of them all. The current issue holds a few ‘gems’ which might be worthy of a comment or two. Here I have selected three articles reporting clinical studies, and I reproduce their abstracts (almost) in full (in italics) and add my comments (for clarity in bold). All the articles are available electronically, and I have provided the links for those who want to investigate beyond the abstracts.

STUDY No 1

The first ‘pilot study‘ was aimed to demonstrate the potential of auricular acupuncture (AAT) for insomnia in maintenance haemodialysis (MHD) patients and to prepare for a future randomized controlled trial.

Eligible patients were enrolled into this descriptive pilot study and received AAT designed to manage insomnia for 4 weeks. Questionnaires that used the Pittsburgh sleep quality index (PSQI) were completed at baseline, after a 4-week intervention, and 1 month after completion of treatment. Sleep quality and other clinical characteristics, including sleeping pills taken, were statistically compared between different time points.

A total of 22 patients were selected as eligible participants and completed the treatment and questionnaires. The mean global PSQI score was significantly decreased after AAT intervention (p<0.05). Participants reported improved sleep quality (p<0.01), shorter sleep latency (p<0.05), less sleep disturbance (p<0.01), and less daytime dysfunction (p=0.01). They also exhibited less dependency on sleep medications, indicated by the reduction in weekly estazolam consumption from 6.98±4.44 pills to 4.23±2.66 pills (p<0.01). However, these improvements were not preserved 1 month after treatment.

Conclusions: In this single-center pilot study, complementary AAT for MHD patients with severe insomnia was feasible and well tolerated and showed encouraging results for sleep quality.

My comments:

In alternative medicine research, it has become far too common (almost generally accepted) to call a flimsy trial a ‘pilot study’. The authors give their game away by stating that, by conducting this trial, they want to ‘demonstrate the potential of AAT’. This is not a legitimate aim of research; science is for TESTING hypotheses, not for PROVING them!

The results of this trial show that patients experienced improvements after receiving AAT which, however, did not last. As there was no placebo control group, the most likely explanation for these outcomes would be that AAT generated a short-lasting placebo effect.

A sample size of 22 is, of course, far to small to allow any conclusions about the safety of the intervention. Despite these obvious facts, the authors seem convinced that AAT is both safe and effective.

STUDY No 2

The aim of the second study was to compare the therapeutic effect of Yamamoto new scalp acupuncture (YNSA), a recently developed microcupuncture system, with traditional acupuncture (TCA) for the prophylaxis and treatment of migraine headache.

In a randomized clinical trial, 80 patients with migraine headache were assigned to receive YNSA or TCA. A pain visual analogue scale (VAS) and migraine therapy assessment questionnaire (MTAQ) were completed before treatment, after 6 and 18 sections of treatment, and 1 month after completion of therapy.

All the recruited patients completed the study. Baseline characteristics were similar between the two groups. Frequency and severity of migraine attacks, nausea, the need for rescue treatment, and work absence rate decreased similarly in both groups. Recovery from headache and ability to continue daily activities 2 hours after medical treatment showed similar improvement in both groups (p>0.05).

Conclusions: Classic acupuncture and YNSA are similarly effective in the prophylaxis and treatment of migraine headache and may be considered as alternatives to pharmacotherapy.

My comments:

This is what is technically called an ‘equivalence trial’, i.e. a study that compares an experimental treatment (YNSA) to one that is (assumed to be) effective. To demonstrate equivalence, such trials need to have large sample sizes, and this study is woefully underpowered. As it stands, the results show nothing meaningful at all; if anything, they suggest that both interventions were similarly useless.

STUDY No 3

The third study determined whether injection with hypertonic dextrose and morrhuate sodium (prolotherapy) using a pragmatic, clinically determined injection schedule for knee osteoarthritis (KOA) results in improved knee pain, function, and stiffness compared to baseline status.

The participants were 38 adults who had at least 3 months of symptomatic KOA and who were in the control groups of a prior prolotherapy randomized controlled trial (RCT) (Prior-Control), were ineligible for the RCT (Prior-Ineligible), or were eligible but declined the RCT (Prior-Declined).

The injection sessions at occurred at 1, 5, and 9 weeks with as-needed treatment at weeks 13 and 17. Extra-articular injections of 15% dextrose and 5% morrhuate sodium were done at peri-articular tendon and ligament insertions. A single intra-articular injection of 6 mL 25% dextrose was performed through an inferomedial approach.

The primary outcome measure was the validated Western Ontario McMaster University Osteoarthritis Index (WOMAC). The secondary outcome measure was the Knee Pain Scale and postprocedure opioid medication use and participant satisfaction.

The Prior-Declined group reported the most severe baseline WOMAC score (p=0.02). Compared to baseline status, participants in the Prior-Control group reported a score change of 12.4±3.5 points (19.5%, p=0.002). Prior-Decline and Prior-Ineligible groups improved by 19.4±7.0 (42.9%, p=0.05) and 17.8±3.9 (28.4%, p=0.008) points, respectively; 55.6% of Prior-Control, 75% of Prior-Decline, and 50% of Prior-Ineligible participants reported score improvement in excess of the 12-point minimal clinical important difference on the WOMAC measure. Postprocedure opioid medication resulted in rapid diminution of prolotherapy injection pain. Satisfaction was high and there were no adverse events.

Conclusions: Prolotherapy using dextrose and morrhuate sodium injections for participants with mild-to-severe KOA resulted in safe, significant, sustained improvement of WOMAC-based knee pain, function, and stiffness scores compared to baseline status.

My Comments:

This study had nothing that one might call a proper control group: all the three groups mentioned were treated with the experimental treatment. No attempt was made to control for even the most obvious biases: the observed effects could have been due to placebo or any other non-specific effects. The authors conclusions imply a causal relationship between the treatment and the outcome which is wrong. The notion that the experimental treatment is ‘safe’ is based on just 38 patients and therefore not reasonable.

IMPLICATION

All of this might seem rather trivial, and my comments could be viewed as a deliberate and vicious attempt to discredit one of the most respected journals of alternative medicine. Yet, considering that articles of this nature are more the rule than the exception in alternative medicine, I do think that this flagrant lack of scientific rigour is a relevant issue and has important implications.

As long as research in this area continues to be deeply flawed, as long as reviewers turn a blind eye to (or are not smart enough to detect) even the most obvious mistakes, as long as journal editors accept any rubbish in order to fill their pages, there is a great danger that we are being continuously being mislead about the supposed therapeutic value of alternative therapies.

Many who read this blog will, of course, have the capacity to think critically and might therefore not fall into the trap of accepting the conclusions of fatally flawed research. But many other people, including politicians, journalists and consumers, might not have the necessary appraisal skills and will thus not be able to tell that such studies can serve only one purpose: to popularise bogus treatments and thereby render health care less effective and more dangerous. Enthusiasts of alternative medicine are usually fully convinced that such studies amount to evidence and ram this pseudo-information down the throat of health care decision makers – the effects of such lobbying on public health can be disastrous.

And there is another downside to the publication of such dismal drivel: assuming (as I do) that not all of alternative medicine is completely useless, such embarrassingly poor research will inevitably have detrimental effects on the discipline of alternative medicine. After being exposed to a seemingly endless stream of pseudo-research, critics will eventually give up taking any of it seriously and might claim that none of it is worth the bother. In other words, those who conduct, accept or publish such nonsensical papers are not only endangering medical progress in general, they are also harming the very cause they try so desperately hard to advance.

I have often asked myself whether it is right/necessary to scientifically test things which are entirely implausible. Should we, for instance test the effectiveness of treatments which have a very low prior probability of generating a positive effect such as paranormal healing, homeopathy or Bach flower remedies? If you believe in the principles of evidence-based medicine you might focus on the clinical evidence and see biological plausibility as secondary. If you are a basic scientist, you are likely to do the reverse.

A recent article addressed this issue. The author points out that evaluating the absurd is absurd. Specifically, he noted that the empirical evaluation of a therapy would normally assume a plausible rationale regarding the mechanism of action. However, examination of the historical background and underlying principles for reflexology, iridology, acupuncture, auricular acupuncture, and some herbal medicines, reveals a rationale founded on the principle of analogical correspondences, which is a common basis for magical thinking and pseudoscientific beliefs such as astrology and chiromancy. Where this is the case, it is suggested that subjecting these therapies to empirical evaluation may be tantamount to evaluating the absurd.

This makes a lot of sense – but is it really entirely true? Are there no legitimate reasons at all for testing alternative treatments that lack biological plausibility? Ten or twenty years ago, I would have disagreed with the notion that plausibility is an essential prerequisite for scientific testing; today, I have changed my mind a little, but not as much as to agree completely with the assumption. In other words, I still see more than one good reason why evaluating the absurd might be reasonable or even advisable.

  1. Using plausibility as the only arbiter of scientific ‘evaluability’, assumes that we understand everything about plausibility there is to know. Yet it might just be possible that we mis-categorise something as implausible simply because we are not yet fully aware of all the facts.
  2. Declaring something as plausible and another thing as implausible are not hard and fast verdicts but judgements which, at least to some degree, are subjective. Sceptics find the axioms of homeopathy utterly implausible, for instance – but ask a homeopath, and you will hear all sorts of explanations which, at least to them, sound plausible.
  3. If an implausible alternative treatment is in wide-spread use, we arguably have a responsibility to test it scientifically in order to demonstrate the truth about it (to those proponents of that therapy who are willing to accept that rigorous science can find the truth). If we fail to do this, it will be the enthusiasts of that therapy who conduct less than rigorous science and produce false positive results. In turn, this will give the impression that the treatment is effective and mislead consumers, politicians, journalists etc. Seen from this perspective, it might even be unethical to not do the science.

So, I am in two minds about this (which might be a reflection of the fact that, during different periods of my life, I have been a clinician, a basic scientist and a clinical researcher). I realise that plausibility and prior probability are important – much more so than I appreciated years ago. But I think they should not be the only criteria. The clinical evidence should not be pushed aside completely.

I’d be interested to learn your views on this tricky issue.

The mechanisms thorough which spinal manipulative therapy (SMT) exerts its alleged clinical effects are not well established. A new study investigated the effects of subject expectation on clinical outcomes.

Sixty healthy subjects underwent quantitative sensory testing to their legs and low backs. They were randomly assigned to receive a positive, negative, or neutral expectation instructional set regarding the effects of a spe cific SMT technique on pain perception. Following the instructional set, all subjects received SMT and underwent repeat sensory tests.

No inter-group differences in pain response were present in the lower extremity following SMT. However, a main effect for hypoalgesia was present. A significant interaction was present between change in pain perception and group assignment in the low back with participants receiving a negative expectation instructional set demonstrating significant hyperalgesia.

The authors concluded that this study provides preliminary evidence for the influence of a non- specific effect (expectation) on the hypoalgesia associated with a single session of SMT in normal subjects. We replicated our previous findings of hypoalgesia in the lower extremity associated with SMT to the low back. Additionally, the resultant hypoalgesia in the lower extremity was independent of an expectation instructional set directed at the low back. Conversely, participants receiving a negative expectation instructional set demonstrated hyperalgesia in the low back following SMT which was not observed in those receiving a positive or neutral instructional set.

More than 10 years ago, we addressed a similar issue by conducting a systematic review of all sham-controlled trials of SMT. Specifically, we wanted to summarize the evidence from sham-controlled clinical trials of SMT. Eight studies fulfilled our inclusion/exclusion criteria. Three trials (two on back pain and one on enuresis) were judged to be burdened with serious methodological flaws. The results of the three most rigorous studies (two on asthma and one on primary dysmenorrhea) did not suggest that SMT leads to therapeutic responses which differ from an inactive sham-treatment. We concluded that sham-controlled trials of SMT are sparse but feasible. The most rigorous of these studies suggest that SMT is not associated with clinically relevant specific therapeutic effects.

Taken together, these two articles provide intriguing evidence to suggest that SMT is little more than a theatrical placebo. Given the facts that SMT is neither cheap nor devoid of risks, the onus is now on those who promote SMT, e.g. chiropractors, osteopaths and physiotherapists, to show that this is not true.

A recent meta-analysis evaluated the efficacy of acupuncture for treatment of irritable bowel syndrome (IBS) and arrived at bizarrely positive conclusions.

The authors state that they searched 4 electronic databases for double-blind, placebo-controlled trials investigating the efficacy of acupuncture in the management of IBS. Studies were screened for inclusion based on randomization, controls, and measurable outcomes reported.

Six RCTs were included in the meta-analysis, and 5 articles were of high quality.  The pooled relative risk for clinical improvement with acupuncture was 1.75 (95%CI: 1.24-2.46, P = 0.001). Using two different statistical approaches, the authors confirmed the efficacy of acupuncture for treating IBS and concluded that acupuncture exhibits clinically and statistically significant control of IBS symptoms.

As IBS is a common and often difficult to treat condition, this would be great news! But is it true? We do not need to look far to find the embarrassing mistakes and – dare I say it? – lies on which this result was constructed.

The largest RCT included in this meta-analysis was neither placebo-controlled nor double blind; it was a pragmatic trial with the infamous ‘A+B versus B’ design. Here is the key part of its methods section: 116 patients were offered 10 weekly individualised acupuncture sessions plus usual care, 117 patients continued with usual care alone. Intriguingly, this was the ONLY one of the 6 RCTs with a significantly positive result!

The second largest study (as well as all the other trials) showed that acupuncture was no better than sham treatments. Here is the key quote from this trial: there was no statistically significant difference between acupuncture and sham acupuncture.

So, let me re-write the conclusions of this meta-analysis without spin, lies or hype: These results of this meta-analysis seem to indicate that:

  1. currently there are several RCTs testing whether acupuncture is an effective therapy for IBS,
  2. all the RCTs that adequately control for placebo-effects show no effectiveness of acupuncture,
  3. the only RCT that yields a positive result does not make any attempt to control for placebo-effects,
  4. this suggests that acupuncture is a placebo,
  5. it also demonstrates how misleading studies with the infamous ‘A+B versus B’ design can be,
  6. finally, this meta-analysis seems to be a prime example of scientific misconduct with the aim of creating a positive result out of data which are, in fact, negative.

Mohamed Khalifa is a therapist who works in Austria and has been practicing manual therapy for more than 30 years. His treatment, the so-called “Khalifa therapy”, is based on rhythmically applying manual pressure on parts of the body. Khalifa claims to be able to speed the self-healing processes of the human body. He has treated many top-athletes from all over the world; however, his method has never been investigated in detail within interdisciplinary scientific studies.

Now the first RCT of Khalifa therapy has become available.

Rupture of the anterior cruciate ligament (ACL) is an injury which usually needs to be treated surgically. It does not heal spontaneously, although some claim this commonly accepted knowledge to be not true. This randomized, controlled, observer-blinded, multicentre study was performed to test the effectiveness of Khalifa therapy for ACL. Thirty patients with complete ACL rupture, magnetic resonance imaging (MRI) verified, were included. Study examinations (e.g., international knee documentation committee (IKDC) score) were performed at inclusion (t 0). Patients were randomized to receive either standardised physiotherapy (ST) or additionally 1 hour of Khalifa therapy at the first session (STK). Twenty-four hours later, study examinations were performed again (t 1). Three months later control MRI and follow-up examinations were performed (t 2).

Initial status was comparable between both groups. There was a highly significant difference of mean IKDC score results at t 1 and t 2. After 3 months, 47% of the STK patients, but no ST patient, demonstrated an end-to-end homogeneous ACL in MRI. Clinical and physical examinations were significantly different in t 1 and t 2. ACL healing can be improved with manual therapy. Physical activity could be performed without pain and nearly normal range of motion after one treatment of specific pressure.

The authors of this study concluded that spontaneous healing of ACL rupture is possible within 3 months after lesion, enhanced by Khalifa therapy. The effect sizes of 1.6 and 2.0 standard deviations after treatment and after 3 months are considerable and prompt further work. Further progress in understanding the underlying mechanisms including placebo will be possible when more experience with the manual pressure therapy has been gathered by other therapists.

The authors of this RCT state that according to common knowledge, it (ACL) does not heal spontaneously. Other authors disagree with this notion:

Observations on 14 patients with ACL, for instance, indicated an acutely injured ACL may eventually spontaneously heal without using an extension brace, allowing return to athletic activity. Another study suggested that an acutely injured ACL has healing capability. It also suggests that conservative management of the acute ACL injury can yield satisfactory results in a group of individuals who have low athletic demands and continuous ACL on MRI, provided the patients are willing to accept the slight risk of late ACL reconstruction and meniscal injury.

So yes, the authors of the new RCT are correct in stating: spontaneous healing of ACL rupture is possible within 3 months … but the healing might indeed be SPONTANEOUS, i.e. unrelated to the Khalifa therapy. Before we can accept that Khalifa therapy is anything but a theatrical placebo, this RCT needs independent replication. Generally speaking, it seems a bad idea to make exaggerated claims on the basis of one single trial, particularly for treatments that are as implausible as this one.

Chronic neck pain is common and makes the life of many sufferers a misery. Pain-killers are helpful, of course, but who wants to take such medications on the long-term? Is there anything else these patients can do?

Massage therapy has been shown to work but how often for how long? This trial was designed to evaluate the optimal dose of massage for individuals with chronic neck pain. 228 individuals with chronic non-specific neck pain were recruited and randomized them to 5 groups receiving various doses of massage:

  1. 30-minute treatments 2 or 3 times weekly
  2. 60-minute treatments once weekly
  3. 60-minutte treatments twice weekly
  4. 60-minute treatments thrice weekly
  5. a 4-week period on a wait list

Neck-related dysfunction was assessed with the Neck Disability Index (range, 0-50 points) and pain intensity with a numerical rating scale (range, 0-10 points) at baseline and at 5 weeks.

The results suggested that 30-minute treatments were not significantly better than the waiting list control condition in terms of achieving a clinically meaningful improvement in neck dysfunction or pain, regardless of the frequency of treatments. In contrast, 60-minute treatments 2 and 3 times weekly significantly increased the likelihood of such improvement compared with the control condition in terms of both neck dysfunction and pain intensity.

The authors conclude that after 4 weeks of treatment, we found multiple 60-minute massages per week more effective than fewer or shorter sessions for individuals with chronic neck pain. Clinicians recommending massage and researchers studying this therapy should ensure that patients receive a likely effective dose of treatment.

So two or three hours of massage therapy seems to be optimal as a treatment for chronic neck pain. This would cost ~£ 200-300 per week! Who can or wants to afford this? And are there other options that might be less expensive and equally or more effective? For instance, is physiotherapeutic exercise an option?

I am not sure I know the answers to these questions but, before we recommend massage therapy to the many who chronically suffer from neck pain, we should find out.

Gravityscan Badge

Recent Comments

Note that comments can be edited for up to five minutes after they are first submitted.


Click here for a comprehensive list of recent comments.

Categories