Updated Edition!
Here is the abstract of a recent article that I find worrying:
In 2020, severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) challenged the world with a global outbreak that led to millions of deaths worldwide. Coronavirus disease 2019 (COVID-19) is the symptomatic manifestation of this virus, which can range from flu-like symptoms to utter clinical complications and even death. Since there was no clear medicine that could tackle this infection or lower its complications with minimal adverse effects on the patients’ health, the world health organization (WHO) developed awareness programs to lower the infection rate and limit the fast spread of this virus. Although vaccines have been developed as preventative tools, people still prefer going back to traditional herbal medicine, which provides remarkable health benefits that can either prevent the viral infection or limit the progression of severe symptoms through different mechanistic pathways with relatively insignificant side effects. This comprehensive review provides scientific evidence elucidating the effect of 10 different plants against SARS-CoV-2, paving the way for further studies to reconsider plant-based extracts, rich in bioactive compounds, into more advanced clinical assessments in order to identify their impact on patients suffering from COVID-19.
The conclusions of this paper read as follows:
…since these 10 herbs hold distinct bioactive compounds with significant properties in vitro and with remarkable benefits to human health, it is possible to prevent SARS-CoV-2 infection and reduce its symptomatic manifestations by consuming any of these 10 plants according to the recommended dose. The diversity in bioactive molecules between the different plants exerts various effects through different mechanisms at once, which makes it more potent than conventional synthetic drugs. Nonetheless, more studies are needed to highlight the clinical efficacy of these extracts and spot their possible side effects on patients, especially those with comorbidities who take multiple conventional drugs.
I should point out that the authors fail to offer a single reliable trial that would prove or even imply that any of the 10 herbal remedies can effectively treat or prevent COVID infections (to the best of my knowledge, no such studies exist). Laguage like “it is possible to prevent SARS-CoV-2 infection and reduce its symptomatic manifestations” is therefore not just misleading but highly dangerous and deeply unethical. Sadly, such evidence-free claims abound in herbal medicine.
I think the journal editor, the peer-reviewer, the authors and their universities ( University of Tripoli in Lebanon, American University of the Middle East, Egaila in Kuwait, University of Balamand, Kalhat, Tripoli in Lebanon, Lebanese University, Tripoli in Lebanon, Aix-Marseille Université in France) should be ashamed to produce such dangerous rubbish.
Acute Otitis Media (AOM) is one of the most common acute infections in children and often injudiciously treated by antibiotics. Homeopathy has been claimed to work but is it really effective?
This open label, randomized, controlled, parallel arm trial was conducted on children (aged 0–12 years), suffering from AOM. The primary outcome was changes in Tympanic Membrane Examination scale (TMES) and Acute Otitis Media-Severity of Symptoms (AOM-SOS) scale, time to improvement in pain through Facial Pain Scale-Revised (FPS-R) over 10 days. The need for antibiotics in both groups and the recurrence of subsequent episodes of AOM over 12 months were also compared.
Intention-to-treat analysis was performed on 222 children; Homeopathy (n = 117) (H-group), Allopathy (A-group) (n = 105). There was a statistically significant reduction of scores in H-group compared with A-group at each time point: at day 3 (mean diff. ± sd: 1.71 ± 0.19; 95% CI: 1.34 to 2.07; p = 0.0001), at day 7 (mean diff. ± sd: 1.29 ± 0.24; 95% CI: 0.82 to 1.76; p = 0.0001) and at day 10 (mean diff. ± sd: 1.23 ± 0.25; 95% CI = 0.74 to 1.71; p = 0.0001) favoring homeopathy. Clinical failure by the third day of treatment was observed in 11% and 24% of children in H-group vs A-group (OR: 0.03; 95% CI: 0.001 to 0.52; p = 0.03). None of the children in the H-group required antibiotics, whereas 14 children in the A-group did.
The authors concluded that both therapies seemed to produce comparable effects and appeared safe. The study consolidated the findings observed during a pilot study, i.e., homeopathy is non-inferior to allopathy in managing AOM in children and antibiotics in children can be avoided.
This study was published in the journal ‘Homeopathy’ and originates from the Central Council for Research in Homeopathy, New Delhi, India. Sadly, I do not have the full text of the paper and cannot therefore scrutinize it adequately.
Let me just mention these three facts:
- The journal ‘Homeopathy’ never publishes negative results.
- Indian researchers of homeopathy publish as good as no negative results.
- As far as I can see, the Central Council for Research in Homeopathy, New Delhi, has never published a negative result.
These points do, of course, not necessarily mean that the study is false-positive, but they do not inspire me with confidence. In any case, it seems wise to insist on better evidence. To render it credible, we would need:
- Several rigorous RCTs that test homeopathy for AOM against placebo.
- If (and only then) they show that homeopathy is better than placebo, at least one independent replication of the present study.
As the biological plausibility of all this is close to zero, the chances that this will happen are also zero.
I have left the German skeptics organisation , GWUP, two days ago. This led to many questions and confusion. I therefore feel that I owe it to those skeptics who I may have upset or unsettled to offer a few clarifications (I do appologise, if this does not make much sense to those readers who were unable to follow the various disputes and discussions that took place, mostly in German, on Twitter).
1. Clarification – accusation of antisemitism: This accusation is completely absurd! In my opinion, the 1st re-Tweet that Bartoschek is using is not anti-Semitic. I have posted thousands of tweets, many of which are the opposite of anti-Semitic, as anyone can verify. Moreover, I have worked for the last 30 years to fight antisemitism and can probably show more results of this endeavor than my accuser.
2. Clarification – I can’t find the 2nd re-tweet that Bartoschek exhibits. No idea who found it and where! I can’t remember the text (but I do vaguely remember the graphic), and I certainly didn’t delete anything. I would delete if, if I could find it and be open about it. If it turns out that I am nevertheless at fault, I can only apologise.
3. Clarification – peer-review publications by Hirsch, Huemmler, Bartoschek (who I sarcastically called ‘the GWUP-elite’). After watching a long video of these gentlemen, I began to doubt whether they are true scientists (or even skeptics) at all. Hence my legitimate question. The answer seems to be largely negative.
4. Clarification – Bartoschek claims “Prof Ernst is on the side of the “anti-woke”. However, I have repeatedly emphasised that I do not believe in and even detest both ‘woke’ and ‘anti-woke’.
5. Clarification – Mr Hirsch is the ‘social media manager’ of the GWUP commissioned by Huemmler, the current chair of the GWUP. The fact that he spreads aggressive nonsense in this role under the pseudonym ‘Endgegner der Kommentarspalten’ is inadmissible.
6. Clarification – I have not gained the impression that the current division of the GWUP is primarily idiological in nature (both sides are not far apart in this respect), but believe that it is a rather ridiculous power struggle on a personal level.
7. Clarification – I have left the GWUP because I am sure that I can do my work better without it, because the current tone amongst GWUP members is unacceptable, because the GWUP is currently not converting its membership fees (I estimate ~200 000 per year) into meaningful activities, because the current GWUP ‘elite’ behaves neither as genuine sceptics nor as true scientists, and because I fear that things will only get worse after the AGM in May.
_________________________
My hope is that this is the last time I have to mention this sorry story here on my blog.
Traditional herbal medicine (THM) is frequently used in pediatric populations. This is perticularly true in many low-income countries. Yet THM has been associated with a range of adverse events, including liver toxicity, renal failure, and allergic reactions. Despite these concerns, its impact on multi-organ dysfunction syndrome (MODS) risk has so far not been thoroughly investigated.
This study aimed to investigate the incidence and predictors of MODS in a pediatric intensive care unit (PICU) in Ethiopia, with a focus on the association between THM use and the risk of MODS. It was designed as a single-center prospective cohort study conducted at a PICU in the university of Gondar Comprehensive Specialized hospital, Northwest Ethiopia. The researchers enrolled eligible patients aged one month to 18 years admitted to the PICU during the study period. Data on demographic characteristics, medical history, clinical and laboratory data, and outcome measures using standard case record forms, physical examination, and patient document reviews. The predictors of MODS were assessed using Cox proportional hazards models, with a focus on the association between traditional herbal medicine use and the risk of MODS.
A total of 310 patients were included in the final analysis, with a median age of 48 months and a male-to-female ratio of 1.5:1. The proportion and incidence of MODS were 30.96% (95% CI:25.8, 36.6) and 7.71(95% CI: 6.10, 9.40) per 100-person-day observation respectively. Renal failure (17.74%), neurologic failure (15.16%), and heart failure (14.52%) were the leading organ failures identified. Nearly one-third of patients (32.9%) died in the PICU, of which 59.8% had MODS. The rate of mortality was higher in patients with MODS than in those without. The Cox proportional hazards model identified renal disease (AHR = 6.32 (95%CI: 3.17,12.61)), intake of traditional herbal medication (AHR = 2.45, 95% CI:1.29,4.65), modified Pediatric Index of Mortality 2 (mPIM 2) score (AHR = 1.54 (95% CI: 1.38,1.71), and critical illness diagnoses (AHR = 2.68 (95% CI: 1.77,4.07)) as predictors of MODS.
The authors concluded that the incidence of MODS was high. Renal disease, THM use, mPIM 2 scores, and critical illness diagnoses were independent predictors of MODS. A more than twofold increase in the risk of MODS was seen in patients who used TMH. Healthcare providers should be aware of risks associated with THM, and educate caregivers about the potential harms of these products. Future studies with larger sample sizes and more comprehensive outcome measures are needed.
I do fully agree with the authors about the high usage of herbal and other so-called alternative medicines by children. We have shown that, in the UK the average one-year prevalence rate was 34% and the average lifetime prevalence was 42%. We have furthermore shown that the evidence base for these treatments in children is weak, even more so than for general populations. Finally, we can confirm that adverse effects are far from rare and often serious.
It is therefore high time, I think, that national regulators do more to protect children from SCAM practitioners who are at best uncritical about their treatments and at worse outright dangerous.
The 29th of February is an unusual date, and I will do something fittingly unusual today – something that I have never done before: I will with a heavy heart resign from an organisation of skeptics.
After I had observed the self-destructive debates within the GWUP for almost one year without saying a single word about it (hoping they would soon dissolve into thin air), I published a comment a few days ago. Soon after, I was aggressed, defamed, wrongly denounced as an anti-Semite, and blackmailed by leading members of that organisation.
Confronted with these events, it was inevitable that I would have doubts about my previous plan to remain a member until the upcoming general assembly in May. While I was contemplating, I received a Tweet on 27/2/2024 from someone under the pseudonym Endgegner der Kommentarspalten; it included this sentence:
Einer der verschwörungsideologischen Clowns, die seit gut einem Jahr Kulturkrieg in der GWUP mit rechtsextremen Talking Points spielen und Märchen von einem “woken Putsch” herbeiphantasieren?
My translation:
One of the conspiracy ideological clowns who have been playing culture war in the GWUP for a good year with right-wing extremist talking points and fantasising about a “woke coup”?
Next, I watched a long discussion on youtube between the new chair of the GWUP, my accuser (Bartoschek) and Sebastian Hirsch. There I learnt that the latter is, in fact, nobody else than Endgegner der Kommentarspalten. He was recently put in charge of Twitter account for GWUP by the chair.
At this point, I lost the hope that the GWUP might be saved. It seems to be in the hand of thugs who call not me personally but their opponents ‘ideological clowns who have been playing culture war’. They claim that they want to keep politics out of the GWUP, yet almost all they do is engaging in politics.
Since the former formidable chair, Amardeo Sarma, left and the rift started, the GWUP has done nothing wothwhile, as far as I can see. On the GWUP website, we are told that (my translation):
- The GWUP aims at promoting science and scientific thinking.
- The GWUP investigates parascientific theories according to the current state of scientific knowledge and reports publicly and comprehensibly on its findings.
- The GWUP aims to disseminate scientific and critical thinking and scientific methods, explain them in a generally understandable way and clearly distinguish real science from parascience. The GWUP thus wants to contribute to reducing society’s susceptibility to parascientific ideas and promises.
- The GWUP is an internationally orientated society. It is happy to work with like-minded individuals, organisations and institutions.
GWUP stands for ‘Gesellschaft zur wissenschaftlichen Untersuchung von Parawissenschaften’ (Society for the Scientific Investigation of Parasciences). The people currently in charge claim to be scientists but most of them are not (talking about science or publishing books for the lay reader about it does not, in my view, make you a scientist!). The leadership of the GWUP, it seems to me, is currently dominated by small-minded inward-looking guys with no international perspective who are in the middle of a mega-ego trip.
Instead of fighting parascience, they feel entitled to fight their colleagues. Instead of doing their job, they open the door to parascience. Instead of being scientists, they are using skepticism as an excuse for their machinations. Instead of running a scientific organisation, they turned it into a veritable kindergarden. In a nutshell: to the utmost delight of German parascientists, they have completely lost the plot.
I do not believe that the general assembly can turn things around. More likely, matters will get worse and it will come to a complete split. Personally, I cannot – not even until May – remain a member of an organisation where the man officially put in charge of the Twitter account feels entitled to collectively call his opponents ‘ideological clowns who have been playing culture war’. This remark in itself might not be all that significant but, for me, it is the ‘last straw’ and a symptom of a deep and irreversible rot.
So, I have come to the conclusion that I can do my work better without any further GWUP-hindrance. Therefore, I will now email my resignation as a member of the GWUP.
Jennifer Jacobs started publishing peer-reviewed papers on homeopathy in the early 1990s. This happens to be around the same time as I did. So, we both have about 30 years of research into homeopathy behind us.
Jennifer just authored a paper entitled “Thirty Years of Homeopathic Research – Lessons Learned“. Here is its abstract:
Conducting double-blind randomized controlled trials is difficult, even in the allopathic medical system. Doing so within the paradigm of classical homeopathy is even more challenging. More than thirty years of experience in carrying out such trials has taught me much about the pitfalls to avoid as well as the factors that can lead to success. The initial steps of putting together a research protocol, securing funding, and obtaining human subjects’ approval can be daunting. After that comes developing questionnaires and surveys, hiring study personnel, and recruitment of subjects. The actual implementation of the research comes with its own set of possible missteps. Sample size determination, entry criteria, as well as type, frequency and duration of treatment are all crucial. Finally, statistical analysis must be performed to a high standard and a manuscript prepared to submit for publication. Even then there can be one or more manuscript revisions to make, based on feedback from reviewers, before a study is actually published. The entire process can take at least two years and is usually much longer.
Mistakes at any one of these steps can damage the outcome, as well as the impact of the study. With examples from my body of research, I will discuss some of the things that I wish I had done differently, as well as those that turned out to be correct. Homeopathic research is held to a much higher standard than conventional trials. Any flaws in study design, implementation, and analysis can be used by critics to negate the results. I am hopeful that the next generation of homeopathic researchers will learn from my experiences and carry on with great success.
Jennifer’s example motivated me to follow suit and contribute some very brief thoughts about my 30 years of homeopathy research and the lessons I have learnt:
Conducting double-blind randomized controlled trials is difficult in any area of medicine. Yet these types of studies are by far the best way to find out which treatments work and which don’t. Therefore, they need doing, regardless of the obstacles they may pose.
In homeopathy, we now have a large body of such trials. Sadly, not all of them are reliable. Those that are, according to accepted criteria, tend to fail to show that homeopathy works better than a placebo. Understandably, homeopaths are disappointed with this overall result and have made numerous attempts to invalidate it.
The main problem with research into homeopathy is not the research methodology. It is well established for clinical trials and can be easily modified to fit all the demands made by individualised treatment or other pecularities that may apply to homeopathy. The main problem is the homeopath who finds it impossible to accept the truth, namely that highly diluted homeopathic remedies are pure placebos and any observed benefits of homeopathy are due to non-specific effects such as the empathetic encounter or a placebo response.
The lesson to be learned from the past is that, in medicine, even the most obsessive belief, conviction or wishful thinking will eventually have to give way to the scientific evidence. In the case of homeopathy, this process has taken an extraordinary amount of time and effort but, finally, we are almost there and the writing is on the wall for everyone to see.
Two resumes of 30 years of work, research and experience!
And what a difference between them!
Who do you think gets closer to the truth,
Jennifer or I?
Of all the forms of so-called alternative medicine (SCAM), Reiki is amongst the least plausible. It is a form of paranormal or ‘energy healing’ popularised by Japanese Mikao Usui (1865–1926). Reiki is based on the assumptions of Traditional Chinese Medicine and the existence of ‘chi’, the life-force that is assumed to determine our health.
Reiki practitioners believe that, with their hands-on healing method, they can transfer ‘healing energy’ to a patient which, in turn, stimulates the self-healing properties of the body. They assume that the therapeutic effects of this technique are obtained from a ‘universal life energy’ that provides strength, harmony, and balance to the body and mind.
Despite its implausibility, Reiki is used for a very wide range of conditions. Some people are even convinced that it has positive effects on sexuality. But is that really so?
This randomised clinical trial was aimed at finding out. Specifically, its authors wanted to determine the effect of Reiki on sexual function and sexual self-confidence in women with sexual distress*. It was was conducted with women between the ages of 15–49 years who were registered at a family health center in the eastern region of Turkey and had sexual distress.
The sample of the study consisted of 106 women, 53 in the experimental group and 53 in the control group. Women in the experimental group received Reiki once a week for four weeks, while no intervention was applied to those in the control group. Data were collected using the Female Sexual Distress Scale-Revised (FSDS-R), the Arizona Sexual Experiences Scale (ASEX), and the Sexual Self-confidence Scale (SSS).
The levels of sexual distress, sexual function, and sexual self-confidence of women in both groups were similar before the intervention, and the difference between the groups was not statistically significant (p > 0.05). After the Reiki application, the FSDS-R and ASEX mean scores of women in the experimental group significantly decreased, while their SSS mean score significantly increased, and the difference between the groups was statistically significant (p < 0.05).
The authors concluded that Reiki was associated with reduced sexual distress, positive outcomes in sexual functions, and increase sexual self-confidence in women with sexual distress. Healthcare professionals may find Reiki to positively enhance women’s sexuality.
Convinced?
I hope not!
The study has the most obvious of all design flaws: it does not control for a placebo effect, nor the effect of empaty/sympathy received from the therapist, nor the negative impact of learning that you are in the control group and will thus not receive any treatment or attention.
To me, it is obvious that these three factors combined must be able to bring about the observed outcomes. Therefore, I suggest to re-write the conclusions as follows:
The intervention was associated with reduced sexual distress, positive outcomes in sexual functions, and increase sexual self-confidence in women with sexual distress. Considering the biological plausibility of a specific effect of Reiki, the most likely cause for the outcome are non-specific effects of the ritual.
*[Sexual distress refers to persistent, recurrent problems with sexual response, desire, orgasm or pain that distress you or strain your relationship with your partner. Yes, I had to look up the definition of that diagnosis.]
Yes, I often moan about the abundance of poor-quality prevalence surveys that we are confronted with when scanning the literaturee on so-called alternative medicine (SCAM), e.g.:
- The survey mania in so-called alternative medicine prevents progress
- A truly homeopathic survey
- A new survey of CAM-use (or is it a promotion for more nonsense on the NHS?)
- A new chiropractic survey seems to avoid all the potentially embarrassing questions
- Survey-mania in alternative medicine: a fruitless, misleading and counter-productive distraction
Here is another example that recently appeared on my screen and that allows me to explain (yet again) why these surveys are such a waste of space:
The Use of Traditional and Complementary Medicine Among Patients With Multiple Sclerosis in Morocco
Let’s assume the survey is done perfectly (a condition that most are very far from meeting). If the information generated by such a perfect survey were worthwhile, we would also need to consider possible mutations that would be just as relevant:
- We have just over 200 nations (other than Morocco) on the planet.
- I assume there are about 1000 conditions (other than multiple sclerosis) for which SCAM is used.
- There are, I estimate, 100 different definitions of SCAM (other than ‘traditional and complementary medicine’) that all include different modalities.
So, this alone would make 20 000 000 surveys that would be important enough to get published. But that’s not all. The usage and nature of SCAM change fairly quickly. That means we would need these 20 million surveys to be repeated every 2 to 3 years to be up-to-date.
For all this, we would need, I estimate, 200 000 research groups doing the work and about 20 000 SCAM journals to publish their results.
I think we can agree that this would be a nonsensical effort for producing millions of papers reaching dramatic conclusions that read something like this:
Our survey shows that patients suffering from xy living in yz use much SCAM. This level of popularity suggests that SCAM is much appreciated and needs to be made available more widely and free of charge.
I rest my case.
I have been called just about everything during my professional life (not to mention the private one). Yesterday, a new addition arrived: a German psychologist who chose to misunderstand a re-Tweet (or is that re-X these days?), Sebastian Bartoschek, implied I am an anti-Semite.
My re-Tweet quoted without any comment by me a Holocaust survivor stating “The Nazis made me afraid to be a Jew, and the Israelis made me ashamed to be a Jew”.
My re-Tweet was meant to make people reflect critical about the horrendous atrocities that is currently happening in Gaza. However, Bartoschek decided it was anti-semitism and demanded I explain myself. As I had previously had an unpleasantly unproductive encounter over an entirely different matter with him, I did not quite see why I should comply to the wishes of this guy. What followed was a rather ridiculous triade by Bartoschek. It included him alerting DIE WELT that someone who sometimes writes for the paper propagates anti-semitism.
A third party (I don’t know who) must have suggested that this amounts to denunciation. Bartoschek replied: “If asking someone why they share anti-Semitic content is denunciation for you, then so be it.” Eventually he sent me this Tweet:
To EdzardErnst – I’ll wait until 11 a.m. tomorrow, Sunday, for a statement. After that, I’ll write about it without it.
This is why I feel that I am blackmailed. Either I explain what I feel is too obvious to explain, or he will write about the matter in what can be expected to be a defaming way.
Well, I prefer to write about it myself by stating categorically that I am definitely not an anti-semite. What is more, I can prove it. I have since many years published numerous articles (around 30, I guess) that make my position entirely clear; to mention just three:
- The most important paper I ever published
- Killing in the name of healing: the active role of the German medical profession during the Third Reich – PubMed (nih.gov)
- Die grauenhaften Verbrechen des Doktor Karl Brandt – Zeit – derStandard.at › Wissenschaft
So, now it will be great fun to see whether Bartoschek has lost his marbles and what version of the truth he will tell in his own write-up of the story.
WATCH THIS SPACE.
Current interventions for posttraumatic stress disorder (PTSD) are efficacious, yet effectiveness may be limited by adverse effects and high withdrawal rates. Acupuncture is an intervention with some positive preliminary but methodologically flawed data for PTSD. Therefore a new study compared verum acupuncture with sham acupuncture (minimal needling) on clinical and physiological outcomes.
This was a 2-arm, parallel-group, prospective blinded randomized clinical trial hypothesizing superiority of verum to sham acupuncture. The study was conducted at a single outpatient-based site, the Tibor Rubin VA Medical Center in Long Beach, California, with recruitment from April 2018 to May 2022, followed by a 15-week treatment period. Following exclusion for characteristics that are known PTSD treatment confounds, might affect biological assessment, indicate past nonadherence or treatment resistance, or indicate risk of harm, 93 treatment-seeking combat veterans with PTSD aged 18 to 55 years were allocated to group by adaptive randomization and 71 participants completed the intervention protocols.
Verum and sham were provided as 1-hour sessions, twice weekly, and participants were given 15 weeks to complete up to 24 sessions. The primary outcome was pretreatment to posttreatment change in PTSD symptom severity on the Clinician-Administered PTSD Scale-5 (CAPS-5). The secondary outcome was pretreatment to posttreatment change in fear-conditioned extinction, assessed by fear-potentiated startle response. Outcomes were assessed at pretreatment, midtreatment, and posttreatment. General linear models comparing within- and between-group were analyzed in both intention-to-treat (ITT) and treatment-completed models.
A total of 85 male and 8 female veterans (mean [SD] age, 39.2 [8.5] years) were randomized. There was a large treatment effect of verum (Cohen d, 1.17), a moderate effect of sham (d, 0.67), and a moderate between-group effect favoring verum (mean [SD] Δ, 7.1 [11.8]; t90 = 2.87, d, 0.63; P = .005) in the intention-to-treat analysis. The effect pattern was similar in the treatment-completed analysis: verum d, 1.53; sham d, 0.86; between-group mean (SD) Δ, 7.4 (11.7); t69 = 2.64; d, 0.63; P = .01). There was a significant pretreatment to posttreatment reduction of fear-potentiated startle during extinction (ie, better fear extinction) in the verum but not the sham group and a significant correlation (r = 0.31) between symptom reduction and fear extinction. Withdrawal rates were low.
The authors concluded that the acupuncture intervention used in this study was clinically efficacious and favorably affected the psychobiology of PTSD in combat veterans. These data build on extant literature and suggest that clinical implementation of acupuncture for PTSD, along with further research about comparative efficacy, durability, and mechanisms of effects, is warranted.
I am not sure that the authors’ enthusiastic verdict is correct. Its lead author was even quoted stating that his study, which used improved controls, was needed to “definitively” support acupuncture for PTSD. He noted that “acupuncture ought to be considered a potential first-line treatment for PTSD.”
While the study is an improvement on the previous research in this area, it is by no means compelling. My main point of criticism is the nature of the sham acupuncture. Such controls are used to account for placebo effects which, of course, can be considerable in the case of acupuncture.
For this concept to work adequately, the patient and the therapist need to be blinded. In the case of acupuncture, therapist blinding is difficult (but not impossible). In this study, therepists were not blinded. Thus they could have influenced the outcome by verbal and non-verbal clues given to the patient. As acupuncturists inevitably have an interest in the positive result of their study, this effect seems inevitable to me.
More important, however, is the adequate blinding of the patient. In this study, it was attempted by using shallow needling as a sham intervention. Yet, shallow needling can easily distinguished from real acupuncture by the patient. At the very least, patients should be asked what treatment – sham or real – they thought they had received. This did not happen, and we therefore might assume that the effect of patient de-blinding – combined with the confounder described above – was sufficient to bring about the relatively small effect sizes observed by the authors.
One might argue that this does not really matter; all that counts is to alleviate the suffering of the patients, never mind by what mechanism. I think, this would be erroneous. It matters because, if acupuncture itself is ineffective (which I suggest), settling for acupuncture as a first line therapy for PTSD is in nobody’s interest and a disservice to severely suffering patients. It would inhibit meaningful research aimed at finding an optimal therapy (one that works beyond placebo) and be a waste of resources.
