study design

The question whether spinal manipulative therapy (SMT) has any specific therapeutic effects is still open. This fact must irritate ardent chiropractors, and they therefore try everything to dispel our doubts. One way would be to demonstrate a dose-effect relationship between SMT and the clinical outcome. But, for several reasons, this is not an easy task.

This RCT was aimed at identifying the dose-response relationship between visits for SMT and chronic cervicogenic headache (CGH) outcomes; to evaluate the efficacy of SMT by comparison with a light massage control.

The study included 256 adults with chronic CGH. The primary outcome was days with CGH in the prior 4 weeks evaluated at the 12- and 24-week primary endpoints. Secondary outcomes included CGH days at remaining endpoints, pain intensity, disability, perceived improvement, medication use, and patient satisfaction. Participants were randomized to 4 different dose levels of chiropractic SMT: 0, 6, 12, or 18 sessions. They were treated 3 times per week for 6 weeks and received a focused light-massage control at sessions when SMT was not assigned. Linear dose effects and comparisons to the no-manipulation control group were evaluated at 6, 12, 24, 39, and 52 weeks.

A linear dose-response was observed for all follow-ups, a reduction of approximately 1 CGH day/4 weeks per additional 6 SMT visits (p<.05); a maximal effective dose could not be determined. CGH days/4 weeks were reduced from about 16 to 8 for the highest and most effective dose of 18 SMT visits. Mean differences in CGH days/4 weeks between 18 SMT visits and control were -3.3 (p=.004) and -2.9 (p=.017) at the primary endpoints, and similar in magnitude at the remaining endpoints (p<.05). Differences between other SMT doses and control were smaller in magnitude (p > .05). CGH intensity showed no important improvement nor differed by dose. Other secondary outcomes were generally supportive of the primary.

The authors concluded that there was a linear dose-response relationship between SMT visits and days with CGH. For the highest and most effective dose of 18 SMT visits, CGH days were reduced by half, and about 3 more days per month than for the light-massage control.

This trial would make sense, if the effectiveness of SMT for CGH had been a well-documented fact, and if the study had rigorously controlled for placebo-effects.

But guess what?

Neither of these conditions were met.

A recent review concluded that there are few published randomized controlled trials analyzing the effectiveness of spinal manipulation and/or mobilization for TTH, CeH, and M in the last decade. In addition, the methodological quality of these papers is typically low. Clearly, there is a need for high-quality randomized controlled trials assessing the effectiveness of these interventions in these headache disorders. And this is by no means the only article making such statements; similar reviews arrive at similar conclusions. In turn, this means that the effects observed after SMT are not necessarily specific effects due to SMT but could easily be due to placebo or other non-specific effects. In order to avoid confusion, one would need a credible placebo – one that closely mimics SMT – and make sure that patients were ‘blinded’. But ‘light massage’ clearly does not mimic SMT, and patients obviously were aware of which interventions they received.

So, an alternative – and I think at least as plausible – conclusion of the data provided by this new RCT is this:

Chiropractic SMT is associated with a powerful placebo response which, of course, obeys a dose-effect relationship. Thus these findings are in keeping with the notion that SMT is a placebo.

And why would the researchers – who stress that they have no conflicts of interest – mislead us by making this alternative interpretation of their findings not abundantly clear?

I fear, the reason might be simple: they also seem to mislead us about their conflicts of interest: they are mostly chiropractors with a long track record of publishing promotional papers masquerading as research. What, I ask myself, could be a stronger conflict of interest?

(Pity that a high-impact journal like SPINE did not spot these [not so little] flaws)

Sipjeondaebo-tang is an East Asian herbal supplement containing Angelica root (Angelicae Gigantis Radix), the rhizome of Cnidium officinale Makino (Cnidii Rhizoma), Radix Paeoniae, Rehmannia glutinosa root (Rehmanniae Radix Preparata), Ginseng root (Ginseng Radix Alba), Atractylodes lancea root (Atractylodis Rhizoma Alba), the dried sclerotia of Poria cocos (Poria cocos Sclerotium), Licorice root (Glycyrrhizae Radix), Astragalus root (Astragali Radix), and the dried bark of Cinnamomum verum (Cinnamomi Cortex).

But does this herbal mixture actually work? Korean researchers wanted to find out.

The purpose of their study was to examine the feasibility of Sipjeondaebo-tang (Juzen-taiho-to, Shi-Quan-Da-Bu-Tang) for cancer-related anorexia. A total of 32 participants with cancer anorexia were randomized to either Sipjeondaebo-tang group or placebo group. Participants were given 3 g of Sipjeondaebo-tang or placebo 3 times a day for 4 weeks. The primary outcome was a change in the Anorexia/Cachexia Subscale of Functional Assessment of Anorexia/Cachexia Therapy (FAACT). The secondary outcomes included Visual Analogue Scale (VAS) of anorexia, FAACT scale, and laboratory tests.

The results showed that anorexia and quality of life measured by FAACT and VAS were improved after 4 weeks of Sipjeondaebo-tang treatment. However, there was no significant difference between changes of Sipjeondaebo-tang group and placebo group.

From this, the authors of the study concluded that sipjeondaebo-tang appears to have potential benefit for anorexia management in patients with cancer. Further large-scale studies are needed to ensure the efficacy.

Well, isn’t this just great? Faced with a squarely negative result, one simply ignores it and draws a positive conclusion!

As we all know – and as trialists certainly must know – controlled trials are designed to compare the outcomes of two groups. Changes within one of the groups can be caused by several factors unrelated to the therapy and are therefore largely irrelevant. This means that “no significant difference between changes of Sipjeondaebo-tang group and placebo group” indicates that the herbal mixture had no effect. In turn this means that a conclusion stating that “sipjeondaebo-tang appears to have potential benefit for anorexia” is just fraudulent.

This level of scientific misconduct is remarkable, even for the notoriously poor 

I strongly suggest that:

  1. The journal is de-listed from Medline because similarly misleading nonsense has been coming out of this rag for some time.
  2. The paper is withdrawn because it can only mislead vulnerable patients.

Cranio-sacral therapy is firstly implausible, and secondly it lacks evidence of effectiveness (see for instance here, here, here and here). Yet, some researchers are nevertheless not deterred to test it in clinical trials. While this fact alone might be seen as embarrassing, the study below is a particular and personal embarrassment to me, in fact, I am shocked by it and write these lines with considerable regret.

Why? Bear with me, I will explain later.

The purpose of this trial was to evaluate the effectiveness of osteopathic manipulative treatment and osteopathy in the cranial field in temporomandibular disorders. Forty female subjects with temporomandibular disorders lasting at least three months were included. At enrollment, subjects were randomly assigned into two groups: (1) osteopathic manipulative treatment group (n=20) and (2) osteopathy in the cranial field [craniosacral therapy for you and me] group (n=20). Examinations were performed at baseline (E0) and at the end of the last treatment (E1), and consisted of subjective pain intensity with the Visual Analog Scale, Helkimo Index and SF-36 Health Survey. Subjects had five treatments, once a week. 36 subjects completed the study.

Patients in both groups showed significant reduction in Visual Analog Scale score (osteopathic manipulative treatment group: p = 0.001; osteopathy in the cranial field group: p< 0.001), Helkimo Index (osteopathic manipulative treatment group: p = 0.02; osteopathy in the cranial field group: p = 0.003) and a significant improvement in the SF-36 Health Survey – subscale “Bodily Pain” (osteopathic manipulative treatment group: p = 0.04; osteopathy in the cranial field group: p = 0.007) after five treatments (E1). All subjects (n = 36) also showed significant improvements in the above named parameters after five treatments (E1): Visual Analog Scale score (p< 0.001), Helkimo Index (p< 0.001), SF-36 Health Survey – subscale “Bodily Pain” (p = 0.001). The differences between the two groups were not statistically significant for any of the three endpoints.

The authors concluded that both therapeutic modalities had similar clinical results. The findings of this pilot trial support the use of osteopathic manipulative treatment and osteopathy in the cranial field as an effective treatment modality in patients with temporomandibular disorders. The positive results in both treatment groups should encourage further research on osteopathic manipulative treatment and osteopathy in the cranial field and support the importance of an interdisciplinary collaboration in patients with temporomandibular disorders. Implications for rehabilitation Temporomandibular disorders are the second most prevalent musculoskeletal condition with a negative impact on physical and psychological factors. There are a variety of options to treat temporomandibular disorders. This pilot study demonstrates the reduction of pain, the improvement of temporomandibular joint dysfunction and the positive impact on quality of life after osteopathic manipulative treatment and osteopathy in the cranial field. Our findings support the use of osteopathic manipulative treatment and osteopathy in the cranial field and should encourage further research on osteopathic manipulative treatment and osteopathy in the cranial field in patients with temporomandibular disorders. Rehabilitation experts should consider osteopathic manipulative treatment and osteopathy in the cranial field as a beneficial treatment option for temporomandibular disorders.

This study has so many flaws that I don’t know where to begin. Here are some of the more obvious ones:

  • There is, as already mentioned, no rationale for this study. I can see no reason why craniosacral therapy should work for the condition. Without such a rationale, the study should never even have been conceived.
  • Technically,  this RCTs an equivalence study comparing one therapy against another. As such it needs to be much larger to generate a meaningful result and it also would require a different statistical approach.
  • The authors mislabelled their trial a ‘pilot study’. However, a pilot study “is a preliminary small-scale study that researchers conduct in order to help them decide how best to conduct a large-scale research project. Using a pilot study, a researcher can identify or refine a research question, figure out what methods are best for pursuing it, and estimate how much time and resources will be necessary to complete the larger version, among other things.” It is not normally a study suited for evaluating the effectiveness of a therapy.
  • Any trial that compares one therapy of unknown effectiveness to another of unknown effectiveness is a complete and utter nonsense. Equivalent studies can only ever make sense, if one of the two treatments is of proven effectiveness – think of it as a mathematical equation: one equation with two unknowns is unsolvable.
  • Controlled studies such as RCTs are for comparing the outcomes of two or more groups, and only between-group differences are meaningful results of such trials.
  • The ‘positive results’ which the authors mention in their conclusions are meaningless because they are based on such within-group changes and nobody can know what caused them: the natural history of the condition, regression towards the mean, placebo-effects, or other non-specific effects – take your pick.
  • The conclusions are a bonanza of nonsensical platitudes and misleading claims which do not follow from the data.

As regular readers of this blog will doubtlessly have noticed, I have seen plenty of similarly flawed pseudo-research before – so, why does this paper upset me so much? The reason is personal, I am afraid: even though I do not know any of the authors in person, I know their institution more than well. The study comes from the Department of Physical Medicine and Rehabilitation, Medical University of Vienna, Austria. I was head of this department before I left in 1993 to take up the Exeter post. And I had hoped that, even after 25 years, a bit of the spirit, attitude, knowhow, critical thinking and scientific rigor – all of which I tried so hard to implant in my Viennese department at the time – would have survived.

Perhaps I was wrong.

Many hard-nosed sceptics might claim that there is no herbal treatment for upper respiratory infections that makes the slightest difference difference. But is this assumption really correct?

According to my own research of 2004, it is not. Here is the abstract of our systematic review:

Acute respiratory infections represent a significant cause of over-prescription of antibiotics and are one of the major reasons for absence from work. The leaves of Andrographis paniculata (Burm. f.) Wall ex Nees (Acanthaceae) are used as a medicinal herb in the treatment of infectious diseases. Systematic literature searches were conducted in six computerised databases and the reference lists of all papers located were checked for further relevant publications. Information was also requested from manufacturers, the spontaneous reporting schemes of the World Health Organisation and national drug safety bodies. No language restrictions were imposed. Seven double-blind, controlled trials (n = 896) met the inclusion criteria for evaluation of efficacy. All trials scored at least three, out of a maximum of five, for methodological quality on the Jadad scale. Collectively, the data suggest that A. paniculata is superior to placebo in alleviating the subjective symptoms of uncomplicated upper respiratory tract infection. There is also preliminary evidence of a preventative effect. Adverse events reported following administration of A. paniculata were generally mild and infrequent. There were few spontaneous reports of adverse events. A. paniculata may be a safe and efficacious treatment for the relief of symptoms of uncomplicated upper respiratory tract infection; more research is warranted.

A. Paniculata (Burm.f.) Wall ex Nees (Acanthaceae family), also known as nemone chinensi, Chuān Xīn Lián, has traditionally been used in Indian and Chinese herbal medicine mostly as an antipyretic for relieving and reducing the severity and duration of symptoms of common colds and alleviating fever, cough and sore throats, or as a tonic to aid convalescence after uncomplicated respiratory tract infections. The active constituents of A. paniculata include the diterpene, lactones commonly known as the andrographolides which have shown anti-inflammatory, antiviral, anti-allergic, and immune-stimulatory activities. A. Paniculata has also been shown, in vitro, to be effective against avian influenza A (H9N2 and H5N1) and human influenza A H1N1 viruses, possibly through blocking the binding of viral hemagglutinin to cells, or by inhibiting H1N1 virus-induced cell death.

But our systematic review was published 14 years ago!

We need more up-to-date information!

And I am pleased to report that a recent paper provided exactly that.

This systematic review included published and unpublished RCTs. Quasi-RCTs, crossover trials, controlled before and after studies, interrupted time series (ITS) studies, and non-experimental studies were not included due to their potential high risk of bias.

Thirty-three trials involving 7175 patients with ARTIs were included. Their methodological quality was restricted as randomisation was not well documented; 73% of the trials included were not blinded; where ITT analysis were performed, loss to follow-up data were counted as no effect; and most trials were published without a protocol available.

Findings suggested limited but consistent evidence that A. Paniculata improved cough and sore throat when compared with placebo. A. Paniculata (alone or plus usual care) had a statistically significant effect in improving overall symptoms of ARTIs when compared to placebo, usual care, and other herbal therapies. A. Paniculata in pillule tended to be more effective in improving overall symptoms over A. Paniculata in tablet. Evidence also suggested that A. Paniculata (alone or plus usual care) shortens the duration of cough, sore throat and sick leave/time to resolution when compared versus usual care. Reduction in antibiotic usage was seldom evaluated in the included trials.

The authors concluded that A. Paniculata appears beneficial and safe for relieving ARTI symptoms and shortening time to symptom resolution. However, these findings should be interpreted cautiously owing to poor study quality and heterogeneity. Well-designed trials evaluating the effectiveness and potential to reduce antibiotic use of A. Paniculata are warranted.

In case you wonder about conflicts of interest: there were none with my 2004 paper, and the authors of the new review state that this paper presents independent research funded by the National Institute for Health Research School for Primary Care Research (NIHR SPCR). The views expressed are those of the author(s) and not necessarily those of the NIHR, the NHS or the Department of Health.

Yes, the RCTs are not all of top quality.

And yes, the effect size is not huge.

But maybe – just maybe – we do have here an alternative therapy that does help against a condition for which conventional drugs are fairly useless!?!

The aim of this three-armed, parallel, randomized exploratory study was to determine, if two types of acupuncture (auricular acupuncture [AA] and traditional Chinese acupuncture [TCA]) were feasible and more effective than usual care (UC) alone for TBI–related headache. The subjects were previously deployed Service members (18–69 years old) with mild-to-moderate TBI and headaches. The interventions explored were UC alone or with the addition of AA or TCA. The primary outcome was the Headache Impact Test (HIT). Secondary outcomes were the Numerical Rating Scale (NRS), Pittsburgh Sleep Quality Index, Post-Traumatic Stress Checklist, Symptom Checklist-90-R, Medical Outcome Study Quality of Life (QoL), Beck Depression Inventory, State-Trait Anxiety Inventory, the Automated Neuropsychological Assessment Metrics, and expectancy of outcome and acupuncture efficacy.

Mean HIT scores decreased in the AA and TCA groups but increased slightly in the UC-only group from baseline to week 6 [AA, −10.2% (−6.4 points); TCA, −4.6% (−2.9 points); UC, +0.8% (+0.6 points)]. Both acupuncture groups had sizable decreases in NRS (Pain Best), compared to UC (TCA versus UC: P = 0.0008, d = 1.70; AA versus UC: P = 0.0127, d = 1.6). No statistically significant results were found for any other secondary outcome measures.

The authors concluded that both AA and TCA improved headache-related QoL more than UC did in Service members with TBI.

The stated aim of this study (to determine whether AA or TCA both with UC are more effective than UC alone) does not make sense and should therefore never have passed ethics review, in my view. The RCT followed a design which essentially is the much-lamented ‘A+B versus B’ protocol (except that a further groups ‘C+B’ was added). The nature of such designs is that there is no control for placebo effects, the extra time and attention, etc. Therefore, such studies cannot fail but generate positive results, even if the tested intervention is a placebo. In such trials, it is impossible to attribute any outcome to the experimental treatment. This means that the positive results are known before the first patient has been enrolled; hence they are an unethical waste of resources which can only serve one purpose: to mislead us. It also means that the conclusions drawn above are not correct.

An alternative and in my view more accurate conclusion would be this one: both AA and TCA had probably no effect; the improved headache-related QoL was due to the additional attention and expectation in the two experimental groups and is unrelated to the interventions tested in this study.

In our new book, MORE HARM THAN GOOD, we discuss that such trials are deceptive to the point of being unethical. Considering the prominence and experience of Wayne Jonas, the 1st author of this paper, such obvious transgression is more than a little disappointing – I would argue that is amounts to overt scientific misconduct.

Can conventional therapy (CT) be combined with herbal therapy (CT + H) in the management of Alzheimer’s disease (AD) to the benefit of patients? This was the question investigated by Chinese researchers in a recent retrospective cohort study funded by grants from China Ministry of Education, National Natural Science Foundation of China, Beijing Municipal Science and Technology Commission, and Beijing Municipal Commission of Health and Family Planning.

In total, 344 outpatients diagnosed as probable dementia due to AD were collected, who had received either CT + H or CT alone. The GRAPE formula was prescribed for AD patients after every visit according to TCM theory. It consisted mainly (what does ‘mainly’ mean as a description of a trial intervention?) of Ren shen (Panax ginseng, 10 g/d), Di huang (Rehmannia glutinosa, 30 g/d), Cang pu (Acorus tatarinowii, 10 g/d), Yuan zhi (Polygala tenuifolia, 10 g/d), Yin yanghuo (Epimedium brevicornu, 10 g/d), Shan zhuyu (Cornus officinalis, 10 g/d), Rou congrong (Cistanche deserticola, 10 g/d), Yu jin (Curcuma aromatica, 10 g/d), Dan shen (Salvia miltiorrhiza, 10 g/d), Dang gui (Angelica sinensis, 10 g/d), Tian ma (Gastrodia elata, 10 g/d), and Huang lian (Coptis chinensis, 10 g/d), supplied by Beijing Tcmages Pharmaceutical Co., LTD. Daily dose was taken twice and dissolved in 150 ml hot water each time. Cognitive function was quantified by the mini-mental state examination (MMSE) every 3 months for 24 months.

The results show that most of the patients were initially diagnosed with mild (MMSE = 21-26, n = 177) and moderate (MMSE = 10-20, n = 137) dementia. At 18 months, CT+ H patients scored on average 1.76 (P = 0.002) better than CT patients, and at 24 months, patients scored on average 2.52 (P < 0.001) better. At 24 months, the patients with improved cognitive function (△MMSE ≥ 0) in CT + H was more than CT alone (33.33% vs 7.69%, P = 0.020). Interestingly, patients with mild AD received the most robust benefit from CT + H therapy. The deterioration of the cognitive function was largely prevented at 24 months (ΔMMSE = -0.06), a significant improvement from CT alone (ΔMMSE = -2.66, P = 0.005).


The authors concluded that, compared to CT alone, CT + H significantly benefited AD patients. A symptomatic effect of CT + H was more pronounced with time. Cognitive decline was substantially decelerated in patients with moderate severity, while the cognitive function was largely stabilized in patients with mild severity over two years. These results imply that Chinese herbal medicines may provide an alternative and additive treatment for AD.

Conclusions like these render me speechless – well, almost speechless. This was nothing more than a retrospective chart analysis. It is not possible to draw causal conclusions from such data.


Because of a whole host of reasons. Most crucially, the CT+H patients were almost certainly a different and therefore non-comparable population to the CT patients. This flaw is so elementary that I need to ask, who are the reviewers letting such utter nonsense pass, and which journal would publish such rubbish? In fact, I can be used for teaching students why randomisation is essential, if we aim to find out about cause and effect.

Ahhh, it’s the ! I think the funders, editors, reviewers, and authors of this paper should all go and hide in shame.

This randomized controlled trial was aimed to investigate the effect of aromatherapy massage on anxiety, depression, and physiologic parameters in older patients with acute coronary syndrome. It was conducted on 90 older women with acute coronary syndrome. The participants were randomly assigned into the intervention and control groups. The intervention group received reflexology with lavender essential oil plus routine care and the control group only received routine care. Physiologic parameters, the levels of anxiety and depression in the hospital were evaluated using a checklist and the Hospital’s Anxiety and Depression Scale, respectively, before and immediately after the intervention.

Significant differences in the levels of anxiety and depression were reported between the groups after the intervention. The analysis of physiological parameters revealed a statistically significant reduction in systolic blood pressure, diastolic blood pressure, mean arterial pressure, and heart rate. However, no significant difference was observed in the respiratory rate.

The authors concluded that aromatherapy massage can be considered by clinical nurses an efficient therapy for alleviating psychological and physiological responses among older women suffering from acute coronary syndrome.


This trial does not show remotely what the authors think. It demonstrates that A+B is always more than B. We have discussed this phenomenon so often that I hesitate to mention it again. Any study with the ‘A+B versus B’ design can only produce a positive result. The danger that this result is false-positive is so high that it is best to forget about such investigations altogether.

Ethics committees should not accept such protocols.

Researchers should stop running such studies.

Reviewers should not pass them for publication.

Editors should not publish such trials.


Gastro-oesophageal reflux disease (GORD) is a common, benign condition. It can be treated by changing eating habits or drugs. Many alternative therapies are also on offer, for instance, acupuncture. But does it work? Let’s find out.

The objective of this meta-analysis was to explore the effectiveness of acupuncture for the treatment of gastro-oesophageal reflux disease (GORD). Four English and four Chinese databases were searched through June 2016. Randomised controlled trials investigating the effectiveness of manual acupuncture or electroacupuncture (MA/EA) for GORD versus or as an adjunct to Western medicine (WM) were selected.

A total of 12 trials involving 1235 patients were included. The results demonstrated that patients receiving MA/EA combined with WM had a superior global symptom improvement compared with those receiving WM alone  with no significant heterogeneity. Recurrence rates of those receiving MA/EA alone were lower than those receiving WM  with low heterogeneity, while global symptom improvement (six studies) and symptom scores (three studies) were similar. Descriptive analyses suggested that acupuncture also improves quality of life in patients with GORD.

The authors concluded that this meta-analysis suggests that acupuncture is an effective and safe treatment for GORD. However, due to the small sample size and poor methodological quality of the included trials, further studies are required to validate our conclusions.

I am glad the authors used the verb ‘suggest’ in their conclusions. In fact, even this cautious terminology is too strong, in my view. Here are 9 reasons why:

  1. The hypothesis that acupuncture is effective for GORD lacks plausibility.
  2. All the studies were of poor or very poor methodological quality.
  3. All but one were from China, and we know that all acupuncture trials from this country are positive, thus casting serious doubt on their validity.
  4. Six trials had the infamous ‘A+B versus B’ design which never generates a negative result.
  5. There was evidence of publication bias, i. e. negative trials had disappeared and were thus not included in the meta-analysis.
  6. None of the trials made an attempt to control for placebo effects by using a sham-control procedure.
  7. None used patient-blinding.
  8. The safety of a therapy cannot be assessed on the basis of 12 trials
  9. Seven studies failed to report adverse effects, thus violating research ethics.

Considering these facts, I think that a different conclusion would have been more appropriate:  this meta-analysis provides no good evidence for the assumption that acupuncture is an effective and safe treatment for GORD.

The claims that are being made for the health benefits of Chinese herbal medicine are impressive. I am not sure that there is even a single human disease that is not alleged to be curable with the use of some Chinese herbal mixture. I find this worrying because some patients might actually believe such outrageous nonsense, particularly since Chinese researchers seem to bend over backwards to support them with science… or should I say pseudoscience?

This study was aimed at evaluating the association between mortality rate and early use of Chinese herbal products (CHPs) among patients with lung cancer. The researchers conducted a retrospective cohort study based on the National Health Insurance Research Database, Taiwan Cancer Registry, and Cause of Death Data. Patients with newly diagnosed lung cancer between 2002 and 2010 were classified as either the CHP (n = 422) or the non-CHP group (n = 2828) based on whether they used CHP within 3 months after first diagnosis of lung cancer. A Cox regression model was used to examine the hazard ratio (HR) of death for propensity score (PS) matching samples.

After PS matching, average survival time of the CHP group was significantly longer than that of the non-CHP group. The adjusted HR (0.82; 95% CI: 0.73-0.92) in the CHP group was lower than the non-CHP group. Stratified by clinical cancer stages, CHP group had longer survival time in the stage 3 subgroup. When the exposure period of CHP use was changed from 3 to 6 months, results remained similar.

The authors concluded that results indicated that patients with lung cancer who used CHP within 3 months after first diagnosis had a lower hazard of death than non-CHP users, especially for stage 3 lung cancer. Further experimental studies are needed to examine the causal relationship.

I would argue the direct opposite: further studies along these lines would be a waste of time!

I can name numerous reasons for this, for example:

  • Investigating CHP as though it is one entity is nonsense. There are thousands of different CHPs; some are placebos; some are toxic; and a few might even have some health effects.
  • The observed effect is almost certainly an artefact; the matching of the groups might have been sub-optimal; the CHP group differed systematically from the control group, for instance, by adhering to a healthier life-style; etc, etc.

All of this should be so obvious that it hardly deserves a mention. Why then do the authors not point it out prominently and clearly? Why did they ever embark on such a fatally flawed project? I cannot be sure, of course, … but perhaps one possible answer might be that the lead author is affiliated to a Department of Chinese Medicine?


The purpose of the study was to compare utilization of conventional psychotropic drugs among patients seeking care for anxiety and depression disorders (ADDs) from general practitioners (GPs) who

  • strictly prescribe conventional medicines (GP-CM),
  • regularly prescribe homeopathy in a mixed practice (GP-Mx),
  • or are certified homeopathic GPs (GP-Ho).

The investigation was an epidemiological cohort study of general practice in France, which included GPs and their patients consulting for ADDs (scoring 9 or more in the Hospital Anxiety and Depression Scale, HADS). Information on all medication utilization was obtained by a standardised telephone interview at inclusion, 1, 3 and 12 months.

Of 1562 eligible patients consulting for ADDs, 710 (45.5 %) agreed to participate. Adjusted multivariate analyses showed that GP-Ho and GP-Mx patients were less likely to use psychotropic drugs over 12 months, compared to GP-CM patients. The rate of clinical improvement (HADS <9) was marginally superior for the GP-Ho group as compared to the GP-CM group, but not for the GP-Mx group.

The authors concluded that patients with ADD, who chose to consult GPs prescribing homeopathy reported less use of psychotropic drugs, and were marginally more likely to experience clinical improvement, than patients managed with conventional care. Results may reflect differences in physicians’ management and patients’ preferences as well as statistical regression to the mean.

Aren’t we glad they added the last sentence to their conclusion!!!

Without it, one might have thought that the observed differences were due to the homeopathic remedies. In fact, the finding amounts to a self-fulfilling prophecy: Homeopaths tend to be against prescribing conventional drugs. This means that patients consulting homeopaths are bound to use less drugs than patients who consult conventional doctors. In that sense, the study was like monitoring whether consumers who go to the butchers buy more meat than those shopping in a shop for vegetarians.

The only result that requires a more serious consideration is that homeopathically treated patients experienced more clinical improvement than those treated conventionally. But even this difference is not hard to explain: firstly, the difference was merely marginal; secondly, patients with ADD are bound to respond particularly well to the empathetic and long therapeutic encounter most homeopaths offer. In other words, the difference had nothing to do with the alleged effectiveness of the homeopathic remedies.

Recent Comments

Note that comments can be edited for up to five minutes after they are first submitted.

Click here for a comprehensive list of recent comments.