The chiropractor Oakley Smith had graduated under D D Palmer in 1899. Smith was a former Iowa medical student who also had investigated Andrew Still’s osteopathy in Kirksville, before going to Palmer in Davenport. Eventually, Smith came to reject the Palmer concept of vertebral subluxation and developed his own concept of “the connective tissue doctrine” or naprapathy. Today, naprapathy is a popular form of manual therapy, particularly in Scandinavia and the US.
But what exactly is naprapathy? This website explains it quite well: Naprapathy is defined as a system of specific examination, diagnostics, manual treatment and rehabilitation of pain and dysfunction in the neuromusculoskeletal system. The therapy is aimed at restoring function through treatment of the connective tissue, muscle- and neural tissues within or surrounding the spine and other joints. Naprapathic treatment consists of combinations of manual techniques for instance spinal manipulation and mobilization, neural mobilization and Naprapathic soft tissue techniques, in additional to the manual techniques Naprapaths uses different types of electrotherapy, such as ultrasound, radial shockwave therapy and TENS. The manual techniques are often combined with advice regarding physical activity and ergonomics as well as medical rehabilitation training in order to decrease pain and disability and increase work ability and quality of life. A Dr. of Naprapathy is specialized in the diagnosis of structural and functional neuromusculoskeletal disorders, treatment and rehabilitation of patients with problems of such origin as well as to differentiate pain of other origin.
DOCTOR OF NAPRAPATHY? I hear you shout.
Yes, in the US, the title exists: The National College of Naprapathic Medicine is chartered by the State of Illinois and recognized by the State Board of Higher Education to grant the degree, Doctor of Naprapathy (D.N.). Graduates of the College are eligible to take the Naprapathic Medicine examination for licensure in the State of Illinois. The D.N. Degree requires:
- 66 hours – Basic Sciences
- 64 hours – Naprapathic Sciences
- 60 hours – Clinical Internship
Things become even stranger when we ask, what does the evidence show?
I found all of three clinical trials on Medline.
A 2016 clinical trial was designed to compare the treatment effect on pain intensity, pain related disability and perceived recovery from a) naprapathic manual therapy (spinal manipulation, spinal mobilization, stretching and massage) to b) naprapathic manual therapy without spinal manipulation and to c) naprapathic manual therapy without stretching for male and female patients seeking care for back and/or neck pain.
Participants were recruited among patients, ages 18-65, seeking care at the educational clinic of Naprapathögskolan – the Scandinavian College of Naprapathic Manual Medicine in Stockholm. The patients (n = 1057) were randomized to one of three treatment arms a) manual therapy (i.e. spinal manipulation, spinal mobilization, stretching and massage), b) manual therapy excluding spinal manipulation and c) manual therapy excluding stretching. The primary outcomes were minimal clinically important improvement in pain intensity and pain related disability. Treatments were provided by naprapath students in the seventh semester of eight total semesters. Generalized estimating equations and logistic regression were used to examine the association between the treatments and the outcomes.
At 12 weeks follow-up, 64% had a minimal clinically important improvement in pain intensity and 42% in pain related disability. The corresponding chances to be improved at the 52 weeks follow-up were 58% and 40% respectively. No systematic differences in effect when excluding spinal manipulation and stretching respectively from the treatment were found over 1 year follow-up, concerning minimal clinically important improvement in pain intensity (p = 0.41) and pain related disability (p = 0.85) and perceived recovery (p = 0.98). Neither were there disparities in effect when male and female patients were analyzed separately.
The authors concluded that the effect of manual therapy for male and female patients seeking care for neck and/or back pain at an educational clinic is similar regardless if spinal manipulation or if stretching is excluded from the treatment option.
Even though this study is touted as showing that naprapathy works by advocates, in all honesty, it tells us as good as nothing about the effect of naprapathy. The data are completely consistent with the interpretation that all of the outcomes were to the natural history of the conditions, regression towards the mean, placebo, etc. and entirely unrelated to any specific effects of naprapathy.
A 2010 study by the same group was to compare the long-term effects (up to one year) of naprapathic manual therapy and evidence-based advice on staying active regarding non-specific back and/or neck pain.
Subjects with non-specific pain/disability in the back and/or neck lasting for at least two weeks (n = 409), recruited at public companies in Sweden, were included in this pragmatic randomized controlled trial. The two interventions compared were naprapathic manual therapy such as spinal manipulation/mobilization, massage and stretching, (Index Group), and advice to stay active and on how to cope with pain, provided by a physician (Control Group). Pain intensity, disability and health status were measured by questionnaires.
89% completed the 26-week follow-up and 85% the 52-week follow-up. A higher proportion in the Index Group had a clinically important decrease in pain (risk difference (RD) = 21%, 95% CI: 10-30) and disability (RD = 11%, 95% CI: 4-22) at 26-week, as well as at 52-week follow-ups (pain: RD = 17%, 95% CI: 7-27 and disability: RD = 17%, 95% CI: 5-28). The differences between the groups in pain and disability considered over one year were statistically significant favoring naprapathy (p < or = 0.005). There were also significant differences in improvement in bodily pain and social function (subscales of SF-36 health status) favoring the Index Group.
The authors concluded that combined manual therapy, like naprapathy, is effective in the short and in the long term, and might be considered for patients with non-specific back and/or neck pain.
This study is hardly impressive either. The results are consistent with the interpretation that the extra attention and care given to the index group was the cause of the observed outcomes, unrelated to ant specific effects of naprapathy.
The last study was published in 2017 again by the same group. It was designed to compare naprapathic manual therapy with evidence-based care for back or neck pain regarding pain, disability, and perceived recovery.
Four hundred and nine patients with pain and disability in the back or neck lasting for at least 2 weeks, recruited at 2 large public companies in Sweden in 2005, were included in this randomized controlled trial. The 2 interventions were naprapathy, including spinal manipulation/mobilization, massage, and stretching (Index Group) and support and advice to stay active and how to cope with pain, according to the best scientific evidence available, provided by a physician (Control Group). Pain, disability, and perceived recovery were measured by questionnaires at baseline and after 3, 7, and 12 weeks.
At 7-week and 12-week follow-ups, statistically significant differences between the groups were found in all outcomes favoring the Index Group. At 12-week follow-up, a higher proportion in the naprapathy group had improved regarding pain [risk difference (RD)=27%, 95% confidence interval (CI): 17-37], disability (RD=18%, 95% CI: 7-28), and perceived recovery (RD=44%, 95% CI: 35-53). Separate analysis of neck pain and back pain patients showed similar results.
The authors thought that this trial suggests that combined manual therapy, like naprapathy, might be an alternative to consider for back and neck pain patients.
As the study suffers from the same limitations as the one above (in fact, it might be a different analysis of the same trial), they might be mistaken. I see no good reason to assume that any of the three studies provide good evidence for the effectiveness of naprapathy.
So, what should we conclude from all this?
If you ask me, naprapathy is something between chiropractic (without some of the woo) and physiotherapy (without its expertise). There is no good evidence that it works. Crucially, there is no evidence that it is superior to other therapeutic options.
I was going to finish on a positive note stating that ‘at least the ‘naprapathologists’ (I refuse to even consider the title of ‘doctor of naprapathy’) do not claim to treat conditions other than musculoskeletal problems’. But then I found this advertisement of a ‘naprapathologist’ on Twitter:
And now, I am going to finish by stating that A LOT OF NAPRAPATHY LOOKS VERY MUCH LIKE QUACKERY TO ME.
Sipjeondaebo-tang is an East Asian herbal supplement containing Angelica root (Angelicae Gigantis Radix), the rhizome of Cnidium officinale Makino (Cnidii Rhizoma), Radix Paeoniae, Rehmannia glutinosa root (Rehmanniae Radix Preparata), Ginseng root (Ginseng Radix Alba), Atractylodes lancea root (Atractylodis Rhizoma Alba), the dried sclerotia of Poria cocos (Poria cocos Sclerotium), Licorice root (Glycyrrhizae Radix), Astragalus root (Astragali Radix), and the dried bark of Cinnamomum verum (Cinnamomi Cortex).
But does this herbal mixture actually work? Korean researchers wanted to find out.
The purpose of their study was to examine the feasibility of Sipjeondaebo-tang (Juzen-taiho-to, Shi-Quan-Da-Bu-Tang) for cancer-related anorexia. A total of 32 participants with cancer anorexia were randomized to either Sipjeondaebo-tang group or placebo group. Participants were given 3 g of Sipjeondaebo-tang or placebo 3 times a day for 4 weeks. The primary outcome was a change in the Anorexia/Cachexia Subscale of Functional Assessment of Anorexia/Cachexia Therapy (FAACT). The secondary outcomes included Visual Analogue Scale (VAS) of anorexia, FAACT scale, and laboratory tests.
The results showed that anorexia and quality of life measured by FAACT and VAS were improved after 4 weeks of Sipjeondaebo-tang treatment. However, there was no significant difference between changes of Sipjeondaebo-tang group and placebo group.
From this, the authors of the study concluded that sipjeondaebo-tang appears to have potential benefit for anorexia management in patients with cancer. Further large-scale studies are needed to ensure the efficacy.
Well, isn’t this just great? Faced with a squarely negative result, one simply ignores it and draws a positive conclusion!
As we all know – and as trialists certainly must know – controlled trials are designed to compare the outcomes of two groups. Changes within one of the groups can be caused by several factors unrelated to the therapy and are therefore largely irrelevant. This means that “no significant difference between changes of Sipjeondaebo-tang group and placebo group” indicates that the herbal mixture had no effect. In turn this means that a conclusion stating that “sipjeondaebo-tang appears to have potential benefit for anorexia” is just fraudulent.
This level of scientific misconduct is remarkable, even for the notoriously poor Evid Based Complement Alternat Med.
I strongly suggest that:
- The journal is de-listed from Medline because similarly misleading nonsense has been coming out of this rag for some time.
- The paper is withdrawn because it can only mislead vulnerable patients.
Cranio-sacral therapy is firstly implausible, and secondly it lacks evidence of effectiveness (see for instance here, here, here and here). Yet, some researchers are nevertheless not deterred to test it in clinical trials. While this fact alone might be seen as embarrassing, the study below is a particular and personal embarrassment to me, in fact, I am shocked by it and write these lines with considerable regret.
Why? Bear with me, I will explain later.
The purpose of this trial was to evaluate the effectiveness of osteopathic manipulative treatment and osteopathy in the cranial field in temporomandibular disorders. Forty female subjects with temporomandibular disorders lasting at least three months were included. At enrollment, subjects were randomly assigned into two groups: (1) osteopathic manipulative treatment group (n=20) and (2) osteopathy in the cranial field [craniosacral therapy for you and me] group (n=20). Examinations were performed at baseline (E0) and at the end of the last treatment (E1), and consisted of subjective pain intensity with the Visual Analog Scale, Helkimo Index and SF-36 Health Survey. Subjects had five treatments, once a week. 36 subjects completed the study.
Patients in both groups showed significant reduction in Visual Analog Scale score (osteopathic manipulative treatment group: p = 0.001; osteopathy in the cranial field group: p< 0.001), Helkimo Index (osteopathic manipulative treatment group: p = 0.02; osteopathy in the cranial field group: p = 0.003) and a significant improvement in the SF-36 Health Survey – subscale “Bodily Pain” (osteopathic manipulative treatment group: p = 0.04; osteopathy in the cranial field group: p = 0.007) after five treatments (E1). All subjects (n = 36) also showed significant improvements in the above named parameters after five treatments (E1): Visual Analog Scale score (p< 0.001), Helkimo Index (p< 0.001), SF-36 Health Survey – subscale “Bodily Pain” (p = 0.001). The differences between the two groups were not statistically significant for any of the three endpoints.
The authors concluded that both therapeutic modalities had similar clinical results. The findings of this pilot trial support the use of osteopathic manipulative treatment and osteopathy in the cranial field as an effective treatment modality in patients with temporomandibular disorders. The positive results in both treatment groups should encourage further research on osteopathic manipulative treatment and osteopathy in the cranial field and support the importance of an interdisciplinary collaboration in patients with temporomandibular disorders. Implications for rehabilitation Temporomandibular disorders are the second most prevalent musculoskeletal condition with a negative impact on physical and psychological factors. There are a variety of options to treat temporomandibular disorders. This pilot study demonstrates the reduction of pain, the improvement of temporomandibular joint dysfunction and the positive impact on quality of life after osteopathic manipulative treatment and osteopathy in the cranial field. Our findings support the use of osteopathic manipulative treatment and osteopathy in the cranial field and should encourage further research on osteopathic manipulative treatment and osteopathy in the cranial field in patients with temporomandibular disorders. Rehabilitation experts should consider osteopathic manipulative treatment and osteopathy in the cranial field as a beneficial treatment option for temporomandibular disorders.
This study has so many flaws that I don’t know where to begin. Here are some of the more obvious ones:
- There is, as already mentioned, no rationale for this study. I can see no reason why craniosacral therapy should work for the condition. Without such a rationale, the study should never even have been conceived.
- Technically, this RCTs an equivalence study comparing one therapy against another. As such it needs to be much larger to generate a meaningful result and it also would require a different statistical approach.
- The authors mislabelled their trial a ‘pilot study’. However, a pilot study “is a preliminary small-scale study that researchers conduct in order to help them decide how best to conduct a large-scale research project. Using a pilot study, a researcher can identify or refine a research question, figure out what methods are best for pursuing it, and estimate how much time and resources will be necessary to complete the larger version, among other things.” It is not normally a study suited for evaluating the effectiveness of a therapy.
- Any trial that compares one therapy of unknown effectiveness to another of unknown effectiveness is a complete and utter nonsense. Equivalent studies can only ever make sense, if one of the two treatments is of proven effectiveness – think of it as a mathematical equation: one equation with two unknowns is unsolvable.
- Controlled studies such as RCTs are for comparing the outcomes of two or more groups, and only between-group differences are meaningful results of such trials.
- The ‘positive results’ which the authors mention in their conclusions are meaningless because they are based on such within-group changes and nobody can know what caused them: the natural history of the condition, regression towards the mean, placebo-effects, or other non-specific effects – take your pick.
- The conclusions are a bonanza of nonsensical platitudes and misleading claims which do not follow from the data.
As regular readers of this blog will doubtlessly have noticed, I have seen plenty of similarly flawed pseudo-research before – so, why does this paper upset me so much? The reason is personal, I am afraid: even though I do not know any of the authors in person, I know their institution more than well. The study comes from the Department of Physical Medicine and Rehabilitation, Medical University of Vienna, Austria. I was head of this department before I left in 1993 to take up the Exeter post. And I had hoped that, even after 25 years, a bit of the spirit, attitude, knowhow, critical thinking and scientific rigor – all of which I tried so hard to implant in my Viennese department at the time – would have survived.
Perhaps I was wrong.
Some say that Chinese herbal medicine offers a solution.
This Chinese multi-centre RCT included 588 mothers considering breastfeeding. The intervention group received the Chinese herbal mixture Zengru Gao, while the control group received no therapy. The primary outcomes were the percentages of fully and partially breastfeeding mothers, and a secondary outcome was baby’s daily formula intake.
At day 3 and 7 after delivery, significant differences were found in favour of Zengru Gao group on the percentage of full/ partial breastfeeding. At day 7, the percentage of full/ partial breastfeeding of the active group increased to 71.48%/20.70% versus 58.67%/30.26% in the control group, the differences remained significant. No statistically significant differences were detected on primary measures at day. While intake of formula differed between groups at day 1 and 3, this difference did not achieve statistical significance, but this difference was apparent by day 7.
The authors concluded that the Chinese Herbal medicine Zengru Gao enhanced breastfeeding success during one week postpartum. The approach is acceptable to participants and merits further evaluation.
To the naïve observer, this study might look rigorous, but it is a seriously flawed RCT. Here are just some of its most obvious limitations:
- All we get in the methods section is this explanation: Participants were randomly allocated to the blank control group or the intervention group: Zengru Gao, orally, 30 g a time and 3 times a day. This seems to indicate that the control group got no treatment at all which means there was no blinding nor placebo control. The authors even comment on this point in the discussion section of their paper stating that because we included new mothers who received no treatment as a control group, we were able to prove that the improvement in breastfeeding was not due to the placebo effect. However, this is a totally nonsensical argument.
- The experimental treatment is not reproducible. The authors state: Zengru Gao, a Chinese herbal formula, which is composed of 8 herbs: Semen Vaccariae, Medulla Tetrapanacis, Radix Rehmanniae Praeparata, Radix Angelicae Sinensis, Radix Paeoniae Alba,Rhizoma Chuanxiong, Herba Leonuri, Radix Trichosanthis. This is not enough information to replicate the study outside China where the mixture is not commercially available.
- The primary outcome was the percentage of fully, and partially breastfeeding mothers. Breastfeeding was defined as mother’s milk given by direct breast feeding. Full breastfeeding meant that no other types of milk or solids were given. Partially breastfeeding meant that sustained latch with deep rhythmic sucking through the length of the feed, with some pause, on either/ or both breasts. We are not being told how the endpoint was quantified. Presumably women kept diaries. We cannot guess how accurate this process was.
- As far as I can see, there was no correction for multiple testing for statistical significance. This means that some or all of the significant results might be false-positive.
- There is insufficient data to show that the herbal mixture is safe for the mothers and the babies. At the very minimum, the researchers should have measured essential safety parameters. This omission is a gross violation of research ethics.
- Towards the end of the paper, we find the following statement: The authors would like to thank the Research and Development Department of Zhangzhou Pien Tze Huang Pharmaceutical co., Ltd. … The authors declare that they have no competing interests. And the 1st and 3rd authors are “affiliated with” Guangzhou Hipower Pharmaceutical Technology Co., Ltd, Guangzhou, China, i. e. work for the manufacturer of the mixture. This does clearly not make any sense whatsoever.
I have seen too many flawed studies of alternative medicine to be shocked or even surprised by this level of incompetence and nonsense. Yet, I still find it lamentable. But, in my view, the worst is that supposedly peer-reviewed journals such as ‘BMC Complement Altern Med’ publish such overt rubbish.
It would be easy to shrug one’s shoulder and bin the paper. But the effect of such fatally flawed research is too serious for that. In our recent book MORE HARM THAN GOOD? THE MORAL MAZE OF COMPLEMENTARY AND ALTERNATIVE MEDICINE, we discuss that such flawed science amounts to a violation of medical ethics: CAM journals allocate peer review tasks to a narrow range of CAM enthusiasts who often have been chosen by the authors of the article in question. The raison d’être of CAM journals and CAM researchers is inextricably tied to a belief in CAM, resulting in a self-referential situation which is permissive to the acceptance of weak or ﬂawed reports of clinical effectiveness… Defective research—whether at the design, execution, analysis, or reporting stage—corrupts the repository of reliable medical knowledge. Ultimately, this leads to suboptimal and erroneous treatment decisions…
The authors of this systematic review aimed to summarize the evidence of clinical trials on cupping for athletes. Randomized controlled trials on cupping therapy with no restriction regarding the technique, or co-interventions, were included, if they measured the effects of cupping compared with any other intervention on health and performance outcomes in professionals, semi-professionals, and leisure athletes. Data extraction and risk of bias assessment using the Cochrane Risk of Bias Tool were conducted independently by two pairs of reviewers.
Eleven trials with n = 498 participants from China, the United States, Greece, Iran, and the United Arab Emirates were included, reporting effects on different populations, including soccer, football, and handball players, swimmers, gymnasts, and track and field athletes of both amateur and professional nature. Cupping was applied between 1 and 20 times, in daily or weekly intervals, alone or in combination with, for example, acupuncture. Outcomes varied greatly from symptom intensity, recovery measures, functional measures, serum markers, and experimental outcomes. Cupping was reported as beneficial for perceptions of pain and disability, increased range of motion, and reductions in creatine kinase when compared to mostly untreated control groups. The majority of trials had an unclear or high risk of bias. None of the studies reported safety.
The authors concluded that no explicit recommendation for or against the use of cupping for athletes can be made. More studies are necessary for conclusive judgment on the efficacy and safety of cupping in athletes.
Considering the authors’ stated aim, this conclusion seems odd. Surely, they should have concluded that THERE IS NO CONVINCING EVIDENCE FOR THE USE OF CUPPING IN ATHLETES. But this sounds rather negative, and the JCAM does not seem to tolerate negative conclusions, as discussed repeatedly on this blog.
The discussion section of this paper is bar of any noticeable critical input (for those who don’t know: the aim of any systematic review must be to CRITICALLY EVALUATE THE PRIMARY DATA). The authors even go as far as stating that the trials reported in this systematic review found beneficial effects of cupping in athletes when compared to no intervention. I find this surprising and bordering on scientific misconduct. The RCTs were mostly not on cupping but on cupping in combination with some other treatments. More importantly, they were of such deplorable quality that they allow no conclusions about effectiveness. Lastly, they mostly failed to report on adverse effects which, as I have often stated, is a violation of research ethics.
In essence, all this paper proves is that, if you have rubbish trials, you can produce a rubbish review and publish it in a rubbish journal.
If you ask me, the field of alternative medicine is plagued with surveys; too many are published and most are complete, meaningless rubbish which serve merely the purpose of being misinterpreted as a means of popularising bogus treatments. Yet, every now and then, a decent and informative article appears – like this survey from Canada.
It yields a number of fascinating findings:
- More than three-quarters of Canadians (79%) had used at least one from of CAM sometime in their lives in 2016 (74% in 2006 and 73% in 1997). British Columbians were most likely to have used an alternative therapy during their lifetime (89%), followed by Albertans (84%) and Ontarians (81%).
- More than half (56%) of Canadians had used at least one CAM therapy in the year prior to the 2016 survey, compared to 54% in 2006 and 50% in 1997.
- In 2016, massage was the most common type of therapy that Canadians used over their lifetime with 44 percent having tried it, followed by chiropractic care (42%), yoga (27%), relaxation techniques (25%), and acupuncture (22%).
- The most rapidly expanding therapies over the past two decades were massage, yoga, acupuncture, chiropractic care, osteopathy, and naturopathy.
- High dose/mega vitamins, herbal therapies, and folk remedies were in declining use over that same time period.
- The most likely users of CAM over the past 12 months in 2016 were from the 35- to 44-year-old age group (61%). The use of CAM diminished with age, and generally rose with both income and education. These trends are similar to those observed in 2006 and 1997.
- The majority of people choosing to use CAM in the 12 months preceding the 2016 survey did so for “wellness”.
- Canadians spent an estimated $8.8 billion on CAM in the last 12 months ($8.0 billion in 2005/06 and $6.3 billion in 1996/97.
- Of the $8.8 billion spent in 2016, more than $6.5 billion was spent on providers of CAM, while another $2.3 billion was spent on herbs, vitamins, special diet programs, books, classes, and equipment.
- The majority of Canadians believe that CAM should be paid for privately and not by provincial health.
The strengths of this survey are that it is methodologically rigorous, and that it provides longitudinal data (this is in sharp contrast to the plethora of CAM surveys published recently). Many of its findings confirm what has already been known. Yet some results are new and noteworthy.
To many readers of this blog, the high CAM-usage will be disturbing. However, I am mildly encouraged by the results of this survey.
- Firstly, the choice of CAM by Canadians seems rather more reasonable than that by other nations. Canadians seem to avoid the more ridiculous types of CAM, such as homeopathy or para-normal healing.
- Secondly, many Canadians seem to view CAM not as medicine, but as a sort of luxurious pampering that they use to relax and feel well. Consequently, most are not pushing to get it reimbursed which I find more sensible than consumers’ attitudes in many other countries.
As I have stated repeatedly, I am constantly on the look-out for positive news about alternative medicine. Usually, I find plenty – but when I scrutinise it, it tends to crumble in the type of misleading report that I often write about on this blog. Truly good research in alternative medicine is hard to find, and results that are based on rigorous science and show a positive finding are a bit like gold-dust.
But hold on, today I have something!
This systematic review was aimed at determining whether physical exercise is effective in improving cognitive function in the over 50s. The authors evaluated all randomised controlled trials of physical exercise interventions in community-dwelling adults older than 50 years with an outcome measure of cognitive function.
39 studies were included in the systematic review. Analysis of 333 dependent effect sizes from 36 studies showed that physical exercise improved cognitive function. Interventions of aerobic exercise, resistance training, multicomponent training and tai chi, all had significant point estimates. When exercise prescription was examined, a duration of 45–60 min per session and at least moderate intensity, were associated with benefits to cognition. The results of the meta-analysis were consistent and independent of the cognitive domain tested or the cognitive status of the participants.
The authors concluded that physical exercise improved cognitive function in the over 50s, regardless of the cognitive status of participants. To improve cognitive function, this meta-analysis provides clinicians with evidence to recommend that patients obtain both aerobic and resistance exercise of at least moderate intensity on as many days of the week as feasible, in line with current exercise guidelines.
But this is not alternative medicine, I hear you say.
You are right, mostly, it isn’t. There were a few RCTs of tai chi and yoga, but the majority was of conventional exercise. Moreover, most of these ‘alternative’ RCTs were less convincing than the conventional RCTs; here is one of the former category:
Community-dwelling older adults (N = 118; mean age = 62.0) were randomized to one of two groups: a Hatha yoga intervention or a stretching-strengthening control. Both groups participated in hour-long exercise classes 3×/week over the 8-week study period. All participants completed established tests of executive function including the task switching paradigm, n-back and running memory span at baseline and follow-up. Analysis of covariances showed significantly shorter reaction times on the mixed and repeat task switching trials (partial η(2) = .04, p < .05) for the Hatha yoga group. Higher accuracy was recorded on the single trials (partial η(2) = .05, p < .05), the 2-back condition of the n-back (partial η(2) = .08, p < .001), and partial recall scores (partial η(2) = .06, p < .01) of running span task.
I just wanted to be generous and felt the need to report a positive result. I guess, this just shows how devoid of rigorous research generating a positive finding alternative medicine really is.
Of course, there are many readers of this blog who are convinced that their pet therapy is supported by excellent evidence. For them, I have this challenge: if you think you have good evidence for an alternative therapy, show it to me (send it to me via the ‘contact’ option of this blog or post the link as a comment below). Please note that any evidence I would consider analysing in some detail (writing a full blog post about it) would need to be recent, peer-reviewed and rigorous.
This systematic review aimed to identify and explore published studies on the health, wellbeing and economic impact of retreat experiences. Three electronic databases were searched for residential retreat studies published in English. Studies were included, if they involved an intervention program in a residential setting of one or more nights, and included before-and-after data related to the health of participants.
A total of 23 studies including 8 randomised controlled trials, 6 non-randomised controlled trials and 9 longitudinal cohort studies met the inclusion criteria. These studies included a total of 2592 participants from diverse geographical and demographic populations and a great heterogeneity of outcome measures, with 7 studies examining objective outcomes such as blood pressure or biological makers of disease, and 16 studies examining subjective outcomes that mostly involved self-reported questionnaires on psychological and spiritual measures.
All studies reported post-retreat health benefits ranging from immediately after to five-years post-retreat. Study populations varied widely and most studies had small sample sizes, poorly described methodology and little follow-up data, and no studies reported on health economic outcomes or adverse effects, making it difficult to make definite conclusions about specific conditions, safety or return on investment.
The authors concluded that health retreat experiences appear to have health benefits that include benefits for people with chronic diseases such as multiple sclerosis, various cancers, HIV/AIDS, heart conditions and mental health. Future research with larger numbers of subjects and longer follow-up periods are needed to investigate the health impact of different retreat experiences and the clinical populations most likely to benefit. Further studies are also needed to determine the economic benefits of retreat experiences for individuals, as well as for businesses, health insurers and policy makers.
In the article, the authors also state that the findings from the reviewed studies suggest there are many positive health benefits from retreat experiences that includes improvements in both subjective and objective measures… The results from the most rigorous studies that used randomized controlled designs were consistent with less rigorous studies and suggest that retreat experiences can produce benefits that include positive changes in metabolic and neurological pathways, loss of weight, blood pressure and abdominal girth, reduction in health symptoms and improvements in quality of life and subjective wellbeing.
As it happens, we have discussed one of their ‘most rigorous’ RCTs on this blog. Here is what I wrote about it when it was first published:
The ‘study‘ in question allegedly examined the effects of a comprehensive residential mind–body program on well-being. The authors describe it as “a quasi-randomized trial comparing the effects of participation in a 6-day Ayurvedic system of medicine-based comprehensive residential program with a 6-day residential vacation at the same retreat location.” They included 69 healthy women and men who received the Ayurvedic intervention addressing physical and emotional well-being through group meditation and yoga, massage, diet, adaptogenic herbs, lectures, and journaling. Key components of the program include physical cleansing through ingestion of herbs, fiber, and oils that support the body’s natural detoxification pathways and facilitate healthy elimination; two Ayurvedic meals daily (breakfast and lunch) that provide a light plant-based diet; daily Ayurvedic oil massage treatments; and heating treatments through the use of sauna and/or steam. The program includes lectures on Ayurvedic principles and lifestyle as well as lectures on meditation and yoga philosophy. The study group also participated in twice-daily group meditation and daily yoga and practiced breathing exercises (pranayama) as well as emotional expression through a process of journaling and emotional support. During the program, participants received a 1-hour integrative medical consultation with a physician and follow-up with an Ayurvedic health educator.
The control group simply had a vacation without any of the above therapies in the same resort. They were asked to do what they would normally do on a resort vacation with the additional following restrictions: they were asked not to engage in more exercise than they would in their normal lifestyle and to refrain from using La Costa Resort spa services. They were also asked not to drink ginger tea or take Gingko biloba during the 2 days before and during the study week.
Recruitment was via email announcements on the University of California San Diego faculty and staff and Chopra Center for Wellbeing list-servers. Study flyers stated that the week-long Self-Directed Biological Transformation Initiative (SBTI) study would be conducted at the Chopra Center for Wellbeing, located at the La Costa Resort in Carlsbad, California, in order to learn more about the psychosocial and physiologic effects of the 6-day Perfect Health (PH) Program compared with a 6-day stay at the La Costa Resort. The study participants were not blinded, and site investigators and study personnel knew to which group participants were assigned.
Participants in the Ayurvedic program showed significant and sustained increases in ratings of spirituality and gratitude compared with the vacation group, which showed no change. The Ayurvedic participants also showed increased ratings for self-compassion as well as less anxiety at the 1-month follow-up.
The authors arrived at the following conclusion: Findings suggest that a short-term intensive program providing holistic instruction and experience in mind–body healing practices can lead to significant and sustained increases in perceived well-being and that relaxation alone is not enough to improve certain aspects of well-being.
This ‘study’ had ethical approval from the University of California San Diego and was supported by the Fred Foundation, the MCJ Amelior Foundation, the National Philanthropic Trust, the Walton Family Foundation, and the Chopra Foundation. The paper’s first author is director of research at the Chopra Foundation… Just for the record, let me formulate a short conclusion that actually fits the data from this ‘study’: Lots of TLC, attention and empathy does make some people feel better…
END OF QUOTE FROM MY OWN POST
The subject of health retreats could be relevant and important. Educating people and teaching them the essentials about healthy life-styles is potentially a good thing. It could well turn out that health retreats benefit many individuals, while saving money for society.
Yet, do we need all sorts of quackery for achieving this aim?
No, we don’t!
A rational programme would need to teach and motivate people about diet, weight control, smoking cessation, regular sleep, relaxation, exercise, etc. It could prevent disease and save funds. This approach has existed in Europe long before the US ‘New Agers’ with their flimflam jumped on this bandwagon. Health education is a good idea, but it does not require the use of alternative therapies or luxury retreats.
As it turns out, the new systematic review is a disappointment. It fails to stress that no firm conclusions can be drawn from flimsy data and degenerates into little more than an embarrassing advertisement for Deepak Chopra’s and similar entrepreneurs’ money-making retreats. It totally ignores the sizable body of Non-English literature on the subject, and is focussed on promoting fashionable retreats and wellness centres in the US and Australia.
To be fair to the authors, they almost admit as much when they state: “Competing interests: MC is a board member of the Global Wellness Summit and has previously been a paid presenter at the Gwinganna Health Retreat. RMIT University has received donations from Danubius Hotel Group, Lapinha, Sunswept Resorts, Sheenjoy and The Golden Door for ongoing retreat research.”
I rest my case.
Can conventional therapy (CT) be combined with herbal therapy (CT + H) in the management of Alzheimer’s disease (AD) to the benefit of patients? This was the question investigated by Chinese researchers in a recent retrospective cohort study funded by grants from China Ministry of Education, National Natural Science Foundation of China, Beijing Municipal Science and Technology Commission, and Beijing Municipal Commission of Health and Family Planning.
In total, 344 outpatients diagnosed as probable dementia due to AD were collected, who had received either CT + H or CT alone. The GRAPE formula was prescribed for AD patients after every visit according to TCM theory. It consisted mainly (what does ‘mainly’ mean as a description of a trial intervention?) of Ren shen (Panax ginseng, 10 g/d), Di huang (Rehmannia glutinosa, 30 g/d), Cang pu (Acorus tatarinowii, 10 g/d), Yuan zhi (Polygala tenuifolia, 10 g/d), Yin yanghuo (Epimedium brevicornu, 10 g/d), Shan zhuyu (Cornus officinalis, 10 g/d), Rou congrong (Cistanche deserticola, 10 g/d), Yu jin (Curcuma aromatica, 10 g/d), Dan shen (Salvia miltiorrhiza, 10 g/d), Dang gui (Angelica sinensis, 10 g/d), Tian ma (Gastrodia elata, 10 g/d), and Huang lian (Coptis chinensis, 10 g/d), supplied by Beijing Tcmages Pharmaceutical Co., LTD. Daily dose was taken twice and dissolved in 150 ml hot water each time. Cognitive function was quantified by the mini-mental state examination (MMSE) every 3 months for 24 months.
The results show that most of the patients were initially diagnosed with mild (MMSE = 21-26, n = 177) and moderate (MMSE = 10-20, n = 137) dementia. At 18 months, CT+ H patients scored on average 1.76 (P = 0.002) better than CT patients, and at 24 months, patients scored on average 2.52 (P < 0.001) better. At 24 months, the patients with improved cognitive function (△MMSE ≥ 0) in CT + H was more than CT alone (33.33% vs 7.69%, P = 0.020). Interestingly, patients with mild AD received the most robust benefit from CT + H therapy. The deterioration of the cognitive function was largely prevented at 24 months (ΔMMSE = -0.06), a significant improvement from CT alone (ΔMMSE = -2.66, P = 0.005).
The authors concluded that, compared to CT alone, CT + H significantly benefited AD patients. A symptomatic effect of CT + H was more pronounced with time. Cognitive decline was substantially decelerated in patients with moderate severity, while the cognitive function was largely stabilized in patients with mild severity over two years. These results imply that Chinese herbal medicines may provide an alternative and additive treatment for AD.
Conclusions like these render me speechless – well, almost speechless. This was nothing more than a retrospective chart analysis. It is not possible to draw causal conclusions from such data.
Because of a whole host of reasons. Most crucially, the CT+H patients were almost certainly a different and therefore non-comparable population to the CT patients. This flaw is so elementary that I need to ask, who are the reviewers letting such utter nonsense pass, and which journal would publish such rubbish? In fact, I can be used for teaching students why randomisation is essential, if we aim to find out about cause and effect.
Ahhh, it’s the BMC Complement Altern Med! I think the funders, editors, reviewers, and authors of this paper should all go and hide in shame.
We have discussed the NHMRC report on homeopathy several times – see, for instance, here, here and here. Perhaps understandably, homeopaths have great difficulties accepting its negative findings, and have complained about it ever since it was published. Now, a very detailed and well-researched analysis has become available of both the report and its criticism. Here I take the liberty to copy and (clumsily) translate its conclusions; if you can read German, I highly recommend studying the full document.
START OF MY TRANSLATION
The criticism of the NHMRC review is very voluminous and highlights many different aspects of the background, the methodology, the execution and the unwanted results from a homeopathic perspective. The very engaging discussions in the general public about this document and its flaws are, however, relatively meaningless: the NHMRC arrives at exactly the same conclusions as the employee of the Homeopathic Research Institute (HRI), Mathie, in his reviews of 2014 and 2017.
In both reviews, Mathie evaluated a total of 107 primary studies and found only 2 trials that could be rated as qualitatively good, that is to say constituting reliable evidence. Mathie did upgrade 2 further studies to the category of reliable evidence, however, this was in violation of the procedures proscribed in the study protocol.
The criticism of the NHMRC review was not able to make a single valid rebuttal. No condition could be identified for which homeopathy is clearly superior to placebo. This is all the more important, as Mathie avoided the mistakes that constituted the most prominent alleged criticisms of the NHMRC report.
- Since Mathie and most of his co-authors are affiliated with organisations of homeopathy, an anti-homeopathy bias can be excluded.
- Mathie conducted classic reviews and even differentiated between individualised and non-individualised homeopathy.
- Mathie did not exclude studies below a certain sample size.
Yet, in both reviews, he draws the same conclusion.
In view of the truly independent replications of an employee of the HRI, we can be sure that there are, in fact, no solid proofs for the effectiveness of homeopathy. The claim of a strong efficacy, equivalent to conventional medicines, that is made by homeopathy’s advocates is therefore not true.
END OF MY TRANSLATION
And here is the original German text:
Die Kritik an dem Review des NHMRC ist sehr umfangreich und beleuchtet sehr viele verschiedene Facetten über das Umfeld, die Methodik und die Durchführung sowie das aus Sicht der Homöopathen unerwünschte Ergebnis selbst. Die in der Öffentlichkeit sehr engagierte Diskussion um diese Arbeit und ihre möglichen Unzulänglichkeiten sind jedoch relativ bedeutungslos: Das NHMRC kommt zu genau dem gleichen Ergebnis wie Mathie als Mitarbeiter des HRI in seinen in 2014 und 2017 veröffentlichten systematischen Reviews:
Insgesamt hat Mathie in beiden Reviews 107 Einzelstudien untersucht und fand nur zwei Studien, die als qualitativ gut („low risk of bias“), also als zuverlässige Evidenz betrachtet werden können. Mathie hat zwar vier weitere Studien zur zuverlässigen Evidenz aufgewertet, was allerdings im Widerspruch zu den üblichen Vorgehensweisen steht und im Studienprotokoll nicht vorgesehen war.
Die Kritik am Review des NHMRC hat keinen einzigen Punkt fundiert widerlegen können. Man konnte keine Indikation finden, bei der sich die Homöopathie als klar über Placebo hinaus wirksam erwiesen hätte. Diese Punkte sind umso bedeutsamer, weil Mathie die am NHMRC hauptsächlich kritisierten Fehler nicht gemacht hat:
- Als Mitarbeiter des HRI und mit Autoren, die überwiegend für Homöopathie-affine Organisationen arbeiten, ist eine Voreingenommenheit gegen die Homöopathie auszuschließen.
- Mathie hat klassische Reviews ausgeführt, sogar getrennt zwischen einzelnen Ausprägungen (individualisierte Homöopathie und nicht-individualisierte Homöopathie).
- Mathie hat keine Größenbeschränkung der Studien berücksichtigt.
Er kommt aber dennoch zweimal zum gleichen Ergebnis wie das NHMRC.
Angesichts der wirklich als unabhängig anzusehenden Bestätigung der Ergebnisse des NHMRC durch einen Mitarbeiter des Homeopathy Research Institute kann man sicher davon ausgehen, dass es tatsächlich keine belastbaren Wirkungsnachweise für die Homöopathie gibt und dass die von ihren Anhängern behauptete starke, der konventionellen Medizin gleichwertige oder gar überlegene Wirksamkeit der Homöopathie nicht gegeben ist.
I do apologise for my clumsy translation and once again encourage those who can to study the detailed original in full.
My conclusion of this (and indeed of virtually all criticism of homeopathy) is that homeopaths are just as unable to accept criticism as an evangelic believer is going to accept any rational argument against his belief. In other words, regardless of how convincing the evidence, homeopaths will always dismiss it – or, to put it in a nutshell: HOMEOPATHY IS A CULT.