A press-release from a company based in Germany recently caught my attention. I here present only the most relevant sections from this document:
Natural remedies like medicinal mushrooms also called vitality mushrooms haven proven helpful in prevention and as a support in the therapy, of diabetes type 2. This could be shown by long-time observational studies in naturopathy, for example by MykoTroph – Institute for Medicinal Mushrooms. Medicinal mushroom Coprinus has regenerating effects on the pancreas; it also helps the sensitization of the receptors responsible for the absorption of insulin and claims to have a blood sugar lowering effect.
Medicinal mushroom Maitake has positive effects on the fat metabolism and the sensitivity of insulin receptors. Diabetes type 2 is often linked to circulation problems, vascular diseases and hypertension. Therefore, regular monitoring of the blood pressure, blood lipids, triglycerides and body weight is highly important. The intake of Maitake can help ‒ even in a preliminary stage ‒ to get a grip on these determining factors.
Within the scope of a holistic therapy of diabetes type 2 with metabolic syndrome, the combined intake of medicinal mushrooms and Nopal juice (prickly pear) can be very reasonable. Nopal juice has a lowering effect on the glycemic index of ingested food. The consequence is a slower release of carbohydrates in the intestines and is therefore favorable for a healthy level of blood sugar…
Medicinal mushrooms are available as mushroom powder capsules. According to observational studies of MykoTroph – Institute for Medicinal Mushrooms, especially mushroom powder derived from the whole mushroom has proven effective. Only if the mushroom powder is derived from the whole mushroom, the powder will contain all of the effective ingredients of medicinal mushrooms. It should also be taken care that the mushrooms are from certified organic production. For further information, please visit us on http://www.mykotroph.com
a Japanese study participants comprised 726 Japanese T2DM outpatients free of history of CVD. Life styles were analyzed using self-reported questionnaires. The relationship between dietary patterns, identified by factor analysis, and potential risk factors for CVD was investigated by linear and logistic regression analyses….The “Seaweeds, Vegetables, Soy products and Mushrooms” pattern, characterized by high consumption of seaweeds, soy products and mushrooms, was associated with lower use of diabetes medication and healthier lifestyles.
END OF QUOTE
These are claims that could be relevant to millions of diabetic patients worldwide – but are they true?
The study cited above did indeed show an association; but an association is not necessarily a causal relationship! So what evidence is there fore a causal relationship between mushroom-consumption and diabetes? The answer is: frustratingly little.
A Cochrane review concluded that “evidence from a small number of randomised controlled trials does not support the use of G lucidum [Ganoderma lucidum (also known as lingzhi or reishi)] for treatment of cardiovascular risk factors in people with type 2 diabetes mellitus. Future research into the efficacy of G lucidum should be placebo-controlled and adhere to clinical trial reporting standards.”
The authors of another Cochrane review concluded that “our review did not find sufficient evidence to justify the use of G. lucidum as a first-line treatment for cancer. It remains uncertain whether G. lucidum helps prolong long-term cancer survival. However, G. lucidum could be administered as an alternative adjunct to conventional treatment in consideration of its potential of enhancing tumour response and stimulating host immunity. G. lucidum was generally well tolerated by most participants with only a scattered number of minor adverse events. No major toxicity was observed across the studies. Although there were few reports of harmful effect of G. lucidum, the use of its extract should be judicious, especially after thorough consideration of cost-benefit and patient preference. Future studies should put emphasis on the improvement in methodological quality and further clinical research on the effect of G. lucidum on cancer long-term survival are needed. An update to this review will be performed every two years.”
A further study determined whether a supplement of Agaricus blazei Murill extract improves insulin resistance in type 2 diabetes. It was designed as a clinical randomized, double-blind, placebo-controlled trial. Diabetic patients were randomly assigned to either receiving supplement of Agaricus blazei Murill (ABM) extract or placebo (cellulose) 1500 mg daily for 12 weeks. At the end of the study, the subjects who received supplement of ABM extract (n = 29) showed significantly lower HOMA-IR index than the control group (n = 31). The plasma adiponectin concentration increased by 20% in the ABM group after 12 weeks of treatment, but decreased 20% among those taking the placebo. The authors concluded that “ABM extract improves insulin resistance among subjects with type 2 diabetes. The increase in adiponectin concentration after taking AMB extract for 12 weeks might be the mechanism that brings the beneficial effect. Studies with longer periods of follow-up should be conducted in the future.”
On the basis of all this evidence, it seems fair to conclude that mushrooms have little or no effect on diabetes.
And what about the above press-release?
Diabetes is a serious condition that can be well-controlled with diet, exercise and drugs. Many diabetics are nevertheless fed up with taking drugs throughout their entire life and would only be too happy to exchange them for ‘something natural’. Therefore patients might try mushrooms or other natural ‘cures’, if they are promoted in this way. However, this decision could prove fatal (examples of such tragedies abound).
In view of these considerations, I find such promotion irresponsible, unethical and outright dangerous.
Acupuncture for hot flushes?
I know, to rational thinkers this sounds bizarre – but, actually, there are quite a few studies on the subject. Enough evidence for me to have published not one but four different systematic reviews on the subject.
The first (2009) concluded that “the evidence is not convincing to suggest acupuncture is an effective treatment of hot flash in patients with breast cancer. Further research is required to investigate whether there are specific effects of acupuncture for treating hot flash in patients with breast cancer.”
The second (also 2009) concluded that “sham-controlled RCTs fail to show specific effects of acupuncture for control of menopausal hot flushes. More rigorous research seems warranted.”
The third (again 2009) concluded that “the evidence is not convincing to suggest acupuncture is an effective treatment for hot flush in patients with prostate cancer. Further research is required to investigate whether acupuncture has hot-flush-specific effects.”
The fourth (2013), a Cochrane review, “found insufficient evidence to determine whether acupuncture is effective for controlling menopausal vasomotor symptoms. When we compared acupuncture with sham acupuncture, there was no evidence of a significant difference in their effect on menopausal vasomotor symptoms. When we compared acupuncture with no treatment there appeared to be a benefit from acupuncture, but acupuncture appeared to be less effective than HT. These findings should be treated with great caution as the evidence was low or very low quality and the studies comparing acupuncture versus no treatment or HT were not controlled with sham acupuncture or placebo HT. Data on adverse effects were lacking.”
And now, there is a new systematic review; its aim was to evaluate the effectiveness of acupuncture for treatment of hot flash in women with breast cancer. The searches identified 12 relevant articles for inclusion. The meta-analysis without any subgroup or moderator failed to show favorable effects of acupuncture on reducing the frequency of hot flashes after intervention (n = 680, SMD = − 0.478, 95 % CI −0.397 to 0.241, P = 0.632) but exhibited marked heterogeneity of the results (Q value = 83.200, P = 0.000, I^2 = 83.17, τ^2 = 0.310). The authors concluded that “the meta-analysis used had contradictory results and yielded no convincing evidence to suggest that acupuncture was an effective treatment of hot flash in patients with breast cancer. Multi-central studies including large sample size are required to investigate the efficiency of acupuncture for treating hot flash in patients with breast cancer.”
What follows from all this?
- The collective evidence does NOT seem to suggest that acupuncture is a promising treatment for hot flushes of any aetiology.
- The new paper is unimpressive, in my view. I don’t see the necessity for it, particularly as it fails to include a formal assessment of the methodological quality of the primary studies (contrary to what the authors state in the abstract) and because it merely includes articles published in English (with a therapy like acupuncture, such a strategy seems ridiculous, in my view).
- I predict that future studies will suggest an effect – as long as they are designed such that they are open to bias.
- Rigorous trials are likely to show an effect beyond placebo.
- My own reviews typically state that MORE RESEARCH IS NEEDED. I regret such statements and would today no longer issue them.
Athletes tend to adopt a healthy life-style, and today this seems to include the regular intake of a range of dietary supplements. Supplements specifically marketed for sports-people promote good health and performance, we are constantly told – but is this true?
A 2010 review found that “there is good evidence that caffeine can improve single-sprint performance, while caffeine, creatine and sodium bicarbonate ingestion have all been demonstrated to improve multiple-sprint performance. The evidence is not so strong for the performance-enhancing benefits of β-alanine or colostrum. Current evidence does not support the ingestion of ribose, branched-chain amino acids or β-hydroxy-β-methylbutyrate, especially in well trained athletes.”
However, a 2011 paper was considerably more cautious: “For most supplements, the evidence is weak, or even completely absent. A few supplements, including caffeine, creatine, and bicarbonate, are supported by a strong research base. Difficulties arise when new evidence appears to support novel supplements: in recent years, β-alanine has become popular, and the use of nitrate and arginine is growing. Athletes seldom wait until there is convincing evidence of efficacy or of safety, but caution is necessary to minimize risk.”
The purpose of this new article was to collect the most recent data regarding the safety of well-known or emerging dietary supplements used by athletes.
The review suggests that about 90% of sports supplements contain estrogenic endocrine disruptors, and about 25% of them having a higher estrogenic activity than acceptable. About 50% of the supplements are contaminated by melamine, a source of non-protein nitrogen. Additional data accumulate toward the safety of nitrate ingestion. In the last 2 years, the safety of emerging supplements such as higenamine, potentially interesting to lose weight, creatine nitrate and guanidinoacetic acid has been evaluated but still needs further investigation.
The authors of this article claim that “the consumption of over-the-counter supplements is very popular in athletes. Although most supplements may be considered as safe when taking at the recommended doses, athletes should be aware of the potential risks linked to the consumption of supplements. In addition to the risks linked to overdosage and cross-effects when combining different supplements at the same time, inadvertent or deliberate contamination with stimulants, estrogenic compounds, diuretics or anabolic agents may occur.”
Despite these cautions, the market for supplements is growing and the myth that supplements are good for health continues. The truth is, however, more complex and far less encouraging:
- It is impossible to generalise across the entire range of highly diverse supplements.
- Some have positive effects.
- The vast majority do nothing at all.
- Most are quite harmless.
- Some can have serious adverse effects.
- All of them cause harm to your bank account.
Stable angina is a symptom of coronary heart disease which, in turn, is amongst the most frequent causes of death in developed countries. It is an alarm bell to any responsible clinician and requires causal, often life-saving treatments of which we today have several options. The last thing a patient needs in this condition is ACUPUNCTURE, I would say.
Yet acupuncture is precisely the therapy such patients might be tempted to employ.
Because irresponsible or criminally naïve acupuncturists advertise it!
Take this website, for instance; it informs us that a meta-analysis of eight clinical trials conducted between 2000 and 2014 demonstrates the efficacy of acupuncture for the treatment of stable angina. In all eight clinical trials, patients treated with acupuncture experienced a greater rate of angina relief than those in the control group treated with conventional drug therapies (90.1% vs 75.7%)….
I imagine that this sounds very convincing to patients and I fear that many might opt for acupuncture instead of potentially invasive/unpleasant but life-saving intervention. The original meta-analysis to which the above promotion referred to is equally optimistic. Here is its abstract:
Angina pectoris is a common symptom imperiling patients’ life quality. The aim of this study is to evaluate the efficacy and safety of acupuncture for stable angina pectoris. Clinical randomized-controlled trials (RCTs) comparing the efficacy of acupuncture to conventional drugs in patients with stable angina pectoris were searched using the following database of PubMed, Medline, Wanfang and CNKI. Overall odds ratio (ORs) and weighted mean difference (MD) with their 95% confidence intervals (CI) were calculated by using fixed- or random-effect models depending on the heterogeneity of the included trials. Total 8 RCTs, including 640 angina pectoris cases with 372 patients received acupuncture therapy and 268 patients received conventional drugs, were included. Overall, our result showed that acupuncture significantly increased the clinical curative effects in the relief of angina symptoms (OR=2.89, 95% CI=1.87-4.47, P<0.00001) and improved the electrocardiography (OR=1.83, 95% CI=1.23-2.71, P=0.003), indicating that acupuncture therapy was superior to conventional drugs. Although there was no significant difference in overall effective rate relating reduction of nitroglycerin between two groups (OR=2.13, 95% CI=0.90-5.07, P=0.09), a significant reduction on nitroglycerin consumption in acupuncture group was found (MD=-0.44, 95% CI=-0.64, -0.24, P<0.0001). Furthermore, the time to onset of angina relief was longer for acupuncture therapy than for traditional medicines (MD=2.44, 95% CI=1.64-3.24, P<0.00001, min). No adverse effects associated with acupuncture therapy were found. Acupuncture may be an effective therapy for stable angina pectoris. More clinical trials are needed to systematically assess the role of acupuncture in angina pectoris.
In the discussion section of the full paper, the authors explain that their analysis has several weaknesses:
Several limitations were presented in this meta-analysis. Firstly, conventional drugs in control group were different, this may bring some deviation. Secondly, for outcome of the time to onset of angina relief with acupuncture, only one trial included. Thirdly, the result of some outcomes presented in different expression method such as nitroglycerin consumption. Fourthly, acupuncture combined with traditional medicines or other factors may play a role in angina pectoris.
However, this does not deter them to conclude on a positive note:
In conclusion, we found that acupuncture therapy was superior to the conventional drugs in increasing the clinical curative effects of angina relief, improving the electrocardiography, and reducing the nitroglycerin consumption, indicating that acupuncture therapy may be effective and safe for treating stable angina pectoris. However, further clinical trials are needed to systematically and comprehensively evaluate acupuncture therapy in angina pectoris.
So, why do I find this irresponsibly and dangerously misleading?
Here a just a few reasons why this meta-analysis should not be trusted:
- There was no systematic attempt to evaluate the methodological rigor of the primary studies; any meta-analysis MUST include such an assessment, or else it is not worth the paper it was printed on.
- The primary studies all look extremely weak; this means they are likely to be false-positive.
- They often assessed not acupuncture alone but in combination with other treatments; consequently the findings cannot be attributed to acupuncture.
- All the primary studies originate from China; we have seen previously (see here and here) that Chinese acupuncture trials deliver nothing but positive results which means that their results cannot be trusted: they are false-positive.
My conclusion: the authors, editors and reviewers responsible for this article should be ashamed; they committed or allowed scientific misconduct, mislead the public and endangered patients’ lives.
I have blogged about the herbal antidepressant before; for instance about the fact that it can cause potentially dangerous herb-drug interactions. When taken alone, however, it seems to be both safe and efficacious in reducing the symptoms of depression. This notion has just been confirmed yet again.
A new systematic review evaluated St. John’s wort (SJW) for the treatment of Major Depressive Disorder (MDD). The objectives of this review were to (1) evaluate the efficacy and safety of SJW in adults with MDD compared to placebo and active comparator and (2) evaluate whether the effects vary by severity of MDD.
The authors searched 9 electronic databases and existing reviews to November 2014. Two independent reviewers screened the citations, abstracted the data, and assessed the risk of bias. They included randomized controlled trials (RCTs) examining the effect of at least a 4-week administration of SJW on depression outcomes against placebo or active comparator in adults with MDD. Risk of bias was assessed using the Cochrane Risk of Bias tool and USPSTF criteria. Quality of evidence (QoE) was assessed using the GRADE approach.
Thirty-five studies examining 6993 patients met inclusion criteria; 8 studies evaluated a SJW extract that combined 0.3 % hypericin and 1-4 % hyperforin. SJW was associated with more treatment responders than placebo (relative risk [RR] 1.53; 95 % confidence interval [CI] 1.19, 1.97; I(2) 79 %; 18 RCTs; N = 2922, moderate QoE; standardized mean differences [SMD] 0.49; CI 0.23, 0.74; 16 RCTs; I(2) 89 %, N = 2888, moderate QoE). Compared to antidepressants, SJW participants were less likely to experience adverse events (OR 0.67; CI 0.56, 0.81; 11 RCTs; moderate QoE) with no difference in treatment effectiveness (RR 1.01; CI 0.90, 1.14; 17 RCTs, I(2) 52 %, moderate QoE; SMD -0.03; CI -0.21, 0.15; 14 RCTs; I(2) 74 %; N = 2248, moderate QoE) in mild and moderate depression.
The authors concluded that SJW monotherapy for mild and moderate depression is superior to placebo in improving depression symptoms and not significantly different from antidepressant medication. However, evidence of heterogeneity and a lack of research on severe depression reduce the quality of the evidence. Adverse events reported in RCTs were comparable to placebo and fewer compared with antidepressants. However, assessments were limited due to poor reporting of adverse events and studies were not designed to assess rare events. Consequently, the findings should be interpreted with caution.
This is an excellent review from a reputable and independent team. The findings are therefore trustworthy.
Does that mean that we can now recommend SJW for patients suffering from depression?
Perhaps – but we need to keep an eye on the interaction issue. As a sole treatment, SJW is much safer than conventional antidepressants. But if a patient takes other medicines, we ought to be very careful.
Other currently unresolved issues are the questions of which extract and which dose. At present, there is not enough evidence to provide conclusive answers to either of these, and therefore the enthusiasm of many doctors for prescribing SJW is understandably limited.
Irrespective of these problems, I have to say that SJW is without question one of the biggest ‘success stories’ from the realm of alternative medicine. Pity that there are not more of them!
A website I recently came across promised to teach me 7 things about acupuncture. This sort of thing is always of interest to me; so I read them with interest and found them so remarkable that I decided to reproduce them here:
1. Addiction recovery
Acupuncture calms and relaxes the mind making it easier for people to overcome addictions to drugs, cigarettes, and alcohol by reducing the anxiety and stress they feel when quitting.
2. Helps the body heal itself
The body contains natural pain relief chemicals, such as endorphins and has an amazing capacity for self-healing. Acupuncture helps stimulate the natural healing mechanisms and causes the body to manufacture pain relieving chemicals.
3. Builds a stronger immune system
The body’s immune system is negatively affected by stress, poor diet, illness and certain medical treatments, but acupuncture targets the underlying imbalances naturally and helps it to regain balance.
4. Eliminate that killer hangover
While it may not have been the best choice to finish off that bottle of wine, acupuncture can help the body detox and flush out the morning side effects.
5. Mood stabilizer
If you find yourself snapping at friends, family, or co-workers for unexplained reasons, acupuncture can get to the root of the problem, find the imbalance and help your body return to a healthier state of mind.
6. Chronic stomach problems
Some people suffer from stomach problems and never find the cause. Acupuncture targets your whole body, including the digestive tract and helps it to work in harmony with the rest of the body’s systems.
7. Coping with death
Grief can have an overwhelming effect on the body and manifest itself physically. Acupuncture helps reduce the anxiety of dealing with loss and help you cope with the stress.
END OF QUOTE
The ‘7 things’ are remarkably mislabelled – they should be called 7 lies! Let me explain:
- There are several Cochrane reviews on the subject of acupuncture for various addictions. Here are their conclusions: There is currently no evidence that auricular acupuncture is effective for the treatment of cocaine dependence. The evidence is not of high quality and is inconclusive. Further randomised trials of auricular acupuncture may be justified. There is no clear evidence that acupuncture is effective for smoking cessation. There is currently no evidence that auricular acupuncture is effective for the treatment of cocaine dependence. The evidence is not of high quality and is inconclusive. Further randomised trials of auricular acupuncture may be justified.
- Even if the ‘endorphin story’ is true (in my view, it’s but a theory), there is no good evidence that acupuncture enhances our body’s self-healing mechanisms via endorphins or any other mechanism.
- Stronger immune system? My foot! I have no idea where this claim comes from, certainly not from anything resembling good evidence.
- Acupuncture for hangover or detox? This is just a stupid joke with no evidential support. I imagine, however, that it is superb marketing.
- The same applies to acupuncture to ‘stabilize’ your mood.
- Unexplained stomach problems? Go and see a doctor! Here is the conclusion of a Cochrane review related to IBS which is one of the more common unexplained stomach complaint: Sham-controlled RCTs have found no benefits of acupuncture relative to a credible sham acupuncture control for IBS symptom severity or IBS-related quality of life.
- I am not aware of any good evidence to show that acupuncture could ease the grieving process; I even doubt that this would be such a good or desirable thing: grieving is a necessary and essential process.
So, what we have here are essentially 7 fat lies. Yes, I know, the literature and the internet are full of them. And I suspect that they are a prominent reason why acupuncture is fairly popular today. Lies are a major marketing tool of acupuncturists – but that does not mean that we should let them get away with them!
Bogus claims may be good for the cash flow of alternative practitioners, but they are certainly not good for our health and well-being; in fact, they can cost lives!!!
IN THIS SPIRIT, LET ME ADD SEVEN THINGS YOU DO NEED TO KNOW ABOUT ACUPUNCTURE
- Traditional acupuncture is based on complete hocus pocus and is therefore implausible.
- ‘Western’ acupuncture is based on endorphin and other theories, which are little more than that and at best THEORIES.
- Acupuncture is often promoted as a ‘cure all’ which is implausible and not supported by evidence.
- Meridians, acupoints chi and all the other things acupuncturists claim to exist are pure fantasy.
- For a small list of symptoms, acupuncture is backed up by some evidence, but this is less than convincing and could well turn out to rely on little more than placebo.
- The claim of acupuncturists that acupuncture is entirely safe is false.
- Acupuncture studies from China cannot be trusted.
Low back pain (LBP) is a ‘minor complaint’ in the sense that it does not cost patients’ lives. At the same time, LBP is amongst the leading causes of disability and one of the most common reasons for patients to seek primary care. Chiropractors, osteopaths, physical therapists and general practitioners are among those treating LBP patients, but there is only limited evidence regarding the effectiveness offered by these provider groups.
The aim of this systematic review was to estimate the clinical effectiveness and to systematically review economic evaluations of chiropractic care compared to other commonly used approaches among adult patients with non-specific LBP.
A comprehensive search strategy was conducted to identify 1) pragmatic randomized clinical trials (RCTs) and/or 2) full economic evaluations of chiropractic care for low back pain compared to standard care delivered by other healthcare providers. Studies published between 1990 and 4th June 2015 were considered. The primary outcomes included pain, functional status and global improvement. Study selection, critical quality appraisal and data extraction were conducted by two independent reviewers. Data from RCTs with low risk of bias were included in a meta-analysis to determine estimates of effect sizes. Cost estimates of full economic evaluations were converted to 2015 USD and results summarized.
Six RCTs and three full economic evaluations were included. Five RCTs with low risk of bias compared chiropractic care to exercise therapy (n = 1), physical therapy (n = 3) and medical care (n = 1). The authors found similar effects for chiropractic care and the other types of care. Three low to high quality full economic evaluations studies (one cost-effectiveness, one cost-minimization and one cost-benefit) compared chiropractic to medical care. Highly divergent conclusions (favours chiropractic, favours medical care, equivalent options) were noted for economic evaluations of chiropractic care compared to medical care.
The authors drew the following conclusions: moderate evidence suggests that chiropractic care for LBP appears to be equally effective as physical therapy. Limited evidence suggests the same conclusion when chiropractic care is compared to exercise therapy and medical care although no firm conclusion can be reached at this time. No serious adverse events were reported for any type of care. Our review was also unable to clarify whether chiropractic or medical care is more cost-effective. Given the limited available evidence, the decision to seek or to refer patients for chiropractic care should be based on patient preference and values. Future studies are likely to have an important impact on our estimates as these were based on only a few admissible studies.
This is a thorough and timely review. Its results are transparent and clear, however, its conclusions are, in my view, more than a little odd.
Let me try to re-formulate them such that they are better supported by the actual data: There is no good evidence to suggest that chiropractic care is better or worse that conventional therapeutic approaches currently used for LBP. The pooled sample size dimensions too small to allow any statements about the risks of the various approaches. The data are also too weak for any pronouncements on the relative cost-effectiveness of the various options. Given these limitations, the decision which approach to use should be based on a more comprehensive analysis of the therapeutic risks.
The point I am trying to make is quite simple:
- The fact that RCTs fail to show adverse effects could be due to the small collective sample size and/or to the well-known phenomenon that, in well-controlled trials, adverse effects tend to be significantly rarer than in routine care.
- Hundreds of serious adverse events have been reported after chiropractic spinal manipulations; to these we have to add the fact that ~50% of all chiropractic patients suffer from transient, mild to moderate adverse effects after spinal manipulations.
- If we want to generate a realistic picture of the safety of a therapy, we need to include case-reports, case-series and other non-RCT evidence.
- Conventional treatments of LBP may not be free of adverse effects, but some are relatively safe.
- It seems reasonable, necessary and ethical to consider a realistic picture of the relative risks when deciding which therapy amongst equally (in)effective treatments might be best.
To me, all this seems almost painfully obvious, and I ask myself why the authors of this otherwise sound review failed to consider such thoughts. As one normally is obliged to, the authors included a section about the limitations of their review:
Our review has limitations. First, we did not search the grey literature for clinical effectiveness studies. McAuley et al. showed that the inclusion of results from the grey literature tend to decrease effectiveness estimates in meta-analyses because the unpublished studies tend to report smaller treatment effects. Second, critical appraisal requires scientific judgment that may vary among reviewers. This potential bias was minimized by training reviewers to use a standardized critical appraisal tool and using a consensus process among reviewers to reach decisions regarding scientific admissibility. Most of the original between-group differences and pooled estimates in our meta-analysis did not favour a specific provider group, and we believe it is unlikely that the inclusion of unpublished grey literature would change our conclusions. Third, the low number of clinical trials prevents us from conducting a meaningful investigation for publication bias. Fourth, the majority of the included clinical effectiveness studies (three out of five) and all three economic evaluations were conducted in the United States. Caution should therefore be used when generalizing our findings to other settings or jurisdictions. With respect to economic evaluations in particular, local healthcare systems and insurance plans may have a higher impact on cost than the type of healthcare provider.
Remarkably, this section does not mention their useless assessment of the risks with one word. Why? One answer might be found in the small-print of the paper:
The authors … have the following competing interests: MAB: Personal fees from Ordre des chiropraticiens du Québec for one teaching presentation, outside the submitted work. MJS: Position at the Nordic Institute of Chiropractic and Clinical Biomechanics is funded by the Danish Chiropractic Research Foundation. The Foundation had no role in the study design; in the design and conduct of the study, in the collection, management, analysis, and interpretation of data; in the preparation, review or approval of the manuscript; or in the decision to submit the article for publication. RBDS: Nothing to disclose. JB: Nothing to disclose. PH: Nothing to disclose. AB: Position at the School of Physical and Occupational Therapy at McGill University is funded by the Canadian Chiropractic Research Foundation. The Foundation had no role in the study design; in the design and conduct of the study, in the collection, management, analysis, and interpretation of data; in the preparation, review or approval of the manuscript; or in the decision to submit the article for publication.
In alternative medicine, good evidence is like gold dust and good evidence showing that alternative therapies are efficacious is even rarer. Therefore, I was delighted to come across a brand-new article from an institution that should stand for reliable information: the NIH, no less.
According to its authors, this new article “examines the clinical trial evidence for the efficacy and safety of several specific approaches—acupuncture, manipulation, massage therapy, relaxation techniques including meditation, selected natural product supplements (chondroitin, glucosamine, methylsulfonylmethane, S-adenosylmethionine), tai chi, and yoga—as used to manage chronic pain and related disability associated with back pain, fibromyalgia, osteoarthritis, neck pain, and severe headaches or migraines.”
The results of this huge undertaking are complex, of course, but in a nutshell they are at least partly positive for alternative medicine. Specifically, the authors state that “based on a preponderance of positive trials vs negative trials, current evidence suggests that the following complementary approaches may help some patients manage their painful health conditions: acupuncture and yoga for back pain; acupuncture and tai chi for OA of the knee; massage therapy for neck pain with adequate doses and for short-term benefit; and relaxation techniques for severe headaches and migraine. Weaker evidence suggests that massage therapy, SM, and osteopathic manipulation might also be of some benefit to those with back pain, and relaxation approaches and tai chi might help those with fibromyalgia.”
This is excellent news! Finally, we have data from an authoritative source showing that some alternative treatments can be recommended for common pain conditions.
Hold on, not so fast! Yes, the NIH is a most respectable organisation, but we must not blindly accept anything of importance just because it appears to come form a reputable source. Let’s look a bit closer at the actual evidence provided by the authors of this paper.
Reading the article carefully, it is impossible not to get troubled. Here are a few points that concern me most:
- the safety of a therapy cannot be evaluated on the basis of data from RCTs (particularly as it has been shown repeatedly that trials of alternative therapies often fail to report adverse effects); much larger samples are needed for that; any statements about safety in the aims of the paper are therefore misplaced;
- the authors talk about efficacy but seem to mean effectiveness;
- the authors only included RCTs from the US which must result in a skewed and incomplete picture;
- the article is from the National Center for Complementary and Integrative Health which is part of the NIH but which has been criticised repeatedly for being biased in favour of alternative medicine;
- not all of the authors seem to be NIH staff, and I cannot find a declaration of conflicts of interest;
- the discussion of the paper totally lacks any critical thinking;
- there is no assessment of the quality of the trials included in this review.
My last point is by far the most important. A summary of this nature that fails to take into account the numerous limitations of the primary data is, I think, as good as worthless. As I know most of the RCTs included in the analyses, I predict that the overall picture generated by this review would have changed substantially, if the risks of bias in the primary studies had been accounted for.
Personally, I find it lamentable that such a potentially worthy exercise ended up employing such lousy methodology. Perhaps even more lamentable is the fact that the NIH (or one of its Centers) can descend that low; to mislead the public in this way borders on scientific misconduct and is, in my view, unethical and unacceptable.
A new Cochrane review evaluated the effectiveness and safety of Chinese herbal medicines (CHM) in the treatment of menopausal symptoms. Its authors conducted a thorough search for randomised controlled trials (RCTs) comparing the effectiveness of CHM with placebo, hormone therapy (HT), pharmaceutical drugs, acupuncture, or another CHM formula in women suffering from menopausal symptoms.
Two review authors independently assessed 864 studies for eligibility. Data extractions were performed by them with disagreements resolved through group discussion and clarification of data or direct contact with the study authors. Data analyses were performed in accordance with Cochrane Collaboration guidelines.
In total, 22 RCTs (2902 women) could be included. When CHM was compared with placebo (8 RCTs), there was little or no evidence of a difference between the groups for the following outcomes: hot flushes per day (MD 0.00, 95% CI -0.88 to 0.89; 2 trials, 199 women; moderate quality evidence); hot flushes per day assessed by an overall hot flush score in which a difference of one point equates to one mild hot flush per day (MD -0.81 points, 95% CI -2.08 to 0.45; 3 RCTs, 263 women; low quality evidence); and overall vasomotor symptoms per month measured by the Menopause-Specific Quality of Life questionnaire (MENQOL, scale 0 to 6) (MD -0.42 points; 95% CI -1.52 to 0.68; 3 RCTs, 256 women; low quality evidence). In addition, results from individual studies suggested there was no evidence of a difference between the groups for daily hot flushes assessed by severity (MD -0.70 points, 95% CI -1.00, -0.40; 1 RCT, 108 women; moderate quality evidence); or overall monthly hot flushes scores (MD -2.80 points, 95% CI -8.93 to 3.33; 1 RCT, 84 women; very low quality evidence); or overall daily night sweats scores (MD 0.07 points, 95% CI -0.19 to 0.33, 1 RCT, 64 women; low quality evidence); or overall monthly night sweats scores (MD 1.30 points, 95% CI -1.76 to 4.36, 1 RCT, 84 women; very low quality evidence). However, one study reported that overall monthly vasomotor symptom scores were lower in the CHM group (MD -4.79 points, 95% CI -5.52 to -4.06; 1 RCT, 69 women; low quality evidence).
When CHM was compared with HT (10 RCTs), only two RCTs reported monthly vasomotor symptoms using MENQOL. It was uncertain whether CHM reduces vasomotor symptoms (MD 0.47 points, 95% CI -0.50 to 1.44; 2 RCTs, 127 women; very low quality evidence).
Adverse effects were not fully reported in the included studies. Adverse events reported by women taking CHM included mild diarrhoea, breast tenderness, gastric discomfort and an unpleasant taste. Effects were inconclusive because of imprecise estimates of effects: CHM versus placebo (RR 1.51; 95% CI 0.69 to 3.33; 7 trials, 705 women; I² = 40%); CHM versus HT (RR 0.96; 95% CI 0.66 to 1.39; 2 RCTs, 864 women; I² = 0%); and CHM versus specific conventional medications (such as Fluoxetine and Estazolam) (RR 0.20; 95% CI 0.03 to 1.17; 2 RCTs, 139 women; I² = 61%).
The authors concluded: We found insufficient evidence that Chinese herbal medicines were any more or less effective than placebo or HT for the relief of vasomotor symptoms. Effects on safety were inconclusive. The quality of the evidence ranged from very low to moderate; there is a need for well-designed randomised controlled studies.
This review seems well done and reports clear findings. The fact that there was insufficient evidence for CHM is probably no surprise to most readers of this blog. However, I would like to draw your attention to a finding that could easily be missed: most of the primary studies failed to mention adverse effects; to be perfectly clear: they did not state “there were no adverse effects”, but they simply did not mention the subject of adverse effects at all.
In my view, this is a breach of research ethics. I have been banging on about this phenomenon for some time now, because I think it is important. Many if not most clinical trials in this area neglect reporting adverse effects. This means that we get an entirely misleading impression about the safety of the treatments in question. Reviewers of such studies are bound to conclude that they seem to be safe, while, in fact, researchers have only been withholding crucial information from us.
The solution to this fast-growing problem would be simple: trialists must be forced to fully report adverse effects. This is less complicated that it might seem: journal editors must insist that all authors fully report adverse effects of alternative treatments. Even if there were none at all – a very unlikely proposition if you think about it – they must disclose this fact.
The aim of a new meta-analysis was to estimate the clinical effectiveness and safety of acupuncture for amnestic mild cognitive impairment (AMCI), the transitional stage between the normal memory loss of aging and dementia. Randomised controlled trials (RCTs) of acupuncture versus medical treatment for AMCI were identified using six electronic databases.
Five RCTs involving a total of 568 subjects were included. The methodological quality of the RCTs was generally poor. Participants receiving acupuncture had better outcomes than those receiving nimodipine with greater clinical efficacy rates (odds ratio (OR) 1.78, 95% CI 1.19 to 2.65; p<0.01), mini-mental state examination (MMSE) scores (mean difference (MD) 0.99, 95% CI 0.71 to 1.28; p<0.01), and picture recognition score (MD 2.12, 95% CI 1.48 to 2.75; p<0.01). Acupuncture used in conjunction with nimodipine significantly improved MMSE scores (MD 1.09, 95% CI 0.29 to 1.89; p<0.01) compared to nimodipine alone. Three trials reported adverse events.
The authors concluded that acupuncture appears effective for AMCI when used as an alternative or adjunctive treatment; however, caution must be exercised given the low methodological quality of included trials. Further, more rigorously designed studies are needed.
Meta-analyses like this one are, in my view, perfect examples for the ‘rubbish in, rubbish out’ principle of systematic reviews. This may seem like an unfair statement, so let me justify it by explaining the shortfalls of this specific paper.
The authors try to tell us that their aim was “to estimate the clinical effectiveness and safety of acupuncture…” While it might be possible to estimate the effectiveness of a therapy by pooling the data of a few RCTs, it is never possible to estimate its safety on such a basis. To conduct an assessment of therapeutic safety, one would need sample sizes that go two or three dimensions beyond those of RCTs. Thus safety assessments are best done by evaluating the evidence from all the available evidence, including case-reports, epidemiological investigations and observational studies.
The authors tell us that “two studies did not report whether any adverse events or side effects had occurred in the experimental or control groups.” This is a common and serious flaw of many acupuncture trials, and another important reason why RCTs cannot be used for evaluating the risks of acupuncture. Too many such studies simply don’t mention adverse effects at all. If they are then submitted to systematic reviews, they must generate a false positive picture about the safety of acupuncture. The absence of adverse effects reporting is a serious breach of research ethics. In the realm of acupuncture, it is so common, that many reviewers do not even bother to discuss this violation of medical ethics as a major issue.
The authors conclude that acupuncture is more effective than nimodipine. This sounds impressive – unless you happen to know that nimodipine is not supported by good evidence either. A Cochrane review provided no convincing evidence that nimodipine is a useful treatment for the symptoms of dementia, either unclassified or according to the major subtypes – Alzheimer’s disease, vascular, or mixed Alzheimer’s and vascular dementia.
The authors also conclude that acupuncture used in conjunction with nimodipine is better than nimodipine alone. This too might sound impressive – unless you realise that all the RCTs in question failed to control for the effects of placebo and the added attention given to the patients. This means that the findings reported here are consistent with acupuncture itself being totally devoid of therapeutic effects.
The authors are quite open about the paucity of RCTs and their mostly dismal methodological quality. Yet they arrive at fairly definitive conclusions regarding the therapeutic value of acupuncture. This is, in my view, a serious mistake: on the basis of a few poorly designed and poorly reported RCTs, one should never arrive at even tentatively positive conclusion. Any decent journal would not have published such misleading phraseology, and it is noteworthy that the paper in question appeared in a journal that has a long history of being hopelessly biased in favour of acupuncture.
Any of the above-mentioned flaws could already be fatal, but I have kept the most serious one for last. All the 5 RCTs that were included in the analyses were conducted in China by Chinese researchers and published in Chinese journals. It has been shown repeatedly that such studies hardly ever report anything other than positive results; no matter what conditions is being investigated, acupuncture turns out to be effective in the hands of Chinese trialists. This means that the result of such a study is clear even before the first patient has been recruited. Little wonder then that virtually all reviews of such trials – and there are dozens of then – arrive at conclusions similar to those formulated in the paper before us.
As I already said: rubbish in, rubbish out!