MD, PhD, FMedSci, FSB, FRCP, FRCPEd

clinical trial

The common cold is one of the indications for which homeopathy is deemed to be effective… by homeopaths that is! Non-homeopaths are understandably critical about this claim, not least because there is no good evidence for it. But, hold on, there is a new study which might change all this.

This study was recently published in COMPLEMENTARY THERAPIES IN MEDICINE which is supposed to be one of the better journals in this area. According to its authors, it was conducted “to determine if a homeopathic syrup was effective in treating cold symptoms in preschool children.” Children diagnosed with an upper respiratory tract infection were randomized to receive a commercial homeopathic cold syrup containing allium cepa 6X, hepar sulf calc 12X, natrum muriaticum 6X, phosphorous 12X, pulsatilla 6X, sulphur 12X, and hydrastasis 6X or placebo. Parents administered the study medication as needed for 3 days. The primary outcome was change in symptoms one hour after each dose. Parents also assessed the severity of each of the symptoms of runny nose, cough, congestion and sneezing at baseline and twice daily for 3 days, using a 4-point rating scale. A composite cold score was calculated by combining the values for each of the four symptoms. Among 261 eligible participants, data on 957 doses of study medication in 154 children were analyzed. There was no significant difference in improvement one hour after the dose for any symptom between the two groups. Analysis of twice daily data on the severity of cold symptoms compared to baseline values found that improvements in sneezing, cough and the composite cold score were significantly greater at both the first and second assessments among those receiving the cold syrup compared to placebo recipients.

The authors concluded that the homeopathic syrup appeared to be effective in reducing the severity of cold symptoms in the first day after beginning treatment.

Where to start? There are so many problems with this study that I find it difficult to chose the most crucial ones:

  • The study had a clearly defined primary endpoint; it was not affected by the homeopathic treatment which doubtlessly makes the study a negative trial. The only correct conclusion therefore is that THE HOMEOPATHIC SYRUP FAILED TO AFFECT THE PRIMARY OUTCOME MEASURE OF THIS STUDY. THEREFORE THE TRIAL DID NOT PRODUCE ANY EVIDENCE TO ASSUME THAT THE EXPERIMENTAL TREATMENT WAS EFFICACIOUS.
  • I don’t think that many of the primary or secondary outcome measures are validated or reliable.
  • All the positive results reported in the abstract and the article relate to secondary endpoints which are purely explanatory by nature. They should, in my view, not be mentioned in the conclusions at all.
  • The fact that some results turned out to be positive can be explained by the fact that the investigators ran dozens of tests for statistical significance which means that, by simple chance, some will turn out to produce a positive result.
  • A further explanation for the seemingly positive results might be the fact disclosed in the text of the article that the children in the homeopathy group received more conventional drugs than those in the placebo group.
  • Whatever the reason for these positive results, they certainly had nothing to do with the homeopathic syrup.
  • The study was funded by the company producing the syrup and for which one of the authors was employed as a consultant. This might be an explanation for the abominably poor science. In other words, this paper is not an exercise in testing a hypothesis but one in marketing.

While I might forgive the company for trying to maximise their sales figures, I do find it harder to forgive the authors, reviewers and editors for publishing such overtly false conclusions. In my view, they are all guilty of scientific misconduct.

The boom of alternative medicine in the US – and consequently in the rest of the developed world – is intimately connected with a NHI centre now called NCCIH (National Center for Complementary and Integrative Health). It was founded in the early 1990s because some politicians were bent on promoting quackery. Initially the institution had modest funding but, after more political interference, it had ample cash to pursue all sorts of activities, including sponsoring research into alternative therapies at US universities. A most interesting video summarising the history of the NCCIH can be seen here.

No other institution in the world had more funds for research into alternative medicine than the NCCIH, and it soon became the envy of alt med researchers globally. I have been invited by the NCCHI on several occasions and invariably was impressed by their apparent affluence. While we Europeans usually had to do our research on a shoe-string, our American colleagues seemed to be ‘rolling in it’.

I was often far less impressed with the research they sponsored. Not only it was invariably eye-wateringly expensive, but also its quality seemed often dismal. Sometimes, I even got the impression that research was used as a means of mainstreaming quackery for the unsuspecting American – and consequently world-wide – public.

An example of this mainstreaming is an article in JAMA published yesterday. Here is a short but telling excerpt:

Researchers led by Richard L. Nahin, PhD, MPH, lead epidemiologist at the NIH’s National Center for Complementary and Integrative Health (NCCIH), examined efficacy and safety evidence in 105 randomized controlled trials (RCTs) conducted between January 1966 and March 2016. The review—geared toward primary care physicians as part of the journal’s Symposium on Pain Medicine—focused on popular complementary approaches to common pain conditions.

Unlike a typical systematic review that assigns quality values to the studies, the investigators conducted a narrative review, in which they simply looked at the number of positive and negative trials. “If there were more positives than negatives then we generally felt the approach had some value,” Nahin explained. “If there were more negatives, we generally felt the approach had less value.” Trials that were conducted outside of the United States were excluded from the review.

Based on a “preponderance” of positive vs negative trials, complementary approaches that may offer pain relief include acupuncture and yoga for back pain; acupuncture and tai chi for osteoarthritis of the knee; massage therapy for neck pain; and relaxation techniques for severe headaches and migraine. Several other techniques had weaker evidence, according to the qualitative assessments, for specific pain conditions (see “Selected Complementary Health Approaches for Pain”). The treatments were generally safe, with no serious adverse events reported.

To me, this looks that NCCIH has now managed to persuade even the editors of JAMA to white-wash their dodgy science. The review referred to here is a paper we discussed some time ago on this blog. I then stated about it the following:

Reading the article carefully, it is impossible not to get troubled. Here are a few points that concern me most:

  • the safety of a therapy cannot be evaluated on the basis of data from RCTs (particularly as it has been shown repeatedly that trials of alternative therapies often fail to report adverse effects); much larger samples are needed for that; any statements about safety in the aims of the paper are therefore misplaced;
  • the authors talk about efficacy but seem to mean effectiveness;
  • the authors only included RCTs from the US which must result in a skewed and incomplete picture;
  • the article is from the National Center for Complementary and Integrative Health which is part of the NIH but which has been criticised repeatedly for being biased in favour of alternative medicine;
  • not all of the authors seem to be NIH staff, and I cannot find a declaration of conflicts of interest;
  • the discussion of the paper totally lacks any critical thinking;
  • there is no assessment of the quality of the trials included in this review.

My last point is by far the most important. A summary of this nature that fails to take into account the numerous limitations of the primary data is, I think, as good as worthless. As I know most of the RCTs included in the analyses, I predict that the overall picture generated by this review would have changed substantially, if the risks of bias in the primary studies had been accounted for.

I find it puzzling that the ‘lead epidemiologist at the NIH’s National Center for Complementary and Integrative Health’ would publish such dubious research. Why does he do it? If you have watched the video mentioned above, you are inclined to think that it might be because of political interference.

However, I suggest another, in a way much more damming reason or contributing factor: the NCCIH has so long indulged in such poor science that even its top people have forgotten what good science looks like. I know this is a bold hypothesis; so, let me try to support it with some data.

Several years ago, my team together with several other researches have looked at the NCCIH-sponsored research systematically according to 4 different subject areas. Here are the conclusions of our articles reporting the findings:

ACUPUNCTURE

Seven RCTs had a low risk of bias. Numerous methodological shortcomings were identified. Many NCCAM-funded RCTs of acupuncture have important limitations. These findings might improve future studies of acupuncture and could be considered in the ongoing debate regarding NCCAM-funding. [Focus on Alternative and Complementary Therapies Volume 17(1) March 2012 15–21]

HERBAL MEDICINE

This independent assessment revealed a plethora of serious concerns related to NCCAM studies of herbal medicine. [Perfusion 2011; 24: 89-102]

ENERGY MEDICINE

In conclusion, the NCCAM-funded RCTs of energy medicine are prime examples of misguided investments into research. In our opinion, NCCAM should not be funding poor-quality studies of implausible practices. The impact of any future studies of energy medicine would be negligible or even detrimental. [Focus on Alternative and Complementary Therapies Volume 16(2) June 2011 106–109 ]

CHIROPRACTIC

In conclusion, our review demonstrates that several RCTs of chiropractic have been funded by the NCCAM. It raises numerous concerns in relation to these studies; in particular, it suggests that many of these studies are seriously flawed. [https://www.ncbi.nlm.nih.gov/pubmed/21207089]

I think I can rest my case and urge you to watch the video mentioned above.

This randomized, double-blind study evaluated the efficacy of a homeopathic treatment in preventing excessive weight gain during pregnancy in overweight or obese women who were suspected of having a common mental disorder. For the homeopathic group (n=62), 9 homeopathic remedies were pre-selected: (1) Pulsatilla nigricans, (2) Sepia succus, (3) Lycopodium clavatum, (4) sulphur, (5) Lachesis trigonocephalus, (6) Nux vomica, (7) Calcarea carbonica, (8) phosphorus; and (9) Conium maculatum. From those 9 drugs, one was prioritized for administration for each participant. After the first appointment, a re-selection or selection of a new, more appropriate drug occurred, using the list of preselected drugs. The dosage was 6 drops orally 2 ×/day, in the morning and at night, on 4 consecutive days each week, with an interval of 3 d between doses, up until the next appointment medical appointment. The control group (n=72) took placebos. Both groups also received a diet orientation.

Weight change during pregnancy was defined as the difference between the body mass index (BMI) at the initial evaluation and that recorded at the final evaluation, adjusted for 40 weeks of gestation. In addition, the APGAR index in the newborn  (a measure of the health of the baby) was evaluated. The mean variation between baseline BMI and BMI at week 40 of gestation was +4.95 kg/m2 in the control group and +5.05 kg/m2 in the homeopathy group. The difference between the two groups was not significant. APGAR 10 at 5 min (59.6% in the homeopathy group and 36.4% in the control group) was statistically significant (P = .016).

The authors concluded that homeopathy does not appear to prevent excessive body mass gain in pregnant women who are overweight or obese and suspected of having a common mental disorder. Homeopathy did not change the APGAR score to modified clinical attention at delivery room. However, the evidence observed at APGAR 10 at minute 5 suggests that  homeopathy had a modulating effect on the vitality of newborns, warranting further studies designed to investigate it.

I have seen many odd studies in my time, but this must be one of the oddest?

  • What is the rationale for assuming that homeopathy might affect body weight?
  • Why take pregnant women with a weight problem who were suspected of having a common mental disorder?
  • Why try to turn a clearly negative result into a finding that is (at least partly) positive?

The last point seems the most important one to me. The primary outcome measure of this study (weight gain) was clearly defined and was not affected by the therapy. Yet the authors feel it justified to add to their conclusions that homeopathy had a modulating effect on the vitality of newborns (almost certainly nothing but a chance finding).

Are they for real?

I suppose they are: they are real pseudo-scientific promoters of quackery!

Meniscus-injuries are common and there is no consensus as to how best treat them. Physiotherapists tend to advocate exercise, while surgeons tend to advise surgery.

Of course, exercise is not a typical alternative therapy but, as many alternative practitioners might disagree with this statement because they regularly recommend it to their patients, it makes sense to cover it on this blog. So, is exercise better than surgery for meniscus-problems?

The aim of this recent Norwegian study aimed to shed some light on this question. Specifically wanted to determine whether  exercise therapy is superior to arthroscopic partial meniscectomy for knee function in  patients with degenerative meniscal tears.

A total of 140 adults with degenerative medial meniscal tear verified by magnetic resonance imaging were randomised to either receiving 12 week supervised exercise therapy alone, or arthroscopic partial meniscectomy alone. Intention to treat analysis of between group difference in change in knee injury and osteoarthritis outcome score (KOOS4), defined a priori as the mean score for four of five KOOS subscale scores (pain, other symptoms, function in sport and recreation, and knee related quality of life) from baseline to two-year follow-up and change in thigh muscle strength from baseline to three months.

The results showed no clinically relevant difference between the two groups in change in KOOS4 at two years (0.9 points, 95% confidence interval −4.3 to 6.1; P=0.72). At three months, muscle strength had improved in the exercise group (P≤0.004). No serious adverse events occurred in either group during the two-year follow-up. 19% of the participants allocated to exercise therapy crossed over to surgery during the two-year follow-up, with no additional benefit.

The authors concluded that the observed difference in treatment effect was minute after two years of follow-up, and the trial’s inferential uncertainty was sufficiently small to exclude clinically relevant differences. Exercise therapy showed positive effects over surgery in improving thigh muscle strength, at least in the short-term. Our results should encourage clinicians and middle-aged patients with degenerative meniscal tear and no definitive radiographic evidence of osteoarthritis to consider supervised exercise therapy as a treatment option.

As I stated above, I mention this trial because exercise might be considered by some as an alternative therapy. The main reason for including it is, however, that it is in many ways an exemplary good study from which researchers in alternative medicine could learn.

Like so many alternative therapies, exercise is a treatment for which placebo-controlled studies are difficult, if not impossible. But that does not mean that rigorous tests of its value are impossible. The present study shows the way how it can be done.

Meaningful clinical research is no rocket science; it merely needs well-trained scientists who are willing to test the (rather than promote) their hypotheses. Sadly such individuals are as rare as gold dust in the realm of alternative medicine.

A press-release from a company based in Germany recently caught my attention. I here present only the most relevant sections from this document:

Natural remedies like medicinal mushrooms also called vitality mushrooms haven proven helpful in prevention and as a support in the therapy, of diabetes type 2. This could be shown by long-time observational studies in naturopathy, for example by MykoTroph – Institute for Medicinal Mushrooms. Medicinal mushroom Coprinus has regenerating effects on the pancreas; it also helps the sensitization of the receptors responsible for the absorption of insulin and claims to have a blood sugar lowering effect.

Medicinal mushroom Maitake has positive effects on the fat metabolism and the sensitivity of insulin receptors. Diabetes type 2 is often linked to circulation problems, vascular diseases and hypertension. Therefore, regular monitoring of the blood pressure, blood lipids, triglycerides and body weight is highly important. The intake of Maitake can help ‒ even in a preliminary stage ‒ to get a grip on these determining factors.

Within the scope of a holistic therapy of diabetes type 2 with metabolic syndrome, the combined intake of medicinal mushrooms and Nopal juice (prickly pear) can be very reasonable. Nopal juice has a lowering effect on the glycemic index of ingested food. The consequence is a slower release of carbohydrates in the intestines and is therefore favorable for a healthy level of blood sugar…

Medicinal mushrooms are available as mushroom powder capsules. According to observational studies of MykoTroph – Institute for Medicinal Mushrooms, especially mushroom powder derived from the whole mushroom has proven effective. Only if the mushroom powder is derived from the whole mushroom, the powder will contain all of the effective ingredients of medicinal mushrooms. It should also be taken care that the mushrooms are from certified organic production. For further information, please visit us on http://www.mykotroph.com
a Japanese study participants comprised 726 Japanese T2DM outpatients free of history of CVD. Life styles were analyzed using self-reported questionnaires. The relationship between dietary patterns, identified by factor analysis, and potential risk factors for CVD was investigated by linear and logistic regression analyses….The “Seaweeds, Vegetables, Soy products and Mushrooms” pattern, characterized by high consumption of seaweeds, soy products and mushrooms, was associated with lower use of diabetes medication and healthier lifestyles.

END OF QUOTE

These are claims that could be relevant to millions of diabetic patients worldwide – but are they true?

The study cited above did indeed show an association; but an association is not necessarily a causal relationship! So what evidence is there fore a causal relationship between mushroom-consumption and diabetes? The answer is: frustratingly little.

A Cochrane review concluded that “evidence from a small number of randomised controlled trials does not support the use of G lucidum [Ganoderma lucidum (also known as lingzhi or reishi)] for treatment of cardiovascular risk factors in people with type 2 diabetes mellitus. Future research into the efficacy of G lucidum should be placebo-controlled and adhere to clinical trial reporting standards.”

The authors of another Cochrane review concluded that “our review did not find sufficient evidence to justify the use of G. lucidum as a first-line treatment for cancer. It remains uncertain whether G. lucidum helps prolong long-term cancer survival. However, G. lucidum could be administered as an alternative adjunct to conventional treatment in consideration of its potential of enhancing tumour response and stimulating host immunity. G. lucidum was generally well tolerated by most participants with only a scattered number of minor adverse events. No major toxicity was observed across the studies. Although there were few reports of harmful effect of G. lucidum, the use of its extract should be judicious, especially after thorough consideration of cost-benefit and patient preference. Future studies should put emphasis on the improvement in methodological quality and further clinical research on the effect of G. lucidum on cancer long-term survival are needed. An update to this review will be performed every two years.”

A further study determined whether a supplement of Agaricus blazei Murill extract improves insulin resistance in type 2 diabetes. It was designed as a clinical randomized, double-blind, placebo-controlled trial. Diabetic patients were randomly assigned to either receiving supplement of Agaricus blazei Murill (ABM) extract or placebo (cellulose) 1500 mg daily for 12 weeks. At the end of the study, the subjects who received supplement of ABM extract (n = 29) showed significantly lower HOMA-IR index than the control group (n = 31). The plasma adiponectin concentration increased by 20% in the ABM group after 12 weeks of treatment, but decreased 20% among those taking the placebo. The authors concluded that “ABM extract improves insulin resistance among subjects with type 2 diabetes. The increase in adiponectin concentration after taking AMB extract for 12 weeks might be the mechanism that brings the beneficial effect. Studies with longer periods of follow-up should be conducted in the future.”

On the basis of all this evidence, it seems fair to conclude that mushrooms have little or no effect on diabetes.

And what about the above press-release?

Diabetes is a serious condition that can be well-controlled with diet, exercise and drugs. Many diabetics are nevertheless fed up with taking drugs throughout their entire life and would only be too happy to exchange them for ‘something natural’. Therefore patients might try mushrooms or other natural ‘cures’, if they are promoted in this way. However, this decision could prove fatal (examples of such tragedies abound).

In view of these considerations, I find such promotion irresponsible, unethical and outright dangerous.

On 25 and 26 May of this year I wrote two posts about an acupuncture trial that, in my view, was dodgy. To refresh your memory, here is the relevant part of the 2nd post:

This new study was designed as a randomized, sham-controlled trial of acupuncture for persistent allergic rhinitis in adults investigated possible modulation of mucosal immune responses. A total of 151 individuals were randomized into real and sham acupuncture groups (who received twice-weekly treatments for 8 weeks) and a no acupuncture group. Various cytokines, neurotrophins, proinflammatory neuropeptides, and immunoglobulins were measured in saliva or plasma from baseline to 4-week follow-up.

Statistically significant reduction in allergen specific IgE for house dust mite was seen only in the real acupuncture group. A mean (SE) statistically significant down-regulation was also seen in pro-inflammatory neuropeptide substance P (SP) 18 to 24 hours after the first treatment. No significant changes were seen in the other neuropeptides, neurotrophins, or cytokines tested. Nasal obstruction, nasal itch, sneezing, runny nose, eye itch, and unrefreshed sleep improved significantly in the real acupuncture group (post-nasal drip and sinus pain did not) and continued to improve up to 4-week follow-up.

The authors concluded that acupuncture modulated mucosal immune response in the upper airway in adults with persistent allergic rhinitis. This modulation appears to be associated with down-regulation of allergen specific IgE for house dust mite, which this study is the first to report. Improvements in nasal itch, eye itch, and sneezing after acupuncture are suggestive of down-regulation of transient receptor potential vanilloid 1.

…the trial itself raises a number of questions:

  1. Which was the primary outcome measure of this trial?
  2. What was the power of the study, and how was it calculated?
  3. For which outcome measures was the power calculated?
  4. How were the subjective endpoints quantified?
  5. Were validated instruments used for the subjective endpoints?
  6. What type of sham was used?
  7. Are the reported results the findings of comparisons between verum and sham, or verum and no acupuncture, or intra-group changes in the verum group?
  8. What other treatments did each group of patients receive?
  9. Does anyone really think that this trial shows that “acupuncture is a safe, effective and cost-effective treatment for allergic rhinitis”?

In the comments section, the author wrote: “after you have read the full text and answered most of your questions for yourself, it might then be a more appropriate time to engage in any meaningful discussion, if that is in fact your intent”, and I asked him to send me his paper. As he does not seem to have the intention to do so, I will answer the questions myself and encourage everyone to have a close look at the full paper [which I can supply on request].

  1. The myriad of lab tests were defined as primary outcome measures.
  2. Two sentences are offered, but they do not allow me to reconstruct how this was done.
  3. No details are provided.
  4. Most were quantified with a 3 point scale.
  5. Mostly not.
  6. Needle insertion at non-acupoints.
  7. The results are a mixture of inter- and intra-group differences.
  8. Patients were allowed to use conventional treatments and the frequency of this use was reported in patient diaries.
  9. I don’t think so.

So, here is my interpretation of this study:

  • It lacked power for many outcome measures, certainly the clinical ones.
  • There were hardly any differences between the real and the sham acupuncture group.
  • Most of the relevant results were based on intra-group changes, rather than comparing sham with real acupuncture, a fact, which is obfuscated in the abstract.
  • In a controlled trial fluctuations within one group must never be interpreted as caused by the treatment.
  • There were dozens of tests for statistical significance, and there seems to be no correction for multiple testing.
  • Thus the few significant results that emerged when comparing sham with real acupuncture might easily be false positives.
  • Patient-blinding seems questionable.
  • McDonald as the only therapist of the study might be suspected to have influenced his patients through verbal and non-verbal communications.

I am sure there are many more flaws, particularly in the stats, and I leave it to others to identify them. The ones I found are, however, already serious enough, in my view, to call for a withdrawal of this paper. Essentially, the authors seem to have presented a study with largely negative findings as a trial with positive results showing that acupuncture is an effective therapy for allergic rhinitis. Subsequently, McDonald went on social media to inflate his findings even more. One might easily ask: is this scientific misconduct or just poor science?

END OF QUOTE

This and the previous post created lots of discussion and comments. However, the question whether the study in question amounted to scientific misconduct was never satisfactorily resolved. Therefore, I decided to write to the editor of ‘Ann Allergy Asthma Immunol‘ where the trial had been published. He answered by saying I would need to file an official complaint for him to address the issue. On 13 June, I therefore sent him the following email:

Thank you for your letter of 3/6/2016 suggesting I make a formal complaint about the paper entitled ‘EFFECT OF ACUPUNCTURE ON HOUSE DUST MITE…’ [ Ann Allergy Asthma Immunol 2016] by McDonald et al. I herewith wish to file such a complaint.

The article in question reports an RCT of acupuncture for persistent allergic rhinitis. It followed a parallel group design with 3 groups receiving the following interventions:

1.       Acupuncture

2.       Sham-acupuncture

3.       No treatment

There was a plethora of outcome measures and time points on which they were measured. A broad range of parameters was defined as primary endpoints.

The conclusion reached by the authors essentially was that acupuncture affected several outcome measures in a positive sense, thus supporting the notion that acupuncture is efficacious [“Symptoms and quality of life improved significantly and were still continuing to improve 4 weeks after treatment ceased.”] This conclusion, however, is misleading and needs correcting.

The main reasons for this are as follows:

·         Despite the fact that the authors did many dozens of statistical tests for significance, they did not correct for this multiplicity of tests. Consequently, some or most of the significant results are likely to be false positive.

·         Many of the positive results of this paper were not obtained by comparing one group to another but by doing before/after comparisons within one group. This approach defies the principle of a controlled clinical trial. For doing intra-group comparisons, we obviously do not need any control group at all. The findings from intra-group comparisons are prominently reported in the paper, for instance in the abstract, giving the impression that they originate from inter-group comparisons. One has to read the paper very carefully to find that, when inter-group comparisons were conducted, their results did NOT confirm the findings from the reported intra-group comparisons. As this is the case for most of the symptomatic endpoints, the impression given is seriously misleading and needs urgent correction.

On the whole, the article is a masterpiece of obfuscation and misrepresentation of the actual data. I urge you to consider the harm than can be done by such a misleading publication. In my view, the best way to address this problem is to withdraw the article.

I look forward to your decision.

Regards

E Ernst

END OF QUOTE

I had to send several reminders but my most recent one prompted the following response dated 7/11/ 2016:

Dear Professor Ernst,
Thank you for your patience while we worked through the process of considering your complaints levied on the article entitled ‘EFFECT OF ACUPUNCTURE ON HOUSE DUST MITE…’ [ Ann Allergy Asthma Immunol 2016] by McDonald et al. I considered the points that you made in your previous letter, sought input from our editorial team (including our biostatistics editor) , our publisher and the authors themselves. I sent the the  charges ( point by point) anonymously to the authors and allowed them time to respond which they did. I had their responses reviewed by selected editors and , as a result of this process, have decided not to pursue any corrective or punitive action based upon the following :
 
  1. Our editorial team recognizes that this is not the best clinical trial we have published in the Annals of Allergy, Asthma and Immunology. However, neither is is the worst. As in most published research studies, there are always things that could have been done better to make it a stronger paper. Never-the-less, the criticism falls fall short of any sort of remedy that would include withdrawal of the manuscript.
  2. Regarding your accusation that the multiple positive endpoint resulted in the authors making specific therapeutic claims, our assessment is that no specific therapeutic claim was made but rather the authors maintained that the data support the value of acupuncture in improving symptoms and quality of life in patients with AR. We do not believe there was overreach in those statements.
  3. The authors’ stated intent was to show immune changes associated with clinical markers of improvement in the active acupuncture group compared to controls. The authors maintain (and our editors agree) that their data assessments were primarily based upon three statistical tests not “dozens” (as stated in your original letter of complaint).  The power analysis and sample size calculations were presented to us and deemed adequate , making the probability of a type I error quite low.
  4. The authors acknowledge in their paper that there could be limitations to their data interpretation based upon potential disparities between intra- and intergroup comparisons. The editors felt their transparency was adequately disclosed.
In summary, as editor-in-chief of the Annals of Allergy, Asthma and Immunology, I did not find sufficient merit in your charges to initiate any corrective or punitive action for this manuscript. I understand you will strongly disagree with this decision and I regret that. However, in the final analysis, my primary intent is to preserve the objectivity, fairness, and integrity of our journal and its review process. I believe I have accomplished that in this instance.
 
Sincerely
END OF QUOTE
This seems to settle the issue: the study in question does not involve scientific misconduct!
Or does it?
I would be grateful for the view of the readers of this post.

I have been alerted to the fact that my former medical school in Munich at one of Germany’s highest-ranked universities is currently running an elective course in homeopathy. For those who do not read German (the original announcement [apparently posted all over Munich university hospitals] is copied below), it teaches the use of homeopathy in/for:

  • INTERNAL MEDICINE
  • NEONATOLOGY
  • SINUSITIS
  • RECURRENT OTITIS MEDIA
  • INSOMNIA
  • PALLIATION OF RESPIRATORY PROBLEMS
  • PROSTATE CANCER
  • POST-TRAUMATIC SYNDROMES
  • BIPOLAR DISEASE
  • MULTIMORBID PATIENTS WITH UVEITIS
  • COUGH
  • DISEASES OF THE FEMALE BREAST
  • SUPPORTIVE CANCER CARE
  • PAEDIATRIC ASTHMA

The course is being organised by Dr. med. Sigrid Kruse, von Haunersches Kinderspital des Klinikums der Universität München in co-operation with the ‘Landesverband Bayern des Deutschen Zentralvereins homöopathischer Ärzte’. The lecturers of this course seem to be mostly homeopaths from practices in and around Munich.

This article provides further explanations:

The project „Homeopathy in pediatrics“ was established in the Dr. von Hauner’s Children’s Hospital University of Munich in 1995 to integrate homeopathy into a university hospital. Selected children (outpatients and in the wards) are treated conventionally and homeopathically. The Karl and Veronica Carstens-Foundation initially financed the project over six years. An association of parents, whose children were treated for cancer, funded the project for one year. Since 2002, for the first time in Germany, the National Health Insurance is providing the financial background for two consultants for Homeopathy at this University hospital.

Who are we?

Dr. Mira Dorcsi-Ulrich, who initiated the project and carries out the supervision. She is a pediatrician in her own practice with 23 years of experience.

Dr. Sigrid Kruse has managed to integrate homeopathy into the clinic, starting at first in 1995 as a resident for pediatrics. Now she fulfills the requests of doctors and parents in the wards demanding concomitant homeopathic treatment.

Dr. Christian Lucae mainly treats the outpatients while focussing on his research project with children showing attention-deficit-hyperactivity-syndrome (ADHS).

Concomitant homeopathic therapy was successful in the following cases: intracerebral bleeding 3rd degree in premature babies, drug withdrawal in neonates addicted mothers, epilepsy, handicapped children, ADHS, migraine, tic, recurrent infections, asthma and atopic eczema, complications in wound healing and other problems. Homeopathic treatment of children parallel to conventional methods is particularly well accepted in the treatment of cancer. The side effects of oncological treatment like vomiting and stomatitis can be relieved, aggressions and anxiety intercepted and life quality improved.

END OF QUOTE

Which journal with a modicum of self-respect or rigor allows a homeopath to publish anything like the last paragraph without providing a jot of evidence? The answer is the ‘ALLGEMEINE HOMOEOPATHISCHE ZEITUNG’ – no further explanation needed, I think.

Courses like the one above, run at university level, make me first a little speechless and then more than a little angry. Medical schools should have other roles than teaching impressionable students things that fly in the face of science and evidence. They should guide them to become responsible doctors not misguide them to turn into irresponsible quacks. The fact that this comes from the medical school where I,  many years ago, studied, graduated, worked and made both my MD and PhD theses renders the whole thing painfully sad for me personally.

But let’s not get depressed… ‘always look on the bright side of life’!!!

Luckily, there are glimpses of a bright side here. For instance, the fact that doctor Quak is one of the lecturers of this course (see below) is not without jollity, I must admit. Also amusing – at least to me – is be the vision of Dr. med. Mira Dorcsi-Ulrich (see below) standing in front of her students explaining the findings of one of the few RCT of individualised homeopathy for paediatric asthma. This study from my team found no evidence that “adjunctive homeopathic remedies, as prescribed by experienced homeopathic practitioners, are superior to placebo in improving the quality of life of children with mild to moderate asthma in addition to conventional treatment in primary care.”

——————————————————————————————————————————————

Here is the German original announcement of the course:

RINGVORLESUNG IM WINTERSEMESTER 2016/2017
HOMÖOPATHIE VON DER THEORIE ZUR PRAXIS MIT PRAXISBEISPIELEN UND PATIENTENVORSTELLUNGEN

1. 20.10.2016 … IN DER INNEREN MEDIZIN: MÖGLICHKEITEN UND GRENZEN Dr. med. Ulf Riker
2. 27.10.2016 … IN DER NEONATOLOGIE: IKTERUS, ASPHYXIE UND UNRUHE Dr. med. Monika Grasser
3. 03.11.2016 … BEI PATIENTEN MIT SINUSITIS Dr. med. Michael Schreiner
4. 10.11.2016 … BEI KINDERN MIT REZIDIVIERENDER OTITIS MEDIA Dr. med. Christian Lucae
5. 17.11.2016 … BEI SCHLAFSTÖRUNGEN Dr. med. Brigitte Seul
6. 24.11.2016 … BEI PALLIATIV-PATIENTEN MIT RESPIRATORISCHEN PROBLEMEN Herbert Michalczyk
7. 01.12.2016 … IN DER BEGLEITUNG VON PATIENTEN MIT EINEM PROSTATA-CARCINOM Uwe Kraemer-Hoenes
8. 08.12.2016 … BEI POSTTRAUMATISCHER BELASTUNGS-STÖRUNG Dr. med. Ingrid Pfanzelt
9. 15.12.2016 … BEI EINER PATIENTIN MIT BIPOLARER AFFEKTIVER STÖRUNG Dr. med. Stephan Gerke
10. 12.01.2017 … BEI EINEM MULTIMORBIDEN PATIENTEN MIT UVEITIS Dr. med. Thomas Quak
11. 19.01.2017 … BEI PATIENTEN MIT HUSTEN Dr. med. Renate Grötsch
12. 26.01.2017 … BEI ERKRANKUNGEN DER WEIBLICHEN BRUST Dr. med. Ute Bullemer
13. 02.02.2017 … IN DER BEGLEITUNG VON KREBSPATIENTEN MIT Q-POTENZEN Miclós Takács
15. 09.02.2017… BEI KINDERN MIT ASTHMA BRONCHIALE Dr. med. Mira Dorcsi-Ulrich
Organisation: Dr. med. Sigrid Kruse, Dr. von Haunersches Kinderspital des Klinikums der Universität München
E-Mail: sigrid.kruse@med.uni-muenchen.de in Zusammenarbeit mit dem Landesverband Bayern des Deutschen Zentralvereins homöopathischer Ärzte,

Prince Charles’ views on health have repeatedly taken centre stage on this blog. And rightly so; they are often weird and wonderful. In 2013, for instance, I quoted them extensively:

Charles stands for…”the kind of care that integrates the best of new technology and current knowledge with ancient wisdom. More specifically, perhaps, it is an approach to care of the patient which includes mind, body and spirit and which maximizes the potential of conventional, lifestyle and complementary approaches in the process of healing”. Charles believes that conventional medicine aims “to treat the symptoms of disease” his vision of a post-modern medicine therefore is “actively to create health and to put the patient at the heart of this process by incorporating those core human elements of mind, body and spirit…This whole area of work – what I can only describe as an ‘integrated approach’ in the UK, or ‘integrative’ in the USA – takes what we know about appropriate conventional, lifestyle and complementary approaches and applies them to patients. I cannot help feeling that we need to be prepared to offer the patient the ‘best of all worlds’ according to a patient’s wishes, beliefs and needs“. Charles also points out that “health inequalities have lowered life-expectancy” in parts of the UK and suggests, if we “tackle some of these admittedly deep-seated problems, not only do you begin to witness improvements in health and other inequalities, but this can lead to improvements in the overall cost-efficiency and effectiveness of local services.

Sounds alright? Well – at least it is touching to see how he is concerned about inequalities in the UK!

But the royal and no doubt well-intended views need to be followed by royal actions. If not, such words might degenerate into royal BS. If Charles is so keen on giving us all THE BEST OF BOTH WORLDS, he should stop promoting outright quackery such as homeopathic remedies. They contain nothing but sugar! But that is one substance Charles seems to be rather fond of, regardless of the harm it can do in high doses to public health.

Recently, Prince Charles has been criticised by health campaigners for the high sugar content of his Duchy Organic ice cream. The Duchy Organic vanilla ice cream contains 14.5g of sugar per 100g, almost double the amount of Asda’s ‘smart price’ vanilla ice cream which has 7.9g sugar per 100g.  If that wasn’t enough of a blow to the Prince’s brand, the Asda ice cream is also much more affordable at 85p for two litres – compared with £3.49 for every 750ml tub of the Duchy Organic product. Charles’ Dutchy Originals products are sold by Waitrose, and a spokesman of the retailer said: “Waitrose Duchy Organic vanilla ice cream is an indulgent product which is not aimed at children.”

Indulgent like in ‘expensive’? So much for inequalities, Charles.

But let’s not go there; let’s be constructive; after all, the man is full of good will, isn’t he?

I recommend the R&D department of Dutchy Originals put their profits and Charles convictions to good use. Specifically, I suggest they start a research programme on the homeopathic cure for sugar-induced obesity. If Charles is correct, and LIKE CURES LIKE, the obesity epidemic in the UK should be treatable with the very cause of excess body weight. It follows that potentised sugar ought to be a cure for obesity.

I can see it now: DUTCHY ORIGINALS – ‘SUGAR C30’, £15.99 per 10g.

This website tells us that ‘Stopain Migraine’ is the first topical product to effectively relieve migraine pain. It is a safe alternative to other migraine relief products that begins to work as soon as it’s applied. And the press release informs us that Troy Healthcare extended its Stopain line with a Stopain Migraine offering – a topical pain relieving gel that is massaged onto the back of the neck and behind each ear.

“Many of the women we shopped with told us they like that Stopain Migraine lacks systemic side effects and can be used in conjunction with other products – whether that’s natural remedies like peppermint essential oil, Epsom salts and ginger tea, or even prescription drugs or other over-the-counter products,” stated Anthony Cicini, VP Troy Healthcare.

Stopain Migraine begins to work as soon as it’s applied, can be reapplied after 30 minutes, and can be used up to four times daily, the company noted. It’s unique in that it can be used alone, or in addition to other ingestible migraine products to relieve migraine pain.

The homeopathic blend of ingredients follow the guidelines of The Homeopathic Pharmacopoeia of the United State and is recommended by both by primary care physicians and OBGYNs, the company stated.

In addition to providing effective relief quickly, Stopain Migraine offers peace of mind for migraine sufferers, knowing the product is free from aspirin, acetaminophen and caffeine, has no known drug interactions and contains no dyes or preservatives.

Consumers can now find Stopain Migraine nationwide for the suggested retail price of $11.99

END OF PRESS RELEASE

Any evidence, you’d probably ask. A quick Medline search located this abstract:

OBJECTIVE:

To determine whether topical menthol 6% gel will relieve a migraine attack.

MATERIALS AND METHODS:

A single-center, open-label pilot trial of 25 patients with at least 1 year of diagnosed episodic migraine and <15 headache days per month. Patients treated one migraine attack with STOPAIN topical menthol 6% gel to skull base within 2 h of headache onset. Headache pain severity was assessed prior to and after gel application.

RESULTS:

Thirty-two patients enrolled and 25 completed the study. Prior to treatment, 7 patients had mild pain, 13 moderate pain, and 5 severe pain. Two hours following gel application, 7 (28%) patients had no pain, 7 (28%) mild pain, 6 (25%) moderate pain, and 5 (20%) severe pain. The majority of patients had similar pain intensity (8; 32%) or improvement (13; 52%). At 24-h, only two non-rescued patients still had mild headache. Of the 25 completers, 2 patients took rescue medication prior to the 2-h period, and an additional 10 patients rescued between 2 and 24 h.

CONCLUSION:

Study results showed a significant improvement in headache intensity by 2 h after gel application. This pilot study shows STOPAIN gel may be effective in treating an acute migraine attack.

A pilot study! I thought pilots were for testing feasibility, not effectiveness!

No control group! The observed effect is therefore not attributable to ‘Stopain’ at all!

But there is more! Iranian researchers published this RCT:

OBJECTIVE:

To investigate the efficacy and safety of the cutaneous application of menthol 10% solution for the abortive treatment of migraine.

BACKGROUND:

Peppermint and its active ingredient menthol have long been used for the treatment of various pain conditions including headache.

METHODS:

This is a randomised, triple-blind, placebo-controlled, crossed-over study conducted in the neurology Clinic of Nemazee Hospital, affiliated with Shiraz University of Medical Sciences, Shiraz, southern Iran, from March 2007 to March 2008. The patients were recruited via local newspaper advertisements. Eligible patients were categorised into two groups and a 10% ethanol solution of menthol (as drug) and 0.5% ethanol solution of menthol (as placebo) were applied to the forehead and temporal area in a crossover design. Pain free, pain relief, sustained pain free and sustained pain relief end-points were measured by questionnaires using a visual analogue scale.

RESULTS:

The intent-to-treat population consisted of 35 patients (80% women, 20% men, mean age: 29.6 +/- 6.2) with 118 migraine attacks. In the intent-to-treat population, the menthol solution was statistically superior to the placebo on 2-h pain free (p = 0.001), 2-h pain relief (p = 0.000), sustained pain free and sustained pain relief end-points (p = 0.008). The menthol solution was also more efficacious in the alleviation of nausea and/or vomiting and phonophobia and/or photophobia (p = 0.02). In the per-protocol population, there was significantly higher number of patients who experienced at least one pain free/pain relief after the application of menthol rather than the placebo (p = 0.002). No significant difference was seen between the adverse effects of the drug and the placebo groups (p = 0.13).

CONCLUSION:

Menthol solution can be an efficacious, safe and tolerable therapeutic option for the abortive treatment of migraine.

Yes, you are quite right; this must be a different product. It contains just menthol and at a higher concentration than ‘Stopain’.

So what does ‘Stopain’ actually contain?  I must say that 6% menthol does not sound very homeopathic to me! The website of Troy Healthcare tells us that it has a total of 4 ingredients:

Mentholum 1X HPUS – 50.00%
Belladonna 3X HPUS – 1.33%
Iris Versicolor 6X HPUS – 1.33%
Sanguinaria Canadensis 6X HPUS – 1.33%

And what do the three homeopathically diluted ingredients do?

Is the term ‘homeopathic’ used here merely to attract a certain type of customer?

And why do they claim that ‘Stopain’ is effective when there is no evidence?

Or perhaps there is evidence and they haven’t published it?

And why do they claim that ‘Stopain’ is the first topical product?

Wasn’t a German topical menthol product marketed years ago?

Search me! I am not sure I know all the answers.

I hope someone from Troy Healthcare reads this and cares to explain.

The risks of consulting a chiropractor have regularly been the subject of this blog (see for instance here, here and here). My critics believe that I am alarmist and have a bee in my bonnet. I think they are mistaken and believe it is important to warn the public of the serious complications that are being reported with depressing regularity, particularly in connection with neck manipulations.

It has been reported that the American model Katie May died earlier this year “as the result of visiting a chiropractor for an adjustment, which ultimately left her with a fatal tear to an artery in her neck” This is the conclusion drawn by the L.A. County Coroner.

katie-may-ist-mit-34-jahre-gestorben

According to Wikipedia, Katie tweeted on January 29, 2016, that she had “pinched a nerve in [her] neck on a photoshoot” and “got adjusted” at a chiropractor. She tweeted on January 31, 2016 that she was “going back to the chiropractor tomorrow.” On the evening of February 1, 2016, May “had begun feeling numbness in a hand and dizzy” and “called her parents to tell them she thought she was going to pass out.” At her family’s urging, May went to Cedars Sinai Hospital; she was found to be suffering a “massive stroke.” According to her father, she “was not conscious when we got to finally see her the next day. We never got to talk to her again.” Life support was withdrawn on February 4, 2016.

Katie’s death certificate states that she died when a blunt force injury tore her left vertebral artery, and cut off blood flow to her brain. It also says the injury was sustained during a “neck manipulation by chiropractor.” Her death is listed as accidental.

Katie’s family is said to be aware of the coroner’s findings. They would not comment on whether they or her estate would pursue legal action.

The coroner’s verdict ends the uncertainty about Katie’s tragic death which was well and wisely expressed elsewhere:

“…The bottom line is that we don’t know for sure. We can’t know for sure. If you leave out the chiropractic manipulations of her neck, her clinical history—at least as far as I can ascertain it from existing news reports—is classic for a dissection due to neck trauma. She was, after all, a young person who suffered a seemingly relatively minor neck injury that, unbeknownst to her, could have caused a carotid artery dissection, leading to a stroke four or five days later… Thus, it seems to be jumping to conclusions for May’s friend Christina Passanisi to say that May “really didn’t need to have her neck adjusted, and it killed her.” … Her two chiropractic manipulations might well have either worsened an existing intimal tear or caused a new one that led to her demise. Or they might have had nothing to do with her stroke, her fate having been sealed days before when she fell during that photoshoot. There is just no way of knowing for sure. It is certainly not wrong to suspect that chiropractic neck manipulation might have contributed to Katie May’s demise, but it is incorrect to state with any degree of certainty that her manipulation did kill her.”

My conclusions are as before and I think they need to be put as bluntly as possible: avoid chiropractors – the possible risks outweigh the documented benefits – and if you simply cannot resist consulting one: DON’T LET HIM/HER TOUCH YOUR NECK!

Recent Comments

Note that comments can now be edited for up to five minutes after they are first submitted.


Click here for a comprehensive list of recent comments.

Categories