The aim of this review is to synthesise systematic reviews (SRs) of randomised clinical trials (RCTs) evaluating the efficacy of acupuncture to alleviate chronic pain. A total of 177 reviews of acupuncture from 1989 to 2019 met the eligibility criteria. The majority of SRs found that RCTs of acupuncture had methodological shortcomings, including inadequate statistical power with a high risk of bias. Heterogeneity between RCTs was such that meta-analysis was often inappropriate.
Having (co-) authored 13 of these SRs myself, I am impressed with the amount of work that went into this synthesis. The authors should be congratulated for doing it – and for doing it well! The paper itself differentiates the findings according to various types of pain. Here I reproduce the authors’ conclusion regarding different pain entities:
- Evidence from SRs suggests that there are insufficient high‐quality RCTs to judge the efficacy of acupuncture for chronic pain associated with various medical conditions. There is no specific NICE guidance about the use of acupuncture for chronic pain conditions irrespective of aetiology or pathophysiology, although some guidance exists for specific pain conditions (see respective sections below). Guidance by NICE on chronic pain assessment and management is currently being developed (GIDNG10069) with publication expected in August 2020.
- Evidence from the SRs suggests that acupuncture prevents episodic or chronic tension‐type headaches and episodic migraine, although long‐term studies and studies comparing acupuncture with other treatment options are still required. The current NICE guidance (clinical guideline CG150) is that a course of up to 10 sessions of acupuncture over 5–8 weeks is recommended for tension‐type headache and migraine.
- The most recent evidence from a Cochrane review of 16 RCTs suggests that acupuncture is not superior to sham acupuncture for OA of the hip, although in contrast, evidence from nonCochrane reviews suggests that there is moderate‐quality evidence that acupuncture may be effective in the symptomatic relief of pain from OA of the knee. Why there should be a difference in evidence between the knee and the hip is not known. Interestingly, guidance from NICE (CG177) states: “Do not offer acupuncture for the management of osteoarthritis”.
- Evidence suggests that there are insufficient high‐quality RCTs to judge the efficacy of acupuncture for low back pain. In 2009, NICE published guidance for the management of nonspecific low back pain that recommended a course of acupuncture as part of first line treatment. This guidance produced much debate. Subsequently, NICE have updated guidance for the management of low back pain and sciatica in people over 16 (NG59) and currently recommend in Section 1.2.8 “Do not offer acupuncture for managing low back pain with or without sciatica”, even though the evidence had not significantly changed.
- Evidence from SRs suggests that dry needling acupuncture might be effective in alleviating pain associated with myofascial trigger points, at least in the short‐term, although there are insufficient high‐quality RCTs to judge the efficacy with any degree of certainty. There is no guidance from NICE on the management of myofascial pain syndrome.
- Evidence from the SRs suggests that there are insufficient high‐quality RCTs to judge the efficacy of acupuncture for cancer‐related pain and more high‐quality, appropriately designed and adequately powered studies are needed. The most recent guidance from NICE (CSG4) recognises that patients who are receiving palliative care often seek complementary therapies, but it does not specifically recommend acupuncture. It recognises that “Many studies have a considerable number of methodological limitations, making it difficult to draw definitive conclusions”.
- Evidence from SRs suggests that there are insufficient high‐quality RCTs to judge the efficacy of acupuncture for fibromyalgia pain. There is no NICE guidance on the treatment of fibromyalgia.
- Evidence from the SRs suggests that there are insufficient high‐quality RCTs to judge the efficacy of acupuncture for primary dysmenorrhea or chronic pelvic pain. There is NICE guidance on endometriosis (NG73)  but this does not recommend any form of Chinese medicine for this type of pelvic pain, although acupuncture is not specifically mentioned.
- Evidence from the SRs suggests that there are insufficient high‐quality RCTs to judge the efficacy of acupuncture for pain in inflammatory arthritis. There is a NICE guideline (NG100)  for the treatment of rheumatoid arthritis but this does not recommend acupuncture.
- Evidence from the SRs suggests that there are insufficient high‐quality RCTs to judge the efficacy of acupuncture for neuropathic pain or neuralgia. There is NICE guidance (CG173) on the management of neuropathic pain, but acupuncture is not included in the list of recommended/not recommended treatments.
- Evidence from SRs suggests that there are insufficient high‐quality RCTs to judge the efficacy of acupuncture for a variety of other painful conditions, including lateral elbow pain, shoulder pain and labour pain. There is no guidance available from NICE on the treatment of any of these conditions.
So, what should we make of all this?
Maybe I just point out two things:
- This is a most valuable addition to the literature about acupuncture. It can serve as a reference for all who are interested in an honest account of the (lack of) value of acupuncture in the management of chronic pain.
- If a therapy has been tested in hundreds of (sadly often flawed) trials and the conclusions fail to come out clearly in favour of it, it is most likely not a very effective treatment.
Until we have data to the contrary, acupuncture should not be considered to be an effective therapy for chronic pain management.
Realgar, α-As4S4, is an arsenic sulfide mineral, also known as “ruby sulphur” or “ruby of arsenic”. It is a soft, sectile mineral occurring in monoclinic crystals, or in granular, compact, or powdery form, often in association with the related mineral, orpiment (As2S3).
In Traditional Chinese Medicine (TCM), realgar is often used in combination with herbs. An investigation found a total of 191 different, realgar-containing traditional Chinese patent medicines, and about 87% of them were for oral application. Realgar is said to:
counteract toxic pathogen both externally and internally. For abscess swelling and sores, it can be used singly or in compound prescription for external application mostly. When taken internally, it is combined with blood-activating and abscess-curing herbs to obtain the action of activating blood to relieve swelling, removing toxicity to cure sores. For example, it is combined with Ru Xiang, Mo Yao and She Xiang in Xing Xiao Wan from Wai Ke Quan Sheng Ji. For itching of skin due to scabies and ringworm, it is often combined with dampness-astringing and itching-relieving herbs to obtain actions of killing parasites and curing ringworm, astringing dampness and relieving itching. For instance, it is combined with the same dose of Bai Fan in powder mixed with clear tea for external application in Er Wei Ba Du San from Yi Zong Jin Jian. For poisonous insect bite, it is mixed with sesame oil and then applied on the afflicted sites.
This herb can kill parasites so it is indicated for intestine track parasites. For roundworm induced abdominal pain, it is often combined with other roundworm-killing herbs to reinforce action. For instance, it is combined with Qian Niu Zi and Bing Lang, etc. in Qian Niu Wan from Shen Shi Zun Sheng Shu. For anus pruritus caused by pinworm, it can be made into gauze strip by mixing with vaseline, and then inserted into the anus.
In addition, according to some ancient formulas, this herb can dispel phlegm and check malaria for internal application, so it can also be indicated for epilepsy, asthma and malaria.
Longtime topical over-dose or oral intake of realgar can cause chronic arsenic poisoning and even death. Chinese authors recently published the case of a 35-year-old Chinese man, who was diagnosed with severe psoriasis and died of fatal acute arsenic poisoning after he applied a local folk prescription ointment containing mainly realgar to the affected skin for about 4 days. The autopsy showed multiple punctate haemorrhages over the limbs, pleural effusion, oedematous lungs with consolidation, mild myocardial hypertrophy and normal-looking kidneys. The histopathological examination of renal tissue showed severe degeneration, necrosis and desquamation of renal tubular epithelial cells, presence of protein cast and a widened oedematous interstitium with interstitial fibrosis. The presence of arsenic in large amount in the ointment (about 6%), in blood (1.76 μg/mL), and in skin (4.71 μg/g), were confirmed analytically. The authors also review 7 similar cases in literature.
My advice is that, when you see recommendations by TCM practitioners like this one
the typical internal dose of realgar is between 0.2 and 0.4 grams, decocted in water and taken up to two times per day. Some practitioners may recommend slightly higher doses (0.3-0.9 grams). Larger doses of realgar may be used if it is being applied topically
you think again and consider that TCM really is not a form of healthcare that can be trusted to be safe.
Radiation-induced xerostomia (RIX) is a common, often debilitating, adverse effect of radiation therapy among patients with head and neck cancer. Quality of life can be severely affected, and current treatments have limited benefit. Acupuncture is often recommended, but does it work? This study was aimed at finding out whether acupuncture can prevent RIX in patients with head and neck cancer undergoing radiation therapy.
The 2-center, phase 3, randomized clinical trial compared a standard care control (SCC) with true acupuncture (TA) and sham acupuncture (SA) among patients with oropharyngeal or nasopharyngeal carcinoma who were undergoing radiation therapy in comprehensive cancer centres in the United States and China. Patients were enrolled between December 16, 2011, and July 7, 2015. Final follow-up was August 15, 2016. Analyses were conducted February 1 through 28, 2019. Either TA or SA using a validated acupuncture placebo device were performed 3 times per week during a 6- to 7-week course of radiation therapy. The primary end point was RIX, as determined by the Xerostomia Questionnaire in which a higher score indicates worse RIX, for combined institutions 1 year after radiation therapy ended. Secondary outcomes included incidence of clinically significant xerostomia (score >30), salivary flow, quality of life, salivary constituents, and role of baseline expectancy related to acupuncture on outcomes.
Of 399 patients randomized, 339 were included in the final analysis, including 112 patients in the TA group, 115 patients in the SA group, and 112 patients in the SCC group. For the primary aim, the adjusted least square mean (SD) xerostomia score in the TA group (26.6 [17.7]) was significantly lower than in the SCC group (34.8 [18.7]) (P = .001; effect size = -0.44) and marginally lower but not statistically significant different from the SA group (31.3 [18.6]) (P = .06; effect size = -0.26). Incidence of clinically significant xerostomia 1 year after radiation therapy ended followed a similar pattern, with 38 patients in the TA group (34.6%), 54 patients in the SA group (47.8%), and 60 patients in the SCC group (55.1%) experiencing clinically significant xerostomia (P = .009). Post hoc comparisons revealed a significant difference between the TA and SCC groups at both institutions, but TA was significantly different from SA only at Fudan University Cancer Center, Shanghai, China (estimated difference [SE]: TA vs SCC, -9.9 [2.5]; P < .001; SA vs SCC, -1.7 [2.5]; P = .50; TA vs SA, -8.2 [2.5]; P = .001), and SA was significantly different from SCC only at the University of Texas MD Anderson Cancer Center, Houston, Texas (estimated difference [SE]: TA vs SCC, -8.1 [3.4]; P = .016; SA vs SCC, -10.5 [3.3]; P = .002; TA vs SA, 2.4 [3.2]; P = .45).
The authors concluded that this randomized clinical trial found that TA resulted in significantly fewer and less severe RIX symptoms 1 year after treatment vs SCC. However, further studies are needed to confirm clinical relevance and generalizability of this finding and to evaluate inconsistencies in response to sham acupuncture between patients in the United States and China.
In essence this two-centre study shows that:
- real acupuncture is better than usual care, but the effect size is small and of doubtful clinical relevance;
- real acupuncture is not significantly better than sham acupuncture;
- the findings differ remarkably between the US and the Chinese centre.
I find the last point the most interesting one. We know from previous research that acupuncture studies from China are notoriously unreliable; they never report a negative result and there is evidence that data fabrication is rife in China. The new findings seems to throw more light on this notion. In the US centre, real and sham acupuncture generated practically identical results. By contrast, in the Chinese centre, real acupuncture generated significantly better results than sham. The authors offer several hypotheses to explain this remarkable phenomenon. Yet, in my view, the most likely one is that Chinese researchers are determined to show that acupuncture is effective. Thus all sorts of unconscious or even conscious biases might get introduced into such studies.
In essence, trial therefore confirms that acupuncture is little more than a theatrical placebo, particularly if we consider the US data which, in my opinion, are more trustworthy.
Lorenzo Cohen, Professor of Palliative, Rehabilitation, and Integrative Medicine and director of the Integrative Medicine Program as well as senior author of the paper unsurprisingly disagrees. He was quoted saying: “The evidence is to a point where patients should incorporate acupuncture alongside radiation treatment as a way to prevent the severity of dry mouth symptoms. I think with this study we can add acupuncture to the list for the prevention and treatment of xerostomia, and the guidelines for the use of acupuncture in the oncology setting should be revised to include this important chronic condition.”
Who do you think is closer to the truth?
The medical literature is currently swamped with reviews of acupuncture (and other forms of TCM) trials originating from China. Here is the latest example (but, trust me, there are hundreds more of the same ilk).
The aim of this review was to evaluate the effectiveness of scalp, tongue, and Jin’s 3-needle acupuncture for the improvement of post-apoplectic aphasia. PubMed, Cochrane, Embase databases were searched using index words to identify qualifying randomized controlled trials (RCTs). Meta-analyses of odds ratios (OR) or standardized mean differences (SMD) were performed to evaluate the outcomes between investigational (scalp / tongue / Jin’s 3-needle acupuncture) and control (traditional acupuncture; TA and/or rehabilitation training; RT) groups.
Thirty-two RCTs (1310 participants in investigational group and 1270 in control group) were included. Compared to TA, (OR 3.05 [95% CI: 1.77, 5.28]; p<0.00001), tongue acupuncture (OR 3.49 [1.99, 6.11]; p<0.00001), and Jin’s 3-needle therapy (OR 2.47 [1.10, 5.53]; p = 0.03) had significantly better total effective rate. Compared to RT, scalp acupuncture (OR 4.24 [95% CI: 1.68, 10.74]; p = 0.002) and scalp acupuncture with tongue acupuncture (OR 7.36 [3.33, 16.23]; p<0.00001) had significantly better total effective rate. In comparison with TA/RT, scalp acupuncture, tongue acupuncture, scalp acupuncture with tongue acupuncture, and Jin’s three-needling significantly improved ABC, oral expression, comprehension, writing and reading scores.
The authors concluded that compared to traditional acupuncture and/or rehabilitation training, scalp acupuncture, tongue acupuncture, and Jin’ 3-needle acupuncture can better improve post-apoplectic aphasia as depicted by the total effective rate, the ABC score, and comprehension, oral expression, repetition, denomination, reading and writing scores. However, quality of the included studies was inadequate and therefore further high-quality studies with lager samples and longer follow-up times and with patient outcomes are necessary to verify the results presented herein. In future studies, researchers should also explore the efficacy and differences between scalp acupuncture, tongue acupuncture and Jin’s 3-needling in the treatment of post-apoplectic aphasia.
I’ll be frank: I find it hard to believe that sticking needles in a patient’s tongue restores her ability to speak. What is more, I do not believe a word of this review and its conclusion. And now I better explain why.
- All the primary studies originate from China, and we have often discussed how untrustworthy such studies are.
- All the primary studies were published in Chinese and cannot therefore be checked by most readers of the review.
- The review authors fail to provide the detail about a formal assessment of the rigour of the included studies; they merely state that their methodological quality was low.
- Only 6 of the 32 studies can be retrieved at all via the links provided in the articles.
- As far as I can find out, some studies do not even exist at all.
- Many of the studies compare acupuncture to unproven therapies such as bloodletting.
- Many do not control for placebo effects.
- Not one of the 32 studies reports findings that are remotely convincing.
I conclude that such reviews are little more than pseudo-scientific propaganda. They seem aim at promoting acupuncture in the West and thus serve the interest of the People’s Republic of China. They pollute our medical literature and undermine the trust in science.
I seriously ask myself, are the editors and reviewers all fast asleep?
The journal ‘BMC Complement Altern Med‘ has, in its 18 years of existence, published almost 4 000 Medline-listed papers. They currently charge £1690 for handling one paper. This would amount to about £6.5 million! But BMC are not alone; as I have pointed out repeatedly, EBCAM is arguably even worse.
And this is, in my view, the real scandal. We are being led up the garden path by people who make a very tidy profit doing so. BMC (and EBCAM) must put an end to this nonsense. Alternatively, PubMed should de-list these publications.
This has been going on for far too long; urgent action is required!
Traditional Chinese Medicine (TCM) is a term created by Mao lumping together various modalities in an attempt to pretend that healthcare in the People’s Republic of China (PRC) was being provided despite the most severe shortages of conventional doctors, drugs and facilities. Since then, TCM seems to have conquered the West, and, in the PRC, the supply of conventional medicine has hugely increased. Today therefore, TCM and conventional medicine peacefully co-exist side by side in the PRC on an equal footing.
At least this is what we are being told – but is it true?
I have visited the PRC twice. The first time, in 1980, I was the doctor of a university football team playing several games in the PRC, including one against their national team. The second time, in 1991, I co-chaired a scientific meeting in Shanghai. On both occasions, I was invited to visit TCM facilities and discuss with colleagues issues related to TCM in the PRC. All the official discussions were monitored by official ‘minders’, and therefore fee speech and an uninhibited exchange of ideas are not truly how I would describe them. Yet, on both visits, there were occasions when the ‘minders’ were absent and a more liberal discussion could ensue. Whenever this was the case, I did not at all get the impression that TCM and conventional medicine were peacefully co-existing. The impression that I did get was that their co-existence resembled more a ‘shot-gun marriage’.
During my time running the SCAM research unit at Exeter, I had the opportunity to welcome several visiting researchers from the PRC. This experience seemed to confirm my impression that TCM in the PRC was less than free. As an example, I might cite one acupuncture project I was once working on with a scientist from the PRC. When it was nearing its conclusion and I mentioned that we should now think about writing it up to publish the findings, my Chinese colleague said that being a co-author was unfortunately not an option. Knowing how important publications in Western journals are for researchers from the PRC, I was most surprised by this revelation. The reason, it turned out, was that our findings failed to be favourable for TCM. My friend explained that such a paper would not advance but hinder an academic career, once back in the PRC.
Suspecting that the notion of a peaceful co-existence of TCM and conventional medicine in the PRC was far from true, I have always been puzzled how the myth could survive for so many years. Now, finally, it seems to crumble. This is from a recent journalistic article entitled ‘Chinese Activists Protest the Use of Traditional Treatments – They Want Medical Science’ which states that thousands of science activists in the PRC protest that the state neglects its duty to treat its citizens with evidence-based medicine (here is the scientific article this is based on):
Over a number of years, Chinese researcher Qiaoyan Zhu, who has been affiliated with the University of Copenhagen’s Department of Communication, has collected data on the many thousand science activists in China through observations in Internet forums, on social media and during physical meetings. She has also interviewed hundreds of activists. Together with Professor Maja Horst, who has specialized in research communication, she has analyzed the many data on the activists and their protests in an article that has just been published in the journal Public Understanding of Science:
“The activists are better educated and wealthier than the average Chinese population, and a large majority of them keep up-to-date with scientific developments. The protests do not reflect a broad popular movement, but the activists make an impact with their communication at several different levels,” Maja Horst explained and added: “Many of them are protesting individually by writing directly to family, friends and colleagues who have been treated with – and in some cases taken ill from – Traditional Chinese Medicine. Some have also hung posters in hospitals and other official institutions to draw attention to the dangers of traditional treatments. But most of the activism takes place online, on social media and blogs.
Activists operating in a regime like the Chinese are obviously not given the same leeway as activists in an open democratic society — there are limits to what the authorities are willing to accept in the public sphere in particular. However, there is still ample opportunity to organize and plan actions online.
“In addition to smaller groups and individual activists that have profiles on social media, larger online groups are also being formed, in some cases gaining a high degree of visibility. The card game with 52 criticisms about Traditional Chinese Medicine that a group of activists produced in 37,000 copies and distributed to family, friends and local poker clubs is a good example. Poker is a highly popular pastime in rural China so the critical deck of cards is a creative way of reaching a large audience,” Maja Horst said.
Maja Horst and Qiaoyan Zhu have also found examples of more direct action methods, where local activist groups contact school authorities to complain that traditional Chinese medicine is part of the syllabus in schools. Or that activists help patients refuse treatment if they are offered treatment with Traditional Chinese Medicine.
I am relieved to see that, even in a system like the PRC, sound science and compelling evidence cannot be suppressed forever. It has taken a mighty long time, and the process may only be in its infancy. But there is hope – perhaps even hope that the TCM enthusiasts outside the PRC might realise that much of what came out of China has led them up the garden path!?
On this blog, we have often noted that (almost) all TCM trials from China report positive results. Essentially, this means we might as well discard them, because we simply cannot trust their findings. While being asked to comment on a related issue, it occurred to me that this might be not so much different with Korean acupuncture studies. So, I tried to test the hypothesis by running a quick Medline search for Korean acupuncture RCTs. What I found surprised me and eventually turned into a reminder of the importance of critical thinking.
Even though I found pleanty of articles on acupuncture coming out of Korea, my search generated merely 3 RCTs. Here are their conclusions:
The results of this study show that moxibustion (3 sessions/week for 4 weeks) might lower blood pressure in patients with prehypertension or stage I hypertension and treatment frequency might affect effectiveness of moxibustion in BP regulation. Further randomized controlled trials with a large sample size on prehypertension and hypertension should be conducted.
The results of this study show that acupuncture might lower blood pressure in prehypertension and stage I hypertension, and further RCT need 97 participants in each group. The effect of acupuncture on prehypertension and mild hypertension should be confirmed in larger studies.
Bee venom acupuncture combined with physiotherapy remains clinically effective 1 year after treatment and may help improve long-term quality of life in patients with AC of the shoulder.
So yes, according to this mini-analysis, 100% of the acupuncture RCTs from Korea are positive. But the sample size is tiny and I many not have located all RCTs with my ‘rough and ready’ search.
But what are all the other Korean acupuncture articles about?
Many are protocols for RCTs which is puzzling because some of them are now so old that the RCT itself should long have emerged. Could it be that some Korean researchers publish protocols without ever publishing the trial? If so, why? But most are systematic reviews of RCTs of acupuncture. There must be about one order of magnitude more systematic reviews than RCTs!
Why so many?
Perhaps I can contribute to the answer of this question; perhaps I am even guilty of the bonanza.
In the period between 2008 and 2010, I had several Korean co-workers on my team at Exeter, and we regularly conducted systematic reviews of acupuncture for various indications. In fact, the first 6 systematic reviews include my name. This research seems to have created a trend with Korean acupuncture researchers, because ever since they seem unable to stop themselves publishing such articles.
So far so good, a plethora of systematic reviews is not necessarily a bad thing. But looking at the conclusions of these systematic reviews, I seem to notice a worrying trend: while our reviews from the 2008-2010 period arrived at adequately cautious conclusions, the new reviews are distinctly more positive in their conclusions and uncritical in their tone.
Let me explain this by citing the conclusions of the very first (includes me as senior author) and the very last review (does not include me) currently listed in Medline:
penetrating or non-penetrating sham-controlled RCTs failed to show specific effects of acupuncture for pain control in patients with rheumatoid arthritis. More rigorous research seems to be warranted.
Electroacupuncture was an effective treatment for MCI [mild cognitive impairment] patients by improving cognitive function. However, the included studies presented a low methodological quality and no adverse effects were reported. Thus, further comprehensive studies with a design in depth are needed to derive significant results.
Now, you might claim that the evidence for acupuncture has overall become more positive over time, and that this phenomenon is the cause for the observed shift. Yet, I don’t see that at all. I very much fear that there is something else going on, something that could be called the suspension of critical thinking.
Whenever I have asked a Chinese researcher why they only publish positive conclusions, the answer was that, in China, it would be most impolite to publish anything that contradicts the views of the researchers’ peers. Therefore, no Chinese researcher would dream of doing it, and consequently, critical thinking is dangerously thin on the ground.
I think that a similar phenomenon might be at the heart of what I observe in the Korean acupuncture literature: while I always tried to make sure that the conclusions were adequately based on the data, the systematic reviews were ok. When my influence disappeared and the reviews were done exclusively by Korean researchers, the pressure of pleasing the Korean peers (and funders) became dominant. I suggest that this is why conclusions now tend to first state that the evidence is positive and subsequently (almost as an after-thought) add that the primary trials were flimsy. The results of this phenomenon could be serious:
- progress is being stifled,
- the public is being misled,
- funds are being wasted,
- the reputation of science is being tarnished.
Of course, the only right way to express this situation goes something like this:
BECAUSE THE QUALITY OF THE PRIMARY TRIALS IS INADEQUATE, THE EFFECTIVENESS OF ACUPUNCTURE REMAINS UNPROVEN.
In a paper discussed in a previous blog, Ioannidis et al published a comprehensive database of a large number of scientists across science. They used Scopus data to compile a database of the 100,000 most-cited authors across all scientific fields based on their ranking of a composite indicator that considers six citation metrics (total citations; Hirsch h-index; coauthorship-adjusted Schreiber hm-index; number of citations to papers as single author; number of citations to papers as single or first author; and number of citations to papers as single, first, or last author). The authors also added this caution:
Citation analyses for individuals are used for various single-person or comparative assessments in the complex reward and incentive system of science. Misuse of citation metrics in hiring, promotion or tenure decision, or other situations involving rewards (e.g., funding or awards) takes many forms, including but not limited to the use of metrics that are not very informative for scientists and their work (e.g., journal impact factors); focus on single citation metrics (e.g., h-index); and use of calculations that are not standardized, use different frames, and do not account for field. The availability of the data sets that we provide should help mitigate many of these problems. The database can also be used to perform evaluations of groups of individuals, e.g., at the level of scientific fields, institutions, countries, or memberships in diversely defined groups that may be of interest to users.
It seems thus obvious and relevant to employ the new metrics for defining the most ‘influential’ (most frequently cited) researchers in so-called alternative medicine (SCAM). Doing this creates not one but two non-overlapping tables (because ‘complementary&alternative medicine’ is listed both as a primary and a secondary field (not sure about the difference)). Below, I have copied a small part of these tables; the first three columns are self-explanatory; the 4th relates to the number of published articles, the 4th to the year of the author’s first publication, the 5th to the last, the 6th column is the rank amongst 100 000 scientists of all fields who have published more than a couple of papers.
|Ernst, E.||University of Exeter||gbr||2253||1975||2018||104|
|Davidson, Jonathan R. T.||Duke University||usa||426||1972||2017||1394|
|Kaptchuk, Ted J.||Harvard University||usa||245||1993||2018||6545|
|Eisenberg, David M.||Harvard University||usa||127||1991||2018||8641|
|Linde, Klaus||Technische Universitat Munchen||deu||276||1993||2018||19488|
|Schwartz, Gary E.||University of Arizona||usa||264||1967||2018||21893|
|Eloff, J.N.||University of Pretoria||zaf||204||1997||2018||23830|
|Birch, Stephen||McMaster University||can||244||1985||2018||31925|
|Wilson, Kenneth H.||Duke University||usa||76||1976||2017||40760|
|Kemper, Kathi J.||Ohio State University||usa||181||1988||2017||45193|
|Oken, Barry S.||Oregon Health and Science University||usa||121||1974||2018||51325|
|Postuma, Ronald B.||McGill University||can||159||1998||2018||61018|
|Patwardhan, Bhushan||University of Pune||ind||144||1989||2018||64465|
|Krucoff, Mitchell W.||Duke University||usa||261||1986||2016||66028|
|Baliga, Manjeshwar Shrinath||142||2002||2018||83030|
|Mischoulon, David||Harvard University||usa||194||1992||2018||91705|
|Büssing, Arndt||University of Witten/Herdecke||deu||207||1980||2018||95907|
|Langevin, Helene M.||Harvard University||usa||67||1999||2018||98290|
|Kuete, Victor||University of Dschang||cmr||239||2005||2018||128347|
|White, Adrian||University of Plymouth||gbr||294||1990||2016||16714|
|Astin, John A.||California Pacific Medical Center||usa||50||1994||2014||21379|
|Kelly, Gregory S.||37||1985||2011||31037|
|Walach, Harald||University of Medical Sciences Poznan||pol||246||1996||2018||31716|
|Berman, Brian M.||University of Maryland School of Medicine||usa||211||1986||2018||34022|
|Lewith, George||University of Southampton||gbr||380||1980||2018||34830|
|Kidd, Parris M.||University of California at Berkeley||usa||38||1976||2011||36571|
|Jonas, Wayne B.||187||1992||2018||42445|
|MacPherson, Hugh||University of York||gbr||143||1996||2018||49923|
|Bell, Iris R.||University of Arizona||usa||142||1984||2015||51016|
|Ritenbaugh, Cheryl||University of Arizona||usa||172||1981||2018||63248|
|Boon, Heather||University of Toronto||can||188||1988||2017||69066|
|Aickin, Mikel||University of Arizona||usa||149||1996||2014||72040|
|Lee, Myeong Soo||430||1996||2018||72358|
|Lao, Lixing||University of Hong Kong||hkg||247||1990||2018||74896|
|Witt, Claudia M.||Charite – Universitatsmedizin Berlin||deu||238||2001||2018||78849|
|Sherman, Karen J.||136||1984||2017||82542|
|Verhoef, Marja J.||University of Calgary||can||190||1989||2016||84314|
|Smith, Caroline A.||University of Western Sydney||aus||135||1979||2018||94130|
|Miller, Alan L.||30||1980||2016||94421|
|Paterson, Charlotte||University of Bristol||gbr||71||1995||2017||95130|
|Milgrom, Lionel R.||London Metropolitan University||gbr||107||1979||2017||112943|
|Adams, Jon||University of Technology NSW||aus||294||1999||2018||128486|
|Litscher, Gerhard||Medical University of Graz||aut||245||1986||2018||133122|
|Chen, Calvin Yu-Chian||China Medical University Taichung||chn||130||2007||2016||164522|
No other researchers are listed in the ‘Complementary&Alternative Medicine’ categories and made it into the list of the 100 000 most-cited scientists.
To make this easier to read, I have ordered all SCAM researchers according to their rank in one single list and, where known to me, added the respective focus in SCAM research (ma = most areas of SCAM):
- ERNST EDZARD (ma)
- DONALDSON JONATHAN
- KAPTCHUK TED (acupuncture)
- EISENBERG DAVID (TCM)
- WHITE ADRIAN (acupuncture)
- LUNDEBERG THOMAS (acupuncture)
- LINDE KLAUS (homeopathy)
- ASTIN JOHN (mind/body)
- SCHWARTZ GARRY (healing)
- ELOFF JN
- KELLY GREGORY
- WALLACH HARALD (homeopathy)
- BIRCH STEVEN (acupuncture)
- BERMAN BRIAN (acupuncture)
- LEWITH GEORGE (acupuncture)
- KIDD PARRIS
- WILSON KENNETH
- JONAS WAYNE (homeopathy)
- KEMPER KATHIE (ma)
- MACPHERSON HUGH (acupuncture)
- BELL IRIS (homeopathy)
- OKEN BARRY (dietary supplements)
- PITTLER MAX (ma)
- PATRICK LYN
- RITENBAUGH CHERYL (ma)
- POSTUMA RONALD
- PATWARDHAN BHUSHAN
- KRUCOFF MICHELL
- BOON HEATHER
- AICKIN MIKEL (ma)
- LEE MYEONG SOO (TCM)
- LAO LIXING (acupuncture)
- WITT CLAUDIA (ma)
- CHIESA ALBERTO
- SHERMAN KAREN (acupuncture)
- BALIGA MANJESHWAR
- VERHOEF MARIA (ma)
- MISCHOULON DAVID
- SMITH CAROLINE (acupuncture)
- MILLER ALAN
- PATERSON CHARLOTTE (ma)
- BUESSING ARNDT (anthroposophical medicine)
- LANGEVIN HELENE (ma)
- CREATH KATHERINE
- MILGROM LIONEL (homeopathy)
- KUETE VICTOR
- ADAMS JON (ma)
- LITSCHER GERHARD
- CHEN CALVIN
The list is interesting in several regards. Principally, it offers individual SCAM researchers for the first time the opportunity to check their international standing relative to their colleagues. But, as the original analysis in Ioannidis’s paper contains much more data than depicted above, there is much further information to be gleaned from it.
For instance, I looked at the rate of self-citation (not least because I have sometimes been accused of overdoing this myself). It turns out that, with 7%, I am relative modest and well below average in that regard. Most of my colleagues are well above that figure. Researchers who have exceptionally high self-citation rates include Buessing (30%), Kuete (43%), Adams (36%), Litscher (45%), and Chen (53%).
The list also opens the possibility to see which countries dominate SCAM research. The dominance of the US seems fairly obvious and would have been expected due to the size of this country and the funds the US put into SCAM research. Considering the lack of funds in the UK, my country ranks surprisingly high, I find. No other country is well-represented in this list. In particular Germany does not appear often (even if we would classify Wallach as German); considering the large amounts of money Germany has invested in SCAM research, this is remarkable and perhaps even a bit shameful, in my view.
Looking at the areas of research, acupuncture and homeopathy seem to stand out. Remarkably, many of the major SCAMs are not or not well represented at all. This is in particular true for herbal medicine, chiropractic and osteopathy.
The list also confirms my former team as the leaders in SCAM research. (Yes, I know: in the country of the blind, the one-eyed man is king.) Pittler, White and Lee were, of course, all former co-workers of mine.
Perhaps the most intriguing finding, I think, relates to the many SCAM researchers who did not make it into the list. Here are a few notable absentees:
- Behnke J – GERMANY (homeopathy)
- Bensoussan A – AUSTRALIA (acupuncture)
- Brinkhaus B – GERMANY (acupuncture)
- Bronfort G – US (chiropractic)
- Chopra D – US (mind/body)
- Cummings M – UK (acupuncture)
- Dixon M – UK (ma)
- Dobos G – GERMANY (ma)
- Fisher P – UK (homeopathy)
- Fonnebo V – NORWAY (ma)
- Frass M – AUSTRIA (homeopathy)
- Goertz C – US (chiropractic)
- Hawk C -US (chiropractic)
- Horneber M – GERMANY (ma)
- Jacobs J – US (homeopathy)
- Jobst K – UK (homeopathy)
- Kraft K – GERMANY (naturopathy)
- Lawrence D – US (chiropractic)
- Long CR – US (chiropractic)
- Meeker WC – US (chiropractic)
- Mathie R – UK (homeopathy)
- Melchart – GERMANY (ma)
- Michalsen A – GERMANY (ma)
- Mills S – UK (herbal medicine)
- Peters D – UK (ma)
- Reilly D -US (homeopathy)
- Reily D – UK (homeopathy)
- Robinson N – UK (ma)
- Streitberger K – GERMANY (acupuncture)
- Tuchin PJ – US (chiropractic)
- Uehleke – GERMANY (naturopathy)
- Ullman D – US (homeopathy)
- Weil A – US (ma)
I leave it to you to interpret this list and invite you to add more SCAM researchers to it.
(thanks to Paul Posadski for helping with the tables)
An article in the Sydney Morning Herald might be interesting to some readers. It informs us that, after more than 25 years of running, the University of Technology Sydney (UTS) intends to stop offering its degree in Traditional Chinese Medicine (TCM). A review of the Chinese Medicine Department found it should be wound up at the end of 2021 because
- it was no longer financially viable,
- did not produce enough research,
- and did not fit with the “strategic direction” of the science faculty.
The UTS’s Chinese medicine clinic, which offers acupuncture and herbal treatments, would also close. Students who don’t finish by the end of 2021 will either move to another health course, or transfer to another university (Chinese medicine is also offered by the University of Western Sydney, RMIT in Melbourne, and several private colleges).
TCM “is a historical tradition that pre-dated the scientific era,” said the president of Friends of Science, Associate Professor Ken Harvey. “There’s nothing wrong with looking at that using modern scientific techniques. The problem is people don’t, they tend to teach it like it’s an established fact. If I was a scientifically-orientated vice chancellor I would worry about having a course in my university that didn’t have much of a research profile in traditional Chinese medicine.”
But a spokesman for the University of Technology Sydney said the debate over the scientific validity of Chinese medicine had nothing to do with the decision, and was “in no way a reflection of an institutional bias against complementary health care”. Personally, I find this statement surprising. Should the scientific validity of a subject not be a prime concern of any university?
In this context, may I suggest that the UTS might also have a critical look at their ‘AUSTRALIAN RESEARCH CENTRE IN COMPLEMENTARY AND INTEGRATIVE MEDICINE‘. They call themselves ‘the first centre worldwide dedicated to public health and health services research on complementary and integrative medicine’. Judging from the centre director’s publications, this means publishing one useless survey after another.
Acupuncture is effective in alleviating angina when combined with traditional antianginal treatment, according to a study published today in JAMA Internal Medicine. Researchers conducted a 20-week randomized clinical trial at 5 clinical centres in China. Patients with chronic, stable angina (a serious symptom caused by coronary heart disease) were randomly assigned to 4 groups:
- acupuncture on acupoints in the disease-affected meridian,
- acupuncture on a non-affected meridian,
- sham acupuncture,
- waitlist group that did not receive acupuncture.
All participants also received recommended antianginal medications. Acupuncture was given three times each week for 4 weeks. Patients were asked to keep a diary to record angina attacks. 398 patients were included in the intention-to-treat analysis. Greater reductions in angina attacks occurred in those who received acupuncture at acupoints in the disease-affected meridian compared with those in the nonaffected meridian group, the sham acupuncture group and the wait list group.
“Acupuncture was safely administered in patients with mild to moderate angina”, Zhao et al wrote. “Compared with the [control] groups, adjunctive acupuncture showed superior benefits … Acupuncture should be considered as one option for adjunctive treatment in alleviating angina.”
This study is well-written and looks good – almost too good to be true!
Let me explain: during the last 25 years, I must have studied several thousand clinical trials of SCAM, and I think that, in the course of this work, I have developed a fine sense for detecting trials that are odd or suspect. While reading the above RCT, my alarm-bells were ringing loud and clear.
The authors claim they have no conflicts of interest. This may well be true as far as financial conflicts of interest are concerned, but I have long argued that, in SCAM, ideological conflicts are much more powerful than financial ones. If we look at some of the authors’ affiliations, we get a glimpse of this possibility:
- Acupuncture and Tuina School, Chengdu University o fTraditional Chinese Medicine, Chengdu, Sichuan, China
- Department of Acupuncture, Hospital of Chengdu University of Traditional Chinese Medicine, Chengdu, Sichuan, China
- Acupuncture and Tuina School, Hunan University of Traditional Chinese Medicine, Changsha, Hunan, China
- Acupuncture and Tuina School, Guiyang University of Traditional Chinese Medicine, Guiyang, Guizhou, China
- Acupuncture and Tuina School, Shaanxi University of Chinese Medicine, Xianyang, Shaanxi, China
- Acupuncture and Tuina School, Yunnan Provincial Hospital of Traditional Chinese Medicine, Kunming, Yunnan, China
I have reported repeatedly that several independent analyses have shown that as good as no TCM studies from China ever report negative results. I have also reported that data falsification is said to be rife in China.
I am aware, of course, that these arguments are hardly evidence-based and therefore amount to mere suspicions. So, let me also mention a few factual points about the new trial:
- The study was concluded 4 years ago; why is it published only now?
- The primary outcome measure was entirely subjective; an objective endpoint would have been valuable.
- Patient blinding was not checked but would have been important.
- The discussion is devoid of any critical input; this is perhaps best seen when looking at the reference list. The authors cite none of the many critical analyses of acupuncture.
- The authors did actually not use normal acupuncture but electroacupuncture. One would have liked to see a discussion of effects of the electrical current versus those of acupuncture.
- The therapists were not blinded (when using electroacupuncture, this would have been achievable). Therefore, one explanation for the outcome is lies in the verbal/non-verbal communication between therapists and patients.
- Acupuncture was used as an add-on therapy, and it is conceivable that patients in the acupuncture group were more motivated to take their prescribed medications.
- The costs for 12 sessions of acupuncture would have been much higher (in the UK) than those for an additional medication.
- The practicality of consulting an acupuncturist three times a week need to be addressed.
- The long-term effects of acupuncture on angina pectoris (which is a long-term condition) are unknown.
Coming back to my initial point about the reliability of the data, I feel that it is important to not translate these findings into clinical routine without independent replications by researchers from outside China who are not promoters of acupuncture. Until such data are available, I believe that acupuncture should NOT be considered as one option for adjunctive treatment in alleviating angina.
Many cancer patients use so-called alternative medicine (SCAM) such as Traditional Chinese Medicine (TCM). On this blog, we have repeatedly discussed whether this does more good than harm. This study sheds new light on the question. Specifically, it aims to explore the benefits of TCM therapy in the long-term survival of patients with hepatocellular carcinoma in China.
In total, 3483 patients with HCC admitted to the Beijing Ditan Hospital of Capital Medical University were enrolled. The researchers used 1:1 frequency matching by sex, age, diagnosis time, Barcelona Clinic Liver Cancer staging, and type of treatments to compare the TCM users (n = 526) and non-TCM users (n = 526). A Cox multivariate regression model was employed to evaluate the effects of TCM therapy on the HR value and Kaplan-Meier survival curve for mortality risk in HCC patients. A log-rank test was performed to analyse the effect of TCM therapy on the survival time of HCC patients.
The Cox multivariate analysis indicated that TCM therapy was an independent protective factor for 5-year survival in patients with HCC. The Kaplan-Meier curve also showed that after PS matching, TCM users had a higher overall survival rate and a higher progression-free survival rate than non-TCM users. TCM users, regardless of the classification of etiology, tumor stage, liver function level, or type of treatment, all benefited significantly from TCM therapy. The most commonly used Chinese patent medications used were Fufang Banmao Capsule, Huaier Granule, and Jinlong Capsule.
The authors concluded that using traditional Chinese medications as adjuvant therapy can probably prolong median survival time and improve the overall survival among patients with HCC. Further scientific studies and clinical trials are needed to examine the efficiency and safety.
I was unable to access the full article and therefore am unable to provide a detailed critique of it. From reading the abstract, I should point out, however, that this was not an RCT. To minimise bias, the researchers used a matching technique to generate two comparable groups. Such methods can be successful in matching for the named parameters, but they cannot match for the plethora of variables that might be relevant but were not measured. Therefore, the survival difference between the two groups might be due not to the therapies they received, but to the fact that the groups were not comparable in terms of factors that impact on survival.
Another important point about this paper is the obvious fact that it originates from China. We know from several independent investigations that such studies almost never report negative findings. We also know that TCM is a hugely important export item for China. Adding two and two together should therefore make us sceptical. I for one take the present findings with more than a pinch of salt.