In the latest issue of ‘Simile’ (the Faculty of Homeopathy‘s newsletter), the following short article with the above title has been published. I took the liberty of copying it for you:
Members of the Faculty of Homeopathy practising in the UK have the opportunity to take part in a trial of a new homeopathic remedy for treating infant colic. An American manufacturer of homeopathic remedies has made a registration application for the new remedy to the MHRA (Medicines and Healthcare products Regulatory Agency) under the UK “National Rules” scheme. As part of its application the manufacturer is seeking at least two homeopathic doctors who would be willing to trial the product for about a year, then write a short report about using the remedy and its clinical results. If you would like to take part in the trial, further details can be obtained from …
END OF QUOTE
A homeopathic remedy for infant colic?
The British Homeopathic Association and many similar ‘professional’ organisations recommend homeopathy for infant colic: Infantile colic is a common problem in babies, especially up to around sixteen weeks of age. It is characterised by incessant crying, often inconsolable, usually in the evenings and often through the night. Having excluded underlying pathology, the standard advice given by GPs and health visitors is winding technique, Infacol or Gripe Water. These measures are often ineffective but fortunately there are a number of homeopathic medicines that may be effective. In my experience Colocynth is the most successful; alternatives are Carbo Veg, Chamomilla and Nux vomica.
SO, IT MUST BE GOOD!
But hold on, I cannot find a single clinical trial to suggest that homeopathy is effective for infant colic.
Ahhhhhhhhhhhhhhhhhhh, I see, that’s why they now want to conduct a trial!
They want to do the right thing and do some science to see whether their claims are supported by evidence.
How very laudable!
After all, the members of the Faculty of Homeopathy are doctors; they have certain ethical standards!
After all, the Faculty of Homeopathy aims to provide a high level of service to members and members of the public at all times.
Judging from the short text about the ‘homeopathy for infant colic trial’, it will involve a few (at least two) homeopaths prescribing the homeopathic remedy to patients and then writing a report. These reports will unanimously state that, after the remedy had been administered, the symptoms improved considerably. (I know this because they always do improve – with or without treatment.)
These reports will then be put together – perhaps we should call this a meta-analysis? – and the overall finding will be nice, positive and helpful for the American company.
And now, we all understand what homeopaths, more precisely the Faculty of Homeopathy, consider to be evidence.
A survey was commissioned in 2015 to obtain general population figures for practitioner-led CAM use in England, and to discover people’s views and experiences regarding access.
Of 4862 adults surveyed, 766 (16%) had seen a CAM practitioner. People most commonly visited CAM practitioners for manual therapies (massage, osteopathy, chiropractic) and acupuncture, as well as yoga, pilates, reflexology, and mindfulness or meditation. Women, people with higher socioeconomic status (SES) and those in south England were more likely to access CAM. Musculoskeletal conditions (mainly back pain) accounted for 68% of use, and mental health 12%. Most was through self-referral (70%) and self-financing. GPs (17%) or NHS professionals (4%) referred and/or recommended CAM to users. These CAM users were more often unemployed, with lower income and social grade, and receiving NHS-funded CAM. Responders were willing to pay varying amounts for CAM; 22% would not pay anything. Almost two in five responders felt NHS funding and GP referral and/or endorsement would increase their CAM use.
The authors concluded that CAM use in England is common for musculoskeletal and mental health problems, but varies by sex, geography, and SES. It is mainly self-referred and self-financed; some is GP-endorsed and/or referred, especially for individuals of lower SES. Researchers, patients, and commissioners should collaborate to research the effectiveness and cost-effectiveness of CAM and consider its availability on the NHS.
The table below shows the percentage figures for specific CAMs (right column).
|Type of CAM practitioner||n||%|
|Meditation and/or mindfulness teacher||20||3|
|Chinese herbal medical practitioner||12||2|
Our own survey suggested that, in 2005, the 1-year prevalence of CAM-use in England was 26.3 % and the practitioner-led CAM-use was 12.1 %. The two surveys are, however, not comparable because they did use different methodologies; for instance, they included different types of CAM. I therefore think that any conclusion of an increase in practitioner-led CAM-use between 2005 and 2015 is not warranted. It also follows that the graphic below is misleading.
In the discussion, the authors of the new survey make the following point: Ability to pay may be a factor in accessing CAM (indicated by the association of CAM use with higher SES; lower SES responders being more likely to be GP-referred to CAM; and responders stating that they may use more CAM if the NHS provided services, and GPs endorsed and/or referred them). Integration of CAM into the NHS through primary care could promote continuity of care, safety, and balance of power. An integrative medicine approach includes many of the values recently included in UK health policy documents; for example, Five Year Forward View. It is patient-centred, as discussed in 2010, focuses on prevention, and emphasises patient self-management and person- and community-centred approaches to health and wellbeing. Many of these values underpin social prescribing, which is an increasingly popular model of health care. There seems to be significant patient demand for CAM and more holistic approaches, and a view that CAM may improve patient satisfaction.
I have in a previous post commented on prevalence surveys: the argument that is all too often spun around such survey data goes roughly as follows: a large percentage of the population uses alternative medicine; people pay out of their own pocket for these treatments; they are satisfied with them (if not, they would not pay for them). BUT THIS IS GROSSLY UNFAIR! Why should only those individuals who are rich enough to afford alternative medicine benefit from it? ALTERNATIVE MEDICINE SHOULD BE MADE AVAILABLE FOR ALL.
To me, it is obvious that this line of argument is dangerously wrong. It lends itself to the promotion of unproven therapies to the detriment of good healthcare and progress. Sadly, I fear that the new survey is going to be misused in this way.
Back pain is a huge problem: it affects many people, causes much suffering and leads to extraordinary high cost for all of us. Considering these facts, it would be excellent to identify a treatment that truly works. However, at present, we do not have found the ideal therapy; instead we have dozens of different approaches that are similarly effective/ineffective. Two of these therapies are massage and acupuncture.
Is one better than the other?
This study compared the efficacy of classical massage (KMT, n = 66) with acupuncture therapy (AKU, n = 66) in patients with chronic back pain. The primary endpoint was the non-inferiority of classical massage compared with the acupuncture treatment in respect of the impairment in everyday life, with the help of the Hannover function questionnaire (HFAQ) and the reduction in pain (“Von Korff”-Questionnaire) at the follow-up after one month.
In the per-protocol analysis during the period between enrollment in the study and follow-up, the responder rate of the KMT was 56.5% and thus tended to be inferior to the responder rate of the AKU with 62.5% (Δ = - 6%; KIΔ: - 23.5 to + 11.4%).
The authors concluded that classical massage therapy is not significantly inferior to acupuncture therapy in the period from admission to follow-up. Thus, the non-inferiority of the KMT to the AKU cannot be proven in the context of the defined irrelevance area.
I find such studies oddly useless.
To conduct a controlled trial, one needs an experimental treatment (the therapy that is not understood) and compare it with an intervention that is understood (such as a placebo that has no specific effects, or a treatment that has been shown to work). In comparative studies like the one above, one compares one unknown with another unknown. I do not see how such a comparison can ever produce a meaningful result.
In a way, it is like an equation with two unknowns: x + 5 = y. It is simply not possible to define either x nor y, and the equation is unsolvable.
For comparative studies of two back-pain treatments to make sense, we would need one of which the effect size is well-established. I do not think that we currently have identified such a therapy. Certainly, we cannot say that we know it for massage or acupuncture.
In other words, comparative studies like the one above are a waste of resources that cannot possibly make a meaningful contribution to our knowledge.
To put it even more bluntly: we ought to stop such pseudo-research.
The Clinic for Complementary Medicine and Diet in Oncology was opened, in collaboration with the oncology department, at the Hospital of Lucca (Italy) in 2013. It uses a range of alternative therapies aimed at reducing the adverse effects of conventional oncology treatments.
Their latest paper presents the results of complementary medicine (CM) treatment targeted toward reducing the adverse effects of anticancer therapy and cancer symptoms, and improving patient quality of life. Dietary advice was aimed at the reduction of foods that promote inflammation in favour of those with antioxidant and anti-inflammatory properties.
This is a retrospective observational study on 357 patients consecutively visited from September 2013 to December 2017. The intensity of symptoms was evaluated according to a grading system from G0 (absent) to G1 (slight), G2 (moderate), and G3 (strong). The severity of radiodermatitis was evaluated with the Radiation Therapy Oncology Group (RTOG) scale. Almost all the patients (91.6%) were receiving or had just finished some form of conventional anticancer therapy.
The main types of cancer were breast (57.1%), colon (7.3%), lung (5.0%), ovary (3.9%), stomach (2.5%), prostate (2.2%), and uterus (2.5%). Comparison of clinical conditions before and after treatment showed a significant amelioration of all symptoms evaluated: nausea, insomnia, depression, anxiety, fatigue, mucositis, hot flashes, joint pain, dysgeusia, neuropathy.
The authors concluded that the integration of evidence-based complementary treatments seems to provide an effective response to cancer patients’ demand for a reduction of the adverse effects of anticancer treatments and the symptoms of cancer itself, thus improving patient’s quality of life and combining safety and equity of access within public healthcare systems. It is, therefore, necessary for physicians (primarily oncologists) and other healthcare professionals in this ﬁeld to be appropriately informed about the potential beneﬁts of CMs.
Why do I call this ‘wishful thinking’?
I have several reasons:
- A retrospective observational study cannot establish cause and effect. It is likely that the findings were due to a range of factors unrelated to the interventions used, including time, extra attention, placebo, social desirability, etc.
- Some of the treatments in the therapeutic package were not CM, reasonable and evidence-based. Therefore, it is likely that these interventions had positive effects, while CM might have been totally useless.
- To claim that the integration of evidence-based complementary treatments seems to provide an effective response to cancer patients’ is pure fantasy. Firstly, some of the CMs were certainly not evidence-based (the clinic’s prime focus is on homeopathy). Secondly, as already pointed out, the study does not establish cause and effect.
- The notion that it is necessary for physicians (primarily oncologists) and other healthcare professionals in this ﬁeld to be appropriately informed about the potential beneﬁts of CMs is not what follows from the data. The paper shows, however, that the authors of this study are in need to be appropriately informed about EBM as well as CM.
I stumbled across this paper because a homeopath cited it on Twitter claiming that it proves the effectiveness of homeopathy for cancer patients. This fact highlights why such publications are not just annoyingly useless but acutely dangerous. They mislead many cancer patients to opt for bogus treatments. In turn, this demonstrates why it is important to counterbalance such misinformation, critically evaluate it and minimise the risk of patients getting harmed.
Acupuncture is a branch of alternative medicine where pseudo-science abounds. Here is yet another example of this deplorable phenomenon.
This study was conducted to evaluate the efficacy of acupuncture in the management of primary dysmenorrhea.
Sixty females aged 17-23 years were randomly assigned to either a study group or a control group.
- The study group received acupuncture for the duration of 20 minutes/day, for 15 days/month, for the period of 90 days.
- The control group did not receive acupuncture for the same period.
Both groups were assessed on day 1; day 30 and day 60; and day 90. The results showed a significant reduction in all the variables such as the visual analogue scale score for pain, menstrual cramps, headache, dizziness, diarrhoea, faint, mood changes, tiredness, nausea, and vomiting in the study group compared with those in the control group.
The authors concluded that acupuncture could be considered as an effective treatment modality for the management of primary dysmenorrhea.
These findings contradict those of a recent Cochrane review (authored by known acupuncture-proponents) which included 42 RCTs and concluded that there is insufficient evidence to demonstrate whether or not acupuncture or acupressure are effective in treating primary dysmenorrhoea, and for most comparisons no data were available on adverse events. The quality of the evidence was low or very low for all comparisons. The main limitations were risk of bias, poor reporting, inconsistency and risk of publication bias.
The question that I ask myself is this: why do researchers bother to conduct studies that contribute NOTHING to our knowledge and progress? The new study had a no-treatment control group which means it cannot control for the effects of placebo, the extra attention, social desirability etc. In view of the fact that already 42 poor quality trials exist, it is not just useless to add a 43rd but, in my view, it is scandalous! A 43rd useless trial:
- tells us nothing of value;
- misleads the public;
- pollutes the medical literature;
- is a waste of resources;
- undermines the trust in clinical research;
- is deeply unethical.
It is high time to stop such redundant, foolish, wasteful and unethical pseudo-science.
I regularly scan the new publications in alternative medicine hoping that I find some good quality research. And sometimes I do! In such happy moments, I write a post and make sure that I stress the high standard of a paper.
Sadly, such events are rare. Usually, my searches locate a multitude of deplorably poor papers. Most of the time, I ignore them. Sometime, I do write about exemplarily bad science, and often I report about articles that are not just bad but dangerous as well. The following paper falls into this category, I fear.
The aim of this systematic review was to assess the efficacy and safety of herbal medicines for the induction of labor (IOL). The researchers considered experimental and non-experimental studies that compared relevant pregnancy outcomes between users and non-user of herbal medicines for IOL.
A total of 1421 papers were identified and 10 studies, including 5 RCTs met the authors’ inclusion criteria. Papers not published in English were not considered. Three trials were conducted in Iran, two in the USA and one each in South Africa, Israel, Thailand, Australia and Italy.
The quality of the included trial, even of the 5 RCTs, was poor. The results suggest, according to the authors of this paper, that users of herbal medicine – raspberry leaf and castor oil – for IOL were significantly more likely to give birth within 24 hours than non-users. No significant difference in the incidence of caesarean section, assisted vaginal delivery, haemorrhage, meconium-stained liquor and admission to nursery was found between users and non-users of herbal medicines for IOL.
The authors concluded that the findings suggest that herbal medicines for IOL are effective, but there is inconclusive evidence of safety due to lack of good quality data. Thus, the use of herbal medicines for IOL should be avoided until safety issues are clarified. More studies are recommended to establish the safety of herbal medicines.
As I stated above, I am not convinced that this review is any good. It included all sorts of study designs and dismissed papers that were not in English. Surely this approach can only generate a distorted or partial picture. The risks of herbal remedies for mother and baby are not well investigated. In view of the fact that even the 5 RCTs were of poor quality, the first sentence of this conclusion seems most inappropriate.
On the basis of the evidence presented, I feel compelled to urge pregnant women NOT to consent to accept herbal remedies for IOL.
And on the basis of the fact that far too many papers on alternative medicine that emerge every day are not just poor quality but also dangerously mislead the public, I urge publishers, editors, peer-reviewers and researchers to pause and remember that they all have a responsibility. This nonsense has been going on for long enough; it is high time to stop it.
On this blog, I have repeatedly discussed chiropractic research that, on closer examination, turns out to be some deplorable caricature of science. Today, I have another example of what I would call pseudo-research.
This RCT compared short-term treatment (12 weeks) versus long-term management (36 weeks) of back and neck related disability in older adults using spinal manipulative therapy (SMT) combined with supervised rehabilitative exercises (SRE).
Eligible participants were aged 65 and older with back and neck disability for more than 12 weeks. Co-primary outcomes were changes in Oswestry and Neck Disability Index after 36 weeks. An intention to treat approach used linear mixed-model analysis to detect between group differences. Secondary analyses included other self-reported outcomes, adverse events and objective functional measures.
A total of 182 participants were randomized. The short-term and long-term groups demonstrated significant improvements in back and neck disability after 36 weeks, with no difference between groups. The long-term management group experienced greater improvement in neck pain at week 36, self-efficacy at week 36 and 52, functional ability and balance.
The authors concluded that for older adults with chronic back and neck disability, extending management with SMT and SRE from 12 to 36 weeks did not result in any additional important reduction in disability.
What renders this paper particularly fascinating is the fact that its authors include some of the foremost researchers in (and most prominent proponents of) chiropractic today. I therefore find it interesting to critically consider the hypothesis on which this seemingly rigorous study is based.
As far as I can see, it essentially is this:
36 weeks of chiropractic therapy plus exercise leads to better results than 12 weeks of the same treatment.
I find this a most remarkable hypothesis.
Imagine any other form of treatment that is, like SMT, not solidly based on evidence of efficacy. Let’s use a new drug as an example, more precisely a drug for which there is no solid evidence for efficacy or safety. Now let’s assume that the company marketing this drug publishes a trial based on the hypothesis that:
36 weeks of therapy with the new drug plus exercise leads to better results than 12 weeks of the same treatment.
Now let’s assume the authors affiliated with the drug manufacturer concluded from their findings that for patients with chronic back and neck disability, extending drug therapy plus exercise from 12 to 36 weeks did not result in any additional important reduction in disability.
WHAT DO YOU THINK SUCH A TRIAL CAN TELL US?
My answer is ‘next to nothing’.
I think, it merely tells us that
- daft hypotheses lead to daft research,
- even ‘top’ chiropractors have problems with critical thinking,
- SMT might not be the solution to neck and back related disability.
I REST MY CASE.
According to the 2014 European Social Survey, Spain is relatively modest when it comes to using alternative therapies. While countries such as Austria, Denmark, Estonia, Finland, France, Germany, Lithuania, Sweden and Switzerland all have 1-year prevalence figures of over 30%, Spain only boasts a meagre 17%. Yet, its opposition to bogus treatments has recently become acute.
In 2016, it was reported that a master’s degree in homeopathic medicine at one of Spain’s top universities has been scrapped. Remarkably, the reason was “lack of scientific basis”. A university spokesman confirmed the course was being discontinued and gave three main reasons: “Firstly, the university’s Faculty of Medicine recommended scrapping the master’s because of the doubt that exists in the scientific community. Secondly, a lot of people within the university – professors and students across different faculties – had shown their opposition to the course. Thirdly, the postgraduate degree in homeopathic medicine is no longer approved by Spain’s Health Ministry.”
A few weeks ago, I had the great pleasure of being invited to a science festival in Bilbao and was impressed by the buoyant sceptic movement in Spain. At the time, two of my books were published in Spanish and received keen interest by the Spanish press.
And now, it has been reported that Spain’s Ministry of Health has released a list of only 2,008 homeopathic products whose manufacturers will have to apply for an official government license for if they wish to continue selling them. The homeopathic producers have until April 2019 to prove that their remedies actually work, which may very well completely slash homeopathic products in Spain.
It’s the latest blow for Spain’s homeopathy industry, once worth an estimated €100 million but which has seen a drop in public trust and therefore sales of around 30 percent in the last five years. Spain’s Health Ministry stopped allowing homeopathy treatments from being prescribed as part of people’s social security benefits, along with acupuncture, herbal medicine and body-based practices such as osteopathy, shiatsu or aromatherapy.
“Homeopathy is an alternative therapy that has not shown any scientific evidence that it works” Spanish Minister of Health Maria Luisa Carcedo is quoted as saying in La Vanguardia in response to the homeopathic blacklist. “I’m committed to combatting all forms of pseudoscience.”
Homeopathy for depression? A previous review concluded that the evidence for the effectiveness of homeopathy in depression is limited due to lack of clinical trials of high quality. But that was 13 years ago. Perhaps the evidence has changed?
A new review aimed to assess the efficacy, effectiveness and safety of homeopathy in depression. Eighteen studies assessing homeopathy in depression were included. Two double-blind placebo-controlled trials of homeopathic medicinal products (HMPs) for depression were assessed.
- The first trial (N = 91) with high risk of bias found HMPs were non-inferior to fluoxetine at 4 and 8 weeks.
- The second trial (N = 133), with low risk of bias, found HMPs was comparable to fluoxetine and superior to placebo at 6 weeks.
The remaining research had unclear/high risk of bias. A non-placebo-controlled RCT found standardised treatment by homeopaths comparable to fluvoxamine; a cohort study of patients receiving treatment provided by GPs practising homeopathy reported significantly lower consumption of psychotropic drugs and improved depression; and patient-reported outcomes showed at least moderate improvement in 10 of 12 uncontrolled studies. Fourteen trials provided safety data. All adverse events were mild or moderate, and transient. No evidence suggested treatment was unsafe.
The authors concluded that limited evidence from two placebo-controlled double-blinded trials suggests HMPs might be comparable to antidepressants and superior to placebo in depression, and patients treated by homeopaths report improvement in depression. Overall, the evidence gives a potentially promising risk benefit ratio. There is a need for additional high quality studies.
I beg to differ!
What these data really show amounts to far less than the authors imply:
- The two ‘double-blind’ trials are next to meaningless. As equivalence studies they were far too small to produce meaningful results. Any decent review should discuss this fact in full detail. Moreover, these studies cannot have been double-blind, because the typical adverse-effects of anti-depressants would have ‘de-blinded’ the trial participants. Therefore, these results are almost certainly false-positive.
- The other studies are even less rigorous and therefore do also not allow positive conclusions.
This review was authored by known proponents of homeopathy. It is, in my view, an exercise in promotion rather than a piece of research. I very much doubt that a decent journal with a responsible peer-review system would have ever published such a biased paper – it had to appear in the infamous EUROPEAN JOURNAL OF INTEGRATIVE MEDICINE.
Who cares? No harm done!
Again, I beg to differ.
The conclusion that homeopathy has a ‘promising risk/benefit profile’ is frightfully dangerous and irresponsible. If seriously depressed patients follow it, many lives might be lost.
Yet again, we see that poor research has the potential to kill vulnerable individuals.
Mini-scalpel acupuncture or acupotomy is a relatively new type of non-invasive acupuncture/ micro surgery using a small needle-scalpel invented by Professor Zhu Hanzhang around 30 years ago in China. It is a slightly thicker and more blunt instrument that gets under the skin and is able to break apart adhesions and muscle knots more effectively than a regular acupuncture needle would.
Never mind, the question is does it work!
A systematic review showed that almost all studies reported an effect of acupotomy on joint pain compared to a variety of controls. On reflection, this is hardly surprising:
- all the trials were from China;
- all had major methodological flaws.
This means that we need better studies to decide the efficacy question.
This new study investigated the efficacy and safety of mini-scalpel acupuncture (MA) for knee osteoarthritis (KOA) in an assessor-blinded randomized controlled pilot trial; this would provide information for a large-scale randomized controlled trial.
Participants (n = 24) were recruited and randomly allocated to the MA group (experimental) or acupuncture group (control). The MA group received treatment once a week for 3 weeks (total of 3 treatments), while the acupuncture group received treatment two times per week for 3 weeks (total of 6 treatments). The primary outcome was pain as assessed by a visual analogue scale (VAS). The secondary outcomes (intensity of current pain, stiffness, and physical function) were assessed using the short-form McGill Pain Questionnaire (SF-MPQ) and Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC). Assessments were performed at baseline, 1, 2, and 3 during treatment and at week 5 (2 weeks after the end of treatment).
Of the 24 participants, 23 completed the study. Both groups showed significant improvements in VAS, SF-MPQ, and WOMAC. There were no significant differences between the MA and acupuncture groups. No serious adverse event occurred and blood test results were within normal limits.
The authors concluded that although both MA and acupuncture provide similar effects with regard to pain control in patients with KOA, MA may be more effective in providing pain relief because the same relief was obtained with fewer treatments. A large-scale clinical study is warranted to further clarify these findings.
I can recommend this article to anyone who wants a quick introduction into the critical analysis of clinical trials. It is a veritable treasure trove of mistakes, flaws, errors, fallacies etc. Here are just a few:
- The authors aim of investigating the safety of MA is unobtainable. It would require not 24 but probably 24 000 patients.
- The authors aim of investigating the efficacy of MA is equally unobtainable. It would require a much larger sample than 24, a sham control arm, identical treatment schedules, patient-blinding, etc.
- Calling the trial a ‘pilot’ is endearing but, except for the title and the insufficient sample size, this study has none of the characteristics of a pilot study.
- In their ‘introduction’, the authors state that miniscalpel acupuncture (MA) is a new subtype of acupuncture that is effective in treating chronic soft tissue injuries such as adhesions and contractures. This is clearly wrong but discloses their bias very plainly.
- The authors statement that both MA and acupuncture provide similar effects with regard to pain control in patients with KOA is misleading. It implies that both interventions had specific effects. Without a sham control arm, this is pure speculation.
- Similarly their assumption that MA may be more effective in providing pain relief because the same relief was obtained with fewer treatments, is pure fantasy.
- In fact, as MA requires injections of local anaesthetics, any outcome is heavily confounded by this addition.
- In the discussion section, the authors state that because MA is invasive and provides a strong stimulus, some participants complained of stiff and dull pain for few days after treatment. Yet, when reporting adverse effects in the results section, this was not mentioned.
- The way this study was designed, it should have been clear from the start that it would not produce any meaningful findings. Seen from this perspective, running the trial could even be seen as a breach of research ethics.
- According to the aims of a pilot study and the authors hope that their study would provide information for a large-scale randomized controlled trial, all reporting of outcomes is misplaced and should be replaced by information as to how a definitive trial should be conducted.
The following footnote is worth mentioning: This study is supported by a grant from the Ministry of Health & Welfare, Korea. It suggests to me that this ministry should urgently re-think its funding strategy and recruit some reviewers who are capable of critical analysis.
In my view, this is a lousy study which the authors decides to call ‘a pilot’ in order to get it published in a lousy journal.