MD, PhD, MAE, FMedSci, FRSB, FRCP, FRCPEd.

Before a scientific paper gets published in a journal, it is submitted to the process of peer-review. Essentially, this means that the editor sends it to 2 or 3 experts in the field asking them to review the submission. Reviewers usually do not get any reward for this, yet the task they are asked to do can be tedious, difficult and time-consuming. Therefore, most reviewers think carefully before accepting it.

My friend Timothy Caulfield was recently invited by a medical journal to review a study of homeopathy. Here is his response to the editor as posted on Twitter:

I find myself regularly in similar situations. Yet, I have never responded in this way. Here is what I normally do:

  1. I have a look at the journal itself. If it is one of those SCAM publications, I tend to politely reject the invitation because, in my experience, their review process is farcical and not worth the effort. All too often it has happened that I reviewed a paper that was of very poor quality and thus recommended rejecting it. Yet the editor ignored my expert opinion and published the article nevertheless. This is why, several years ago, I decided enough is enough and no longer consider investing my time is such frustrating work.
  2. If the journal is of decent standing, I would have a look at the submission the editor sent me. If it makes any sense at all I would consider reviewing it (obviously depending on whether I have the time and the expertise).
  3. If a decent journal invites me to review a nonsensical paper (I assume that was the case Timothy referred to), I find myself in the same position as my friend Timothy. But, contrary to Timothy, I normally take the trouble to write a critical review of a nonsensical submission. Why? The reason is simple: if I don’t do it, the editor will simply send it to another reviewer. Many journals allow authors to suggest reviewers of their choice. Thus, the editor might send the submission next to the person suggested by the author who most likely will write a favourable review, thus hugely increasing the chances that the paper will be published in a decent journal.

On this blog, we have seen repeatedly that even top journal occasionally publish rubbish papers. Perhaps they do so because well-intentioned experts react in the way my friend Timothy did above (as he failed to tell us what journal invited him, I might be wrong).

If we want pseudoscience to disappear, we are fighting a lost battle. It will always rear its ugly head in third class journals. This is lamentable, but perhaps not so disastrous: by publishing little else than rubbish, these SCAM journals discredit themselves and will eventually be read only by pseudoscientists.

But we can do our bit to get rid of pseudoscience in decent journals. For this to happen, I think, rational thinkers need to accept invitations from such journals and do a proper review. And, of course, they can add to it a sentence or two about the futility of reviewing nonsense.

I am sure Timothy and I both want to eliminate pseudoscience as much as possible. In other words, we are in agreement about the aim, yet we differ in our approach. The question is: which is more effective?

2 Responses to Reviewing a study of homeopathy. How do we best prevent pseudoscience from getting published?

  • A respectable medical journal should know that homeopathy is tantamount to fraud. As far as I am concerned any medical journal which doesn’t know this – in the year 2019 for goodness sake – is not respectable and should be called out.

  • Step 1:
    Remove from this blog site, advertisements making health claims without providing evidence of their efficacy.
    Please.

Leave a Reply to Richard Rawlins Cancel reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Subscribe via email

Enter your email address to receive notifications of new blog posts by email.

Recent Comments

Note that comments can be edited for up to five minutes after they are first submitted but you must tick the box: “Save my name, email, and website in this browser for the next time I comment.”

The most recent comments from all posts can be seen here.

Archives
Categories