Guest post by Norbert Aust and Viktor Weisshäupl
Readers of this blog may remember the recent study of Frass et al. about the adjunct homeopathic treatment of patients suffering from non-small cell lung cancer (here). It was published in 2020 by the ‘Oncologist’, a respectable journal, and came to stunning results about to the effectiveness of homeopathy.
In our analysis, however, we found strong indications for duplicity: important study parameters like exclusion criteria or observation time were modified post hoc, and data showed characteristics that occur when unwanted data sets get removed.
We, that is the German Informationsnetzwerk Homöopathie and the Austrian ‘Initiative für wissenschaftliche Medizin’, had informed the Medical University Vienna about our findings – and the research director then asked the Austrian Agency for Scientific Integrity (OeAWI) to review the paper. The analysis took some time and included not only the paper and publicly available information but also the original data. In the end, OeAWI corroborated our findings: The results are not based on sound research but on modified or falsified data.
Here is their conclusion in full:
The committee concludes that there are numerous breaches of scientific integrity in the Study, as reported in the Publication. Several of the results can only be explained by data manipulation or falsification. The Publication is not a fair representation of the Study. The committee cannot for all the findings attribute the wrongdoings and incorrect representation to a single individual. However following our experience it is highly unlikely that the principal investigator and lead author, but also the co-authors were unaware of the discrepancies between the protocols and the Publication, for which they bear responsibility. (original English wording)
Profil, the leading news magazine of Austria reported in its issue of October 24, 2022, pp 58-61 (in German). There the lead author, Prof. M. Frass, a member of Edzard’s alternative medicine hall of fame, was asked for his comments. Here is his concluding statement:
All the allegations are known to us and completely incomprehensible, we can refute all of them. Our work was performed observing all scientific standards. The allegation of breaching scientific integrity is completely unwarranted. To us, it is evident that not all documents were included in the analysis of our study. Therefore we requested insight into the records to learn about the basis for the final statement.
(Die Vorwürfe sind uns alle bekannt und absolut unverständlich, alle können wir entkräften. Unsere Arbeit wurde unter Einhaltung aller wissenschaftlichen Standards durchgeführt. Der Vorhalt von Verstößen gegen die wissenschaftliche Intergrität enbehrt jeder Grundlage. Für uns zeigt sich offenkundig, dass bei der Begutachtung unserer Studie nicht alle Unterlagen miteinbezogen wurden. Aus diesem Grunde haben wir um Akteneinsicht gebeten, um die Grundlagen für das Final Statment kennenzulernen.)
The OeAWI together with the Medical University Vienna asked the ‘Oncologist’ for a retraction of this paper – which has not occurred as yet.