One way the scientific community controls the quality of research work is by relying on peer review. New discoveries and their analysis are submitted to scientific journals in the form of articles, which are critically read by experts in the field; experts whose job it is to reject the paper if at all possible (success rate is pretty low, especially on a first try).
This system is not perfect, but has proven to be very worthwhile. It is much, much harder to disseminate nonsense in a respectable journal like
Cell than it is on Facebook. That's why scientific journals are assigned an impact factor, a measure of how often what it publishes is referred to in other works (an indirect measure of how actually useful it is).
However, everyone is aware of the system's limitations. The first and most benign is that nobody is perfect, even reviewers, and that bad science can still go through the peer review sieve. It's not that worrying because it quickly becomes clear that an experiment can't be reproduced, even if at first it was thought to be well done, well controlled and well interpreted.
A bigger problem is that a scientist's career hangs on being able to publish articles. That means that there is a market for publishing low-level science, or even total b######t. So-called predatory journals will print whatever you send them, and their contributing authors may include scientists desperate to boost their publication list or crooks trying to say their
Authentic Cancer-Curing Atlantis Crystals have been scientifically proven to work.
From time to time, a few people have fun showing that the emperor has no clothes. This morning I learned of a neat example: entomologist Matan Shelomi, from Taiwan, published a paper on how Covid-19 was caused by...
the consumption of Zubats, the bat-shaped Pokemon. It was published in the serious-sounding "
American Journal of Biomedical Science & Research".
Not only is the title a dead giveaway, but even the address provided by the author should have triggered an alarm in any reviewer: Gotham General Hospital, Wooster, NZ 90210, USA.
The paper's bogus references list is a joy to behold. Note the multiple references to Pokemon and to predatory journals, as well as to Batman, the Teenage Mutant Ninja Turtles, Harry Potter, Xi Jingpin loking like Winnie the Pooh and more!
Joy NC, Joy NS, Joy NM (2007) Signs and symptoms of Pokérus infection. The Lancet 54: 3-45.
Shelomi M (2019) Entomoludology: Arthropods in video games. American Entomologist 65(2): 97-106.
Jesse J James J (2020) Prepare for trouble: Coronavirus outbreak reaches North America. Rocket Science Monthly 21(2): 45-47.
Bowman JD (2014) Predatory publishing, questionable peer review, and fraudulent conferences. American Journal of Pharmaceutical Education 78(10): 176.Joy MP, Joy DD, Joy TP (2006) Rabies outbreak in Pokémon daycare center. Infectious Diseases 33: 377-378.
Joy CV, Joy L, Joy R (2013) Nidoran envenomation and associated viruses. Surgery Journal of Unova 23: 5-9.
Seadle M (2018) Publication quality, peer review and predatory journals. Proceedings of the Association for Information Science and Technology 55(1): 730-731.Jesse J James J (2020) Make it double: Coronavirus outbreak reaches Antarctica. Rocket Science Monthly 21(3): 32-37.Mazzetti D (2016) Fraud in exercise science journals: Do you even peer review? Archives of Broscience 112(7): 896-902.Wayne B (2016) Phobia of Bats and Its Applications in Criminal Justice. Gotham Forensics Quarterly 26(8): 807-814.Crichton M (2013) Origin and Defeat of the Andromeda Strain. Journal of Cryptovirology 116(6): 1360-1363.Beall J (2016) Dangerous predatory publishers threaten medical research. Journal of Korean Medical Science 31(10): 1511-1513.Johal J, Ward R, Gielecki J, Jerzy Walocha, Kostantinos Natsis, et al. (2017) Beware of the predatory science journal: A potential threat to the integrity of medical research. Clinical Anatomy 30(6): 767-773.Masic I (2017) Predatory publishing–experience with OMICS International. Medical Archives 71(5): 304-307.Strielkowski W (2017) Predatory journals: Beall's List is missed. Nature 544(7651): 416.Yarbs S, Syme S, Rubin B, Moungher W, Stamper M, et al. (2020) Laughter is ineffective medicine against COVID-19. Taiwan Journal of Anesthesiology 2: 1-15.
Jesse J, James J (2020) Meowth, that’s right: Coronavirus detected in cats. Rocket Science Monthly 21(4): 66.
Joy SM (2006) Pangolins do not cure cancer any other diseases. Journal of Please Stop Eating Endangered Species 21: 420-430.Zhivago Y (1965) Love caught in the fire revolution. MGM Studios 12: 193.
Ketchum A, Oak S (2020) The importance of handwashing in Aipoms. Training Today 3: 14.
Shelomi M, Richards A, Li I, Okido Y (2012) A phylogeny and evolutionary history of the Pokémon. Annals of Improbable Research 18(4): 15-17.
Potter H, Weasley R, Granger H (2013) Novel rhinovirus responsible for newt eye infection. Magical Creatures 6: 31-36.
Dickson T (2006) Will it blend with a p-value below 0.5? Nature 420: 32-35.
Schmidt-Jeffris R, Nelson J (2018) Gotta catch ’em all! Communicating entomology with Pokémon. American Entomologist 64(3): 159-164.
Winnfield J, Vega V (1994) What do they call a predatory journal in France? Pulp Nonfiction 521: 154.Applebaum E, Schlangemann H, Schlomi M (2019) Anthocyanin Receptor Expressions Across Tangela (Monjara tangela) Vines. Journal of Plant Biochemistry & Physiology 7: 1000237.
Un KJ, Stalin J, Pot P, Hoxha E (1984) Comparative methods of involuntary movement restriction as applied in Wuhan and Xinjiang. Journal of Dictatorial Behaviour 32(1): 172-181.
Stromberg J (2014) ‘Get Me Off Your F*****g Mailing List’ is an Actual Science Paper Accepted by a Journal. Vox 21: 10-11.Pooh W, Milne AA (2019) Similarities between politicians and fictional bears, part xi. Hong Kong Journal of Democracy 5: 50-55.Berenstain B (2004) Masks do not prevent the spread of viral particles in Cubchoo sneezes. Revista Não Revisada por Pares 76(2): 289-295.
Laine C, Winker MA (2017) Identifying predatory or pseudo-journals. Biochemia medica: Biochemia Medica 27(2): 285-291.
Finger B, Kane B, Robinson J (1965) Case study of depression in a comedian with pseudobulbar affect. DC Medical Journal 77(1): 5-37.
da Vinci L, Simoni MdLB, da Urbino MS, Bardi DdNdB (2014) Effects of exposure to sewage on martial arts skills in turtles. Journal of Cowabungan Zoology 479(2): 149-155.Orwell G (1984) Why arresting doctors for discovering a new virus is a terrible idea. Annals of the Zhēnxiàngbù 112(2): 748-759.
Vakil C (2019) Predatory journals: Authors and readers beware. Can Fam Physician 65(2): 92-94.Beall J (2016) Essential information about predatory publishers and journals. International Higher Education 86: 2-3.Pinky M, Brain M (2005) Hantavirus transmission in aerosolized Rattata feces. Royal Society of Cryptobiology 420: 32-34.
Wright P, Fey M, Justice A (2007) A guide to legal defense. South Harmon Review of Law 3: 46-53.
Edgeworth M, von Karma F, von Karma M (2007) A guide to legal prosecution. South Harmon Review of Law 31: 343-354.
Counihan J (1986) Effects on perceived hotness of chili when cooked over Charmander flames. Suisun Journal of Burnination 1:10
Squarepants, S Star P, Cheeks S (2014) Treatment of Karenovirus infection with processed food. Bikini Bottom Journal of Morbidity and Mortality 32: 2-50.
Joy NY, Joy CA, Joy NZ, Joy MO, Joy FK, et al. (2019) The importance of peer review in medical journals. Journal of Nursing Ethics 12: 73-86.
--------------------
Remember: this article on Pokemon causing Covid was accepted by a supposedly "scientific" journal!
That's why I always roll my eyes when people try to argue that a journal's impact factor isn't as relevant as it used to be. In an era of disinformation, it strikes me as more important than ever.
Note the Stromberg paper: as stated, it is an actual article published in another predatory journal. It consist entirely of the phrase "get me off your f******g mailing list", repeated over and over. And it was accepted.
Much, much respect for Dr. Shelomi and his whimsical experiment, and to all those who work hard to fight bogus science!
edit, because this is too good: I kid you not, the second I pressed "send", I received an e-mail from a predatory journal asking me to contribute a paper!!! This is straight out of a comedy film!