The truth about scientific peer review

On the whole reviewing a scientific paper is a thankless task (as is editing them, I hasten to add, still smarting from the bitter experience of facing three-feet high stacks of “manuscripts” requiring urgent attention). Peer review is entirely, ahem, voluntary although pretty much obligatory if you want your own papers reviewed, it’s unpaid and yet is a professional task. Editors expect response in a very short time and when a referee gets it wrong, all hell breaks loose (viz. the NASA arsenic bacteria story and the debacle about two molecules in a molecular cage).

In my time as a journal editor, I must have requested thousands of referee reports from hundreds of chemists across the globe, always with urgency. Reports came back randomly by mail of fax, and only in the latter months of my tenancy of those offices by email. We had referees who insisted on using snailmail, claiming that fax was accelerating the pace of life beyond that which is bearable. I hope that referee retired before Twitter came along.

In general papers were accepted or rejected, it seems on the meanest of criteria, although on the whole they were expertly assessed. Some authors were rejected by one particular referee because they used a dagger next to an author’s name to point to a footnote and this “cross” was considered offensive by the referee. Unfortunately, said referee was a leader in a small field and an almost obligatory assessor of many papers.

Anyway, enough of my reminiscing. The journal Environmental Microbiology has just published a run-down of the most amusing and perhaps offensive referees’ comments on papers it received this year.

Here’s my top ten selection from their list, check out their original item for the complete peer revelations:

  • This paper is desperate. Please reject it completely and then block the author’s email ID so they can’t use the online system in future.
  • I would suggest that EM set up a fund that pays for the red wine reviewers may need to digest manuscripts like this one.
  • The biggest problem with this manuscript, which has nearly sucked the will to live out of me, is the terrible writing style.
  • Hopeless – Seems like they have been asleep and are not up on recent work on metagenomics.
  • A weak paper, poor experimental design, comparison of sequences using different primers, no statistical analysis possible, carelessly written, poorly thought through.
  • I agreed to review this Ms whilst answering e-mails in the golden glow of a balmy evening on the terrace of our holiday hotel on Lake Como. Back in the harsh light of reality in Belfast I realize that it’s just on the limit of my comfort zone and that it would probably have been better not to have volunteered.
  • The writing and data presentation are so bad that I had to leave work and go home early and then spend time to wonder what life is about.
  • Reject – More holes than my grandad’s string vest!
  • The presentation is of a standard that I would reject from an undergraduate student
  • The lack of negative controls. . . . results in the authors being lost in the funhouse. Unfortunately, I do not think they even realize this.

One thought on “The truth about scientific peer review”

  1. From my standpoint as an outside observer, the system of scientific checks and balances that is supposed to correct error, including peer review, seems remarkably dysfunctional, at least where nutrition research is concerned. The most glaring example is the Dietary Guidelines for Americans, the ultimate nutritional authority.

    One wonders if the scientists, involved in perpetuating (for nearly four decades, the twin myths that high intake of omega-6 is healthy and high intake of saturated fats is unhealthy, spend any time at all exploring alternative views and familiarizing themselves with the supporting data. Failure to correct these mistaken ideas has generated an incredibly costly system of medical care that threatens to bankrupt developed countries.

    Obesity and virtually all chronic inflammatory diseases are related in some way to excessive omega-6 intake. That, there is little concern about omega-6s in the mainstream nutrition science establishment is evident by the fact that the omega-6 issue was not included in the 2010 Dietary Guidelines Advisory Committee agenda.

    Now, while I’m wary of anyone who writes material aimed at persuading people to buy a product, I’m impressed with Canadian physician and businessman Cosmas Ho. He seems to have an impressive grasp of the connection between essential fatty acid imbalance and the modern nutritional diseases. He writes, “Degenerative diseases that involve fats prematurely kill over two thirds of the people currently living in affluent, industrialized nations. 68% of people die from just three conditions that involve fatty degeneration: Cardiovascular disease (43.8%), Cancer (22.4%), and Diabetes (1.8%). These deaths are the result of eating habits based on ignorance and misconceptions…Throughout human history mankind has ingested an approximate equal proportion (1/1 ratio) of Omega 6 to Omega 3 fatty acids…The relationship of equivalence between the two Omegas is critical because they self – check each other in a delicate balance to regulate thousands of metabolic functions through prostaglandin pathways. Nearly every biologic function is somehow interconnected with the delicate balance between Omega 6 and Omega 3. Omega 3s are intimately involved in the control of inflammation, cardiovascular health, myelin sheath development, allergic reactivity, immune response, hormone modulation, IQ, and behavior. A seemingly minor, yet major change in Omega balance dictated by dietary ingestion has absolute deleterious health effects. The rapid change in dietary fat ingestion within only the last 50 – 100 years has bewildered human biophysiology created to function optimally on equal proportions of dietary omegas…The so-called western degenerative diseases have risen in a near perfect linear fashion with the elimination of Omega 3, and the over-provision of Omega 6 in the food chain. In many regards saturated fats may have been ruled guilty by association as the genesis of cardiovascular disease appears to be more closely related to a rise in vegetable oil ingestation than it does to saturated fat.

Comments are closed.