Feb2010

Is there really any place for peer review in modern scientific publishing

Is there really any place for peer review in modern scientific publishing? It seems to me that this process, grounded in 18th century gentlemanly science, has little or no place in a world with such wonders as the internet. At best, the submission of research to a group of scientific peers (also sometimes know as ’scientific rivals’) is rather quaint. At worst, if we are to believe the complaints levelled this week in the field of stem cell research, it is corrupt.

Dissatisfaction has surfaced among stem cell researchers with the publication of an open letter to the editors of academic journals. The complaints centre around the time and quality of peer reviewing, which they say delays unneccessarily the publication of important findings, while promoting papers of lower scientific value. Some also voice fears that work may be suppressed in order to allow others to claim breakthroughs.

Peer review has been questioned before, but is staunchly defended by those who see the value of the status quo. Certainly, for most researchers most of the time, the system works adequately - but that is about as much endorsement as I can give it. Peer review is not there for the benefit of science, but rather for the benefit of publishers. It is not a form of scientific quality control, and is barely even a certificate of validity. Its main purpose is simply to stop publishers getting egg on their face.

But even in this limited role, it has a questionable track record. This week also saw the final and full retraction of Dr Andrew Wakefield’s notorious 1998 paper in the prestigious UK medical journal The Lancet, in which he linked the MMR vaccine to autism. That paper had been fully peer reviewed. Fleischmann and Pons’s work on cold fusion was published in the peer reviewed Journal of Electroanalytical Chemistry, and yet the very phrase ‘cold fusion’ has now become a synonym for bogus science.

Is there an alternative? Well, yes - in fact there are a few. In astronomy, peer review has largely been abandoned in favour of paper ‘preprints’ which circulate widely and freely thanks to the internet. Alternatively, peer review could be conducted in a more open and honest way - reviewers could lose their anonymity, and discussions could take place in the open (again thanks to the internet). Exchanges may need to be refereed, but that shouldn’t be too onerous. Or the whole idea could be abandoned in favour of professional editorial quality control.

Some of the greatest scientific discoveries of the last century or so found their way into the public domain without the benefit of peer review. Crick and Watson’s structure of DNA was first published as a letter, rather than a paper - and, given the intense rivalry between teams seeking the structure of the molecule, that may just have precluded any temptation for bias by reviewers. Albert Einstein’s greatest works, published during his ‘annus mirabilis’ in 1905, were reviewed only by the editors of the journal. It seems to me that peer review may cause more problems than it solves, and that the time is right for a major overhaul of the system.
This comment was originally published in the Laboratorytalk Newsletter

3 Responses to “Is there really any place for peer review in modern scientific publishing”

  1. Steve Mansey Says:

    Although I can see the problems here, I think they bigger issue is the cost to individuals out here, in the wider world to actually get to read it!
    Once a publisher decides they will actually put it out there on their website, they charge e.g. $30 to view it.
    More often than not, the paper, although looked promising from the abstract, ends up not giving you the info you actually wished for.
    It also seems to rub salt in the wound, when you may find a 1980 paper, which looks really promising, and you still have to pay $30!
    To my mind, it is the publishers, wanting a quick buck, that is actually slowing down research in the world!

  2. Zen Faulkes Says:

    I’ve been arguing recently that anonymity is the prime culprit in making peer review toxic.

    Should we give up anonymous reviewing?

    ANonymity doesn’t make science better

    Is a reason that physics and astronomy have been able to move to the “pre-print” model because those are relatively small fields of workers? There may be scaling issues that will prevent that solution from being widely adopted.

  3. Jim Till Says:

    See also this excerpt from “Why Open Access Advocates Don’t Tell the Whole Truth” by Barak, January 13, 2010:

    Of course, the big-name journals are less than genuine as well. The real “value” that they provide is not the editing and peer-review as they often claim. The value that they provide is marketing. The publishers are paid to reject. Journals are often considered to be better if they reject more manuscripts. Rejection of everyone’s manuscript but their own allows authors to feel like they belong to an exclusive club. Memberships in exclusive clubs, as many companies have proven time an again, is worth money.

Leave a Reply

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>



About the Author

Laboratorytalk and this Editor's Blog are edited by Russ Swan

Russ Swan

Russ has edited Laboratorytalk since its launch in 2001. After an early career in civil engineering, he joined the trade journal Concrete as technical editor, later freelancing for a variety of trade and consumer magazines and newspapers. In the 1990s he co-founded a publishing company which launched three successful magazines covering highways, transportation networks, and structural engineering, and later joined the Institution of Chemical Engineers to edit The Chemical Engineer. He was among the first dozen employees of VerticalNet Europe, the spectacularly disastrous poster child of the first wave of internet publishing, in 2000. He has written for Private Eye, the Financial Times, and the Encyclopaedia Britannica, is a member of the Association of British Science Writers (ABSW), and in his spare time rides a 1200cc Suzuki.

Spread the word...

Add to Technorati Favorites

Share on Facebook

Stumble this!