Friday, May 28, 2010

Journal Reviewing

How often do you review?

In the latest early releases from the American Journaol of Epidemiology, the editors discuss the concern of authors who submit heavily but do not accept requests to review articles. This situation is a classic case of the "Tragedy of the Commons"; the credit for reviewing is small (and typically anoymous). If nobody reviewed then the peer-review system would break down. However, the cost of any one person removing themselves from the reviewer pool is small compared to the benefit (for that person) in being able to focus on their own research projects.

Even worse, it is hard to know if the person who refuses at journal X might be a common reviewer at journal Y. Is the person who refuses refusing because they already do a lot of reviewing for another journal? Heck, I have reviewed for the American Journal of Epidemiology and I've never had a paper accepted there!

Female Science Professor once assembled a list of why people might see reviewing as a rewarding experience. It is an interesting list but maybe not completely convincing that the benefits outweigh the costs.

On the other hand, it is somewhat insirational that this system works despite everything that is working against it. Maybe science still has a critical mass of idealists left?

It's rather a nice thought.

2 comments:

  1. I've reviewed for journals I've never sent anything to and I've reviewed for journals I would never normally read.

    Why can't journals do what the funding bodies are doing? If you send them stuff you have to tick a box confirming that you will also serve as a reviewer at least once or twice?

    It's particularly disheartening to see that behaviour reported by public health people who ought to know better than to free ride in a trust/common property system.

    ReplyDelete
  2. One day I hope to get involved with a journal so I spend an unhealthy amount of time thinking about this issue. The problem with making journal review an expectation of submission is that reviewers can give back reviews.

    This is less obviously a good strategy in NIH study section where sloppy work can convince the people who evaluate your funding that you aren't that good . . .

    ReplyDelete