One of my New Year's Resolutions was to avoid refereeing so many dang papers. On day 13 I'm up to 3 papers in my review pile. Ugh. I've changed my resolution to avoiding papers totally outside my comfort zone (no more hedonics!). 

Upon acceptance of a review task today I noticed the days until completed review data. I can't resist a good exploration of data. 

My average review time on 34 papers in JEEM (5), ERE (14), REE (6) and EcolEcon (9) is 47 days with a range of 6 to 190. Trimming two outliers at the low and high end lowers the mean to 44 days. The standard deviation is 17 with a range of 13 to 77. 

There seems to be no pattern to the trimmed data: 

Reviews

 

Posted in
  1. Rene Salinas Avatar

    If I am reading it right, the data says if you are going to agree to review 10 papers, you might as well agree to 15 because it will take the same amount of time…. It would be cool to break down the time of year you reviewed those papers. I bet you are more efficient at different times of the year…
    But as I look at the graph again, maybe that isn’t what yo are plotting. Should the x-asix be “review number” as opposed to “number of reviews”. Does the last data point say that it took you 77 days to do 34 reviews or the 34th review took 77 days? I think you may mean the latter in which case, yeah, you need to see if time of year pulls out any patterns…

  2. willwheels Avatar

    34 papers over how many years?

  3. John Whitehead Avatar

    The data goes back to 2007 or 2008, I think. JEEM didn’t start using computers until later.

  4. John Whitehead Avatar

    The days to review is sorted from lowest to highest and then plotted in order.

  5. Drew Moxon Avatar

    I would be interested to see days to review as well. If less time is spent per review when there are more papers reviewed, you could say there was more efficiency or you could say that the more papers are reviewed, the less quality time each one gets (no offense John)!

  6. David Zetland Avatar

    You have enough data points (sad to say) to use median…

  7. willwheels Avatar

    I thought it was a year or two and I got worried.

Leave a Reply

Discover more from Environmental Economics

Subscribe now to keep reading and get access to the full archive.

Continue reading