{"id":88,"date":"2019-09-16T14:12:14","date_gmt":"2019-09-16T13:12:14","guid":{"rendered":"http:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/?p=88"},"modified":"2019-09-17T12:48:59","modified_gmt":"2019-09-17T11:48:59","slug":"peer-review-week-2019-quality-in-peer-review","status":"publish","type":"post","link":"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/2019\/09\/16\/peer-review-week-2019-quality-in-peer-review\/","title":{"rendered":"Peer Review Week 2019: Quality in Peer Review"},"content":{"rendered":"\n<figure class=\"wp-block-image\"><a href=\"http:\/\/www.lab-initio.com\/\"><img decoding=\"async\" src=\"http:\/\/www.lab-initio.com\/images\/fullsize\/nz060.jpg\" alt=\"A cartoon showing a researcher running past reviewers holding weapons to reach the goal of 'Paper Accepted'\" \/><\/a><figcaption>From http:\/\/www.lab-initio.com\/images\/fullsize\/nz060.jpg<\/figcaption><\/figure>\n\n\n\n<p>When I started writing this blog post I titled it \u201cPeer review: the good, the bad and the ugly\u201d. Then I googled \u201cpeer review\u201d and found that was not a clever or original title (see <a href=\"https:\/\/www.enago.com\/academy\/authors-perspective-on-peer-review-good-bad-and-ugly\/\">here<\/a> and <a href=\"https:\/\/info.reprintsdesk.com\/about\/blog\/peer-review-the-good-the-bad-and-the-ugly\">here<\/a> for starters), and certainly wouldn\u2019t get past Reviewer 2.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p>&#8220;Peer review is the system used to assess the quality of a manuscript before it is published. Independent researchers in the relevant research area assess submitted manuscripts for originality, validity and significance to help editors determine whether a manuscript should be published in their journal.&#8221;  <a href=\"https:\/\/www.biomedcentral.com\/getpublished\/peer-review-process\">h<em>ttps:\/\/www.biomedcentral.com\/getpublished\/peer-review-process <\/em><\/a><\/p><\/blockquote>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter is-resized\"><a href=\"https:\/\/peerreviewweek.wordpress.com\/\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-content\/uploads\/sites\/349\/2019\/09\/peerreviewwk-1.png\" alt=\"Logo for Peer Review Week 2019\" class=\"wp-image-112\" width=\"280\" height=\"158\" srcset=\"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-content\/uploads\/sites\/349\/2019\/09\/peerreviewwk-1.png 560w, https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-content\/uploads\/sites\/349\/2019\/09\/peerreviewwk-1-300x169.png 300w\" sizes=\"auto, (max-width: 280px) 100vw, 280px\" \/><\/a><\/figure><\/div>\n\n\n\n<h2 class=\"wp-block-heading\"><a href=\"https:\/\/peerreviewweek.wordpress.com\/\">Peer Review Week<\/a> (a global event celebrating the vital role peer review plays in maintaining scientific quality) has a focus on quality in 2019: how can you, the research community, provide and be provided with quality peer review? <\/h2>\n\n\n\n<p><\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p> &#8220;The goals of peer review are both lofty and mundane. It is the responsibility of journals to administer an effective review system. Peer review is designed to select technically valid research of significant interest. Referees are expected to identify flaws, suggest improvements and assess novelty. If the manuscript is deemed important enough to be published in a high visibility journal, referees ensure that it is internally consistent, thereby ferreting out spurious conclusions or clumsy frauds.&#8221; <a href=\"https:\/\/www.nature.com\/nature-research\/editorial-policies\/peer-review\"><em>www.nature.com\/nature-research\/editorial-policies\/peer-review<\/em><\/a><\/p><\/blockquote>\n\n\n\n<p>How do you know if you are reviewing well? There are some great resources written by researchers and publishers including <a href=\"https:\/\/fsolt.org\/blog\/2017\/04\/14\/reviewing-workshop\">Notes for Those New to Writing Peer Reviews<\/a>, <a href=\"https:\/\/publons.com\/blog\/5-tips-to-write-a-structured-reviewer-report\/\">How to write a structured reviewer report<\/a> and the hashtag <a href=\"https:\/\/twitter.com\/hashtag\/BeReviewer1?src=hashtag_click\">#BeReviewer1<\/a> on Twitter. There is also plenty of information on how NOT to peer review well \u2013 see the hashtag <a href=\"https:\/\/twitter.com\/search?q=%23Reviewer2&amp;src=typed_query\">#Reviewer2<\/a> on Twitter, or <a href=\"https:\/\/www.chronicle.com\/article\/The-3-Types-of-Peer-Reviewers\/243698\">The Three Types of Peer Reviewers<\/a>. It is always worth reading the peer review policy of key journals in your field, both so you know what to expect when you submit a paper and so you know what is expected from you as a peer reviewer.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p>&#8220;The review by peers is a tried and tested method \u2026. it places great demands on reviewers whose assessments must be honest, fair, safe and independent.&#8221; <a href=\"https:\/\/publons.com\/community\/academy\/\"><em>https:\/\/publons.com\/community\/academy\/<\/em><\/a><\/p><\/blockquote>\n\n\n\n<p><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What makes a good reviewer?<\/h2>\n\n\n\n<ul class=\"wp-block-list\"><li>Responds to accept or decline review invite emails promptly and provides the review in a timely way<\/li><li>Provides constructive criticism with justification<\/li><li>Is helpful and collegiate, treating others as they expect to be treated<\/li><li>Discloses conflicts of interest<\/li><li>Has relevant expertise and informs the editor if any part of the paper falls outside their expertise<\/li><li>Assesses validity of research, results and conclusions<\/li><li>Raises ethical considerations in a balanced, respectful way<\/li><li>Highlights if key literature is not referenced<\/li><\/ul>\n\n\n\n<p>Most journals with a traditional single blind peer review system (where the reviewers remain anonymous to the authors) require that the manuscript is only seen and commented on by the specified reviewer, not in collaboration with their research group of PhD students, for example <a href=\"https:\/\/www.nature.com\/nature-research\/editorial-policies\/peer-review#the-peer-review-system\">Nature<\/a>. However, some journals offer more flexibility such as <a href=\"https:\/\/www.embopress.org\/transparent-process\">EMBO Press<\/a> journals: <\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p><em>\u201cWe subscribe to referee confidentiality rules. On the other hand, we are aware of the relatively common practice of handing a review onto someone else in the laboratory. If carried out correctly, this can in fact be an important part of training, but it should be reserved for experienced postdoctoral researchers. Thus, all EMBO Press journals allow co-refereeing with one other senior member of a referee&#8217;s laboratory as part of the mentoring process only if the primary referee has independently evaluated the manuscript and agrees with the report filed. For co-review, conflict of interest and confidentiality rules apply to both referees. In order to provide accountability and appropriate credit, we request that the name of the co-referee be documented to the editors.\u201d<\/em>  <em><a href=\"https:\/\/www.embopress.org\/transparent-process\">https:\/\/www.embopress.org\/transparent-process<\/a><\/em><\/p><\/blockquote>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"581\" height=\"612\" src=\"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-content\/uploads\/sites\/349\/2019\/09\/rosecoloured.jpg\" alt=\"Cartoon showing one person asking &quot;What's with the rose-coloured glasses?&quot;. Person 2 responds &quot;Avoiding despair about biases in science&quot;\" class=\"wp-image-101\" srcset=\"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-content\/uploads\/sites\/349\/2019\/09\/rosecoloured.jpg 581w, https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-content\/uploads\/sites\/349\/2019\/09\/rosecoloured-285x300.jpg 285w\" sizes=\"auto, (max-width: 581px) 100vw, 581px\" \/><figcaption><br> Cartoon by <a href=\"https:\/\/statistically-funny.blogspot.com\/\">Hilda Bastian<\/a>, CC BY-NC-ND<\/figcaption><\/figure>\n\n\n\n<p>Blind peer review can be affected by bias as explained in this <a href=\"https:\/\/blogs.plos.org\/absolutely-maybe\/2017\/10\/31\/the-fractured-logic-of-blinded-peer-review-in-journals\/\">PLOS blog post<\/a>. Some journals allow, or mandate, open peer review meaning that the author knows who the reviewers are. Over 70 of the journals published by BMC have adopted open peer review, stating that <em>\u201cOpen peer review facilitates accountability and recognition, and may help in training early career researchers about the peer review process.\u201d <a href=\"https:\/\/www.biomedcentral.com\/about\/advancing-peer-review\">https:\/\/www.biomedcentral.com\/about\/advancing-peer-review<\/a> <\/em><\/p>\n\n\n\n<p>Proceedings of the Royal Society A provides authors and reviewers the option of either blind or open peer review: <em>\u201cWhere authors opt for open peer review, Proceedings A will make the editorial process transparent for all accepted papers, by publishing reviewer reports, the substantive part of decision letter after review and the associated author responses alongside published articles. This will allow readers to better assess the published paper and provide post-publication comments (which will also be published). If the reviewers have opted to disclose their names this will be included too. Referee reports are made public under the CC-BY open access licence.\u201d <a href=\"https:\/\/royalsocietypublishing.org\/rspa\/open-peer-review\">https:\/\/royalsocietypublishing.org\/rspa\/open-peer-review<\/a> <\/em> <\/p>\n\n\n\n<p>Researchers in some disciplines have for many years published pre-prints, drafts of research papers made available prior to peer review, to publicise initial findings and receive feedback before submission to a journal. <a href=\"https:\/\/arxiv.org\/\">arXiv<\/a> (pronounced \u2018archive\u2019) is one of longest established pre-print servers (the University of Southampton recognises the value of arXiv and provides <a href=\"https:\/\/arxiv.org\/about\/ourmembers\">financial support<\/a>). The internet has also enabled the development of post-publication peer review systems such as <a href=\"https:\/\/f1000research.com\/\">F1000<\/a> and allowing authors to make their review history public as with <a href=\"https:\/\/peerj.com\/benefits\/review-history-and-peer-review\/\">PeerJ<\/a>.  <a href=\"https:\/\/www.peerageofscience.org\/\">Peerage of Science<\/a> uses a system called collegiate peer review, where many reviewers can assess a submission and review other reviews. Once a manuscript has been reviewed and amended, member journals can make an offer to publish it.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><a href=\"https:\/\/twitter.com\/SpringerNature\/status\/1173604991153692679\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"149\" src=\"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-content\/uploads\/sites\/349\/2019\/09\/Springerpeerreview-300x149.jpg\" alt=\"Tweet from @SpringerNature about reviewer feelings on peer reviewhttps:\/\/twitter.com\/SpringerNature\/status\/1173604991153692679\" class=\"wp-image-122\" srcset=\"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-content\/uploads\/sites\/349\/2019\/09\/Springerpeerreview-300x149.jpg 300w, https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-content\/uploads\/sites\/349\/2019\/09\/Springerpeerreview.jpg 593w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/figure>\n\n\n\n<p>How can you receive requests to peer review? We recommend creating a free review profile on <a href=\"https:\/\/publons.com\/about\/home\/\">Publons<\/a>, a platform that allows researchers to track, verify and be recognised for their peer review and editorial work. The <a href=\"https:\/\/publons.com\/community\/academy\">Publons Academy<\/a> is a free peer review training course for early career researchers and includes links to useful <a href=\"https:\/\/publons.com\/community\/academy\/resources\">resources<\/a>. Journal editors can use Publons to find reviewers, but networking at conferences and sending a copy of your CV to relevant journals can be good ways of getting noticed. <\/p>\n\n\n\n<p>Publons also provides publishing advice and guidance from researchers. I read this piece offering <a href=\"https:\/\/publons.com\/blog\/advice-for-early-career-peer-reviewers-a-peer-review-q-a-with-robert-faff\/\">advice for early career peer reviewers<\/a> published for Peer Review Week 2015 with interest \u2013 I agree with many of the points but I personally think there can be merit in open peer review. If you are in the mood for a longer read that includes open peer review and issues with preprints and post-publication review, I recommend <a href=\"https:\/\/doi.org\/10.1093\/femsle\/fny204\">The state of the art in peer review<\/a>, an article by J. Tennant in FEMS Microbiology Letters, the <a href=\"https:\/\/fems-microbiology.org\/interview-jon-tennant-author-of-the-state-of-the-art-of-peer-review\/\">follow-up interview<\/a> that took place in Peer Review Week 2018 and a recent preprint by the same author on <a href=\"https:\/\/osf.io\/preprints\/socarxiv\/jq623\/\">The limitations to our understanding of peer review<\/a>, feeding in responses from this <a href=\"https:\/\/twitter.com\/Protohedgehog\/status\/1158312462011240448?s=20\">Twitter thread<\/a>.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>The University of Southampton is a member of <a href=\"https:\/\/www.vitae.ac.uk\/about-us\">Vitae<\/a>, a non-profit programme providing professional development for all types of researchers that has a wealth of <a href=\"https:\/\/www.vitae.ac.uk\/researchers-professional-development\">resources <\/a>available when you create a free <a href=\"https:\/\/www.vitae.ac.uk\/login\">account<\/a>. The <a href=\"https:\/\/www.vitae.ac.uk\/researchers-professional-development\/about-the-vitae-researcher-development-framework\">Vitae Researcher Development Framework<\/a> sets out the knowledge, behaviours and attributes of researchers into clearly defined areas with quick tips, advice sheets with &#8216;action and evidence&#8217; examples for each, enabling you to develop your expertise to provide honest, fair, valid and independent reviews for others.<\/p>\n\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n\n<p>Do you have any thoughts about quality in peer review? We would love to hear your comments.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>When I started writing this blog post I titled it \u201cPeer review: the good, the bad and the ugly\u201d. Then I googled \u201cpeer review\u201d and found that was not a clever or original title (see here and here for starters),<\/p>\n","protected":false},"author":3879,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[6],"tags":[5],"class_list":["post-88","post","type-post","status-publish","format-standard","hentry","category-peer-review","tag-peer-review"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-json\/wp\/v2\/posts\/88","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-json\/wp\/v2\/users\/3879"}],"replies":[{"embeddable":true,"href":"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-json\/wp\/v2\/comments?post=88"}],"version-history":[{"count":31,"href":"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-json\/wp\/v2\/posts\/88\/revisions"}],"predecessor-version":[{"id":131,"href":"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-json\/wp\/v2\/posts\/88\/revisions\/131"}],"wp:attachment":[{"href":"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-json\/wp\/v2\/media?parent=88"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-json\/wp\/v2\/categories?post=88"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/generic.wordpress.soton.ac.uk\/researchmatters\/wp-json\/wp\/v2\/tags?post=88"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}