How to Review a Scientific Paper: Top tips to avoid becoming like the meme of reviewer 2

It’s been a little while since I posted some academic tips, I think mostly because I spent a lot of last year in that space whilst writing It Shouldn’t Happen to a PhD Student. I’ve been speaking to a few people recently, however, who have shown an interest in how the review process works for scientific papers and how they could get started. It felt timely, therefore, to put some of what came to mind down in a blog.

It’s probably worth bearing in mind when you are reading this that every journal is slightly different, some will require very long discussion sections, some will prefer word count to be focused on results sections. This blog will cover the points that are generally important to consider as part of a review, but there will always be journal specific factors that you need to take into consideration. Hopefully it will still act as a helpful starting point.

What are the benefits of undertaking peer review?

There are many benefits of being a reviewer for scientific journals, but let’s get this out of the way at the start, money is not one of them, no you do not get paid. You don’t even get a discount to publish in the journals you review for. What you do get is a lot of experience of seeing papers going through various levels of development. You get to spend time reflecting on your reaction to manuscripts and exploring what leads to the reaction of ‘this paper is amazing’ or ‘this paper is wrong somehow’. Time is one of the things that is limited for almost everyone, and so having a reason to carve out time for this type of reflection is beneficial for both you and the wider scientific community. After all, papers don’t get published if no one takes the time to participate in peer review.

The thing that I personally have found most valuable after over a decade of doing this, is learning to the look at the bones and structure of a paper and being able to provide supportive feedback on how some changes to that structure could make the end result better. Going through this process has allowed me to learn so much, so that when I am developing the structure and content for my own papers I apply the lessons I have learnt from reflecting during reviewing papers for others. I hope this makes the review process for those looking at my own papers easier, as I’ve already acted as my own reviewer with a critical eye before I even submit a paper, but it definitely helps me reduce the number of drafts I produce.

One final, very unique opportunity you get as a reviewer, is that you get to see the reviews that others provide. Once all the reviews are in you will be able to access the reviews that others provide, either online or in the email sent out. This is always very interesting as it is the only circumstance where you can see what others have taken away from reading the same manuscript. It is fascinating to see whether others come to the same conclusions vs acceptance etc, and also to see what points they’ve noted. This is a great learning opportunity, and even after all this time I make sure to look, reflect, and learn from what others have said.

How to get involved?

Once you begin to publish your own scientific papers you will tend to quite naturally end up being involved as a reviewer, because of the fact that your details and expertise will then be part of the database that editors from a journal will select reviewers from. There are other ways to get involved however:

  • Email an editor to volunteer
  • Become part of journal junior editor programme
  • Ask your supervisor to put you forward when they received review invitations they can’t accomodate
  • Ask your supervisor/mentor to send you articles so that you could review in parallel and compare comments
  • Join a journal club, not quite the same but a similar experience that will help
  • Present at conferences, as editors may remember your name
  • A more recent route in is also to review Pre Prints, where you leave your name and comments which may be picked up by an editor further down the line

The more reviews you do, the more you will be asked to do, and so the main thing is to just start and more opportunities will follow.

Principles for reviewing

There are a number of principles or considerations that I try and stick to that I have listed below, but there is one that I think is worth talking about before I discuss the others. This one is simple. Don’t be a jerk. Peer reviews are usually anonymous but this isn’t a license to say anything you wouldn’t say to someone’s face.

Now that’s done, onto some other points to consider:

  • Don’t be ‘that reviewer’ who tells authors to reference your papers, that’s not really the point of peer review
  • Remain impartial, it doesn’t matter if the author is your best friend, a complete unknown, or a star of their field, everyone is entitled to the same level of review. If you can’t be impartial then decline the invite
  • Don’t accept review requests that you know you won’t be able to fit into your diary, it just delays things for everyone
  • Reflect on whether you have the skills and knowledge to fulfil a review request. Over time I have been asked to review in all kinds of areas and I deliberately ask myself every time whether I am the right person to undertake the review
  • Focus on communication, both to the editor and the author. Make your points concise and structured in the way you would like to receive them as an author (often in a bullet pointed list, with a single comment per bullet point). If you are going to be delayed in returning your review let the editor know
  • Rarely, I have reviewed papers where I felt the conclusions or practice was actually unsafe. This has only happened a couple of times, but when it has I have communicated with the editor as well as adding comments, as it had patient safety implications. Often these papers won’t reach review but if they do, it is key that they are escalated
  • Be aware of whether you should be commenting on how well written the article is. Language should be accessible, but it is wrong to discriminate against authors who may not be writing in their first language, and your main purpose is to review the science, not to mark an English essay

Available tools

It can be a bit intimidating reviewing papers when you start, and it can be difficult to know where to begin. There are some tools that can help make this a little easier. My two favourites are ORION and CONSORT. ORION is linked to outbreak papers, and CONSORT is linked to randomised clinical trials. ORION is quite old now, but CONSORT was updated last year (2025).

ORION exists to help authors put together papers that are linked to outbreaks and infection control, and most helpfully comes with a checklist. This checklist can also be really helpful during a review to help you frame your response and pin down things that might be missing. Not all points will be suitable for all papers, so bear that in mind, but as a tool to assist you it is a helpful starter for 10.

CONSORT is a very similar tool for randomised trials. Again, even if you are looking at a paper that is not randomised but has another form of clinical trial, it can be a useful aid to help your thinking and a framework to support your review.

CONSORT, similar to ORION also has a checklist, which can be a useful tool to enable you to make notes when reviewing papers.

My review process

Once you have accepted an invitation to be a reviewer for a scientific paper you will get a link to log in and download the article. You will then have a period, usually two weeks, to submit your review.

Once I have the paper downloaded, I initially read it for an overview to get a feel for the article prior to reviewing each section in detail. I then consider which of the available options for outcome I think it might fall into:

  • Reject
  • Accept without changes
  • Accept minor revisions
  • Accept major revisions

Bear in mind when you go in to review in detail you may change your mind, and you need to remain open, but the reason I do this general overview is because the level of feedback I give, and thus the level of note taking required, will depend on the likely outcome. In general, I will provide more detailed notes for ‘accept with major revisions’ than I will for a reject, as I want to support the authors in having the best outcome possible and that requires a more in depth response.

From these general notes I write an opening review summary, which will includes which gaps I think the paper addresses, the benefits to the academic specialty, and my overall comments about what is good, and where it could be improved. I then move on and makes notes on each manuscript section in detail; which I use to formulate a more detailed list of reviewers comments point by point in order to make it easier for the authors to respond.

Title

My main focus when looking at the title is whether it accurately reflects what is in the paper. I enjoy a fun title, but there are some articles where titles act as the equivalent of ‘click bait’ and can lead the reader in a way that is not reflective of the data. Most of the time the title is fine, but I have had a few occasions where I’ve had to feedback that it needs to be better reflect the outcomes and research question based on the evidence presented.

Abstract

Whilst I have written this section at the top of the sections, because I’ve covered them in order, I always review the abstract last once I’ve got a full understanding of the rest of the paper.

The abstract should act as a stand alone summary, as many readers will read it alone and without additional context prior to decided whether to down load a paper. It should clearly communicate the research question, important components of the methodology, and accurately summarise the results. There can sometimes be a tendency for abstract to over call the results and conclusions so that people engage with the paper, and so this is something I give a lot of consideration to when reviewing.

I personally love an abstract with clear sub-headings as I find this makes them easier to read and review, but bear in mind that the format is based on the style of the individual journal, so don’t feedback on components like this without understanding the journal guidance. It is one of the benefits of reviewing for journals that you know well, or have submitted to yourself, that you are more aware of their editorial style requirements and so won’t need to research this as part of the review process.

Introduction

An introduction should introduce the relevant literature that the reader needs to understand the context of the rest of the paper.

When looking at an introduction I will consider:

  • Do the authors introduce concepts in other sections that they haven’t covered for understanding in the introduction?
  • How balanced are the references included, are they presenting significant bias by the papers they’ve chosen to include? (NB every paper is telling ‘a story’ and so there will always be some of this but it needs to not be extreme)
  • Are the references included suitable, relatively recent, and from peer reviewed journals?

The introduction is the foundation of the paper and so this needs to be right to support the reader in being able to fully access the content that follows it. It also needs to fully articulate the research question that is being addressed.

Methods

For a scientific paper, the main question to evaluate the methods is whether from reading them you could reproduce the paper. Do the authors list all the pertinent details? I often read methods sections and take myself through how they are laid out step by step to decide whether I could actually do that experiment myself. You’d be amazed at the number of times this isn’t possible. Often authors have such an understanding of their work that they make assumptions about what the reader will know, and therefore need to be asked to add in further details. For outbreak papers, authors will often assume you know something about their hospital or patient population, which is often not the case. The method section is somewhere where a CONSORT or ORION checklist can really help you to ensure that all the key components are there.

The methods should also include statements linked to ethical requirements for the study. There is also sometimes a specific ethics statement at the end of the paper, so it is worth making sure that you review both together if present. Again, not method specific but something I tend to take into account as part of method review, are disclosures. Was the study funded by a manufacturer or supplier who is listed in the method section? It is not wrong to undertake sponsored work, and often great science comes out of collaboration, but knowing this is the case and taking it into account when you are reviewing and understanding how it may or may not have impacted how the study was undertaken is important.

The other key thing to reflect on when reading the methods is whether the method chosen is actually the most appropriate method for addressing the research question asked. There are often many different ways to approach a question, and so there be many suitable method approaches meaning it’s important to not be prescriptive, but not all methods may appropriate. This is a point where you need to walk a fine line. You can’t ask someone to completely change their research method as even with major corrections you can only ask for clarifications or some amount of additional work, so if the flaw is fundamental this is one of the reasons I would reject a paper.

Results

The overarching question when looking at any results section is do the findings directly answer the research question posed in the introduction. Sometimes authors can end up answering a different question to the one originally posed, as their results lead them in a different direction, but this isn’t really acceptable in a paper where you have to have a thread through each section that makes sense to the reader.

The other things that are worth paying attention to in a results section include:

  • Are the figures and tables appropriate?
  • Do the figure and/or table legends permit them to be reviewed in isolation from the text?
  • Are error bars or other components to aid interpretation present?
  • Is all data represented i.e. data doesn’t feel cherry picked from what was stated in the methods?
  • Has statistical analysis been undertaken when it should have?
  • Is any statistical analysis undertaken appropriate?
  • Is the full dataset available in an appendix or public access database (if appropriate)?

Discussion

The main thing I am looking for in a discussion is that the authors have undertaken a thorough critique of their results in the context of the available literature and related it back to their original research question. This means that I don’t expect them to have just quoted a lot of their own previous work in order to support their interpretation of their current results, as this can introduce unnecessary bias. I expect a range of references to be used, most of which I would expect to be recent, rather than from the 90’s. As I said previously, every paper will be telling a story, but I don’t expect it to be sales pitch. I want to see the results interpreted within the context of relevant literature, and thought demonstrated about discrepancies and findings that may look like outliers.

I also expect authors to have highlighted limitations of their study and their interpretation. If there is potential bias I would like it acknowledged here alongside how easy the results may be to generalise. All studies will have limitations and it is important for the reader that these are clearly stated in order to reduce over stating the outcomes, but also so that other studies can build upon the current work.

Conclusion

Conclusions are key, and also where some authors fall into the trap of trying to overly dramatise what they have achieved. It can be tempted to over state your results and your impact, everyone wants to think that their work matters, and this is the key area where reviewers can support when looking at conclusions. It is crucial that the conclusion are representative of the work and stated within the context of the research question asked. This section is often quite small, but it is however incredibly important to get right, and reviewers can really help support authors in making sure this happens.

Owning your feedback

You will often be asked if you are happy to have your name associated with your review. I always say yes. Saying yes keeps it present within your mind that you are reviewing the work of people who will have worked hard to create what is in front of you. I never write something in a review that I wouldn’t be happy saying to the authors face if I met them at a conference.

Feedback should always be constructive. It should always be helpful. It should always be kind. Too often I’ve seen reviews that do not keep to these three rules and it makes me both sad and angry. Don’t be lured into taking a different approach because the review is online and feels anonymous. Character is who we are when no one is watching.

Using the learning

If you are just starting out undertaking peer review, make sure you capture what you learn from the process so that you can use it when you are next sitting down to write your next manuscript. Make notes for yourself, as well as the editor. What did you like? What worked well? What are the common errors that you are seeing? How would you correct that in your next work?

Reviewing is a unique opportunity, both to give back to your profession, and to make your own work better. Make sure you maximise this opportunity and when you’ve learnt how to do it well…pay it forward for others to benefit.

Other resources

https://authors.wiley.com/Reviewers/journal-reviewers/how-to-perform-a-peer-review/step-by-step-guide-to-reviewing-a-manuscript.html

https://www.britishjournalofnursing.com/content/top-ten-tips/essential-principles-for-peer-reviewing

https://www.elsevier.com/en-gb/reviewer/how-to-review

All opinions in this blog are my own

If you’d like more academic tips, think about checking out my book on thriving in the world of academia:

Handling Criticism with Grace: Top tips for responding to reviewers’ comments

One of my brilliant PhD students had his first experience of responding to reviewers comments last week, and as we sat and talked it through I thought that it might actually be a useful topic to write a blog about. Now, Sam was responding to reviewers comments on a review, but I think a lot of the principles stand no matter the response is linked to. I feel the same way about responding to comments and reviews on any piece of work I’ve poured my heart and soul into, be that manuscripts, grants, a piece of guidance, a policy or a business case, or my current horror – book submission. It might be that I need to remind myself of this advice as much as I wanted to share it with you 🤣.

Getting the opportunity to respond to reviewers is a success in itself

No matter how rough it feels in the moment when you first open the email/attachment and read all those comments where the reviewers have blatantly failed to read your carefully crafted wording in the way it was intended remember this. Being able to respond to reviewers is itself worthy of celebration. It means you haven’t got a full on NO. It means that the people see there is value in what you have done, even if they believe that it could be improved with some tweaking. Anything that isn’t a rejection is worthy of allowing yourself a mini celebration, chocolate bar, glass of wine, cup of tea, before you tackle the trauma of starting to make the changes.

Put on your positive specs

Whilst I drink my celebratory cup of tea I always take a moment to remind myself that this is actually an opportunity, an opportunity to make something I care about better than it would be without this process, that it’s an opportunity for improvement, and that this opportunity is something to be seized and embraced. Who doesn’t want to deliver the best thing they possibly can?

Always be polite

Now, it can also be said that sometimes recognising that opportunity for improvement can be challenging. Sometimes, those responding can have missed something that you clearly stated in both paragraphs X and Y. The thing is, they won’t have spent hours and hours reading your writing, and they are unlikely to have come to know it in the exquisite detail that you do. I tell you this as the person who blocks out only an hour to review your precious creation as that is all my diary allows. The thing is, most reviewers are doing it for the good of the community/trust/committee. They are, in essence, doing us all a favour. Therefore, when responding to what they have said its important to recognise that, and always always be polite in your response that you write. You are a professional after all.

The moral high ground gives combat bonuses

I have, on occasion, seen reviewers’ comments that shouldn’t have gotten by the editor or panel. Comments that could be considered racist or sexist, or to be honest, blatantly are. I’ve also seen responses where editors return those comments and just added a comment of their own to say ignore them and don’t respond in the review. This later one is interesting to me, I feel editors shouldn’t return these comments and should really respond to the submitter to say they are not acceptable.  When responding to these, I think it’s even more important to respond with grace. I separate out the science and deliberately respond to these with my science head. I then flag and escalate the rest of it, as if it’s a completely separate incident.

Don’t respond immediately

This is my top tip, my one thing if you only take one thing from this blog post. Never ever respond immediately. Open the email, read it once, maybe twice, to really ascertain what’s been said and see the response deadline, then close it and walk away. Nothing good ever comes from responding in the moment. I personally have a 48 hour rule. I will leave that email closed for at least 48 hours before I open it again, during which time I will drink that celebratory cup of tea and try not to dwell. After 48 hours, I’m allowed to re-open and read it again. If at that point I can read it without an overt emotional response I’m ready to respond. If not, I will give it another 48 hours. Almost always, after 48 hours, I open it and it’s nowhere near as bad as I had originally perceived with my emotional goggles on and I can just get on with a response.

Bite the bullet and get on with it

I know, I know. I just told you you need space to switch from emotional to logical response and to read what’s there in an analytical way, but you also can’t wait too long to respond. This is for a number of reasons. One, there will be a deadline for you to accept or reject what you’ve been asked to do, and you have already invested a LOT of time to get to this point. Two, you want to draft your response when the original submission is still relatively fresh in your mind as it helps with rebuttals and references. Finally, if you need more than two 48 hour breaks to get your head in the right space it’s likely that this is feeding into something bigger and you probably need to find a coping mechanism and to start processing what that is, and responding is a good way to start unpicking and reflecting on what’s driving how you feel.

Decide on the structure of your response

You’ve finally got to the point where you are going to sit down and start drafting your response.  There are lots of ways that you can do this, everyone is different, but in case you haven’t had the opportunity before, I thought I’d share how I do it in case it helps.

There are two main pieces that I would work on in parallel, the response to reviewers document and the in-text changes.

Response to reviewers:

  • I do this in Word and always have my paper title as the header.
  • I open with a paragraph where I thank my reviewers for their helpful comments (whether you truly feel it or not, this goes back to always being polite, but in all honesty there’s usually a lot of good to be thankful for)
  • I then break my responses down by reviewer, so I will have a section headed reviewer 1, another headed reviewer 2 etc, also a general one for the editors comments if there are any
  • Within each section for each reviewer, I will copy and paste over the comments I have received. I then break down these comments. Some reviewers give you a lovely bullet pointed list, sometimes with line numbers, and so this is easy. Some will give you paragraphs of text where you then have to extract each point and effectively make a bullet pointed list out of it.
    • At this stage, I tend to remove commentary, things where they is no change requested. This gives me a working list to work from, and I will colour code this text so it stands out from my responses, which I will write under each bullet point. I tend to make the reviewers comments red, I don’t know why I just do. Then, when I start writing my responses, I do these in black.
    • You can also, at this point, identify whether several reviewers have given similar comments, and then you can cluster those changes.

It’s only really at this point that I can see the wood for the trees, and generally, it’s much less bad than I had initially thought.

In-text changes:

This one is pretty straight forward. You may not have this if you are responding to a business case or grant review as they will want all the information contained in the response document. This additional document is mainly for manuscripts and contains the changes that you make in response to the review in your original paper. I tend to highlight changes to the text in yellow and then make sure I cross reference back in my response to reviewers with line numbers, as well as any commentary, so they are easy to find. The main thing to remember here is, once you’ve completed your response, save off a ‘clean’ copy without the highlights as well as the highlighted version as some places will want you to upload both.

Read what is there not what you think is there

So, the above information is about how you prepare to respond, but how do you actually respond? The first thing, and I think this is key, is to read what they have actually said, not what you think they have said. This is where I find splitting the points to be addressed up really helps, as it enables you to read them in a different way.

Common features that reviewers want added/addressed include:

  • addition of references
  • spelling mistakes
  • improvements in unclear sentence structure
  • other nuance changes

For all of these the action is fairly straight forward, you just make the changes within the original document and write a comment in your response to reviewers stating ‘changed in text – line XX and YY’. If you get similar comments from more than one reviewer, I would address them in the order in which they occur. So reviewer 1 has a similar comment to reviewer 3, I’d respond in the reviewer 1 section and in the reviewer 3 section state, for instance, ‘already addressed under reviewer 1 in line XX’.

Decide where you line is

It’s actually quite lovely if you just get quick responses as described above, sometimes however the comments require a little more. Sometimes the reviewers will want new points addressed, or occasionally fresh data included. At this point you need to decide how much the paper in it’s current format is important to you to maintain. This has happened to me a few times. Normally the additional points made actually really strengthen the paper and I am more than happy to spend the few extra hours to add in, especially as they tend to be points I already had in drafts but was forced to lose due to word count. There have however been occasions where I disagreed with the reviewer on either the fact that certain points should be included or the way they had suggested that they be done. On these occasions you are entitled, and I have done, to include commentary under the reviewers’ comment where you state why you don’t feel that it would be a suitable edit. You will need to be polite and clear, and ideally evidence, why you don’t agree. The decision will then lie with the editor as to whether they agree or not.

Get a second opinion

Once you’ve completed your response, or earlier if you are deciding to rebut points, it’s valuable to get a second opinion. You should send your response documents to your other authors for sign off, but if you are a sole author you should still find someone to sense check. This process is important, both to help ensure that you have actually addressed all the points raised, but also to help ensure that your arguments are robust where needed. I have been on papers where the first author has returned the response to reviewers without showing it to the other authors, and on reading it I have seen the response hasn’t fully addressed the reviewers which has then led to another round delaying paper submission. Some papers have loads of authors and you, with their support, may not need all of them to comment, but they should have sight prior to submission and at least the 1st and senior authors should have fully reviewed.

Learn lessons for when you are reviewing in the future

My final point is that this is a great learning opportunity, not just on the subject matter, but on what and what not to do when you are reviewing papers, grants etc. I always try to review and write comments in a way that is clear and actionable for those receiving the comments, in a way that I would like to receive them if the submission was mine. I also think it is so important to consider what should and should not be included in your review. Most journals, for instance, want to know whether the level of writing is good enough for publication but I would never cross the line into making comments about the English skills of the authors, I personally don’t feel that’s appropriate, for me, I’m there to comment on the science. It’s crucial to consider what it constructive and what is not as part of this process. When writing a review it is so important to think ‘is it helpful?’ ‘is it kind?’.

I hope all of this helps you when you are thinking about the best way to take onboard comments as they come in. I would also plea that you aim to see them as an opportunity to improve and learn rather than something that puts you into a spiral and causes you distress. Just getting the opportunity to respond is a success after all!

All opinions in this blog are my own

If you would like more tips and advice linked to your PhD journey then the first every Girlymicrobiologist book is here to help!

This book goes beyond the typical academic handbook, acknowledging the unique challenges and triumphs faced by PhD students and offering relatable, real-world advice to help you:

  • Master the art of effective research and time management to stay organized and on track.
  • Build a supportive network of peers, mentors, and supervisors to overcome challenges and foster collaboration.
  • Maintain a healthy work-life balance by prioritizing self-care and avoiding burnout.
  • Embrace the unexpected and view setbacks as opportunities for growth and innovation.
  • Navigate the complexities of academia with confidence and build a strong professional network

This book starts at the very beginning, with why you might want to do a PhD, how you might decide what route to PhD is right for you, and what a successful application might look like.

It then takes you through your PhD journey, year by year, with tips about how to approach and succeed during significant moments, such as attending your first conference, or writing your first academic paper.

Finally, you will discover what other skills you need to develop during your PhD to give you the best route to success after your viva. All of this supported by links to activities on The Girlymicrobiologist blog, to help you with practical exercises in order to apply what you have learned.

Take a look on Amazon to find out more