EPEleventh Press International Publishing™An Enterprise Research Ecosystem

Search

Search articles, authors and pages, or jump to a dashboard section

Peer Review & Editorial Practice

How Editors Actually Match Reviewers to Manuscripts

Editorial Office, Eleventh Press International Publishing™ 6 min read

At Eleventh Press, reviewers are matched to manuscripts by comparing each manuscript's discipline tag and keywords with reviewers' declared expertise, ranking candidates by match strength, screening out conflicts of interest and inviting the top two or three. Reviewers have a 14-day window, can request extensions, and if too many decline the editor widens the search rather than settling for a weaker match.

Top 10 key takeaways

  1. Reviewer choice is one of the most consequential editorial decisions: a mismatched reviewer produces feedback that helps no one.
  2. Matching compares the manuscript's discipline tag and extracted keywords with each reviewer's declared expertise.
  3. Candidates are ranked by match strength and the top two or three are invited; multidisciplinary papers get reviewers matched to each component.
  4. Conflicts of interest — shared institutions, recent collaborations, personal relationships, competing work — are screened before invitation and must be declared by reviewers.
  5. Reviewers can accept, decline or request an extension on the standard 14-day window.
  6. When too many invitations are declined, the editor widens the search rather than lowering the bar on expertise.
  7. Research shows review work is concentrated on a small share of researchers, so spreading invitations fairly matters for quality and sustainability.
  8. Computational matching supports, but never replaces, the editor's judgement about who can evaluate a paper fairly.
  9. Reviewers improve their own invitations by keeping expertise keywords precise and current.
  10. Reviewers who connect ORCID can have completed reviews credited on their ORCID record, making invisible work visible.

Why does reviewer selection matter so much?

Peer review is only as good as the people doing it. A reviewer who knows the field well can spot a flawed control, a misapplied statistical test or a missing body of literature, and can suggest a fix. A reviewer who is out of their depth tends either to approve weak work or to reject sound work on misunderstood grounds, and in both cases the author receives little that helps them improve the paper. Selecting reviewers is therefore one of the editor's most consequential decisions, even though authors never see it happen.

It is also one of the hardest to do well at scale. Editors must find people who are expert, available, free of conflicts and willing, often across unusual combinations of fields, and must do so without overloading the same small group of reliable reviewers.

How does the matching process work?

When a manuscript clears initial screening, it is matched against our reviewer pool. The system compares the manuscript's discipline tag and the keywords extracted from its title, abstract and author keywords with each reviewer's declared expertise. Candidates are ranked by the strength of that match, and the handling editor reviews the ranked list before invitations go out — typically to two or three reviewers per manuscript. For multidisciplinary manuscripts the editor matches reviewers to each substantive component rather than to the paper as a whole.

Approaches of this kind have a long history in computer science, where conferences receiving thousands of submissions pioneered automated reviewer assignment, such as the Toronto Paper Matching System (Charlin & Zemel, 2013). The research literature is clear that computational matching is best treated as decision support: it surfaces candidates an editor might not have thought of, while the editor judges fit, balance and fairness (Price & Flach, 2017).

How are conflicts of interest handled?

A good expertise match is useless if the reviewer cannot be impartial. Before invitation, the editor screens candidates for obvious conflicts, such as a shared institution, a recent co-authorship or a known close collaboration with an author. Because the review is double-anonymised by default, reviewers cannot always detect conflicts themselves, so the editor carries this responsibility first.

Reviewers carry it second. COPE's guidelines ask reviewers to declare any competing interest — personal, professional, financial or intellectual, including directly competing work — and to decline where it would compromise their judgement (COPE Council, 2017). If a reviewer realises during review that they know the authors or have a conflict, they should tell the editor immediately rather than complete the review.

What happens after an invitation is sent?

Invited reviewers can accept, decline or request an extension. Once a reviewer accepts, the standard window to submit the report is 14 days. If more time is needed, reviewers should request an extension rather than let the deadline lapse silently: editors would much rather adjust the timeline than lose a well-matched reviewer, and a silent lapse delays the author for everyone.

If too many invitations are declined, the editor widens the search — moving down the ranked list, looking at adjacent expertise or asking a declining reviewer for suggestions — rather than settling for a weaker match. This can add time, but a review from someone who cannot evaluate the work is worse than a slightly later one from someone who can.

Why does reviewer workload matter?

Peer review rests on goodwill, and that goodwill is unevenly shared. A study of the biomedical literature estimated that a small fraction of researchers performs a large proportion of all reviews (Kovanis et al., 2016), and large surveys of reviewers have documented both rising invitation volumes and reviewer fatigue (Publons, 2018). Over-relying on the same people burns them out and narrows the range of perspectives the literature receives.

Our matching therefore considers more than expertise. Editors are encouraged to spread invitations across the pool, including well-qualified early-career researchers, and to avoid inviting the same reviewer repeatedly in a short period.

How can reviewers and authors improve matching?

Reviewers can do the most. The quality of every invitation you receive depends on the expertise keywords in your reviewer profile. Keep them specific (“Bayesian hierarchical models for ecological count data” rather than “statistics”), current, and limited to areas you would genuinely be comfortable evaluating. Precise keywords mean fewer irrelevant invitations and more reviews you are qualified to give.

Authors help by choosing accurate discipline tags and three to eight informative keywords, and by writing an abstract that names the methods as well as the findings. If there is someone who should not review your work because of a genuine conflict, say so in your cover letter with a brief reason; editors take such requests seriously, though they are not obliged to follow them.

How is reviewing recognised?

Reviewing is skilled, time-consuming and largely invisible work. Recognition does not make it less demanding, but it makes it count. Reviewers who connect their ORCID iD to their account and grant update permission have each submitted review offered to their ORCID record as a peer-review activity, which credits the service to the journal without revealing the confidential content of the review. Members of the Board of Reviewers can also be issued a formal service certificate.

Frequently asked questions

How do editors choose peer reviewers?

By matching the manuscript's discipline and keywords to reviewers' declared expertise, ranking candidates, screening for conflicts of interest and inviting the strongest two or three, with the editor making the final choice.

How long do reviewers have to complete a review?

Fourteen days from accepting the invitation. Reviewers can request an extension if they need more time.

What counts as a reviewer conflict of interest?

Any personal, professional, financial or intellectual interest that could affect impartiality — for example a shared institution, a recent collaboration, a close relationship or directly competing work.

Can I ask for a specific person not to review my manuscript?

Yes. Explain the genuine conflict briefly in your cover letter. Editors take these requests seriously but are not obliged to follow them.

How can I get more relevant review invitations?

Keep the expertise keywords in your reviewer profile specific and up to date, and limit them to areas you would genuinely be comfortable evaluating.

References

  1. Charlin, L., & Zemel, R. S. (2013). The Toronto paper matching system: An automated paper-reviewer assignment system. In Proceedings of the ICML Workshop on Peer Reviewing and Publishing Models.
  2. Committee on Publication Ethics Council. (2017). Ethical guidelines for peer reviewers (Version 2). doi.org/10.24318/cope.2019.1.9
  3. Kovanis, M., Porcher, R., Ravaud, P., & Trinquart, L. (2016). The global burden of journal peer review in the biomedical literature: Strong imbalance in the collective enterprise. PLOS ONE, 11(11), e0166387. doi.org/10.1371/journal.pone.0166387
  4. Price, S., & Flach, P. A. (2017). Computational support for academic peer review: A perspective from artificial intelligence. Communications of the ACM, 60(3), 70–79. doi.org/10.1145/2979672
  5. Publons. (2018). Global state of peer review. Clarivate Analytics. doi.org/10.14322/publons.GSPR2018
  6. ORCID. (n.d.). Peer review: ORCID integration guide.