Skip to content

Live demo

A real match, start to finish

The matcher run on our own paper, unedited.

The paper

Scaling the Scholar: Distributed Multi-Agent System for Automated Peer Review

We present a multi-agent system for automated peer review of academic papers. Specialist agents score a submission along separate dimensions of review quality, and an orchestrator synthesises their results into a venue-specific accept or reject recommendation using guidelines loaded per venue rather than thresholds fixed in code. The architecture is event-driven, built on a message broker with event sourcing and a read-side projection, and the agents share a common tool server for retrieval against live literature. We evaluate against the published decisions of three machine learning venues spanning eight years, and additionally ablate an iterative deliberation variant in which the reviewer re-invokes sub-agents through function calling.

Placed in

Expert finding and Q&A systems

Information Systems · Computer Science

Our read

written by the model

Journal of the Association for Information Science and Technology

With a 42% topic fit and a 90th percentile reach in the area, this venue provides the strongest balance of relevance and visibility for a system-focused peer review study. Its h-index of 101 and citation rate of 3.3 demonstrate significant impact within information science research.

Worth stretching for

Information Processing & Management

While the topic fit is lower at 29%, its 96th percentile reach and high citation rate of 6.6 offer substantial potential for visibility if the contribution is framed through an information management lens.

Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Proceedings of the International AAAI Conference on Web and Social Media, and International Journal of Crowd Science do not provide information regarding publication charges.

The model chose from the ranked list below and cannot add a venue to it.

What to look at

Topic fit.
Whether they publish this kind of work at all.
Reach.
A percentile against the other venues listed here.
Charge.
What you pay to publish open access. "Not published" means OpenAlex has no figure, which is not the same as free.
Citation rate.
OpenAlex's two year average. "Not published" for most conferences, whose records it has not extended past 2021, so a blank is a gap in the source rather than a venue nobody cites.
A warning.
The venue's own numbers do not hold together.

Two venues a few percentiles apart on reach can be ten times apart on what they charge. Conference figures are the ones OpenAlex has attributed to the standing venue, which for most conferences means work up to 2021 rather than everything they have published since.

Citation rate

3.3

h-index

101

Papers

2317

Charge

$3,000

Topic fit
42%

Springer Science+Business Media

Reach

85th

Citation rate

1.3

h-index

80

Papers

696

Charge

$3,290

Topic fit
39%

Reach

96th

Citation rate

6.6

h-index

190

Papers

7162

Charge

$3,020

Topic fit
29%
04 Proceedings of the AAAI Conference on Human Computation and Crowdsourcing journal open access

Reach

86th

Citation rate

3.7

h-index

38

Papers

408

Charge

not published

Topic fit
36%
05 International Journal of Crowd Science journal open access DOAJ

Emerald Publishing Limited

Reach

83th

Citation rate

6.9

h-index

23

Papers

223

Charge

not published

Topic fit
34%
06 ACM SIGIR Forum journal

Association for Computing Machinery

Reach

83th

Citation rate

1.2

h-index

71

Papers

1482

Charge

not published

Topic fit
33%
07 Journal of Data and Information Science journal open access DOAJ

Chinese Academy of Sciences

Reach

80th

Citation rate

2.9

h-index

25

Papers

410

Charge

not published

Topic fit
34%
08 Proceedings of the International AAAI Conference on Web and Social Media journal open access

Reach

89th

Citation rate

2.3

h-index

130

Papers

2232

Charge

not published

Topic fit
28%
09 Scientometrics journal

Springer Nature (Netherlands)

Reach

95th

Citation rate

4.2

h-index

197

Papers

8466

Charge

$2,890

Topic fit
23%

Reach

75th

Citation rate

0.9

h-index

37

Papers

865

Charge

not published

Topic fit
35%

Reach is a percentile within this research area, and citation rate is OpenAlex's two-year mean citedness, which is not the Impact Factor.

Run it on your own paper

Free, no account, and we keep no copy of your text.