Peer Review: A Cornerstone of Quality Assurance in Medical Research and Healthcare Innovation

The purpose of medical research is to expand the frontiers of medical and pharmaceutical knowledge and to identify more effective methods for treating diseases. Throughout this long journey, the publication of medical journals and literature has enabled the entire scientific community to share resources and advance together. Peer review is a quality control mechanism in which peers evaluate the content, methodology, and conclusions of scientific papers to assess their innovation and feasibility; only those that pass this review are published.

Peer ReviewDevelopment Process

The first documented peer review process was recorded by Syrians in the book Ethics of the Physician. Subsequent Arabic medical manuals also included relevant provisions: after diagnosing a patient, physicians were required to maintain detailed records. Upon the patient’s recovery or death, other physicians on the local medical board would review these clinical records to determine whether the physician’s medical services met the established standards. If the evaluation was unfavorable, the practicing physician could face litigation for medical negligence.

Peer review in the United States originated in 1918, when the American College of Surgeons established the initial standards for evaluating physicians and hospitals. Today, the Joint Commission on Accreditation of Healthcare Organizations (JCAHO), the national body responsible for hospital licensure and accreditation, mandates that all hospitals undergo peer review. Recognizing that peer review proceedings are critical to improving healthcare quality, the U.S. federal government enacted the Health Care Quality Improvement Act in 1986. This legislation stipulates that peer review deliberations need not be disclosed to the public and grants civil lawsuit immunity to peer review committees, thereby encouraging open and candid discussions.

As a fundamental institutional norm for manuscript review and quality control in international academic journals, “peer review of literature” has a history of over 300 years, dating back to the French Journal des Sçavans in 1665.

Peer Review in Medicine, refers to the evaluation conducted by professionals within the same field (typically physicians or nurses) of healthcare providers or medical institutions. This includes assessments of clinical skills, scientific critique of research and literature, and a secondary review of the clinical value of articles published in medical journals. The concept of "medical peer review" has been widely adopted by the American Medical Association as a means to enhance the quality of services provided by healthcare organizations. In particular, the "rating" of clinical practices ensures the professionalism and safety of medical services.

Peer review of literature is an academic evaluation process in which an author’s scholarly work or proposal is assessed by experts in the same field, thereby assisting editors in determining whether the manuscript meets established standards of value. Currently, this mechanism is widely adopted by major scientific and technological journals both domestically and internationally. However, due to variations in cultural backgrounds and publishing management systems, there are significant differences in the implementation of this mechanism across different countries and regions.

Based on whether there is information symmetry between authors and reviewers, “peer review” can be divided into three basic forms:

• Single-blind review: Reviewers are provided with the authors' information, while the reviewers' identities are concealed from the authors.




• Double-blind review: Reviewers and authors are unaware of each other’s identities; this is the most common method.




• Public Peer Review: The specific format adopted depends on the particular characteristics of the academic journal. For instance, humanities and social sciences papers, which may be influenced by ideological factors, tend to employ double-blind peer review. In contrast, natural science journals frequently adopt single-blind peer review, as the authors’ backgrounds and identities can provide reviewers with additional context for their assessments.

The Peer Review Process

Selection of Review Experts

Studies have shown that approximately 50% of journal editors rely almost exclusively on peer review. So, how are reviewers selected? Generally, there are three methods:

① Match experts in relevant fields from each academic journal’s “expert database” based on the submission content;

② The editors themselves identify suitable peer reviewers based on the submission content and their own expertise;

③ Author self-recommendation. While this practice is common abroad, it is rarely used in China due to its susceptibility to manipulation.

Common sense would suggest that more experienced and authoritative experts are better at peer review. However, in 2007PLOS MedicineThe journal’s research report indicates that experience, academic ranking, and formal training in epidemiology or statistics are not significantly correlated with the quality of peer review, whereas younger reviewers tend to provide more practical and targeted comments.

Review Points

Different medical journals each have their own distinct characteristics, with varying preferences for manuscripts, quality expectations, and peer-review criteria. Nevertheless, the following three key principles are widely emphasized and adhered to:

Quality—What is the research process like? Are the conclusions reliable? Assessing the credibility and accuracy of medical research.

Relevance—Is this paper appealing to the journal's readers? Does it fall within a specific medical field or scope?

Significance—How influential is this clinical study? Has it yielded major findings or new breakthroughs?

Peer ReviewThe Importance of

The rapid advancement of science and technology makes it extremely difficult for ordinary editors to accurately assess the value and significance of cutting-edge issues in academic research; such evaluations can only be reliably conducted through peer review by leading experts and scholars. Without the involvement of top-tier scholars in the review process, journals risk rejecting groundbreaking, epoch-making achievements. For instance, in the 1960s, the world-renowned academic journal Physical Review rejected an important paper by Theodore Maiman on laser theory due to the editorial staff’s lack of specialized expertise.

Establishing a peer-review system and leveraging the expertise of scholars in relevant fields can not only prevent such incidents but also ensure the quality of articles, thereby avoiding the publication of erroneous or false papers, such as those by Norwegian scientist John Sudbø inThe LancetIncidents of Publication in Medical Journals. Scientific research papers may have numerous issues, and peer review can help identify the following behaviors:

• Fabricating research results: providing fictitious data and conclusions despite the scientific study not being completed;

• Hazardous conclusions: The research findings may be detrimental to patients, potentially due to the use of unscientific and flawed methodologies;

• Plagiarism: Authors claim that the scientific work was conducted by themselves, when in fact they have misappropriated the labor and findings of other researchers.

Peer review is not limited to the scrutiny of journal article publications; it also guides the funding of medical research.



Deficiencies in Peer Review

Although there are currently no specific industry standards to regulate the norms and details of the peer review process, debates and research on it have never ceased. There is limited and fragmented empirical evidence supporting editorial peer review as a mechanism for ensuring the quality of biomedical research, whereas considerable evidence highlights its shortcomings: it is time-consuming, costly, highly subjective, heavily influenced by chance, prone to contradictory outcomes, and susceptible to abuse.

Time-Consuming

Peer review is a critical component of the manuscript publication process in academic journals across many countries. Publishers engage experts in the same field to evaluate submissions, thereby determining whether to accept them and ensuring the quality of scholarly articles. Even in today’s internet era, many medical journals typically require more than a year to review and publish a single paper. Statistics indicate that approximately 50% of manuscripts are rejected during the initial screening, subsequently undergoing multiple rounds of review at different journals.

High Cost

It is difficult to obtain specific cost data for peer review, largely because peer reviewers typically receive no compensation (a situation that also applies to most journal editors). Reviewing a manuscript is a highly demanding task, and the lack of remuneration discourages some professors from devoting substantial effort to this process. In economic terms, there is a significant “opportunity cost,” as the time spent on manuscript review could be allocated to more meaningful and productive activities, such as basic research. It is estimated that the average cost of peer review per article for the BMJ is $100 (with up to 60% of manuscripts rejected before external review), while the cost for those articles that ultimately pass the review process approaches $1,000.

The current peer-review model is typically “free,” with publishers generating profits by selling access to and download rights for scholarly literature. With the emergence of “open access,” the cost of peer review has become increasingly significant, as open access aims to make research freely available to everyone. One open-access model requires authors to pay upfront for peer review and article publication—currently estimated at $500–$2,500 per article. At present, the academic community pays approximately $5,000 per peer-reviewed paper; in addition to peer-review fees, this amount covers editorial costs, distribution costs, material costs, publisher profits, and other expenses, a sum that deters many scientific researchers. Although the effectiveness of this charging mechanism has not been conclusively demonstrated, the monetary value assigned to peer review does reflect the weight of integrity within the scientific community.

Variations in Individual Perspectives

Different individuals will inevitably vary in their assessments of a manuscript’s strengths, weaknesses, and significance. Consequently, when reviewers are asked to provide a recommendation on whether a paper should be published, their judgments may randomly deviate slightly from their true internal evaluations. In the publication process of medical journals, reviewers do not operate as a team; they neither communicate with nor know one another. As a result, inconsistent or even diametrically opposed decisions may arise under normal circumstances.

Differences in individual perspectives are perhaps inevitable, lending the peer-review process infinite possibilities. Submitting a research paper to a journal is akin to entering a black box system, where the final outcome resembles a game of roulette—resulting either in a devastating loss or a jackpot win, such as publication in Nature or Cell.

Black-box operations

There are high expectations for peer review, with its perceived objectivity and reliability being the most valued aspects. Many authors feel dissatisfied after having their manuscripts rejected by prestigious journals such as the BMJ, particularly when they observe that published papers of significantly lower quality have been accepted. Peer review is not a transparent process; when individual reviewers wield excessive influence, there is a risk of opaque practices. For instance, conflicts of interest may arise due to collaborative relationships, competition, personal conflicts, or biases between reviewers and authors.

Relevant stakeholders are examining the impact of peer review on utility, relevance, methodological rigor, ethical integrity, completeness, and the accuracy of published research reports. Only upon completion of these assessments can we determine whether “peer review” constitutes a scientific, evidence-based approach. Although peer review is time-consuming and does not completely prevent fabrication, plagiarism, or duplicate publication, no superior alternative is currently available.

By Chen Kun |

Edited by | Huang Jia