Abstract
This editorial serves as the introduction to Volume 2022, Issue 2 of the Proceedings on Privacy Enhancing Technologies (PoPETs). We outline the journal’s unique hybrid conference-journal publishing model, provide a transparent overview of the rigorous double-blind peer-review process, and share key submission statistics for this issue. The results highlight the effectiveness of a "revise and resubmit" pipeline in fostering high-quality privacy research.
Introduction
Traditional academic publishing often suffers from a "one-shot" review culture. In many conference settings, papers are either accepted or rejected with little opportunity for constructive iteration between authors and reviewers. PoPETs was established to address this limitation by employing a hybrid model. This model combines the regular, predictable publishing cycles of a journal with the community-building aspects of an annual symposium, the Privacy Enhancing Technologies Symposium (PETS).
The primary objective is to improve the quality of scholarly contributions by allowing authors to revise and resubmit their work within the same year. This editorial documents the application of this process to the 109 submissions received for Volume 2022, Issue 2, ensuring transparency in the community's evaluation of privacy-enhancing technologies.
The PoPETs Review Framework
The journal operates on a procedural framework designed to minimize bias and maximize constructive feedback:
- Hybrid Model: Articles are published quarterly. Accepted authors are invited to present their work at the annual PETS symposium, maintaining the benefits of both journal-style depth and conference-style interaction.
- Double-Blind Review: To ensure impartiality, both authors and reviewers remain anonymous throughout the evaluation process.
- Two-Round Review Process:
- Round 1: Each paper is initially assigned two regular reviewers and one senior meta-reviewer. Papers receiving two "reject" scores are eliminated early to streamline the process.
- Round 2: Papers that pass the first round receive two additional reviews, bringing the total to four.
- Meta-Reviews and Rebuttals: Authors of papers reaching the second round are invited to provide a written rebuttal. Meta-reviewers then facilitate a discussion among all reviewers to reach a consensus, which is summarized in a formal meta-review.
- Artifact Review: PoPETs maintains an optional but highly encouraged artifact review process. A dedicated committee evaluates the quality, documentation, and reproducibility of source code or datasets associated with accepted papers, promoting open science.
Submission Statistics and Results
For Volume 2022, Issue 2, the editorial board handled a total of 109 submissions. The reviewer pool consisted of 155 Regular Editorial Board members, 27 Senior Editorial Board members, and 53 external reviewers.
The quantitative breakdown of the decisions is as follows:
- Accepted: 9 papers.
- Conditionally Accepted (Minor Revisions): 19 papers.
- Total Published in this Issue: 27 articles (one conditionally accepted paper was postponed to a later issue due to medical reasons).
- Major Revisions Requested: 23 papers.
- Reject and Resubmit: 35 papers (9 of which were rejected in the first round).
- Outright Reject: 18 papers (11 of which were rejected in the first round).
- Desk Rejects: 4 papers (rejected for being out of scope, exceeding page limits, or violating anonymity).
- Withdrawn: 1 paper.
Key Insights: The Value of Iteration
A significant portion of this issue’s success is attributed to the resubmission pipeline. Of the submissions, 16 were resubmissions following "Major Revisions," and 12 were resubmissions of previously rejected papers. This demonstrates that the "revise and resubmit" model successfully shepherds research toward a publishable standard rather than simply discarding promising work.
For papers accepted with minor revisions, the journal assigns a "shepherd" (one of the original reviewers) to ensure that the specific concerns raised during the meta-review are addressed before final publication. This hands-on approach ensures that the final versions of the papers meet the community's high standards for clarity and technical rigor.
Procedural Evolution and Limitations
The editors continuously refine the process based on community needs and practical challenges. In this issue, a new practice was introduced: assigning meta-reviewers specifically to resubmissions to ensure continuity and fairness.
However, procedural limitations remain. Real-world circumstances, such as the medical situation mentioned in the results, can occasionally delay the publication of conditionally accepted work. Furthermore, while the artifact review process is gaining traction, it remains an encouraged rather than mandatory step. The journal continues to seek ways to better support the reproducibility of privacy research.
Conclusion
The PoPETs model emphasizes transparency, community-driven expertise, and a proactive approach to conflict management. By publishing board memberships and requiring self-identification of conflicts, the journal maintains a high level of integrity. The statistics for Volume 2022, Issue 2, underscore a healthy, iterative ecosystem for privacy-enhancing technology research.
Sincerely,
Florian Kerschbaum and Michelle Mazurek
Co-Editors-in-Chief of PoPETs Volume 2022 and Program Co-Chairs of PETS 2022
Summary updated