Abstract
This editorial introduces Issue 1 of the 2022 Proceedings on Privacy Enhancing Technologies (PoPETs). It outlines the journal’s rigorous "hybrid" review process, which combines the rapid iteration of conferences with the depth of journal reviews. From 100 submissions, 30 papers were selected through a multi-stage, double-blind peer review and artifact evaluation process. The issue also marks the formal integration of meta-reviewers to enhance editorial consistency and provide clearer guidance to authors.
Introduction: The Hybrid Model for Privacy Research
In fast-moving technical fields like privacy engineering, traditional publication models often face a trade-off: journals offer depth but can be slow, while conferences provide speed but often lack iterative feedback. PoPETs addresses this by employing a hybrid conference-journal model. This approach allows for a high-standard, transparent, and iterative review process, ensuring that authors have the opportunity to revise and resubmit their work within the same year. This process is designed to foster scholarly growth rather than simple gatekeeping.
The Peer-Review Process
The "methods" of PoPETs are defined by its procedural steps during the peer-review cycle:
- Publication and Presentation: Articles are published four times a year but presented at a single annual symposium, the Privacy Enhancing Technologies Symposium (PETS).
- Double-Blind Review: To minimize bias, neither authors nor reviewers know each other's identities.
- Two-Round Review Structure:
- Round 1: Each paper is assessed by two regular reviewers and one meta-reviewer. Papers receiving two "reject" scores are eliminated early to optimize reviewer resources.
- Round 2: Remaining papers receive additional reviews (totaling four) and enter a discussion phase.
- Meta-Reviewers: Introduced formally in this issue, meta-reviewers from the Senior Editorial Board guide discussions and synthesize feedback into a single, cohesive recommendation for the authors.
- Rebuttals: Authors of papers reaching the second round are invited to respond to reviewer critiques before a final decision is reached.
- Artifact Review: Accepted papers are encouraged to submit code, datasets, or proofs to an artifact committee to verify reproducibility and quality.
Insights into the Research Pipeline
A significant portion of the journal's pipeline relies on iteration. Of the 100 submissions for this issue, 25 were invited resubmissions from previous cycles, and another 12 were resubmissions of previously rejected papers. This highlights PoPETs as a venue that values the "polishing" of research over time.
The introduction of the Meta-Reviewer Role is a key evolution. By assigning a meta-reviewer to every paper, the journal aims to resolve disagreements among independent reviewers and provide authors with a clear, unified path forward, especially for papers requiring major revisions.
Quantitative Results for Issue 1
The editorial provides a snapshot of the current state of privacy research for this issue:
- Submissions: 100 papers were received.
- Acceptance Rate: 30% total (16 accepted outright, 14 accepted subject to minor revisions).
- Major Revisions: 17 papers were invited to undergo major revisions for future issues.
- Reject and Resubmit: 41 papers received this decision, indicating they need significant work but are welcome back in future cycles.
- Reviewer Effort: The process was supported by a massive human effort, involving 159 Regular Editorial Board members, 25 Senior Editorial Board members, and 69 external experts.
Administrative Scope and Future Directions
The review process also serves as a quality control mechanism for scope and compliance. Four papers were rejected without full review for being out of scope, exceeding page limits, or violating anonymity requirements (non-anonymous submissions).
Looking ahead, the editors intend to continue the artifact review procedure and the new meta-reviewer system. These refinements are expected to further enhance the quality and transparency of the 2022 volume, maintaining PoPETs' position as a premier venue for privacy-enhancing technologies.
Summary updated