MMODELYST
Papers/Beyond pass@k: Redundancy-Aware RLVR for Multi-Sample Code Generation
PAP

Beyond pass@k: Redundancy-Aware RLVR for Multi-Sample Code Generation

May 27, 2026

arXiv
Abstract

LLMs for code generation are commonly evaluated in repeated-sampling settings using Pass@k, where multiple candidate programs are executed against unit tests under a finite sampling budget. While recent verifier-based reinforcement learning (RLVR) methods improve executable correctness, how these objectives affect redundancy among sampled programs remains poorly understood. In this work, we study implementation-level redundancy in code generation using JPlag, a plagiarism-detection system for code. Across models and benchmarks, we show that correctness-only RLVR often concentrates generations around repeated implementations, whereas Pass@k-aware objectives maintain lower redundancy and improve larger-budget performance. Motivated by these observations, we augment RLVR with direct anti-redundancy rewards based on JPlag similarity. Across 3 models and 3 benchmarks, discouraging near-duplicate generations reliably improves finite-budget executable performance, often matching or outperforming specialized Pass@k-aware objectives.

Select text to highlight · click a highlight to remove · saved in this browser only
Authors
Le Bronnec Florian, Alexandre Verine, Rio Yokota, Benjamin Negrevergne
Your notes (browser-local)
saved
arXiv:2605.28022