No article text was recorded for this version.
regularized preference optimization
Version 1 of 129 papers36 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Provably Mitigating Overoptimization in RLHF: Your SFT Loss is Implicitly an Adversarial Regularizer
- Blog: Marco-o1 v2: Towards Widening The Distillation Bottleneck for Reasoning Models
- Blog: CodeLutra: Boosting LLM Code Generation via Preference-Guided Refinement
- Blog: 3D-Properties: Identifying Challenges in DPO and Charting a Path Forward
- Blog: V.I.P. : Iterative Online Preference Distillation for Efficient Video Diffusion Models
- Blog: Sample-efficient LLM Optimization with Reset Replay
- Blog: TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimization
- Blog: Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement
- Blog: TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models
- Blog: The Paradox of Preference: A Study on LLM Alignment Algorithms and Data Acquisition Methods
- Blog: BAPO: Base-Anchored Preference Optimization for Overcoming Forgetting in Large Language Models Personalization
- Blog: BiasDPO: Mitigating Bias in Language Models through Direct Preference Optimization
- Blog: Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences
- Blog: Protein Inverse Folding From Structure Feedback
- Blog: Margin-Aware Preference Optimization for Aligning Diffusion Models Without Reference
- Blog: FlipGuard: Defending Preference Alignment against Update Regression with Constrained Optimization
- Blog: Leveraging Unpaired Feedback for Long-Term LLM-based Recommendation Tuning
- Blog: A General Theoretical Paradigm to Understand Learning from Human Preferences
- Blog: When Labelers Stay Silent: The Power of Ties in Cost-Effective Preference Learning
- Blog: RLVF: Learning from Verbal Feedback without Overgeneralization
- Blog: Direct Judgement Preference Optimization
- Blog: TinyThinker: Distilling Reasoning through Coarse-to-Fine Knowledge Internalization with Self-Reflection
- Blog: Divide-Then-Align: Honest Alignment based on the Knowledge Boundary of RAG
- Blog: ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipeline
- Blog: New Desiderata for Direct Preference Optimization
- Blog: Is Preference Alignment Always the Best Option to Enhance LLM-Based Translation? An Empirical Analysis
- Blog: Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation
- Blog: From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Language Models
- Blog: Insights into Alignment: Evaluating DPO and its Variants Across Multiple Tasks
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_regularized_preference_optimization_8926cdd6,
title = {regularized preference optimization},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/regularized-preference-optimization/rdr_8926cdd6edae4e2c8235c3067e0d42c4},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_regularized_preference_optimization_8926cdd6_v1,
title = {regularized preference optimization},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/regularized-preference-optimization/rdr_8926cdd6edae4e2c8235c3067e0d42c4/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}