No article text was recorded for this version.
generalized preference optimization
Version 1 of 114 papers21 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Generalizing Offline Alignment Theoretical Paradigm with Diverse Divergence Constraints
- Blog: f-PO: Generalizing Preference Optimization with f-divergence Minimization
- Blog: On the Essence and Prospect: An Investigation of Alignment Approaches for Big Models
- Blog: DPO Unchained: Your Training Algorithm is Secretly Disentangled in Human Choice Theory (and Its Loss' Convexity is Dispensable)
- Blog: Preference Optimization by Estimating the Ratio of the Data Distribution
- Blog: Comparing Bad Apples to Good Oranges Aligning Large Language Models via Joint Preference Optimization
- Blog: Beyond Reverse KL: Generalizing Direct Preference Optimization with Diverse Divergence Constraints
- Blog: Comparing Bad Apples to Good Oranges: Aligning Large Language Models via Joint Preference Optimization
- Blog: Meta-Learning Objectives for Preference Optimization
- Blog: RainbowPO: A Unified Framework for Combining Improvements in Preference Optimization
- Blog: $f$-Divergence Regularized RLHF: Two Tales of Sampling and Unified Analyses
- Blog: Learning Loss Landscapes in Preference Optimization
- Blog: Aligning Language Models with Preferences through $f$-divergence Minimization
- Blog: Generalizing Alignment Paradigm of Text-to-Image Generation with Preferences Through f-Divergence Minimization
History & citation
Current · Permanent link
- This direction split from Generalized Preference Optimization via Divergence Minimization (86% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_generalized_preference_optimization_34962f30,
title = {generalized preference optimization},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/generalized-preference-optimization/rdr_34962f3079a843e9a74a0249656c1d15},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_generalized_preference_optimization_34962f30_v1,
title = {generalized preference optimization},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/generalized-preference-optimization/rdr_34962f3079a843e9a74a0249656c1d15/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}