No article text was recorded for this version.
neural text degeneration
Version 2 of 2353 papers432 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
- Blog: Do Massively Pretrained Language Models Make Better Storytellers?
- Blog: Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation
- Blog: A Theoretical Analysis of the Repetition Problem in Text Generation
- Blog: A Theoretical Analysis of the Repetition Problem in Text Generation
- Blog: Consistency of a Recurrent Language Model With Respect to Incomplete Decoding
- Blog: Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
- Blog: Relating Neural Text Degeneration to Exposure Bias
- Blog: Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation
- Blog: Rethinking Repetition Problems of LLMs in Code Generation
- Blog: The Curious Case of Neural Text Degeneration
- Blog: Do Massively Pretrained Language Models Make Better Storytellers?
- Blog: From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers
- Blog: Intelligent Abstractive Summarization of Scholarly Publications with Transfer Learning
- Blog: Relating Neural Text Degeneration to Exposure Bias
- Blog: Rethinking Repetition Problems of LLMs in Code Generation
- Blog: Penalty Decoding: Well Suppress the Self-Reinforcement Effect in Open-Ended Text Generation
- Blog: On Decoding Strategies for Neural Text Generators
- Blog: Straight to the Gradient: Learning to Use Novel Tokens for Neural Text Generation
- Blog: A Tale about PRO and Monsters
- Blog: Neural Text Generation with Unlikelihood Training
- Blog: PerceiverS: A Multi-Scale Perceiver with Effective Segmentation for Long-Term Expressive Symbolic Music Generation
- Blog: Induction Head Toxicity Mechanistically Explains Repetition Curse in Large Language Models
- Blog: Positional Fragility in LLMs: How Offset Effects Reshape Our Understanding of Memorization Risks
- Blog: Towards Chapter-to-Chapter Context-Aware Literary Translation via Large Language Models
- Blog: Local Temperature Beam Search: Avoid Neural Text DeGeneration via Enhanced Calibration
- Blog: Machine-generated text detection prevents language model collapse
- Blog: The Curious Case of Neural Text Degeneration
- Blog: Truncation Sampling as Language Model Desmoothing
- Blog: Enhancing Automated Audio Captioning via Large Language Models with Optimized Audio Encoding
- Blog: Truncation Sampling as Language Model Desmoothing
- Blog: Amortized Noisy Channel Neural Machine Translation
- Blog: Mirostat: A Perplexity-Controlled Neural Text Decoding Algorithm
- Blog: The Hyperfitting Phenomenon: Sharpening and Stabilizing LLMs for Open-Ended Text Generation
- Blog: A Continuum of Generation Tasks for Investigating Length Bias and Degenerate Repetition
- Blog: A Transcription Prompt-based Efficient Audio Large Language Model for Robust Speech Recognition
- Blog: WikiTableT: A Large-Scale Data-to-Text Dataset for Generating Wikipedia Article Sections
- Blog: Positional Fragility in LLMs: How Offset Effects Reshape Our Understanding of Memorization Risks
- Blog: Perplexity from PLM Is Unreliable for Evaluating Text Quality
- Blog: A Simple Contrastive Learning Objective for Alleviating Neural Text Degeneration
- Blog: Scalable Extraction of Training Data from Aligned, Production Language Models
- Blog: CantonMT: Cantonese-English Neural Machine Translation Looking into Evaluations
- Blog: Straight to the Gradient: Learning to Use Novel Tokens for Neural Text Generation
- Blog: Why are Sequence-to-Sequence Models So Dull? Understanding the Low-Diversity Problem of Chatbots
- Blog: Implicit Unlikelihood Training: Improving Neural Text Generation with Reinforcement Learning
- Blog: The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation
- Blog: Penalty Decoding: Well Suppress the Self-Reinforcement Effect in Open-Ended Text Generation
- Blog: Repetition Neurons: How Do Language Models Produce Repetitions?
- Blog: WikiTableT: A Large-Scale Data-to-Text Dataset for Generating Wikipedia Article Sections
- Blog: LoopGuard: Breaking Self-Reinforcing Attention Loops via Dynamic KV Cache Intervention
- Blog: Short-term memory in neural language models
- Blog: ELLA-V: Stable Neural Codec Language Modeling with Alignment-guided Sequence Reordering
- Blog: From Hours to Minutes: Lossless Acceleration of Ultra Long Sequence Generation up to 100K Tokens
- Blog: A Domain-Knowledge-Inspired Music Embedding Space and a Novel Attention Mechanism for Symbolic Music Modeling
- Blog: Model-Based Minimum Bayes Risk Decoding for Text Generation
- Blog: An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation
- Blog: Quantum-Enhanced Natural Language Generation: A Multi-Model Framework with Hybrid Quantum-Classical Architectures
- Blog: Out of Length Text Recognition with Sub-String Matching
- Blog: A Deep Reinforced Model for Abstractive Summarization
- Blog: Decoding Game: On Minimax Optimality of Heuristic Text Generation Strategies
Showing 60 of 353 papers.
History & citation
Current · Permanent link
- Self-Reinforcing Repetition in Autoregressive Models merged into this direction (82% overlap)
- Contrastive Search for Diverse and Coherent Text Generation merged into this direction (64% overlap)
- Typical Sampling and the Expected Information Hypothesis merged into this direction (60% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_neural_text_degeneration_b299c780,
title = {neural text degeneration},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/neural-text-degeneration/rdr_b299c78029ad4ec183280757b4ef9c1c},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 2, frozen text):
@misc{lacuna_neural_text_degeneration_b299c780_v2,
title = {neural text degeneration},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/neural-text-degeneration/rdr_b299c78029ad4ec183280757b4ef9c1c/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-20},
}