No article text was recorded for this version.
scaling law extrapolation limits
Version 1 of 157 papers60 conceptsfrozen 2026-10-04
Papers in this version
- Blog: (Mis)Fitting Scaling Laws: A Survey of Scaling Law Fitting Techniques in Deep Learning
- Blog: Revisiting Neural Scaling Laws in Language and Vision
- Blog: Pretraining Scaling Laws for Generative Evaluations of Language Models
- Blog: A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language
- Blog: Hallucination Detox: Sensitivity Dropout (SenD) for Large Language Model Training
- Blog: Monotonic Variational Gaussian Process for Efficient Data Collection
- Blog: Zero-Shot Performance Prediction for Probabilistic Scaling Laws
- Blog: A generalizable 3D framework and model for self-supervised learning in medical imaging
- Blog: A benchmarking study of quantum algorithms for combinatorial optimization
- Blog: Revisiting Judge Decoding from First Principles via Training-Free Distributional Divergence
- Blog: cMoLLM at Scale: Horizontal Scaling Laws for Convolutionally-Gated Mixture-of-LLMs
- Blog: RegMix: Data Mixture as Regression for Language Model Pre-training
- Blog: HAAN: A Holistic Approach for Accelerating Normalization Operations in Large Language Models
- Blog: LLM Safety Alignment is Divergence Estimation in Disguise
- Blog: Predicting Emergent Abilities with Infinite Resolution Evaluation
- Blog: Outlier Dimensions Encode Task Specific Knowledge
- Blog: Towards Effective and Efficient Continual Pre-training of Large Language Models
- Blog: Retrieval Capabilities of Large Language Models Scale with Pretraining FLOPs
- Blog: Predicting Task Performance with Context-aware Scaling Laws
- Blog: Scaling Inference-Efficient Language Models
- Blog: Exploring the Capacity of Pretrained Language Models for Reasoning about Actions and Change
- Blog: D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models
- Blog: Quantizable Transformers: Removing Outliers by Helping Attention Heads Do Nothing
- Blog: Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments
- Blog: CMR Scaling Law: Predicting Critical Mixture Ratios for Continual Pre-training of Language Models
- Blog: On the Scaling of Robustness and Effectiveness in Dense Retrieval
- Blog: Scaling Optimal LR Across Token Horizons
- Blog: SFTMix: Elevating Language Model Instruction Tuning with Mixup Recipe
- Blog: Training ML Models with Predictable Failures
- Blog: Scaling Effect of Self-Supervised Speech Models
- Blog: Revisiting Efficiency–Accuracy Scaling in Mixture-of-Experts Architectures
- Blog: Data Efficient Neural Scaling Law via Model Reusing
- Blog: Deriving Neural Scaling Laws from the statistics of natural language
- Blog: P² Law: Scaling Law for Post-Training After Model Pruning
- Blog: Learning Dynamics in Continual Pre-Training for Large Language Models
- Blog: On the Zero-Shot Generalization of Machine-Generated Text Detectors
- Blog: Pre-training under infinite compute
- Blog: Revisiting Scaling Laws for Language Models: The Role of Data Quality and Training Strategies
- Blog: The Effect of Network Width on Stochastic Gradient Descent and Generalization: an Empirical Study
- Blog: NaViL: Rethinking Scaling Properties of Native Multimodal Large Language Models under Data Constraints
- Blog: Multipole Semantic Attention: A Fast Approximation of Softmax Attention for Pretraining
- Blog: Making Open-Source Text LLM Watermarks Durable Against Merging
- Blog: Tracing the Representation Geometry of Language Models from Pretraining to Post-training
- Blog: Scaling Compute Is Not All You Need for Adversarial Robustness
- Blog: Scaling Law for Time Series Forecasting
- Blog: Scaling Laws for Floating-Point Quantization Training
- Blog: Function-Space Learning Rates
- Blog: On the Origin of Neural Scaling Laws: from Random Graphs to Natural Language
- Blog: Model Stock: All We Need Is Just a Few Fine-Tuned Models
- Blog: Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models
- Blog: Stabilizing Native Low-Rank LLM Pretraining
- Blog: Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training
- Blog: Scaling Laws for Downstream Task Performance of Large Language Models
- Blog: Simple and Scalable Strategies to Continually Pre-train Large Language Models
- Blog: Low-Bit Quantization Favors Undertrained LLMs
- Blog: An Empirical Study of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration
- Blog: Periodic orbits in chaotic systems simulated at low precision
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_scaling_law_extrapolation_limits_aefdad8b,
title = {scaling law extrapolation limits},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/scaling-law-extrapolation-limits/rdr_aefdad8b165f426e8f3e1aadf0a041d7},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_scaling_law_extrapolation_limits_aefdad8b_v1,
title = {scaling law extrapolation limits},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/scaling-law-extrapolation-limits/rdr_aefdad8b165f426e8f3e1aadf0a041d7/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}