No article text was recorded for this version.
validation set overfitting (hyperparameter overfitting)
Version 1 of 182 papers100 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Unbiased Assesment of Learning Algorithms
- Blog: Practical guidelines for validation of supervised machine learning models in accelerometer‐based animal behaviour classification
- Blog: Optimizing Millions of Hyperparameters by Implicit Differentiation
- Blog: Rethinking the Setting of Semi-supervised Learning on Graphs
- Blog: Overfitting in Bayesian Optimization: an empirical study and early-stopping solution
- Blog: Guarantees for Tuning the Step Size using a Learning-to-Learn Approach
- Blog: Leveraging Theoretical Tradeoffs in Hyperparameter Selection for Improved Empirical Performance
- Blog: An Empirical Study on Hyperparameter Optimization for Fine-Tuning Pre-trained Language Models
- Blog: Block Forests: random forests for blocks of clinical and omics covariate data
- Blog: On the State of the Art of Evaluation in Neural Language Models
- Blog: Towards Reproducible Indoor Positioning Research
- Blog: Gradient-based Hyperparameter Optimization through Reversible Learning
- Blog: Hyperparameters in Continual Learning: A Reality Check
- Blog: ModernTCN Revisited: A Critical Look at the Experimental Setup in General Time Series Analysis
- Blog: Recognizing Value Resonance with Resonance-Tuned RoBERTa Task Definition, Experimental Validation, and Robust Modeling
- Blog: Reshuffling Resampling Splits Can Improve Generalization of Hyperparameter Optimization
- Blog: Model Validation Using Mutated Training Labels: An Exploratory Study
- Blog: Dynamic Speculation Lookahead Accelerates Speculative Decoding of Large Language Models
- Blog: Qualcomm Research and University of Amsterdam at TRECVID 2015: Recognizing Concepts, Objects, and Events in Video
- Blog: Applications of Multidimensional Space of Mathematical Molecular Descriptors in Large-Scale Bioactivity and Toxicity Prediction- Applications to Prediction of Mutagenicity and Blood-Brain Barrier Entry of Chemicals
- Blog: Fantastic Generalization Measures and Where to Find Them
- Blog: A Reproducible Study on Remote Heart Rate Measurement
- Blog: Automatic Termination for Hyperparameter Optimization
- Blog: Model Selection for Deep Learning with Gradient Norms: An Empirical Study
- Blog: Relatron: Automating Relational Machine Learning over Relational Databases
- Blog: On the Effect of Low-Frequency Terms on Neural-IR Models
- Blog: Gradient-based Hyperparameter Optimization through Reversible Learning
- Blog: Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning
- Blog: Least squares auto-tuning
- Blog: Weak to Strong: VLM-Based Pseudo-Labeling as a Weakly Supervised Training Strategy in Multimodal Video-based Hidden Emotion Understanding Tasks
- Blog: Crafting Distribution Shifts for Validation and Training in Single Source Domain Generalization
- Blog: HPO-RL-Bench: A Zero-Cost Benchmark for HPO in Reinforcement Learning
- Blog: Empirical Comparison between Cross-Validation and Mutation-Validation in Model Selection
- Blog: An Efficient Method for Gradient-Based Adaptation of Hyperparameters in SVM Models
- Blog: λOpt: Learn to Regularize Recommender Models in Finer Levels
- Blog: The need to approximate the use-case in clinical machine learning
- Blog: LassoBench: A High-Dimensional Hyperparameter Optimization Benchmark Suite for Lasso
- Blog: An Empirical Bayes Approach to Optimizing Machine Learning Algorithms
- Blog: FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding
- Blog: A Metric Learning Reality Check
- Blog: Reshuffling Resampling Splits Can Improve Generalization of Hyperparameter Optimization
- Blog: Perturbed Model Validation: A New Framework to Validate Model Relevance
- Blog: Diffusing to the Top: Boost Graph Neural Networks with Minimal Hyperparameter Tuning
- Blog: Data, depth, and design: Learning reliable models for skin lesion analysis
- Blog: Simple Feedfoward Neural Networks are Almost All You Need for Time Series Forecasting
- Blog: Feature Selection and Prediction of Pediatric Tuina in Attention Deficit/Hyperactivity Disorder Management: A Machine Learning Approach Based on Parent-Reported Children’s Constitution
- Blog: Generalization Guarantees for Neural Architecture Search with Train-Validation Split
- Blog: Efficient hyperparameter optimization by way of PAC-Bayes bound minimization
- Blog: Automatic Termination for Hyperparameter Optimization
- Blog: Emotion Recognition from Human Speech Using Temporal Information and Deep Learning
- Blog: Bayesian Model Selection, the Marginal Likelihood, and Generalization
- Blog: Bayesian Hyperparameter Optimization for Ensemble Learning
- Blog: LayoutXLM vs. GNN: An Empirical Evaluation of Relation Extraction for Documents
- Blog: Rethinking Evaluation Paradigms in IBP-based Certified Training
- Blog: The Use of Generative Adversarial Network and Graph Convolution Network for Neuroimaging-Based Diagnostic Classification
- Blog: Generalization Guarantees for Neural Architecture Search with Train-Validation Split
- Blog: Rethinking the Setting of Semi-supervised Learning on Graphs
- Blog: Amplified Early Stopping Bias: Overestimated Performance with Deep Learning
- Blog: Improving Supervised Drug-Protein Relation Extraction with Distantly Supervised Models
- Blog: Guarantees for Tuning the Step Size using a Learning-to-Learn Approach
Showing 60 of 82 papers.
History & citation
Current · Permanent link
- Over-tuning in Automated Machine Learning merged into this direction (52% overlap)
- Meta Overfitting in Hyperparameter Optimization merged into this direction (70% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_validation_set_overfitting_hyperparamete_8f6b2bc2,
title = {validation set overfitting (hyperparameter overfitting)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/validation-set-overfitting-hyperparameter-overfitting/rdr_8f6b2bc2e3cc48c6a88243c7e4b76711},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_validation_set_overfitting_hyperparamete_8f6b2bc2_v1,
title = {validation set overfitting (hyperparameter overfitting)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/validation-set-overfitting-hyperparameter-overfitting/rdr_8f6b2bc2e3cc48c6a88243c7e4b76711/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}