No article text was recorded for this version.
data split sensitivity
Version 2 of 2107 papers167 conceptsfrozen 2026-10-04
Papers in this version
- Blog: We Need to Talk about Standard Splits
- Blog: Performance over Random: A Robust Evaluation Protocol for Video Summarization Methods
- Blog: We Need To Talk About Random Splits
- Blog: The Role of Text Simplification Operations in Evaluation
- Blog: TextEE: Benchmark, Reevaluation, Reflections, and Future Challenges in Event Extraction
- Blog: The Effect of Data Partitioning Strategy on Model Generalizability: A Case Study of Morphological Segmentation
- Blog: Pitfalls of Graph Neural Network Evaluation
- Blog: Simple GNNs with Low Rank Non-parametric Aggregators
- Blog: Morphological Inflection: A Reality Check
- Blog: Challenges in leveraging GANs for few-shot data augmentation
- Blog: Rethinking the Setting of Semi-supervised Learning on Graphs
- Blog: Small data problems in political research: a critical replication study
- Blog: REflex: Flexible Framework for Relation Extraction in Multiple Domains
- Blog: We need to talk about random splits
- Blog: Simplifying GNN Performance with Low Rank Kernel Models
- Blog: CiTrus: Squeezing Extra Performance out of Low-data Bio-signal Transfer Learning
- Blog: Evaluating LLM-Prompting for Sequence Labeling Tasks in Computational Literary Studies
- Blog: A Framework for Effective Application of Machine Learning to Microbiome-Based Classification Problems
- Blog: Run, Forest, Run? On Randomization and Reproducibility in Predictive Software Engineering
- Blog: Stratify or Die: Rethinking Data Splits in Image Segmentation
- Blog: Could Graph Neural Networks Learn Better Molecular Representation for Drug Discovery? A Comparison Study of Descriptor-based and Graph-based Models
- Blog: The Danish Gigaword Corpus
- Blog: The Unreasonable Effectiveness of Open Science in AI: A Replication Study
- Blog: Enabling Reproducibility and Meta-learning Through a Lifelong Database of Experiments (LDE)
- Blog: Event Detection with Neural Networks: A Rigorous Empirical Evaluation
- Blog: Exploring Data Splitting Strategies for the Evaluation of Recommendation Models
- Blog: Event Detection with Neural Networks: A Rigorous Empirical Evaluation
- Blog: Impact of Evaluation Methodologies on Code Summarization
- Blog: Do We Need Cross Validation for Discourse Relation Classification?
- Blog: Bootstrap Model Ensemble and Rank Loss for Engagement Intensity Regression
- Blog: Using J-K-fold Cross Validation To Reduce Variance When Tuning NLP Models
- Blog: Comment on "Sequential validation of treatment heterogeneity" and "Comment on generic machine learning inference on heterogeneous treatment effects in randomized experiments"
- Blog: Verification, Reproduction and Replication of NLP Experiments: a Case Study on Parsing Universal Dependencies
- Blog: Revisiting Alternative Experimental Settings for Evaluating Top-N Item Recommendation Algorithms
- Blog: A Critical Study on Data Leakage in Recommender System Offline Evaluation
- Blog: Model Validation Using Mutated Training Labels: An Exploratory Study
- Blog: The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks
- Blog: Where's Wally Now? Deep Generative and Discriminative Embeddings for Novelty Detection
- Blog: AAPMT: AGI Assessment Through Prompt and Metric Transformer
- Blog: Using J-K fold Cross Validation to Reduce Variance When Tuning NLP Models
- Blog: The NERVE-ML (neural engineering reproducibility and validity essentials for machine learning) checklist: ensuring machine learning advances neural engineering<sup>*</sup>
- Blog: Training parsers by inverse reinforcement learning
- Blog: UDTIRI: An Online Open-Source Intelligent Road Inspection Benchmark Suite
- Blog: Zero-shot sketch-based image retrieval with structure-aware asymmetric disentanglement
- Blog: A Deep Features Based Approach Using Modified ResNet50 and Gradient Boosting for Visual Sentiments Classification
- Blog: EventDrop: Data Augmentation for Event-based Learning
- Blog: BenchMake: Turn Any Scientific Data Set into a Reproducible Benchmark
- Blog: Automated Side-Channel Attacks using Black-Box Neural Architecture Search
- Blog: Toward Content-Based Indexing and Retrieval of Head and Neck CT With Abscess Segmentation
- Blog: Discovering Transformer Circuits via a Hybrid Attribution and Pruning Framework
- Blog: Replication: Contrastive Learning and Data Augmentation in Traffic Classification Using a Flowpic Input Representation
- Blog: Meta-Path Based Attentional Graph Learning Model for Vulnerability Detection
- Blog: Gaining More Insight into Neural Semantic Parsing with Challenging Benchmarks
- Blog: A Novel Co-Designed Multi-Domain Entropy and Its Dynamic Synapse Classification Approach for EEG Seizure Detection
- Blog: Robust Kernel Density Estimation with Median-of-Means principle
- Blog: AutoMS: Automatic Model Selection for Novelty Detection with Error Rate Control
- Blog: Butterfly Effects in Frame Semantic Parsing: impact of data processing on model ranking
- Blog: What is Learnt by the LEArnable Front-end (LEAF)? Adapting Per-Channel Energy Normalisation (PCEN) to Noisy Conditions
- Blog: Improved MALDI-TOF MS based antimicrobial resistance prediction through hierarchical stratification
- Blog: Derandomized novelty detection with FDR control via conformal e-values
Showing 60 of 107 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_data_split_sensitivity_05e6ca3e,
title = {data split sensitivity},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/data-split-sensitivity/rdr_05e6ca3e43f04292970e0e1851cf32ca},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 2, frozen text):
@misc{lacuna_data_split_sensitivity_05e6ca3e_v2,
title = {data split sensitivity},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/data-split-sensitivity/rdr_05e6ca3e43f04292970e0e1851cf32ca/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-20},
}