No article text was recorded for this version.
compositional generalization testing
Version 1 of 199 papers104 conceptsfrozen 2026-10-04
Papers in this version
- Blog: C-VQA: A Compositional Split of the Visual Question Answering (VQA) v1.0 Dataset
- Blog: LogicInference: A new Datasaet for Teaching Logical Inference to seq2seq Models
- Blog: Measuring Compositional Generalization: A Comprehensive Method on Realistic Data
- Blog: Finding needles in a haystack: Sampling Structurally-diverse Training Sets from Synthetic Data for Compositional Generalization
- Blog: Testing the limits of logical reasoning in neural and hybrid models
- Blog: Assessing Combinational Generalization of Language Models in Biased Scenarios
- Blog: Combine to Describe: Evaluating Compositional Generalization in Image Captioning
- Blog: A-I-RAVEN and I-RAVEN-Mesh: Two New Benchmarks for Abstract Visual Reasoning
- Blog: Compositional Generalization in Dependency Parsing
- Blog: Are Object-Centric Representations Better At Compositional Generalization?
- Blog: Fine-tuned Language Models can be Continual Learners
- Blog: Compositional Generalization in Unsupervised Compositional Representation Learning: A Study on Disentanglement and Emergent Language
- Blog: Pento-DIARef: A Diagnostic Dataset for Learning the Incremental Algorithm for Referring Expression Generation from Examples
- Blog: CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning
- Blog: Lost in Latent Space: Examining failures of disentangled models at combinatorial generalisation
- Blog: DiagViB-6: A Diagnostic Benchmark Suite for Vision Models in the Presence of Shortcut and Generalization Opportunities
- Blog: Intervening to learn and compose causally disentangled representations
- Blog: A Machine Learning Method for Material Property Prediction: Example Polymer Compatibility
- Blog: PACO: Parts and Attributes of Common Objects
- Blog: ZOGRASCOPE: A New Benchmark for Semantic Parsing over Property Graphs
- Blog: Compositional Generalization by Factorizing Alignment and Translation
- Blog: Is Chain-of-Thought Reasoning of LLMs a Mirage? A Data Distribution Lens
- Blog: Exploring the Compositional Generalization in Context Dependent Text-to-SQL Parsing
- Blog: Correcting Flaws in Common Disentanglement Metrics
- Blog: Stop Probing, Start Coding: Why Linear Probes and Sparse Autoencoders Fail at Compositional Generalisation
- Blog: CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning
- Blog: Towards Graph Representation Learning in Emergent Communication
- Blog: Equivariant Transduction through Invariant Alignment
- Blog: Evaluating Combinatorial Generalization in Variational Autoencoders
- Blog: Measuring Compositional Generalization: A Comprehensive Method on Realistic Data
- Blog: Dyna-bAbI: unlocking bAbI's potential with dynamic synthetic benchmarking
- Blog: Propositional Logic for Probing Generalization in Neural Networks
- Blog: Rate-Regularization and Generalization in Variational Autoencoders
- Blog: Do Deep Neural Networks Capture Compositionality in Arithmetic Reasoning?
- Blog: CREPE: Can Vision-Language Foundation Models Reason Compositionally?
- Blog: Finding needles in a haystack: Sampling Structurally-diverse Training Sets from Synthetic Data for Compositional Generalization
- Blog: Implicit Bayesian Inference is An Insufficient Explanation of Language Model Behaviour in Compositional Tasks
- Blog: Jump to better conclusions: SCAN both left and right
- Blog: Investigating the Working of Text Classifiers
- Blog: Benchmark for Compositional Text-to-Image Synthesis
- Blog: Dyna-bAbI: unlocking bAbI's potential with dynamic synthetic benchmarking
- Blog: Lost in Latent Space: Disentangled Models and the Challenge of Combinatorial Generalisation
- Blog: L+M-24: Building a Dataset for Language+Molecules @ ACL 2024
- Blog: CLOSURE: Assessing Systematic Generalization of CLEVR Models
- Blog: How do Transformer Embeddings Represent Compositions? A Functional Analysis
- Blog: Challenges in Generalization in Open Domain Question Answering
- Blog: CommonGen: A Constrained Text Generation Challenge for Generative Commonsense Reasoning
- Blog: Visually Grounded Continual Learning of Compositional Phrases
- Blog: A Benchmark for Systematic Generalization in Grounded Language Understanding
- Blog: Defending Compositionality in Emergent Languages
- Blog: A Benchmark for Systematic Generalization in Grounded Language Understanding
- Blog: Visual Representation Learning Does Not Generalize Strongly Within the Same Domain
- Blog: Measuring Generalisation to Unseen Viewpoints, Articulations, Shapes and Objects for 3D Hand Pose Estimation Under Hand-Object Interaction
- Blog: Compositional Generalization in Neuro-Symbolic Visual Question Answering
- Blog: DiagViB-6: A Diagnostic Benchmark Suite for Vision Models in the Presence of Shortcut and Generalization Opportunities
- Blog: Generating unseen complex scenes: are we there yet?
- Blog: How Do Your Biomedical Named Entity Recognition Models Generalize to Novel Entities?
- Blog: SKILL-MIX: a Flexible and Expandable Family of Evaluations for AI Models
- Blog: Pretraining Frequency Predicts Compositional Generalization of CLIP on Real-World Tasks
- Blog: Disentanglement and Compositionality of Letter Identity and Letter Position in Variational Auto-Encoder Vision Models
Showing 60 of 99 papers.
History & citation
Current · Permanent link
- Measuring Compositional Generalization through Strategic Data Partitioning merged into this direction (60% overlap)
- Systematic Generalization to Novel Concept Combinations merged into this direction (57% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_compositional_generalization_testing_a714cced,
title = {compositional generalization testing},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/compositional-generalization-testing/rdr_a714cced98a147f58564b97aa0eac64a},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_compositional_generalization_testing_a714cced_v1,
title = {compositional generalization testing},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/compositional-generalization-testing/rdr_a714cced98a147f58564b97aa0eac64a/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}