Improving out-of-distribution generalization by mimicking the human visual diet.
Its authors withdrew this paper, so there is no full text to read or summarize.
Lists
Only you see this
Abstract
Human visual experience is markedly different from the large-scale computer vision datasets consisting of internet images. Babies densely sample a few $3D$ scenes with diverse variations such as object viewpoints or illuminations, while datasets like ImageNet contain one single snapshot from millions of 3D scenes. We investigated how these differences in input data composition (i.e., visual diet) impact the Out-Of-Distribution (OOD) generalization capabilities of a visual system. Training models on a dataset mimicking attributes of the human-like visual diet improved generalization to OOD lighting, material, and viewpoint changes by up to $18\\%$. This observation held despite the fact that the models were trained on $1,000$-fold less training data. Furthermore, when trained on purely synthetic data and tested on natural images, incorporating these visual diet attributes in the training dataset improved OOD generalization by $17\\%$. These experiments are enabled by our newly proposed benchmark---the Human Visual Diet (HVD) dataset, and a new model (Human Diet Network) designed to leverage the attributes of a human-like visual diet. These findings highlight a critical problem in modern day Artificial Intelligence---building better datasets requires thinking beyond dataset size and rather focus on improving data composition. All data and source code will be made available upon publication.
BibTeX
@inproceedings{madan2024improving,
author = {Spandan Madan and You Li and Mengmi Zhang and Hanspeter Pfister and Gabriel Kreiman},
title = {{Improving out-of-distribution generalization by mimicking the human visual diet.}},
booktitle = {NeuroAI @ NeurIPS},
year = {2024},
url = {https://openreview.net/forum?id=RvhkdGwQ19},
}Loading related content...