BoviShift: A Six-Year Multi-Attribute Audit of Visual Cattle Phenotyping Across Animals and Time

Mobasshir Bhuiya Shagor, Nilambar Halder Tonmoy, Md Saef Ullah MiaharXiv 2026 · arXiv

The promise of computer vision in agriculture is clear: replace expensive, stressful manual measurements (like weighing a 500kg bull) with a simple smartphone photo. However, as the authors of BoviShift point out, our current evaluation methods for these models are often "over-optimistic" due to identity leakage and a lack of testing against temporal distribution shifts.

TL;DR

BoviShift introduces a massive, six-year longitudinal dataset of 2,657 cattle to audit how visual phenotyping models perform across different animals and over time. The study reveals that standard "image-random" data splitting hides significant performance gaps and that models often struggle to generalize to future years, sometimes failing to beat simple "constant mean" baselines.

What Problem Does This Paper Address?

In applied machine learning for livestock, two major pitfalls often go ignored:

  1. Identity Leakage: Most datasets contain multiple images of the same animal. If you split your data randomly by image, views of the same cow end up in both training and testing. The model might simply "memorize" that specific cow's features rather than learning to estimate weight or age from general phenotypic cues.
  2. Temporal Shift: A model deployed today must work on next year's cattle. However, marketplace populations, camera hardware, and even measurement conventions change over time. Most benchmarks use a single "snapshot" in time, failing to test if a model remains robust as the world moves on.

BoviShift tackles these by providing a dataset spanning 2021 to 2026, allowing researchers to test models on entirely new cohorts of animals captured years after the training data was collected.

Methods

The researchers established a rigorous evaluation framework using a fixed ResNet-50 multi-task baseline. Instead of training separate models for every trait, they used a single encoder with multiple "heads" to predict five attributes: weight, age, height, breed, and coat color.

They compared four distinct data-splitting configurations (detailed in Figure 5):

  • P1 (Image-Random): The "leaky" baseline where images of the same animal can span the split.
  • P2 (Cattle-Disjoint): A more honest split where an animal is either entirely in training or entirely in testing.
  • P3 & P4 (Future-Cohort): The ultimate test—training on past years (e.g., 2021–2023) and testing on future years (2025 or 2026).
Table 4: Evaluation configurations. Each split reports images/cattle. P1 is intentionally leakage-prone; P2–P4 are cattle-disjoint.

Datasets

The core contribution is the BoviShift Corpus, a reconstruction and expansion of the earlier CID dataset.

  • Scale: 2,657 cattle, 10,610 still images, and 2,566 walk-around videos (79,390 frames).
  • Attributes: Includes physical (weight, height, age) and visual (breed, color) labels.
  • Integrity Audit: The authors performed a massive cleanup, repairing over 9,000 media references and identifying size-dependent missing labels in the 2024 cohort that could have biased results.

The dataset composition by year is summarized in Figure 1: Table 1: The BoviShift corpus broken down by annual cohort.

Table 1: The BoviShift corpus broken down by annual cohort.

Key Insights and Ideas

  • Leakage isn't a "Universal Penalty": Moving from image-random (P1) to cattle-disjoint (P2) splits didn't always make things worse. While breed classification got harder, height estimation actually improved. This suggests that identity leakage affects different tasks in non-obvious ways.
  • The "Future" is Hard: Performance often tanked on future cohorts. In 2025, the model's weight and age estimates failed to beat a "dumb" baseline that simply predicts the average of the training set.
  • Multi-Tasking is a Win: Training one model to do everything (weight, breed, etc.) significantly outperformed training five specialized models. As shown in Figure 6, multi-tasking slashed weight error (MAE) from 63.6 kg to 45.9 kg.
  • The Still-to-Video Gap: Models trained on curated, high-quality still photos performed poorly when applied "zero-shot" to raw video frames. This highlights a domain gap caused by motion blur and unfavorable poses in uncurated video.
Table 7: P3 single-task versus multi-task learning (seed 42). The final column is single-task minus multi-task under paired cattle bootstrap. Thus, positive MAE dif- ferences and negative F1 differences favor multi-task learning.

Key Results

  • Weight Estimation: In the cattle-disjoint (P2) setting, the model achieved a Mean Absolute Error (MAE) of ~33.8 kg. However, this jumped to ~64.4 kg in the 2025 future-test (P3), highlighting the fragility of these models.
  • Breed & Color: Breed classification (Macro-F1) dropped from 0.469 in P2 to 0.312 in the 2026 test (P4). Interestingly, coat color transferred well to 2025 but degraded significantly in 2026.
  • Baselines Matter: The authors emphasize that without comparing against simple "mean" baselines, researchers might think their models are working when they are actually failing to learn anything beyond the dataset's average.

Limitations and Future Work

  • Narrow Population: The dataset consists almost entirely of intact male beef bulls from a single marketplace in Bangladesh. The results shouldn't be extrapolated to dairy cows or different geographic regions without further validation.
  • Zero-Shot Video: The poor performance on video frames suggests that future work needs to focus on video-specific training or "quality-aware" frame selection.
  • Model Diversity: This study focused on the ResNet-50 architecture; testing newer Vision Transformers (ViTs) or foundation models on BoviShift remains an open opportunity for the community.

Summary updated

Abstract

Computer vision offers a scalable, non-contact means of estimating livestock traits, but correlated images and video frames make reliable evaluation difficult. Image-random splitting can place views of the same animal in both training and test sets, while deployment further requires transfer to animals captured in future years. We introduce BoviShift, a corpus reconstructed from six consecutive annual cohorts of an operational cattle marketplace collected from 2021 to 2026. It contains 2{,}657 cattle, 10{,}610 still images, and 2{,}566 walk-around videos across nine recorded breed categories. We evaluate three splitting strategies through four configurations: image-random and pooled cattle-disjoint splits over the same development cohorts, followed by separate future-2025 and locked future-2026 evaluations. Using a fixed ResNet-50 multi-task baseline, we assess weight, age, height, breed, and coat color. Differences between image-random and cattle-disjoint splitting are task-dependent rather than a universal leakage penalty. Future-cohort behavior is also attribute- and cohort-specific: breed declines relative to pooled evaluation; mean weight and age performance fails to beat constant baselines in 2025; height remains above baseline; and color transfers well to 2025 but degrades in 2026. Multi-task training improves all five point estimates in a single-seed ablation, still-view aggregation helps selectively, and zero-shot video-frame aggregation exposes a still-to-video domain gap. To our knowledge, BoviShift is the longest-spanning cattle-vision resource combining consecutive annual cohorts with physical and visual attributes.
BibTeX
@misc{shagor2026bovishift,
  author = {Mobasshir Bhuiya Shagor and Nilambar Halder Tonmoy and Md Saef Ullah Miah},
  title = {{BoviShift: A Six-Year Multi-Attribute Audit of Visual Cattle Phenotyping Across Animals and Time}},
  year = {2026},
  eprint = {2611.14476},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.14476},
}
Figure