Humanize MLE Agents: Multi-Agent Session Alternation Beyond Single-Agent Limits

Changye Li, Zijian Zhang, Muheng Li, Yiduo Pang, Tingjun Wu, Menghan Li, Yitong Liu, Hongkai Guo, Mengchi Chen, Chenyu He, Kaisheng Ma, Wei Xu, Song Han, Sihao Liu, Ligeng ZhuarXiv 2026 · arXiv

TL;DR

LLM agents for long-horizon engineering tasks eventually "tire out," suffering from declining reasoning intensity and stalling progress. This paper introduces Humanize MLE Agents (HMA), a framework that alternates between two different agents on a shared workspace, resetting their conversation context every few steps to maintain "fresh eyes." This simple workflow-level coordination achieves state-of-the-art results on the MLE-bench leaderboard, outperforming complex single-agent systems while using significantly less time.

What Problem Does This Paper Address?

Building autonomous agents for Machine Learning Engineering (MLE)—tasks like winning a Kaggle competition—requires long-horizon reasoning. Current approaches rely on "context engineering" or custom "harnesses" (specialized prompts and tool-management systems). However, the authors identify two critical failure modes:

  1. Long-horizon Deceleration: As a single-agent session continues, the "reasoning intensity" (measured by output tokens per response) drops significantly, and performance gains plateau. The agent essentially gets bogged down by its own history.
  2. Harness Staleness: Specialized harnesses designed to help a specific model often become redundant or even harmful when that model is upgraded. A harness that helps a "weaker" model might hinder a "stronger" one that no longer needs those specific crutches.

The core question is: Can we move beyond these single-agent limits by coordinating multiple, diverse agents at the workflow level rather than just engineering better prompts for one?

Methods

The authors propose Humanize MLE Agents (HMA), which treats agents as "black boxes" and coordinates them through a structured alternation strategy:

  • Multi-Agent Alternation: The system alternates between two different agents (e.g., GPT-4o and Claude 3.5 Sonnet).
  • Fixed-k Interruption: Each agent session is capped at a maximum of $k$ experiments (the authors found $k=5$ to be effective).
  • Context Reset with Shared Workspace: When agents switch, the conversation context is completely reset to $\emptyset$. However, the agents share a persistent workspace (code, data, logs, and trained models). This forces the incoming agent to re-evaluate the current state of the project from scratch, often discovering refinements the previous agent missed.
  • Theoretical Framework: The authors model this process as a context-reset semi-Markov decision process (CR-SMDP). This allows them to mathematically prove that alternating complementary agents can exceed the performance ceiling of any single agent.
  • Final Review: At the end of the time budget, a final agent reviews the archive of all generated candidates to select the best one for submission.
Figure 1: HMA overview. (A) Declining output tokens per response accompany diminishing score gains, indicating decelerating single-agent exploration; harness gains can vanish or reverse as models improve. (B) HMA alternates native agents after at most k experiments, resetting context while preserving shared work and candidates for final review. The motor analogy illustrates options A and B alternately energizing shared state Xi toward the final result bE. The CR-SMDP view captures how complementary options can extend exploration beyond single-agent limits.

Datasets

The primary evaluation was conducted on MLE-bench, a benchmark consisting of 75 Kaggle competitions. Tasks range from "Lite" (easier) to "High" complexity.

To demonstrate the framework's generality beyond MLE, the authors also tested it on AOPT (Anthropic's Original Performance Take-Home), a challenging kernel optimization task.

Key Insights and Ideas

  • Reasoning as a Resource: The paper uses mean output tokens per response as a proxy for reasoning effort. They observed that in single-agent runs, this effort drops by 30-45% over a 6-hour window. HMA, by contrast, retains 86.4% of its reasoning intensity by constantly "refreshing" the session.
  • The "Fresh Eyes" Effect: Resetting the context prevents an agent from getting stuck in a "local optimum" of reasoning. A new agent, seeing only the code and results but not the previous agent's internal monologue, is more likely to spot errors or new directions.
  • Workflow over Harness: Instead of building increasingly complex, brittle harnesses, the authors show that using a model's "native" harness and focusing on the workflow of how agents hand off tasks is more robust and effective.
HMA sustains reasoning length (output tokens) and continues to improve scores long after single agents have plateaued.

Key Results

  • State-of-the-Art Performance: On MLE-bench, HMA achieved an any-medal rate of 78.2%, surpassing the strongest open-source baseline by 8.0 percentage points.
  • Efficiency: HMA reached these results using only a quarter of the time budget required by some competing specialized workflows.
  • Cross-Pair Generality: The benefit wasn't limited to a specific pair of models. Across six different configurations involving five different model families, HMA improved the medal rate by an average of 6.4 points over the best constituent single agent.
  • Beyond MLE: In the AOPT kernel optimization task, HMA reached 878 cycles, placing it within 1.6% of the top of the community leaderboard.

Limitations and Future Work

  • The Handoff Tax: There is an inherent cost to resetting context; the new agent must spend some time "re-learning" the workspace. While the "fresh eyes" benefit currently outweighs this cost, optimizing the handoff (perhaps by providing a brief summary) is a potential area for improvement.
  • Fixed vs. Adaptive Caps: The current system uses a fixed $k$ (number of experiments). Future work could explore adaptive termination—switching agents only when progress is detected to be slowing down.
  • Scaling to $N$ Agents: This study focused on pairs. Exploring how to coordinate larger "teams" of heterogeneous agents with different specialized roles is a natural next step.
  • Dependency on Artifacts: HMA relies on a shared workspace with persistent artifacts (code, files). It remains to be seen how well this generalizes to long-horizon tasks that are purely conversational or lack a persistent file system.

Summary updated

Abstract

Existing LLM-based agent approaches for long-horizon machine learning engineering (MLE) often use context engineering, implemented through custom harnesses that manage tools, skills, and accumulated experience. However, we find that as single-session execution lengthens, the agent's reasoning intensity declines alongside slowing progress, summarized as long-horizon deceleration, and the benefits of these custom harnesses vanish as the underlying model improves, summarized as harness staleness. These findings suggest that their benefits may not persist across versions, which motivates a workflow-level approach in which agents build on one another's work across sessions. We model these alternating agent sessions as a context-reset semi-Markov decision process (CR-SMDP) and establish sufficient conditions for alternation to exceed single-agent reference limits, derive an explicit experiment-budget bound, and characterize when session caps preserve this advantage. Guided by this analysis, we introduce Humanize MLE Agents (HMA), which alternates two agents on a shared workspace, limits each session to at most k experiments and resets the context between sessions, without additional task-specific harness or prior knowledge supplements. Across 75 Kaggle tasks in MLE-bench, HMA reaches a state-of-the-art any-medal rate of 78.2%, exceeding the strongest open-source baseline by 8.0 points with a quarter of its time budget. Moreover, among six configurations spanning five heterogeneous agent pairs, HMA improves any-medal rate over the constituent baselines by 6.4 points on average, demonstrating cross-pair generality. A supplementary case on kernel optimization reaches 878 cycles, within 1.6% of the community leaderboard leader, demonstrating applicability beyond MLE.
BibTeX
@misc{li2026humanize,
  author = {Changye Li and Zijian Zhang and Muheng Li and Yiduo Pang and Tingjun Wu and Menghan Li and Yitong Liu and Hongkai Guo and Mengchi Chen and Chenyu He and Kaisheng Ma and Wei Xu and Song Han and Sihao Liu and Ligeng Zhu},
  title = {{Humanize MLE Agents: Multi-Agent Session Alternation Beyond Single-Agent Limits}},
  year = {2026},
  eprint = {2610.13494},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.13494},
}
Figure