Time-To-Inconsistency: A Survival Analysis of Large Language Model Robustness to Adversarial Attacks

Yubo Li, Ramayya Krishnan, Rema Padman

This paper introduces a novel approach to understanding why and when Large Language Models (LLMs) "break" during extended conversations. By adapting survival analysis techniques from medical research and reliability engineering, the authors provide a predictive framework to anticipate conversational failure before it occurs.

The Problem: Beyond Static Benchmarks

Most LLM benchmarks are "static"—they test a model on a single question and evaluate the immediate response. However, real-world applications rely on multi-turn dialogues. A model might provide a perfect recommendation in the first turn, but if a user pushes back or introduces misleading information in turn five, the model might "flip" and output a contradictory or incorrect answer.

Current evaluations typically provide a final aggregate score (e.g., "the model was 80% consistent"). This static approach ignores crucial temporal dynamics:

  • Does the model fail immediately under pressure?
  • Does it degrade slowly over time?
  • Can we predict a "high-risk" trajectory before the model actually makes an error?

The authors argue that the trajectory of a conversation matters just as much as the final outcome.

Methodology: Modeling "Time-to-Inconsistency"

The researchers framed conversational failure as a time-to-event problem, where the "event" is the first inconsistent answer and "time" is measured in conversation turns. They compared three types of survival models:

  1. Cox Proportional Hazards: A standard statistical model assuming certain features multiply the "risk" of failure by a constant amount.
  2. Accelerated Failure Time (AFT): A model that assumes features "speed up" or "slow down" the clock leading to failure.
  3. Random Survival Forest (RSF): A non-parametric machine learning approach capable of capturing complex, non-linear interactions.

To power these models, the team engineered Semantic Drift features using text embeddings. These measured how much the topic changed between consecutive prompts (Prompt-to-Prompt), how much it shifted from the original context (Context-to-Prompt), and the total distance traveled from the start (Cumulative Drift).

The Dataset

The study utilized the MT-Consistency benchmark, designed specifically to probe LLM consistency under adversarial pressure. It includes:

  • Scale: 36,951 turns across 9 state-of-the-art LLMs (including GPT-4o, Claude 3.5 Sonnet, DeepSeek R1, and Llama 3.3).
  • Content: 700 questions spanning 39 academic subjects.
  • Attacks: 8 adversarial patterns, such as "Misleading" (suggesting a wrong answer) and "Expert Appeal" ("As an expert, I know you're wrong").

Key Insights and Ideas

By analyzing the survival models, the researchers uncovered several counterintuitive dynamics about how LLMs handle conversational stress.

  • Abrupt Drift is Catastrophic: Sudden, sharp changes in the user's prompt (high Prompt-to-Prompt drift) are the primary drivers of failure. For instance, a sharp jump in topic increased the "hazard" of failing by nearly 5x for GPT-4o.
  • The "Survival of the Fittest" Effect: Counterintuitively, cumulative drift is protective. If a conversation has already drifted significantly but the model has remained consistent, the risk of failure actually decreases. This suggests that if a model "survives" early shifts, it has effectively adapted to the evolving context.
  • Cox Models are Insufficient: The standard Cox model—often considered a gold standard—violates its own assumptions in this domain. LLM failure risk isn't proportional; it accelerates. AFT models proved much more accurate because they better capture this accelerating nature of failure.
Hazard ratios and acceleration factors across different LLMs, highlighting the impact of semantic drift.

Key Results

The shift from Cox to AFT models yielded significant improvements in predicting conversational breakdowns.

  • Superior Prediction: The AFT models achieved a C-index of 0.874 (where 1.0 represents a perfect ranking of which conversations fail first).
  • Better Calibration: AFT models reduced prediction error—measured by the Integrated Brier Score (IBS)—by 48% compared to the baseline Cox models.
  • Real-Time Safeguards: Leveraging the AFT model, the authors built a "risk monitor." It successfully flagged 76% of failing conversations before the error occurred, with a median lead time of 2 turns. This provides a critical window for a system to intervene, perhaps by asking a clarifying question or handing the conversation off to a human.
Predictive performance of survival models, showing AFT models outperforming Cox baselines.

Limitations and Future Work

While promising, the study has a few notable boundaries:

  • Benchmark Specificity: The analysis is limited to the MT-Consistency adversarial style. It is unclear if these "drift" signals behave identically in natural, non-adversarial long-term dialogues.
  • Binary Failure: The paper treats the first inconsistent answer as a binary "event," failing to distinguish between different types of failure (e.g., sycophancy versus pure hallucination).
  • Single Embedding Model: Semantic drift was measured using one specific embedding model; different models might interpret "drift" differently.
  • Offline Analysis: The risk monitor was tested retrospectively. The logical next step is "online" testing—integrating these monitors into live AI assistants to evaluate real-world improvements in user safety and trust.

Summary updated

Abstract

Large Language Models (LLMs) have revolutionized conversational AI, yet their robustness in extended multi-turn dialogues remains poorly understood. Existing evaluation frameworks focus on static benchmarks and single-turn assessments, failing to capture the temporal dynamics of conversational degradation that characterize real-world interactions. In this work, we present a large-scale survival analysis of conversational robustness, modeling failure as a time-to-event process over 36,951 turns from 9 state-of-the-art LLMs on the MT-Consistency benchmark. Our framework combines Cox proportional hazards, Accelerated Failure Time (AFT), and Random Survival Forest models with simple semantic drift features. We find that abrupt prompt-to-prompt semantic drift sharply increases the hazard of inconsistency, whereas cumulative drift is counterintuitively \emph{protective}, suggesting adaptation in conversations that survive multiple shifts. AFT models with model–drift interactions achieve the best combination of discrimination and calibration, and proportional hazards checks reveal systematic violations for key drift covariates, explaining the limitations of Cox-style modeling in this setting. Finally, we show that a lightweight AFT model can be turned into a turn-level risk monitor that flags most failing conversations several turns before the first inconsistent answer while keeping false alerts modest. These results establish survival analysis as a powerful paradigm for evaluating multi-turn robustness and for designing practical safeguards for conversational AI systems.
BibTeX
@inproceedings{li2026time,
  author = {Yubo Li and Ramayya Krishnan and Rema Padman},
  title = {{Time-To-Inconsistency: A Survival Analysis of Large Language Model Robustness to Adversarial Attacks}},
  booktitle = {International Conference on Learning Representations},
  year = {2026},
  url = {https://openreview.net/forum?id=88C7vSdn0t},
}
Figure