From the Gettier Machine to Justified True Output: A Three-Step Account of Rational Trust in Generative AI

Tevfik UyararXiv 2026 · arXiv

TL;DR

Generative AI is a "Gettier machine"—a system that produces fluent, often correct outputs through a process indifferent to truth, making any resulting "knowledge" a matter of mere luck. To move from blind trust to rational inquiry, this paper proposes the Justified True Output (JTO) framework: a three-step process of acquisition, understanding, and independent verification.

What Problem Does This Paper Address?

As Large Language Models (LLMs) become staples of daily research and work, we face a fundamental epistemological crisis: When is it rational to trust an AI’s output?

Currently, users often treat AI like a calculator (a deterministic tool with a perfect track record) or a witness (someone who vouches for the truth). The author argues both models are wrong. LLMs are stochastic and "truth-indifferent"—they don't fetch facts; they predict the next token. This creates a "generality problem" where a model might be highly reliable at writing poetry but hallucinate wildly on legal citations. Without a normative framework, users fall into the trap of "epistemic luck," where they happen to be right only because the machine's high speed of production increases the frequency of coincidental "hits."

Methods

This is a conceptual and normative paper that applies classical and modern epistemology to the use of generative AI. The author utilizes:

  • The JTB Tradition: Mapping AI use onto the "Justified True Belief" framework (dating back to Plato).
  • Post-Gettier Refinements: Incorporating "anti-luck" conditions, specifically Robert Nozick’s sensitivity condition ("Had $p$ been false, would I still have believed $p$?").
  • Analytic Metaphor: The "Fast Clock" analogy. While a stopped clock is right twice a day, a clock running ten times too fast is right eighteen times a day. The author argues that AI’s speed multiplies these "hits," creating an illusion of reliability that masks a lack of actual justification.

Datasets

Not discussed in the paper. This is a theoretical philosophical analysis and does not involve empirical training or benchmarking on specific datasets.

Key Insights and Ideas

  • AI is not a Calculator: Trust in a calculator is "type-level"—we trust the process of arithmetic. AI lacks a "type-stable process"; its reliability swings wildly based on the prompt, domain, and topic. Trusting it like a calculator is a "category mistake."
  • The Gettier Machine: In philosophy, a "Gettier case" is when you have a justified true belief, but the truth and the justification are linked only by accident. The author argues that stopping at the AI output makes the user a "lucky guesser." The AI provides the appearance of justification (fluency) without the substance of truth-tracking.
  • The JTO Criterion: To achieve rational trust, a user must satisfy three conditions:
  • Acquisition (S1): Obtaining the belief from the output.
  • Model-independent Justification (S2): Understanding and "owning" the reasons behind the claim, rather than just saying "the AI said so."
    1. Independent Verification (S3): Testing the claim against a source independent of the model to ensure the belief is sensitive to the truth.
  • The "Pocket" Sensitivity Test: The author provides a simple heuristic for users: "Had this been false, would I have noticed?" If the answer is no, the user is operating on an insensitive belief and must proceed to verification.

Key Results

The primary result is the formalization of the Justified True Output (JTO) criterion, summarized in the table below:

Table 1: The correspondence between the conditions on knowledge and the three steps of AI use

The paper successfully reframes AI "hallucinations" not as bugs, but as a fundamental feature of truth-indifferent systems. By shifting the burden of justification from the model to the user, the JTO framework provides a scalable way to handle AI outputs based on the "stakes" of the situation. In low-stakes scenarios (e.g., brainstorming), S1 might suffice; in high-stakes professional work (e.g., journalism or law), S2 and S3 become mandatory obligations.

Limitations and Future Work

  • Over-demandingness: The author acknowledges that verifying every single AI output is practically impossible. The paper suggests the JTO should be "stakes-indexed," but exactly where to draw the line for "everyday" use remains a matter of individual judgment.
  • Model Improvement: While models are getting better and hallucinating less, the author argues this doesn't solve the underlying epistemological problem—a more accurate "fast clock" is still just a clock that happens to be right more often by luck unless the user verifies it.
  • Redundancy: Critics might argue that if we have to verify everything, the AI is "epistemically idle." The author counters that AI remains valuable for the "context of discovery" (finding candidate answers quickly), even if it cannot provide the "context of justification."
  • Future Directions: The author suggests translating these steps into specific professional codes of conduct for journalists, lawyers, and physicians to prevent the rise of a "technocratic theocracy" where decisions are made by black boxes.

Summary updated

Abstract

As generative artificial intelligence (AI) settles into everyday practices of inquiry, an old epistemological question returns in a new guise: when does a proposition a user takes from an AI output become something the user knows, and when is it rational to trust it as such? This paper argues that the characteristic failures of AI-mediated inquiry are precisely those that the justified-true-belief (JTB) tradition and its post-Gettier anti-luck refinements were built to diagnose, and it advances three claims. First, AI outputs inherit neither the presumptive warrant of testimony nor the reliabilist warrant of deterministic tools: unaudited trust in a calculator rests on a type-level reliability record, and for general-purpose generative models there is no type-stable process to which such a record could attach -- a practical form of the generality problem. Second, use that stops at obtaining an output turns generative AI into a Gettier machine: the user's fluency-based seeming of justification is disconnected from the truth of what is believed, and, as a clock running ten times too fast illustrates, sheer speed of production multiplies coincidental hits, inflating the appearance of reliability without improving the standing of any single hit. Third, the remedy is a three-step structure of use -- acquisition, understanding, independent verification -- whose first two steps answer to the classical belief and justification conditions and whose third answers to the post-Gettier sensitivity condition. The result is a stakes-indexed criterion of rational trust, justified true output (JTO), with an everyday test: "Had this been false, would I have noticed?" The criterion is defended against objections from over-demandingness, the extended mind, model improvement, and redundancy.
BibTeX
@misc{uyar2026from,
  author = {Tevfik Uyar},
  title = {{From the Gettier Machine to Justified True Output: A Three-Step Account of Rational Trust in Generative AI}},
  year = {2026},
  eprint = {2610.38112},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.38112},
}
Figure