TL;DR
Researchers have discovered that Large Language Models (LLMs) possess a distinct, reproducible "proving style" in mathematics that differs significantly from human conventions. By reproving Euclid’s Elements, the study shows that AI tends to "build from the ground up," favoring foundational axioms and distant definitions over the high-level, "mature" theorems typically cited by human mathematicians.
What Problem Does This Paper Address?
As LLMs like Claude and GPT-6 begin to tackle frontier mathematical research—such as disproving the Erdős unit distance conjecture—a new friction has emerged: mathematicians often find AI-generated proofs difficult to interpret. They are frequently described as verbose, dwelling on trivialities, and "not written for humans."
This paper investigates whether this difficulty stems from a fundamental difference in how AI organizes and invokes mathematical knowledge. The authors seek to move beyond qualitative observations of "AI verbosity" to a systematic, quantitative characterization of AI’s deductive style. By comparing how AI and humans construct proofs within a closed axiomatic system, they aim to identify the "concrete signature" of machine reasoning.
Methods
The researchers used Euclid’s Elements as a controlled testbed, consisting of 465 propositions. They tasked three state-of-the-art models—Claude Opus 4.6, Claude Fable 5.1, and GPT-6 Astra—to independently reprove every proposition.
The experimental design (detailed in Experimental pipeline) ensured that models proved propositions sequentially, citing only previously established definitions, postulates, or theorems. To analyze the results, the team:
- Calculated Jaccard Similarity: Measuring the overlap between the sets of citations used by AI vs. humans.
- Complex Network Analysis: Treating the entire body of proofs as a directed graph where nodes are propositions and edges are citations.
- Classification: An AI judge (validated by human experts) categorized proofs as Perfect matches (P), Granularity differences (G), Path differences (D), or Errors (E).
- Ancestor Analysis: Tracing whether AI’s "extra" citations were actually the underlying logical dependencies of the theorems humans cited.
Datasets
The study utilized a structured version of Heath’s classical English translation of Euclid’s Elements, sourced from the Wolfram Data Repository. This dataset provides a rigorous human baseline, including 5 postulates, 5 common notions, 132 definitions, and 465 propositions.
Key Insights and Ideas
- "Building from the Ground Up": The most striking finding is that AI models prefer to cite foundational elements (definitions and postulates) rather than intermediate theorems. While humans cite foundations only 13% of the time, AI does so in roughly 40% of its citations.
- Stable and Reproducible Style: This isn't random hallucination. The "AI style" is remarkably consistent across different models and runs. As shown in Jaccard similarity distributions, the similarity between different AI runs (~0.68) is nearly double the similarity between AI and human proofs (~0.37).
- Complexity Drives Divergence: The more complex a proposition (measured by proof length or available tools), the more likely the AI is to diverge from the human path. Simple problems lead to convergence; complex ones allow the AI to explore its own idiosyncratic logical routes.
- Reinventing the Wheel: About half of the "extra" citations AI uses are actually ancestors of the human citations. Essentially, where a human cites a high-level theorem to save cognitive effort, the AI "re-derives" that theorem by citing its constituent parts.
Key Results
- Network Density: AI citation networks are substantially denser than human ones. The human network contains 1,889 edges, while AI networks range from ~3,500 to over 4,900 edges.
- Citation Distance: AI tends to reach further back in the deductive chain. The mean citation distance for AI was 111.2, compared to 86.3 for humans (see Citation types and distances).
- Verbosity vs. Efficiency: AI proofs are consistently longer. Human proofs average 314 words, while Claude Fable averaged 702. Interestingly, GPT-6 Astra was the most "terse" AI, producing the most concise reasoning per citation.
- Path Divergence: In the final results, roughly 27% of AI proofs followed a valid but "genuinely different route" (Category D) from the human baseline.
Limitations and Future Work
The authors acknowledge several constraints:
- Domain Specificity: The study is limited to the geometry and number theory of Euclid. It remains to be seen if this "ground-up" style persists in modern, abstract fields like topology or analysis.
- Natural Language Focus: The research looked at natural language proofs. The authors suggest extending this comparison to formal proof environments (like Lean or Coq).
- Steerability: Initial attempts to "steer" the AI toward human-like citation patterns using prompt engineering had negligible effects. Future work is needed to determine if AI can be trained to adopt a more "human-readable" hierarchical proving style without sacrificing its logical rigor.
Summary updated