DiSARM: Diverse and Surprising Association Rule Mining with Large Language Models

Lijia Liu, Hisashi KashimaarXiv 2026 · arXiv

Finding meaningful patterns in transactional data is a classic problem in data science, but it often leads to a "sea of the obvious." Traditional algorithms might tell you that people who buy cereal also buy milk—statistically true, but practically useless for a human analyst seeking new insights.

A new paper from researchers at Kyoto University introduces DiSARM (Diverse and Surprising Association Rule Mining), a hybrid framework that combines the statistical rigor of classical mining with the "world knowledge" of Large Language Models (LLMs) to surface rules that are both statistically sound and genuinely surprising.

TL;DR

DiSARM is a hybrid framework that uses classical algorithms to find statistically valid association rules and LLMs to filter them for subjective "surprise." By incorporating a diversity-selection step using Determinantal Point Processes (DPPs), it ensures that the final insights are not only unexpected but also semantically distinct, avoiding the redundancy common in traditional data mining.

What Problem Does This Paper Address?

Exploratory Data Analysis (EDA) on transactional data usually relies on Association Rule Mining (ARM). Algorithms like Apriori or FP-Growth are great at finding rules that satisfy objective metrics like "support" (how often items appear together) and "lift" (how much more likely one item is given another). However, these metrics can't distinguish between a "common sense" rule and a "surprising" one.

While LLMs are excellent at reasoning about what is "surprising" based on their training data, they face two major hurdles in EDA:

  1. Scalability: You cannot fit millions of transactions into an LLM's context window.
  2. Reliability: LLMs are prone to "hallucinating" patterns that don't actually exist in the specific dataset being analyzed.

DiSARM aims to bridge this gap by using classical mining as a "grounding" mechanism and the LLM as a "subjective judge."

Methods

The DiSARM pipeline consists of four distinct stages, as illustrated in the overview below:

Figure 1: Overview of DiSARM. Transaction data is split into mining, validation, and holdout sets. Candidate rules are extracted and analyzed to produce a final subset of statistically sound rules that are both surprising and diverse.
  1. Candidate Rule Mining: The system uses the FP-Growth algorithm to efficiently extract a large pool of candidate rules from a "mining" subset of the data.
  2. Internal Validation: To prevent the LLM from wasting time on statistical noise, rules are filtered using a Fisher’s Exact Test on a separate validation set. The researchers apply the Benjamini-Hochberg adjustment to control the false discovery rate, ensuring only robust associations move forward.
  3. Surprise Evaluation: An LLM (GPT-5.1) acts as a judge. It is prompted to rate each rule from 1 to 5 based on how difficult the association would be to anticipate using ordinary common sense.
  4. Diversity Selection: To avoid returning ten variations of the same insight, the framework uses Determinantal Point Processes (DPPs). By converting rules into Sentence-BERT embeddings, the system selects a "top-k" subset that maximizes both the surprise score and the semantic distance between rules.

Datasets

The researchers evaluated DiSARM on three real-world transactional datasets:

  • Instacart: Over 3 million grocery transactions.
  • Retail Market Basket: A medium-sized dataset of 7,501 transactions.
  • Groceries Market Basket: A smaller dataset of 9,835 transactions.

These datasets provided a range of scales to test how well the framework maintains statistical significance across different sample sizes.

Key Insights and Ideas

  • The "Boringness" of Pure Statistics: Classical baselines (Lift, PS, J-Measure) achieved perfect significance rates but the lowest possible surprise scores (often 1.00). They are statistically "correct" but provide zero new knowledge to an analyst.
  • The Danger of LLM-Only Mining: The authors tested "Serial Surprise" (asking an LLM to find surprising rules directly from data samples). While this produced the highest surprise scores, its significance rate plummeted (as low as 0.02 on some datasets). This confirms that LLMs left to their own devices will "discover" patterns that are actually just local noise or hallucinations.
  • Diversity is the Antidote to Redundancy: Without the DPP selection step, the top-k rules often clustered around the same themes. The use of DPP ensures that the limited "attention" of the human analyst is spent on a broad spectrum of different insights.

Key Results

The experiments demonstrated that DiSARM successfully finds the "middle ground" between boring statistics and unreliable hallucinations.

Figure 6: Quantitative comparison on the Instacart dataset.

As shown in Table 2 (Figure 6), on the Instacart dataset:

  • DiSARM achieved a 1.00 significance rate (meaning all rules held up on unseen data) while doubling the surprise score of classical methods.
  • Serial Surprise (LLM-only) had a high surprise score (3.38) but a disastrous significance rate of 0.44, meaning more than half of its "insights" were statistically invalid.

Ablation studies (Figure 5) further proved that removing the surprise evaluation or diversity selection steps led to a significant drop-off in the quality and variety of the discovered rules.

Figure 5: Results of the ablation study across three datasets.

Limitations and Future Work

The authors acknowledge a few key limitations:

  • The "Rare Rule" Problem: By requiring strict statistical significance and minimum support, DiSARM might filter out extremely rare "black swan" events that are highly surprising but don't appear enough to pass a p-value test.
  • Subjectivity of Surprise: What is "surprising" is culturally and contextually dependent. An LLM trained on general web data might find a rule surprising that a domain expert in a specific industry would consider common knowledge.
  • Future Directions: The researchers suggest that future versions could allow users to provide "domain-specific" context to the LLM to further refine what counts as a surprising insight for a particular business.

Summary updated

Abstract

Exploratory Data Analysis (EDA) aims to discover informative patterns in large datasets. For transactional data, Association Rule Mining (ARM) is an established approach that facilitates EDA by efficiently generating candidate patterns. Beyond efficient mining, identifying informative rules has also been extensively studied through both objective and subjective interestingness measures. Recent advances in Large Language Models (LLMs) offer new opportunities for assessing subjective interestingness using world knowledge. Nevertheless, relying solely on LLMs raises concerns about scalability and statistical reliability. Building on prior ARM research, we propose a hybrid framework, DiSARM, that leverages the world knowledge of LLMs to assess the subjective interestingness of rules, while maintaining statistical reliability and promoting diversity among the selected rules. Across three transactional datasets, experiments demonstrate that DiSARM effectively combines statistical reliability with surprise and diversity, offering a promising approach to ADE from transactional data.
BibTeX
@misc{liu2026disarm,
  author = {Lijia Liu and Hisashi Kashima},
  title = {{DiSARM: Diverse and Surprising Association Rule Mining with Large Language Models}},
  year = {2026},
  eprint = {2611.10445},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.10445},
}
Figure