Kolmogorov-Arnold Networks vs. Multi-Layer Perceptrons: A Rigorous Statistical Benchmark on Clinical Tabular Data

Rafał Wodziński, Paweł SzczerbiakarXiv 2026 · arXiv

The machine learning community has been buzzing about Kolmogorov-Arnold Networks (KANs) since they were proposed as a mathematically elegant alternative to the ubiquitous Multi-Layer Perceptron (MLP). By placing learnable univariate functions on the edges of a network instead of fixed activations at the nodes, KANs promised better accuracy and interpretability. But do they hold up in the high-stakes, messy world of clinical medicine?

A recent study provides a rigorous statistical answer, benchmarking nine KAN variants against standard MLPs and Random Forests across seven diverse medical tabular datasets.

TL;DR

This paper presents a standardized benchmark showing that while KANs (specifically the TabKAN variant) can outperform MLPs in detecting rare medical conditions, they come with a significant "efficiency tax." KANs are often practically equivalent to MLPs on balanced data but require up to 12.5x more parameters and nearly 50% more inference time.

What Problem Does This Paper Address?

Most initial KAN research focused on "toy" symbolic regression problems or standard vision benchmarks like MNIST. Clinical data is a different beast: it’s tabular, heterogeneous, and often suffers from extreme class imbalance (e.g., only 6% of patients in a cohort might actually have the disease being screened for).

Standard metrics like AUROC can paint an overly rosy picture in these imbalanced settings. Furthermore, previous KAN studies often lacked rigorous statistical testing or detailed profiling of computational costs—critical factors for deploying models on resource-constrained medical hardware. This paper fills that gap with a systematic, statistically grounded comparison.

Methods

The researchers didn't just test the original B-spline KAN; they evaluated a suite of eleven architectures:

  • 9 KAN Variants: Including FastKAN (RBF-based), WavKAN (wavelets), and the tabular-optimized TabKAN, which uses a feature-gating mechanism.
  • Baselines: A finely tuned StandardMLP and a Random Forest.

The experimental design was robust: a 3 × 5 Repeated Stratified K-Fold cross-validation with nested Bayesian hyperparameter optimization. To move beyond simple p-values, they employed the Bayesian Correlated t-Test with a Region of Practical Equivalence (ROPE). This allowed them to quantify not just if one model was "better," but if it was meaningfully better within a ±0.01 margin of clinical relevance.

Datasets

The benchmark utilized seven publicly available medical tabular datasets from the UCI repository, covering oncology, cardiology, nephrology, neurology, endocrinology, and obstetrics.

Table 1: Summary of Benchmark Medical Datasets

The Cervical Cancer and Cardiotocography datasets provided the toughest tests for minority-class detection, with positive cases making up only 6.4% and 8.3% of the samples, respectively.

Key Insights and Ideas

  • The "Rare Case" Specialist: KANs, particularly TabKAN and WavKAN, shine when the positive class is rare. Their edge-based activation functions appear better at capturing the subtle, non-linear decision boundaries typical of rare pathological conditions.
  • The Efficiency Tax: KANs are computationally heavy. Replacing scalar weights with parameter vectors for basis functions leads to a massive expansion in model size and a noticeable hit to inference speed.
  • Reliable Calibration: In medicine, a model shouldn't just be right; it should know how certain it is. KANs demonstrated excellent probabilistic calibration (measured by the Brier Score), matching the high standards of tuned MLPs without needing extra post-hoc adjustments.
  • The Pareto Frontier: There is no single winner. The choice is a trade-off: use a StandardMLP for maximum efficiency and low latency, or TabKAN when maximizing precision on rare clinical events is the primary goal.

Key Results

  • Superior Minority Detection: On the highly imbalanced Cervical Cancer dataset, TabKAN achieved a precision of 79.4% on biopsy-positive cases, compared to just 66.5% for the StandardMLP.
  • Overall Performance: Across the entire benchmark, TabKAN reached the highest grand mean Area Under the Precision-Recall Curve (AUPRC) of 0.9061, slightly ahead of the MLP's 0.9028.
Figure 1: Distribution of per-fold Area Under the Precision-Recall Curve (AUPRC) scores for all eleven evaluated architectures across the seven medical datasets, shown as box-and-whisker plots (median, interquartile range, and 1.5-IQR whiskers). The results illustrate that while overall performance distributions overlap across balanced datasets, dedicated architectures such as TabKAN and FastKAN demonstrate competitive or superior retention of discriminative capacity on imbalanced cohorts (e.g., Cervical Cancer and Cardiotocography).
  • Practical Equivalence: Bayesian testing revealed that on more balanced datasets (like Breast Cancer), KANs and MLPs are practically equivalent, with a 100% probability of falling within the ROPE.
Table 2: Bayesian Correlated t-Test Results (AUPRC). ROPE interval = ±0.01.
  • Computational Cost: KAN variants were 1.20× to 1.48× slower in per-sample inference and required 2.8× to 12.5× more trainable parameters than the MLP baseline.

Limitations and Future Work

The study is limited to seven public datasets and focuses on static tabular data. It does not address longitudinal data (like EHR time-series) or the potential for KANs to be more "interpretable" by allowing clinicians to inspect the learned univariate functions directly.

The authors suggest that future research should explore this symbolic interpretability and extend the benchmark to massive, real-world longitudinal databases like MIMIC-IV to see if these findings hold at scale.

Summary updated

Abstract

Kolmogorov-Arnold Networks (KANs) have recently been proposed as a promising alternative to Multi-Layer Perceptrons (MLPs). However, empirical evaluations on structured medical datasets remain scarce, and commonly reported metrics like AUROC can yield overly optimistic performance estimates on imbalanced clinical cohorts. In this study, we present a standardized benchmark comparing eleven architectures - nine KAN variants (FastKAN, WavKAN, ReLUKAN, ChebyKAN, TaylorKAN, GramKAN, JacobiKAN, LegendreKAN, and TabKAN), a tuned StandardMLP, and a Random Forest baseline - across seven heterogeneous medical tabular datasets spanning oncology, cardiology, nephrology, neurology, endocrinology, and obstetrics. Our experimental protocol employs a 3x5 Repeated Stratified K-Fold cross-validation scheme with nested Bayesian hyperparameter optimization and evaluates discrimination via Area Under the Precision-Recall Curve (AUPRC), calibration through the Brier Score, and computational efficiency. Formal equivalence testing is conducted using the Bayesian Correlated t-Test with a Region of Practical Equivalence (ROPE) at +/- 0.01. The results indicate that on datasets with severe class imbalance, dedicated KAN architectures (particularly TabKAN and ReLUKAN) can improve minority-class detection and achieve higher AUPRC than standard MLPs. Nevertheless, across pooled datasets, KAN variants demonstrate comparable overall predictive discrimination rather than a systematic advantage, while requiring 1.20x to 1.48x longer inference latency per sample and up to 12.5x more trainable parameters. Consequently, StandardMLP remains a strong baseline on the efficiency Pareto frontier, while KAN variants provide a viable alternative when precision on rare positive cases is the primary clinical objective. The code for reproducing the results is available at https://github.com/rafalwodzinski/kan_mlp_comparison.
BibTeX
@misc{wodzinski2026kolmogorov,
  author = {Rafał Wodziński and Paweł Szczerbiak},
  title = {{Kolmogorov-Arnold Networks vs. Multi-Layer Perceptrons: A Rigorous Statistical Benchmark on Clinical Tabular Data}},
  year = {2026},
  eprint = {2611.02856},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.02856},
}
Figure