Abstract
In fields ranging from political science to psychometry, treatment is often assigned based on specific individual characteristics rather than random allocation—such as scholarships awarded for merit or medical interventions based on physiological thresholds. Traditional methods for analyzing these non-randomized treatments, like Regression Discontinuity Design (RDD), frequently suffer from slow convergence rates (slower than $\sqrt{n}$) and are limited to estimating local effects near the assignment threshold. This paper introduces SCENTS (Score Explained Non-Randomized Treatment Systems), a novel framework that achieves the optimal $\sqrt{n}$ convergence rate and provides global treatment effect estimates. By leveraging background covariates to explain the assignment score, SCENTS offers a more precise and scalable approach for both fixed and high-dimensional data settings.
Introduction
In a randomized controlled trial (RCT), treatment assignment is independent of a subject's characteristics. However, in observational studies and social policy, treatment is often endogenous: the reason an individual receives a treatment (e.g., high academic ability) is frequently correlated with the outcome (e.g., future earnings).
To address this, researchers have traditionally relied on RDD. While useful, RDD has two primary drawbacks. First, it is "local," meaning it only estimates the treatment effect for individuals right at the cutoff point. Second, because it relies on a narrow bandwidth of data, the estimator is statistically "noisy" and converges slowly as sample sizes increase. The SCENTS framework overcomes these hurdles by modeling the assignment mechanism across the entire population.
The SCENTS Methodology
The core innovation of SCENTS is the utilization of background data to explain the "score" variable $Q$ that determines treatment assignment. The system is modeled as a partial linear model where the outcome $Y$ depends on the treatment, linear covariates, and a non-linear "nuisance" function representing the noise in the score assignment.
Key Components of the Estimator
- B-Spline Approximation: To handle the non-linear relationship between the score's noise and the outcome without imposing rigid parametric assumptions, the framework employs B-splines to approximate the nuisance function.
- Three-Part Data Splitting: To ensure the estimator remains unbiased, the algorithm partitions the dataset into three distinct segments:
- Part 1: Estimation of the relationship between background covariates ($Z$) and the assignment score ($Q$).
- Part 2: Estimation of the non-linear nuisance function.
- Part 3: Calculation of the final treatment effect ($\alpha_0$).
- High-Dimensional Scaling: In modern contexts where the number of variables ($p$) may exceed the number of observations ($n$), SCENTS incorporates a de-biasing procedure using LASSO regression. This allows the model to maintain $\sqrt{n}$ consistency even in high-dimensional covariate spaces.
Empirical Applications
The authors validated the SCENTS framework using two distinct real-world datasets, comparing the results against traditional RDD approaches.
Turkey Municipality Voting Data
This study investigated whether the election of Islamic versus secular mayors in 1994 influenced women’s high school education rates by the year 2000 ($n = 2629$). Previous RDD-based studies suggested that Islamic party rule had a significantly positive effect on women's education. However, the SCENTS analysis found no significant effect. This discrepancy suggests that the RDD results may have been driven by specific conditions in "cliff-hanger" elections, whereas SCENTS provides a more robust "global" view of the social impact across all municipalities.
Canadian University GPA Data
This analysis focused on the effect of academic probation (triggered by a GPA cutoff) on subsequent student performance. SCENTS confirmed a positive and highly significant treatment effect, supporting the "wake-up call" hypothesis—that the threat of expulsion motivates students to improve their academic standing. Unlike RDD, SCENTS was able to provide a more stable estimate by utilizing the full range of student data.
Key Insights and Advantages
- Global vs. Local Inference: By modeling the score variable across its entire range, SCENTS moves beyond the boundary to provide a treatment effect applicable to the broader population.
- Statistical Efficiency: The authors demonstrate that the SCENTS estimator is semi-parametrically efficient under normal errors. This means it achieves the highest possible precision for this class of statistical problems.
- Mathematical Convergence: The framework rigorously achieves the $\sqrt{n}$ convergence rate, making it significantly more stable than non-parametric RDD methods, which typically converge at a slower rate (e.g., $n^{-2/5}$ or $n^{-4/9}$).
Limitations and Future Directions
While powerful, the SCENTS framework relies on the availability of "good" covariates—background variables that can effectively explain the assignment score. If the score is determined by unobserved factors or is purely random, the benefits of the model are reduced. Additionally, the current primary model assumes a constant treatment effect across the population. Future work may focus on expanding the framework to better accommodate heterogeneous treatment effects where the impact varies based on individual "innate ability" or other latent characteristics. Finally, because calculating asymptotic variance is complex, the method currently utilizes bootstrapping for confidence intervals, which can be computationally intensive for extremely large datasets.
Summary updated