Introduction
Modern recommendation engines are typically optimized for prediction accuracy, minimizing the error between predicted and actual ratings. However, these models are often "economically illiterate," failing to account for the fundamental trade-offs between substitutes and complements. This paper introduces Neural Utility Functions (NUFs), a framework that embeds economic inductive biases into neural networks to produce more rational and effective recommendations.
The Rationality Gap in Deep Learning
In microeconomics, consumer behavior is modeled through Utility Theory, which assumes users seek to maximize a "utility function." A critical property of these functions is quasi-concavity, representing diminishing marginal returns and logical trade-offs. The authors demonstrate that standard two-layer neural networks are mathematically "irrational" because they do not inherently satisfy quasi-concavity. In high-dimensional spaces, the probability of a standard network behaving like a valid utility function is nearly zero, leading to recommendations that ignore basic economic relationships.
Neural Utility Functions (NUF)
The proposed NUF approach is a backbone-agnostic framework that can be integrated into existing architectures like Matrix Factorization (MF) or Deep Factorization Machines (DFM).
The core of the method is a specialized loss function inspired by the Marginal Rate of Substitution (MRS). By constraining the gradients of the model, NUFs force the network to learn smoother, more logical internal representations. The training process involves:
- The Utility Prior: A new loss term ($\mathcal{L}_{NUF}$) that aligns model gradients with economic principles.
- Gradient Constraints: Minimizing the gradient ratio between an item and its complements while maximizing it against substitutes.
- Sampling Strategy: For each user-item pair, the model samples complements (items the user liked) and substitutes (items the user did not choose) to calculate these constraints during training.
Experimental Evaluation
The framework was tested on both simulated and real-world datasets:
- Simulated Data: Testing the recovery of theoretical substitution effects using Cobb-Douglas and CES functions.
- MovieLens 25M: A benchmark for explicit movie ratings.
- Amazon 18: Focused on Grocery and Home categories to evaluate real-world product relationships.
Results and Analysis
The inclusion of NUF loss consistently improved performance across four state-of-the-art architectures.
Key findings include:
- Accuracy Gains: NUF improved recommendation accuracy (measured by RMSE and NDCG) in 81% of experimental cases with statistical significance.
- Theoretical Alignment: On simulated data, NUFs were significantly more accurate at identifying true substitution rates than vanilla neural networks.
- Economic Analogies: The model successfully learned complex item relationships. For instance, it identified analogies such as Coffee - Creamer + Pizza ≈ Cheddar, demonstrating an understanding of how complements shift across different contexts (e.g., swapping a breakfast complement for a dinner complement).
Conclusion
By bridging the gap between classical economic theory and modern deep learning, Neural Utility Functions provide a path toward AI that understands the underlying logic of human choice. While the method introduces some computational overhead due to in-graph gradient calculations, the resulting gains in recommendation rationality and accuracy make it a compelling addition to the recommender systems toolkit.
Summary updated