PVL: A Framework for Navigating the Precision-Variety Trade-Off in Automated Animation of Smiles

Nicholas Sohre, Moses Adeagbo, Nathaniel Helwig, Sofia Lyford-Pike, Stephen J. GuyAAAI 2018 · DOI

Introduction

In digital media, creating believable facial animations is a persistent challenge. While procedural content generation (PCG) offers a scalable solution for populating virtual worlds, it often falls into the "uncanny valley." This phenomenon occurs when animations are either too repetitive, appearing robotic, or too varied, resulting in unrealistic "glitches." Researchers from the University of Minnesota addressed this in their AAAI-18 paper by introducing Precision-Variety Learning (PVL), a framework designed to balance the accuracy (precision) and diversity (variety) of automated smile animations.

The Precision-Variety Trade-Off

The core problem in PCG is the tension between quality and diversity. Algorithms prioritizing high precision often converge on a limited set of "safe" outputs, leading to repetitive NPC behavior. Conversely, prioritizing variety can lead to "garbage" results that fail to meet semantic goals. In the context of smiles, a "slight smile" might inadvertently look neutral, or a "full smile" might look like a grimace. PVL provides a heuristic to navigate this trade-off predictably.

The PVL Framework

The PVL framework maps facial expressions into a low-dimensional space defined by three key metrics: mouth angle, smile width, and "dental show" (visibility of teeth). The system employs a learning heuristic to rank positive samples based on their "sample precision," estimated by their distance to the nearest negative (non-smile) samples.

A generated smile with lips closed, representing one mode of expression.

A user-defined parameter, $m$, allows developers to control the training set. By selecting only the top $m$ "safest" positive samples to train a classifier (e.g., KNN or Random Forest), developers can tune the system's output. A low $m$ value yields consistent, high-precision smiles, while a higher $m$ expands the decision boundary to include more diverse expressions.

Experimental Validation

The researchers utilized a dataset of 63 facial expressions categorized into four intensity bins: None, Slight, Partial, and Full. They demonstrated that for neighbor-based classifiers, the relationship between $m$ and variety is monotonic, ensuring predictable control for artists. As $m$ increases, variety increases while precision decreases.

A generated smile with teeth visible, showing a different mode of expression for the same intensity.

User studies further validated the framework. Participants rated pairs of smiles generated with higher $m$ values as significantly more diverse. Additionally, a two-alternative forced choice study confirmed that "Full" smiles were perceived as significantly happier than "Partial" smiles ($p < 0.001$), proving that semantic accuracy is maintained even as variety increases.

Conclusion

PVL offers a robust method for generating diverse, realistic facial animations by treating distance to negative samples as a proxy for quality. While currently focused on mouth animations and limited by dataset size, the framework's mathematical predictability makes it a valuable tool for developers. Future work aims to expand the model to full-face animations and other emotional states, with potential applications ranging from entertainment to medical rehabilitation.

Summary updated

BibTeX
@inproceedings{sohre2018pvl,
  author = {Nicholas Sohre and Moses Adeagbo and Nathaniel Helwig and Sofia Lyford-Pike and Stephen J. Guy},
  title = {{PVL: A Framework for Navigating the Precision-Variety Trade-Off in Automated Animation of Smiles}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2018},
  doi = {10.1609/aaai.v32i1.11431},
}
Figure