Example-Based Hairstyle Advisor

Wei Yang, Masahiro Toyoura, Xiaoyang MaoThe Journal of the Society for Art and Science 2012 · DOI

Choosing a new hairstyle is a high-stakes gamble. We’ve all been there: you see a trendy cut in a magazine, try it out, and immediately realize it doesn't suit your face shape at all. This paper, "Example-Based Hairstyle Advisor" by researchers at the University of Yamanashi, proposes a computational way to take the guesswork out of the salon chair.

TL;DR

The researchers developed a system that automatically recommends hairstyles by matching a user's facial proportions to a database of professional "success stories." By combining Active Shape Models for feature extraction and alpha matting for realistic image synthesis, the system provides a personalized, high-fidelity preview of how a specific style will actually look on the user.

What Problem Does This Paper Address?

The concept of a hairstyle "suiting" someone is deeply subjective and rooted in human aesthetics, making it notoriously difficult to model mathematically. While hairstyle simulators exist, they often suffer from two main flaws:

  1. Manual Effort: They require users to manually adjust hair overlays or define facial contours, which is tedious and prone to error.
  2. Lack of Guidance: They offer a library of styles but don't tell the user which ones actually complement their specific facial structure.

The authors tackle the challenge of "subjective suitability" by using an example-based approach. Instead of trying to define a universal formula for beauty, they lean on the expertise of professional stylists by learning the relationship between facial shapes and the hairstyles that professionals chose for those shapes.

Methods

The system operates in two main phases: Database Construction and Image Synthesis.

  1. Facial Feature Extraction: The system uses Active Shape Models (ASM) to automatically detect 68 landmarks on a user's face. From these, it calculates a 6D feature vector representing facial ratios (e.g., face length to width, forehead height, jaw length). This categorizes the face into types like oval, round, inverted triangle, or "home base" (square).
  2. Example-Based Retrieval: The system searches a database of professional hairstyle examples to find the "nearest neighbor"—the model whose facial proportions most closely match the user’s.
  3. Realistic Synthesis: To show the user the result, the system overlays the recommended hair onto the user's photo.
  4. Alpha Matting: Unlike traditional "binary masks" that create harsh, fake-looking edges, the authors use Robust Matting. This allows for semi-transparent pixels, capturing the fine, wispy details of hair strands for a much more natural blend.
  5. Automated Alignment: The system automatically scales and shifts the hairstyle based on the ASM landmarks to ensure the forehead and ears align correctly.

Datasets

The researchers used two primary datasets for their experiments:

  • General Database: 84 professional hairstyle images from hair catalogs, treated as "successful examples" of styling.
  • Male-Preferred Database: To test if gendered preferences matter, they collected 283 images from the web and had 15 men vote on them. The 160 most popular images formed a specialized database.
  • Evaluation Groups: Testing involved 10 female college students for self-evaluation and 13 students (6 male, 7 female) for third-party evaluation.

Key Insights and Ideas

  • The "Oval" Ideal: The system is built on the aesthetic principle that a "suitable" hairstyle is one that makes the overall head shape appear more oval. For example, a round face benefits from volume on top to add perceived length.
  • Alpha Matting is Essential: The jump in realism from a simple cut-and-paste (binary mask) to alpha matting is significant. It transforms the output from a "sticker" look to a believable photograph.
  • Gendered Perception: One of the most interesting findings was that men and women perceive "suitability" differently. When evaluating hairstyles for women, female observers showed high agreement with the system's choices, while male observers' preferences were more scattered. This led the authors to create gender-specific databases.

Key Results

The researchers validated their system through several user studies:

  • Recommendation Accuracy: In self-evaluation tests, users ranked the system's top recommendations as "suitable" at a rate significantly higher than random chance (p < 0.01).
  • Synthesis Quality: On a 5-point scale for realism, the alpha matting technique scored 2.96, nearly doubling the score of the binary mask technique (1.38). While not as perfect as an unedited photo (4.70), it was deemed sufficient for a simulation.
  • Professional Validation: When four professional stylists evaluated the system, they agreed with the top-3 recommendations in roughly 65% of cases, suggesting the system successfully captured broad aesthetic "rules of thumb."

Limitations and Future Work

While the system handles facial proportions well, it currently ignores other vital factors:

  • Local Balance: Professional stylists noted that the system doesn't account for the placement of individual features (like the distance between eyes or the shape of the nose).
  • Hair Texture and Color: The current model focuses on shape. It doesn't yet account for a user's actual hair volume, texture (curly vs. straight), or color, which limits the "realizability" of the suggested cut.
  • Input Constraints: The system works best if the user's hair is tied back in the input photo; otherwise, the original hair can "peek out" from behind the synthetic overlay.

The authors suggest that future iterations could use machine learning to weight facial features differently and incorporate clothing or fashion style into the recommendation engine.

Summary updated

Abstract

ヘアスタイルは人の外見を決める上でもっとも重要な要素の一つであり,ヘアスタイルを変えるだけで人に与える印象は大きく変わる.本研究では,ノンパラメトリックサンプリングに基づく似合うヘアスタイルの自動探索法を提案する.「似合う」とは感性的な概念であり,その数理モデルを作成することは困難である.提案手法では,ヘアスタイルが似合うかどうかを決めるもっとも重要な要因が顔の形状特徴であることに着目した.ヘアスタイルの成功例から顔の形状特徴とヘアスタイルとの関係を学習することにより,利用者の顔にもっとも似合うヘアスタイルを得ることができる.さらに,利用者の顔写真から顔の形状特徴を自動抽出,マッティングを利用した写実的なヘアスタイル画像の合成,利用者に応じたデータベース構築について,提案・実装する.実験では,他者評価と自己評価の二つの評価を通して,提案手法の有効性を確かめることができた.
BibTeX
@article{yang2012example,
  author = {Wei Yang and Masahiro Toyoura and Xiaoyang Mao},
  title = {{Example-Based Hairstyle Advisor}},
  journal = {The Journal of the Society for Art and Science},
  year = {2012},
  doi = {10.3756/artsci.11.195},
}
Figure