Detecting Body Mass Index from a Facial Photograph in Lifestyle Intervention

Makenzie L. Barr, Guodong Guo, Sarah Colby, Melissa D. OlfertTechnologies 2018 · DOI

TL;DR

This paper explores using facial photographs to estimate Body Mass Index (BMI) as a more accessible method for large-scale health interventions. While the facial BMI (fBMI) algorithm showed good correlation with measured BMI (mBMI) in normal and overweight individuals, it struggled with underweight and obese categories, highlighting the need for further refinement.

What Problem Does This Paper Address?

Accurately measuring Body Mass Index (BMI) is crucial for many health research studies, but it can be a significant hurdle in dissemination and implementation research, especially when dealing with large, geographically dispersed populations. Traditional methods require physical measurements (height and weight), which are time-consuming, resource-intensive, and often impractical for remote or national-level interventions. Self-reported measurements are notoriously unreliable, with individuals tending to overestimate height and underestimate weight. This study investigates whether facial photographs, a readily available data source in the digital age, can provide a viable alternative for estimating BMI, thereby simplifying data collection for widespread health programs.

Methods

The core of this research builds upon a previously developed computational approach by Wen and Guo (2013) for estimating BMI from facial images. The process involves several key steps:

  • Face Detection: Identifying the face within the photograph.
  • Facial Landmark Detection: Pinpointing specific points (fiducial points) on the face.
  • Feature Extraction: Calculating seven facial features based on distances and ratios between these landmarks. These include measures like cheek-to-jaw width, upper-face-to-face height ratio, and mean eyebrow height.
  • Feature Normalization: Standardizing these extracted features.
  • Regression Modeling: Using a Support Vector Regression (SVR) model to learn the relationship between these facial features and actual BMI values.
  • fBMI Calculation: Applying the trained regression model to new facial images to predict a facial BMI (fBMI).

The study then compares these predicted fBMI values against physically measured BMIs (mBMI) collected by trained researchers.

Datasets

The study utilized data from 1210 participants of the "Get Fruved" study, a larger lifestyle intervention program. These participants were young adults (average age 19) and predominantly Caucasian (62.5%) and female (69.6%). Facial images and anthropometric measurements (height and weight) were collected at baseline. No new benchmark datasets were introduced; the study evaluated the existing algorithm on a new cohort.

Key Insights and Ideas

  • Facial features correlate with BMI: The study confirms that facial characteristics captured in photographs do hold a significant relationship with an individual's BMI, particularly in the normal and overweight ranges. This suggests that facial adiposity is a detectable indicator.
  • Accessibility is key: The primary motivation for this research is to overcome the logistical challenges of traditional BMI measurement in large-scale interventions. Using facial photos offers a potentially low-barrier data collection method.
  • Algorithm limitations: The algorithm's performance significantly drops for individuals in the underweight and obese categories. This is a critical finding, as these are often the groups most in need of intervention.
  • Underestimation in obese: A particularly interesting finding is that 109 participants classified as 'obese' by measured BMI were placed into a lower category by the facial BMI algorithm. This suggests the algorithm might not be sensitive enough to detect extreme weight variations.

Key Results

  • Correlation: A significant correlation was found between fBMI and mBMI (r = 0.3070, p < 0.0001).
  • Accuracy in categories: The fBMI algorithm correctly placed participants in the normal and overweight categories with higher accuracy.
  • Underestimation: On average, fBMI underestimated mBMI by 0.4212 kg/m² (p < 0.0007).
  • Obese misclassification: All 109 participants in the 'obese' mBMI category were placed into a lower category by fBMI.
  • Overall placement accuracy: Approximately 60% of participants were placed in the correct BMI category using fBMI.
  • Mean Absolute Error (MAE): The MAE between mBMI and fBMI was 3.2 ± 2.9 kg/m².

Limitations and Future Work

The authors acknowledge several limitations:

  • Bias in retrospective analysis: As with any retrospective data analysis, potential biases exist.
  • Legibility issues: Some facial photos were rendered illegible by the algorithm, impacting data completeness.
  • Generalizability: The study population was predominantly Caucasian and young adults, limiting generalizability to other demographics.
  • Algorithm sensitivity: The algorithm's poor performance in underweight and obese categories is a major limitation.

Future work should focus on:

  • Improving sensitivity: Further testing and refinement of the fBMI algorithm are crucial, especially to improve its accuracy for underweight and obese individuals.
  • Community interventions: Testing the algorithm in real-world community interventions with a wider range of participants and varying photo quality is essential.
  • Comparison with self-reported data: Investigating the reliability of self-reported BMI compared to facial recognition BMI would be valuable.
  • 3D imaging: While not the focus of this paper, the authors mention that 3D imaging has shown promise but is less feasible for widespread dissemination due to participant burden. The goal remains to leverage simple 2D photographs.

Summary updated

Abstract

This study aimed to identify whether a research participant’s body-mass index (BMI) can be correctly identified from their facial image (photograph) in order to improve data capturing in dissemination and implementation research. Facial BMI (fBMI) was measured using an algorithm formulated to identify points on each enrolled participant’s face from a photograph. Once facial landmarks were detected, distances and ratios between them were computed to characterize facial fatness. A regression function was then used to represent the relationship between facial measures and BMI values to then calculate fBMI from each photo image. Simultaneously, BMI was physically measured (mBMI) by trained researchers, calculated as weight in kilograms divided by height in meters squared (adult BMI). Correlation analysis of fBMI to mBMI (n = 1210) showed significant correlation between fBMI and BMIs in normal and overweight categories (p &lt; 0.0001). Further analysis indicated fBMI to be less accurate in underweight and obese participants. Matched pair data for each individual indicated that fBMI identified participant BMI an average of 0.4212 less than mBMI (p &lt; 0.0007). Contingency table analysis found 109 participants in the ‘obese’ category of mBMI were positioned into a lower category for fBMI. Facial imagery is a viable measure for dissemination of human research; however, further testing to sensitize fBMI measures for underweight and obese individuals are necessary.
BibTeX
@inproceedings{barr2018detecting,
  author = {Makenzie L. Barr and Guodong Guo and Sarah Colby and Melissa D. Olfert},
  title = {{Detecting Body Mass Index from a Facial Photograph in Lifestyle Intervention}},
  booktitle = {Technologies},
  year = {2018},
  doi = {10.3390/technologies6030083},
}
Figure