Children Age Group Detection based on Human-Computer Interaction and Time Series Analysis

Juan Carlos Ruiz-Garcia, Carlos Hojas, Ruben Tolosana, Ruben Vera-Rodriguez, Aythami Morales, Julian Fierrez, Javier Ortega-Garcia, Jaime Herreros-RodriguezarXiv 2024 · DOI · arXiv

TL;DR

Researchers have developed a high-precision method to detect a child's age group (with one-year granularity) by analyzing how they color a tree on a tablet. By applying Hidden Markov Models (HMM) to time-series data of stylus pressure, velocity, and spatial coordinates, the system achieves over 85% accuracy, significantly outperforming traditional methods that rely on global summary statistics.

What Problem Does This Paper Address?

As children spend increasing amounts of time on mobile devices, there is a growing need for "age-appropriate" digital environments. Most current systems treat "children" as a monolithic group, or at best, distinguish them from adults. However, a 2-year-old’s motor and cognitive skills differ vastly from those of a 7-year-old.

Existing research has largely focused on coarse-grained classification (e.g., child vs. adult) or broad age brackets (e.g., 3-year spans). This paper tackles the more challenging task of fine-grained age detection—predicting a child's specific educational level (1-year precision) based solely on their interaction patterns. This could enable apps to automatically adjust difficulty levels, limit exposure time based on developmental needs, or even serve as a non-invasive tool for monitoring neuromotor development.

Methods

The authors propose a Children-Computer Interaction (CCI) framework that moves away from "global features" (like total time taken) toward "local features" or time-series analysis.

  1. Input Task: Children perform a "Drawing Test," coloring a tree using a stylus on a tablet.
  2. Feature Extraction: The system extracts 25 distinct time series from the interaction. These include basic spatial coordinates ($x, y$) and pressure ($z$), but also derived kinematic data like path-velocity magnitude, acceleration, log curvature radius, and stroke length-to-width ratios.
  3. Feature Selection: To find the most discriminative signals, the researchers compared two methods:
  4. Statistical Analysis: Selecting features based on inter-class variability.
  5. Sequential Forward Search (SFS): An automatic algorithm that iteratively selects the best subset of features by considering their correlations.
  6. Classification: Two algorithms were tested:
  7. Dynamic Time Warping Barycenter Averaging (DBA): A distance-based approach that creates a "prototype" drawing for each age group.
  8. Hidden Markov Models (HMM): A statistical approach that models the underlying temporal patterns and correlations of the interaction.
Fig. 1: Architecture of the proposed approach to detect the children’s age group through the interaction of the children with mobile devices and the automatic analysis of the time series generated. Blue dashed arrows represent the different configurations studied in this article in terms of Time Series and Classification. First, children perform the input stage by colouring a tree on a tablet device using a stylus as an acquisition tool (Drawing Test). Next, time series extraction and selection are performed. Finally, to predict the children’s age group, two different classifiers are tested independently, DBA and HMM.

Datasets

The study utilized the ChildCIdb (Children Interaction Database), a large-scale public dataset. The authors used an extended version containing data from 492 children aged 18 months to 8 years. The children are grouped into seven categories corresponding to the Spanish educational system (e.g., Group 2 for 18 months–2 years, up to Group 8 for 7–8 years).

Key Insights and Ideas

  • Local > Global: The most significant "aha moment" is the superiority of time-series analysis. Previous work using global features on the same task achieved only ~30% accuracy for 7-group classification. By looking at the process of drawing through time-series, accuracy jumped to over 85%.
  • The "Messy" Middle: The model found intermediate age groups (4 to 6 years old) the most difficult to classify. The authors attribute this to these ages being a "developmental stage full of multiple educational changes," where motor skills are rapidly evolving and overlapping.
  • HMMs Win: HMMs proved far more effective than DBA. While DBA tries to find an "average" drawing, HMMs successfully capture the statistical "style" of how a child of a certain age moves the stylus, accounting for the inherent variability in how children color.

Key Results

The winning configuration was the HMM + SFS approach, which utilized a subset of 9 specific time series (including timestamp, stroke ratio, pressure, and various derivatives of spatial coordinates).

  • Accuracy: 85.39% for detecting the correct 1-year age group.
  • Average Age Group Distance (AGD): 0.17. This metric represents how many groups away the prediction was from the truth. An AGD of 0.17 means that when the model is wrong, it is usually very close to the actual age group.
  • Comparison: This approach crushed the baseline global feature approach, which had an AGD of 1.62 (meaning it was often off by nearly two years).
Fig. 5: SFS Algorithm for DBA and HMM: Average AGD achieved for DBA and HMM during the execution of SFS in the development stage (training + validation).

Limitations and Future Work

While the results are impressive, the authors note several areas for expansion:

  • Longitudinal Data: The current study is a snapshot. Future work aims to track the same children over several years to better model individual motor and cognitive evolution.
  • Clinical Correlation: The researchers plan to analyze how these interaction patterns correlate with metadata like ADHD, prematurity, or school grades, potentially turning a simple coloring app into a diagnostic aid.
  • Privacy: As with any biometric data involving minors, the authors highlight the need for further research into privacy-enhancing technologies to protect these sensitive interaction patterns.

Summary updated

Abstract

This article proposes a novel Children-Computer Interaction (CCI) approach for the task of age group detection. This approach focuses on the automatic analysis of the time series generated from the interaction of the children with mobile devices. In particular, we extract a set of 25 time series related to spatial, pressure, and kinematic information of the children interaction while colouring a tree through a pen stylus tablet, a specific test from the large-scale public ChildCIdb database. A complete analysis of the proposed approach is carried out using different time series selection techniques to choose the most discriminative ones for the age group detection task: i) a statistical analysis, and ii) an automatic algorithm called Sequential Forward Search (SFS). In addition, different classification algorithms such as Dynamic Time Warping Barycenter Averaging (DBA) and Hidden Markov Models (HMM) are studied. Accuracy results over 85% are achieved, outperforming previous approaches in the literature and in more challenging age group conditions. Finally, the approach presented in this study can benefit many children-related applications, for example, towards an age-appropriate environment with the technology.
BibTeX
@misc{ruizgarcia2024children,
  author = {Juan Carlos Ruiz-Garcia and Carlos Hojas and Ruben Tolosana and Ruben Vera-Rodriguez and Aythami Morales and Julian Fierrez and Javier Ortega-Garcia and Jaime Herreros-Rodriguez},
  title = {{Children Age Group Detection based on Human-Computer Interaction and Time Series Analysis}},
  year = {2024},
  eprint = {2403.04574},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2403.04574},
}
Figure