Longitudinal Analysis and Quantitative Assessment of Child Development through Mobile Interaction

Juan Carlos Ruiz-Garcia, Ruben Tolosana, Ruben Vera-Rodriguez, Aythami Morales, Julian Fierrez, Javier Ortega-Garcia, Jaime Herreros-RodriguezarXiv 2024 · DOI · arXiv

TL;DR

This paper introduces ChildCIdbLong, the largest public longitudinal database tracking how children (aged 18 months to 8 years) interact with mobile devices over four years. Alongside the dataset, the authors propose Test Quality ($Q$), an automated, quantitative metric that uses touch and stylus gestures to objectively evaluate a child's motor and cognitive development.

What Problem Does This Paper Address?

As mobile device usage among young children becomes nearly universal, researchers and clinicians are eager to understand its relationship with childhood development. Traditional developmental assessment tools (like the Bayley-III or MABC-2 scales) are the gold standard, but they are time-consuming, require manual administration by specialists, and are highly qualitative.

Furthermore, existing studies on children's screen time rely heavily on subjective, parent-reported questionnaires, which are notoriously inaccurate. This paper addresses the lack of objective, automated, and quantitative tools capable of tracking fine motor and cognitive milestones directly through a child's natural interaction with touchscreens.

Methods

The researchers designed an app containing six distinct tests, divided into two main blocks:

  1. Touch Analysis: Tap and Reaction Time, Drag and Drop, Zoom In, and Zoom Out.
  2. Stylus Analysis: A Spiral Test (line-following) and a Drawing Test (coloring a tree).
Fig. 1: Graphical representation of the different interfaces designed in ChildCIdbLong, which comprises 6 different data acquisitions from January 2020 to October 2022. Two main acquisition blocks are considered: i) touch, and ii) stylus.

To turn these interactions into actionable data, the authors developed the Test Quality ($Q$) metric, which scores performance from 0% to 100%:

  • For Touch Tests: $Q$ balances the total time taken ($p_{time}$) with the efficiency of interaction ($p_{taps}$, penalizing accidental or excessive tapping).
  • For the Spiral Test: The algorithm uses Dynamic Time Warping (DTW) to compare the child's stroke against four optimal adult templates, measuring path deviation regardless of whether the child drew inside-out or outside-in.
  • For the Drawing Test: $Q$ calculates the percentage of the target area colored ($R0$) while applying strict pixel-counting penalties if the child colors outside the lines into concentric outer zones ($R1$ to $R4$).
Concentric penalty regions defined for the tree drawing test.

Datasets

The study introduces ChildCIdbLong, a unique longitudinal dataset collected across six sessions between January 2020 and October 2022:

  • Participants: 615 unique children aged 18 months to 8 years.
  • Data Volume: Over 2,100 individual sessions yielding more than 12,600 test acquisitions.
  • Control Group: 77 healthy adults (aged 25–65) to establish baseline "perfect" performance benchmarks.

The dataset also includes rich metadata, such as gender, handedness, prematurity, academic grades, and pre-existing cognitive disorders (e.g., ADHD or language delays).

Key Insights and Ideas

  • The Stylus vs. Touch Divide: Interestingly, by age 5 to 8, children's stylus skills (drawing and line-following) closely approach adult levels of proficiency. However, their performance on basic touch tests (like tapping and dragging) still lags behind adults. The authors hypothesize this is because the touch tests are gated by cognitive factors like reasoning and reaction time, rather than pure motor control.
  • Pinch Gestures are Hard: Multi-touch gestures like zooming in/out remain a massive hurdle for children under 5, with average $Q$ scores staying below 38%. This highlights a clear boundary for UX/UI designers creating apps for toddlers.
  • Growth Charts for the Mind: By applying traditional WHO-style percentile growth curves (10th, 50th, 90th percentiles) to the $Q$ metric, the authors created a framework to map out "typical" digital development.

Key Results

The $Q$ metric successfully validated expected developmental trajectories across age groups:

  • Toddlers (18M–2Y): Struggled significantly, scoring average $Q$ values below 20% for touch and 30% for stylus tasks, confirming they are in the earliest stages of motor coordination.
  • Preschoolers (3Y–5Y): Showed massive leaps in stylus control, jumping from a $Q$ of 26.4% to 73.9% on the spiral test.
  • Clinical Utility: To prove its diagnostic potential, the authors tracked a typically developing (TD) child against a child with an expressive language disorder (NTD) over three years. While the TD child consistently scored above the 50th percentile, the NTD child dropped below the 10th percentile as tasks grew more complex, demonstrating how the system can flag developmental anomalies automatically.
Longitudinal tracking of a typically developing child vs. a child with a language disorder over 3 years.

Limitations and Future Work

While the results are promising, the authors note that more work is required to explicitly map the $Q$ metric scores to specific clinical conditions (like ADHD or autism spectrum disorders).

Future iterations of the project will focus on expanding the database to include a wider cohort of participants and defining new interaction variables that map directly to classical cognitive domains, such as visuo-spatial processing, attentional control, and executive function.

Summary updated

Abstract

This article provides a comprehensive overview of recent research in the area of Child-Computer Interaction (CCI). The main contributions of the present article are two-fold. First, we present a novel longitudinal CCI database named ChildCIdbLong, which comprises over 600 children aged 18 months to 8 years old, acquired continuously over 4 academic years (2019-2023). As a result, ChildCIdbLong comprises over 12K test acquisitions over a tablet device. Different tests are considered in ChildCIdbLong, requiring different touch and stylus gestures, enabling the evaluation of praxical and cognitive skills such as attentional, visuo-spatial, and executive, among others. In addition to the ChildCIdbLong database, we propose a novel quantitative metric called Test Quality (Q), designed to measure the motor and cognitive development of children through their interaction with a tablet device. In order to provide a better comprehension of the proposed Q metric, popular percentile-based growth representations are introduced for each test, providing a two-dimensional space to compare children's development with respect to the typical age skills of the population. The results achieved in the present article highlight the potential of the novel ChildCIdbLong database in conjunction with the proposed Q metric to measure the motor and cognitive development of children as they grow up. The proposed framework could be very useful as an automatic tool to support child experts (e.g., paediatricians, educators, or neurologists) for early detection of potential physical/cognitive impairments during children's development.
BibTeX
@misc{ruizgarcia2024longitudinal,
  author = {Juan Carlos Ruiz-Garcia and Ruben Tolosana and Ruben Vera-Rodriguez and Aythami Morales and Julian Fierrez and Javier Ortega-Garcia and Jaime Herreros-Rodriguez},
  title = {{Longitudinal Analysis and Quantitative Assessment of Child Development through Mobile Interaction}},
  year = {2024},
  eprint = {2404.06919},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2404.06919},
}
Figure