AttentivU: An EEG-Based Closed-Loop Biofeedback System for Real-Time Monitoring and Improvement of Engagement for Personalized Learning

Nataliya Kosmyna, Pattie MaesSensors 2019 · DOI · OpenReview

TL;DR

This paper introduces AttentivU, a novel wearable system that uses EEG to monitor a user's engagement in real-time and provides haptic feedback (vibrations) when engagement drops. The system successfully redirected participants' attention back to learning tasks and improved their performance on comprehension tests, demonstrating the potential for personalized learning interventions.

What Problem Does This Paper Address?

In today's increasingly distracting world, maintaining focus and engagement, especially during learning activities, is a significant challenge. While many systems can measure physiological signals like EEG to infer engagement, most do not close the feedback loop by presenting this information back to the user in real-time. This lack of immediate feedback limits the potential for users to self-regulate their attention and improve their learning outcomes. The authors aim to bridge this gap by developing a closed-loop biofeedback system that actively helps users stay engaged.

Methods

The core of AttentivU consists of two components:

  • EEG Headband (Component 1): A commercial EEG headband (BrainCo Focus 1) with three hydrogel electrodes is used to measure brain activity. The system calculates an "engagement index" (E) based on the ratio of beta to alpha and theta power, a common approach in EEG-based engagement monitoring. This index is smoothed and normalized to a 0-100 scale, with low engagement defined as a score of 0-30.
  • Haptic Feedback Scarf (Component 2): A soft cotton scarf houses two vibration motors controlled by an Arduino board. This scarf delivers subtle, localized haptic feedback (vibrations) to the upper chest area when the EEG headband detects a sustained drop in engagement (low engagement for at least 15 seconds).

The system was evaluated in two studies:

  • Study 1 (Lab-based): 36 participants watched three video lectures. They were assigned to one of three conditions: biofeedback (vibrations triggered by low engagement), random feedback (vibrations at random intervals), or no feedback.
  • Study 2 (Classroom-based): 12 participants attended three live lectures in a real classroom setting, with similar feedback conditions.

Datasets

The paper does not describe the use of pre-existing datasets for training. Instead, it focuses on the real-time data collection and analysis from participants during experimental sessions. The studies themselves can be considered as generating new benchmarks for evaluating closed-loop biofeedback systems in learning contexts.

Key Insights and Ideas

  • The power of closed-loop biofeedback: The most significant insight is that providing real-time, personalized haptic feedback directly linked to engagement levels can effectively redirect attention and improve learning. This moves beyond passive monitoring to active intervention.
  • Subtle haptic feedback is key: The use of a scarf for vibrations was generally well-received, suggesting that subtle, non-intrusive haptic feedback can be effective without being bothersome. The low intensity vibration (0.3g at 40Hz) was found to be noticeable yet comfortable.
  • EEG engagement index is a viable measure: The study validates the use of a consumer-grade EEG headband and a well-established engagement index formula for real-time monitoring in learning scenarios.
  • Form factor matters for adoption: While the scarf was appreciated, the EEG headband received mixed reviews, highlighting the importance of developing more discreet and comfortable form factors for wider adoption.

Key Results

  • Increased Engagement: Participants in the biofeedback condition reported significantly higher perceived engagement (Study 1: 4.52/5 vs. 2.38/5 for random, 1.02/5 for no feedback) and showed higher EEG-based engagement scores (Study 1: 51.72 vs. 35.32 for random, 28.07 for no feedback). This was consistent across both studies.
  • Improved Learning Performance: The biofeedback group demonstrated better performance on content tests, scoring higher on comprehension questions compared to the random and no feedback groups (Study 1: 7.346 vs. 5.27 for random, 4.38 for no feedback; Study 2: 6.865 vs. 3.67 for random, 2.68 for no feedback).
  • Positive User Perception: The haptic feedback component (scarf) was generally perceived positively, with users appreciating its ability to help them stay focused, especially when they felt themselves dozing off.

Limitations and Future Work

  • Form Factor: The EEG headband received mixed reviews, with participants desiring slimmer and less heavy designs. Future work will explore alternative form factors like magnetic clips and integrated glasses that combine EEG and EOG sensors.
  • Motion Artifacts: The system's reliance on a consumer-grade EEG headband makes it susceptible to motion artifacts, which were mitigated by instructing participants to minimize movement. Future work may involve more robust signal processing or alternative sensing modalities.
  • Realism of Experiments: The studies had limitations in realism, such as prohibiting note-taking or questions during lectures, which are common in actual learning environments. Future studies aim to test the system in more naturalistic classroom settings.
  • Momentary vs. Long-Term Learning: The study focused on "momentary learning performance" (immediate results). Further research is needed to assess long-term learning gains and potential habituation effects.
  • Ethical Considerations: The authors acknowledge the need to investigate long-term consequences, potential depletion of "reserve of attention," and privacy concerns. They plan to explore the system's use with minors and populations with ADHD.
  • Engagement Detection Algorithms: While the current engagement index is well-documented, further research into new algorithms and incorporating additional features (e.g., daily mood) could improve detection accuracy.

Summary updated

Abstract

Information about a person’s engagement and attention might be a valuable asset in many settings including work situations, driving, and learning environments. To this end, we propose the first prototype of a device called AttentivU—a system that uses a wearable system which consists of two main components. Component 1 is represented by an EEG headband used to measure the engagement of a person in real-time. Component 2 is a scarf, which provides subtle, haptic feedback (vibrations) in real-time when the drop in engagement is detected. We tested AttentivU in two separate studies with 48 adults. The participants were engaged in a learning scenario of either watching three video lectures on different subjects or participating in a set of three face-to-face lectures with a professor. There were three conditions administrated during both studies: (1) biofeedback, meaning the scarf (component 2 of the system) was vibrating each time the EEG headband detected a drop in engagement; (2) random feedback, where the vibrations did not correlate or depend on the engagement level detected by the system, and (3) no feedback, when no vibrations were administered. The results show that the biofeedback condition redirected the engagement of the participants to the task at hand and improved their performance on comprehension tests.
BibTeX
@article{kosmyna2019attentivu,
  author = {Nataliya Kosmyna and Pattie Maes},
  title = {{AttentivU: An EEG-Based Closed-Loop Biofeedback System for Real-Time Monitoring and Improvement of Engagement for Personalized Learning}},
  journal = {Sensors},
  year = {2019},
  doi = {10.3390/s19235200},
}
Figure