Implications of Personality on Cognitive Workload, Affect, and Task Performance in Remote Robot Control

Go-Eum Cha, Wonse Jo, Byung-Cheol Min

Introduction

In the high-stakes domains of remote surveillance and disaster response, the "human in the loop" remains the most critical variable in system success. While research has extensively covered how transient states—such as fatigue, stress, or sleep deprivation—impact operator performance, the influence of stable, long-term personality traits remains less explored. This study investigates whether an operator's personality, specifically the "Big Five" traits, can predict their performance and mental workload during remote robot teleoperation.

The researchers sought to determine if an individual's inherent personality influences how they process information and perform when controlling multiple robots. Understanding these relationships could allow organizations to better select operators for specific missions or, more importantly, design "personality-aware" robot interfaces that adapt to the specific needs of the user.

Methodology

Experimental Design

The study utilized the MOCAS (Multi-modal Objective Cognitive Assessment on Simultaneous tasks) dataset, an open-access resource containing physiological signals, facial videos, and subjective questionnaires from high-workload teleoperation scenarios.

Twenty-one participants performed a simulated CCTV monitoring task where they monitored feeds from patrol robots to detect and click on "abnormal objects." To vary the cognitive load, the researchers manipulated two primary variables:

  • Number of Cameras: 1, 2, or 4 feeds.
  • Robot Speed: 100, 200, or 300 mm/s.

These combinations created nine distinct levels of task difficulty.

Psychometric and Statistical Analysis

Participants were assessed using the Big-Five Factor Markers (FFM):

  1. Extroversion (PE)
  2. Emotional Stability (PES)
  3. Agreeableness (PA)
  4. Conscientiousness (PC)
  5. Intellect/Imagination (PII)

The analysis pipeline integrated Pearson Correlation to identify linear relationships, Exploratory Factor Analysis (EFA) to group variables into latent categories (Workload, Performance, and Personality), and Structural Equation Modeling (SEM) to determine the "total effect" of personality on task outcomes.

Key Insights and Discussion

The Extroversion Advantage

Extroversion emerged as the strongest personality predictor, showing a positive correlation with both mission scores ($\gamma = .148, p < .05$) and subjective arousal ($\gamma = .335, p < .01$). Extroverts appear to thrive in high-stimulus environments, potentially maintaining higher levels of engagement that lead to prompter behavioral responses in the teleoperation interface.

The "Agreeableness Trap"

Counterintuitively, high agreeableness was linked to a lower success rate ($\gamma = -.153, p < .05$). The authors hypothesize an "optimistic bias" where agreeable individuals might be more prone to clicking "abnormal" objects too quickly or uncritically, leading to a higher frequency of penalized false positives.

The Conscientiousness Paradox

While conscientiousness is typically a strong predictor of job performance, it did not provide a significant benefit in this specific fast-paced task. The researchers suggest that highly conscientious individuals might over-regulate their movements or suppress natural gestures, which may actually hinder performance in a high-speed, point-and-click GUI environment.

Task Difficulty vs. Personality

Perhaps the most significant finding was that the technical difficulty of the task—robot speed and the number of camera feeds—was a far more robust driver of performance than personality. While personality provides a "tint" to the operator's experience and affect, it does not fundamentally change the outcome as much as the system's design and operational parameters. This was confirmed by the SEM, which rejected the hypothesis that personality has a significant total effect on performance ($p = .154$).

Conclusion and Future Directions

While the study confirmed that increasing robot speed and camera count successfully increased cognitive load (verified via NASA-TLX and ISA scores), the influence of personality remains secondary to task design.

However, the findings point toward the potential for adaptive systems. Rather than simply selecting operators based on personality traits, future robotic interfaces could detect an operator's personality-driven stress response in real-time. Such a system could automatically reduce the number of camera feeds or slow down robot movement to maintain an optimal workload balance, ensuring mission success across a diverse range of operator profiles.

Supplementary Video: Watch the experiment in action

Summary updated

BibTeX
@inproceedings{cha2023implications,
  author = {Go-Eum Cha and Wonse Jo and Byung-Cheol Min},
  title = {{Implications of Personality on Cognitive Workload, Affect, and Task Performance in Remote Robot Control}},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
  year = {2023},
  url = {https://openreview.net/forum?id=iDbtrcV4la},
}
Figure