Collective Problem-Solving of Groups Across Tasks of Varying Complexity

Abdullah Almaatouq, Ming Yin, Duncan J. WattsPsyArXiv 2020 · DOI

TL;DR

This paper investigates how group composition and task complexity affect collective problem-solving performance. They found that groups are more efficient than individuals on complex tasks but less so on simple ones, and crucially, that average individual skill level is the most dominant predictor of group success, overshadowing factors like social perceptiveness or diversity.

What Problem Does This Paper Address?

Organizations increasingly rely on teams, but there's a persistent lack of understanding about how to best form and manage them. Specifically, it's unclear:

  • When do groups actually outperform individuals?
  • Which individual attributes best predict group success?
  • How does task complexity influence these relationships?

This ambiguity makes it difficult for managers to make informed decisions about team formation, leading to potential inefficiencies and suboptimal outcomes.

Methods

The researchers designed a novel "two-phase" experiment:

  • Phase 1: Participants completed a series of room assignment tasks of varying complexity and a "Reading the Mind in the Eyes" (RME) test to measure individual skill and social perceptiveness.
  • Phase 2: Participants were then randomly assigned to either individual or group conditions to solve similar tasks. Crucially, they used a block randomization scheme to intentionally oversample less common combinations of individual attributes (e.g., high skill and high social perceptiveness), increasing statistical power. They also systematically varied task complexity across a wide range without changing the task's nature.

This approach allowed them to simultaneously investigate multiple group composition attributes and their interaction with task complexity, focusing on out-of-sample prediction of collective performance.

Datasets

The study used data collected from 1200 participants recruited via Amazon Mechanical Turk. The primary dataset consists of performance metrics from the room assignment tasks and RME test scores. No external datasets were used for training or evaluation.

Key Insights and Ideas

  • Complexity is King (for efficiency): Groups only outperform individuals in terms of efficiency (score per unit time) when tasks become complex. For simpler tasks, individuals can be more efficient. This challenges the notion that groups are always more efficient.
  • Skill Trumps All: The average skill level of group members is overwhelmingly the most important factor for group performance, far outweighing social perceptiveness, skill diversity, or cognitive style diversity. This suggests a strong "sum of parts" effect when it comes to raw ability.
  • Diversity's Double-Edged Sword: Contrary to some popular beliefs, skill diversity was found to be negatively associated with collective performance. Cognitive style diversity showed no consistent significant effect. This implies that for this specific type of task, homogeneity in skill might be more beneficial.
  • "Solution-Oriented" Approach: The study emphasizes a practical, "solution-oriented" approach, aiming to provide actionable insights for managers rather than just theoretical exploration.

Key Results

  • Groups vs. Individuals: Groups outperformed comparable individuals on average, but performed worse than "nominal groups" (where only the best individual's performance is considered).
  • Complexity Interaction: Groups were more efficient than individuals on complex tasks, but less efficient on simple tasks.
  • Predictive Power: Average skill level accounted for approximately 80% of the explained variance in group performance, significantly more than other factors.
  • Skill Dominance: A model predicting group performance using only skill level achieved an R² of 0.19, which was only slightly improved by adding other factors like social perceptiveness and skill diversity.

Limitations and Future Work

  • Task Specificity: The study focused on a single type of task (Constraint Satisfaction and Optimization Problems - CSOPs). The authors acknowledge that findings might not generalize to other task types (e.g., creative problem-solving, process improvement).
  • Future Directions: The authors suggest extending this "virtual lab" approach to qualitatively different tasks, varying group size, incentives, communication patterns, and other interaction parameters. A comprehensive research program systematically varying task types and contextual factors is proposed to advance the science of collective problem-solving.

Summary updated

Abstract

As organizations gravitate to group-based structures, the problem of improving performance through judicious selection of group members has preoccupied scientists and managers alike. However, it remains poorly understood under what conditions groups outperform comparable individuals, which individual attributes best predict group performance, or how task complexity mediates these relationships. Here we describe a novel two-phase experiment in which individuals were evaluated on a series of tasks of varying complexity; then randomly assigned to solve similar tasks either in groups of different compositions or as individuals. We describe two main sets of findings. First, while groups are more efficient than individuals and comparable “nominal group” when the task is complex, this relationship is reversed when the task is simple. Second, we find that average skill level dominates all other factors combined, including social perceptiveness, skill diversity, and diversity of cognitive style. Our findings illustrate the utility of a “solution-oriented” approach to identifying principles of collective performance.
BibTeX
@misc{almaatouq2020collective,
  author = {Abdullah Almaatouq and Ming Yin and Duncan J. Watts},
  title = {{Collective Problem-Solving of Groups Across Tasks of Varying Complexity}},
  year = {2020},
  doi = {10.31234/osf.io/ra9qy},
  howpublished = {PsyArXiv},
}

Loading related content...

Figure