Collaborative Interface Agents

Yezdi Lashkari, Max Metral, Pattie MaesAAAI 1994 · OpenReview

Abstract

Learning interface agents are designed to assist users by observing their behavior and automating repetitive tasks. However, these agents typically face a "cold start" problem, requiring a lengthy period of observation before they can make reliable predictions. This paper introduces a collaborative framework that allows agents to share knowledge and expertise. By implementing a decentralized protocol and trust-modeling system, novice agents can consult experienced peers to provide immediate, high-confidence assistance. Experimental results demonstrate that collaboration effectively eliminates the initial learning lag, enabling agents to be useful from their first interaction.

Introduction

In the early 1990s, the paradigm for AI assistants shifted from rigid, rule-based systems toward "learning interface agents." These agents aim to reduce user workload by detecting patterns in tasks such as email management or meeting scheduling. Despite their potential, learning agents face two significant challenges: the slow learning curve and limited competence. An agent starting with zero knowledge requires many examples before its confidence reaches a threshold where it can safely suggest actions. Furthermore, an agent's knowledge is restricted to its specific user's history, leaving it ill-equipped for novel situations.

To address these issues, we propose that agents should not learn in isolation. Instead, they should participate in a social network of agents, allowing them to "ask a friend" when faced with uncertainty.

Methods

The proposed system combines individual learning with a social collaboration protocol.

Individual Learning: Object-Based MBR

The core learning mechanism is Memory-Based Reasoning (MBR). When a user performs an action, the agent stores a "situation-action" pair. For new situations, the agent identifies the most similar historical matches. Our "Object-Based MBR" improves upon simple string matching by treating data as objects with hierarchical properties (e.g., a "Person" object with a specific "Role"). This allows for better generalization across similar but not identical entities.

The Collaboration Protocol

To facilitate knowledge sharing, we developed a decentralized framework:

  1. Bulletin Board Agent: Acts as a registry for agents to list their expertise.
  2. Request-for-Prediction: When an agent lacks sufficient confidence, it broadcasts the situation to its peers. Peers respond with a predicted action and a confidence score.
  3. Trust Modeling: Agents maintain a trust value (between 0 and 1) for each peer. Trust increases with correct predictions and decreases with confident but incorrect ones. This allows agents to learn which peers are reliable for specific types of tasks.

Results

The system was evaluated using real-world email data from two graduate students, representing a "Novice" agent (Calvin) and an "Expert" agent (Hobbes).

Without collaboration, the novice agent's confidence grew slowly. As shown in Figure 1, it required approximately 40 examples before its confidence consistently crossed the threshold for active suggestion. The learning curve is characterized by a gradual, jagged ascent as the agent slowly builds its internal memory.

Learning curve of an individual agent without collaboration.

In contrast, the collaborative approach yielded immediate benefits. By consulting the expert agent, the novice agent achieved high confidence from the very first message. As illustrated in Figure 2, the confidence trend line remains high and stable, effectively bypassing the cold-start period.

Learning curve of a collaborative agent leveraging peer knowledge.

Discussion and Limitations

While collaborative agents offer a significant performance boost, several challenges remain. The computational intensity of MBR was a concern for 1990s hardware, though less so today. More critically, collaboration depends on a shared ontology; agents must agree on the meaning of data fields to communicate effectively.

Privacy also presents a complex trade-off. While agents can selectively disclose features of a situation to protect user data, sharing behavioral patterns across a network necessitates robust privacy-preserving mechanisms. Future work should explore more sophisticated Bayesian trust strategies and advanced privacy protocols to further refine the social learning paradigm.

Conclusion

Collaborative interface agents transform individual learning into a social process. By leveraging the collective experience of a network, agents can overcome the limitations of isolated learning, providing immediate value to users and handling a broader range of situations with high confidence.

Summary updated

BibTeX
@inproceedings{lashkari1994collaborative,
  author = {Yezdi Lashkari and Max Metral and Pattie Maes},
  title = {{Collaborative Interface Agents}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {1994},
  url = {https://openreview.net/forum?id=fDQDANYME3U},
}

Loading related content...

Figure