Introduction
Robots often struggle to transfer skills learned in controlled laboratory settings to the messy, variable real world. A robot trained to scoop pasta in one kitchen may fail if the bowl is moved, the spoon is replaced with a ladle, or the table is rotated. Traditional solutions involve massive datasets covering every possible variation, which is impractical for many applications. This research introduces Tiered Task Abstraction (TTA), a framework designed for data-sparse task transfer. TTA allows robots to generalize skills by selectively "abstracting" or forgetting specific task details, enabling them to handle structural, perceptual, and functional changes without exhaustive retraining.
Tiered Task Abstraction (TTA)
The core of the TTA framework is a mathematical decomposition of a task into a hierarchical chain:
- Action Model ($a$): The fundamental movement trajectory (e.g., a Dynamic Movement Primitive).
- Parameterization Function ($p$): Defines task-specific spatial targets (e.g., "scoop at the surface of the source container").
- Feature Selector ($f$): Identifies relevant environmental entities (e.g., which object is the bowl).
- Feature Values ($E$): Raw sensory inputs.
By moving up the abstraction hierarchy, the robot intentionally discards lower-level information, which must then be "grounded" in the new environment through perception or human input.
The framework defines three primary levels:
- Abstraction 1: Retains the action, parameters, and feature selectors; requires only new feature values (ideal for displaced objects).
- Abstraction 2: Retains the action and parameters; requires re-selecting features (ideal for visually new objects).
- Abstraction 3: Retains only the action model; requires re-learning both parameters and features (necessary for functional changes like new tools).
Experimental Evaluation
The authors evaluated TTA using a 7-DOF Curi robot performing scooping and table-setting tasks across 90 transfer scenarios. These scenarios were categorized into displaced objects, replaced objects (visually different but functionally similar), and new constraints (e.g., rotated scenes or tools with different dimensions).
Key Results
The experiments validated the hierarchy's effectiveness:
- Abstraction 1 achieved 100% success for displaced objects but failed in more complex scenarios.
- Abstraction 2 maintained high success (90-100%) for replaced objects but struggled with functional constraints.
- Abstraction 3 proved the most robust, achieving 70-80% success in the most challenging "New Constraint" scenarios, such as using a long-handled scoop or operating on a rotated table.
Discussion and Future Work
The findings highlight a fundamental trade-off: higher levels of abstraction provide greater generality but require more "grounding" data to be executable. While Abstraction 3 can handle significant environmental shifts, it places a higher demand on the system to fill in the missing parameters.
A current limitation is that grounding information was provided manually in these experiments. Future research will focus on interactive grounding, where robots autonomously use perception or natural language queries to resolve ambiguities in novel environments. This shift toward collaborative grounding aims to make robots more adaptable and less dependent on expert intervention during deployment.
Summary updated