Train Once for All: A Transitional Approach for Efficient Aspect Sentiment Triplet Extraction

Xinmeng Hou, Lingyue Fu, Chao Meng, Kounianhua Du, Hai Hu

TL;DR

Trans-AOPE/ASTE is the first transition-based model for joint aspect-opinion extraction, reducing the task's complexity to linear time ($O(n)$). By learning structural transition actions rather than just token patterns, the model achieves new state-of-the-art results across multiple benchmarks, particularly when trained on combined datasets from different domains.

What Problem Does This Paper Address?

In Aspect-Based Sentiment Analysis (ABSA), researchers aim to extract triplets: the aspect (e.g., "service"), the opinion (e.g., "welcoming"), and the sentiment (e.g., positive). This is known as Aspect Sentiment Triplet Extraction (ASTE).

Current approaches face two major hurdles:

  1. Disconnected Extraction: Many models extract aspects and opinions independently before trying to pair them. This leads to "error propagation"—if the model misses an aspect, it can't possibly form the correct triplet.
  2. High Computational Cost: State-of-the-art models often use 2D matrix tagging to capture relationships between all possible pairs of tokens. This results in $O(n^2)$ time complexity, making them slow and memory-intensive for long sentences.

Methods

The authors introduce a transition-based framework inspired by dependency parsing. Instead of looking at the whole sentence as a grid, the model uses a stack and a buffer to process tokens one by one.

The Transition Mechanism

The model navigates the sentence using seven specific actions:

  • Default Actions: Shift (move token to buffer) and Stop.
  • Primary Actions: Merge (combine tokens into a multi-word span like "gourmet food"), Left/Right Constituent Removal.
  • Secondary Actions: Left/Right-Relation Formation (creating the actual link between an aspect and an opinion).

Neural Architecture & Optimization

  • Encoder: Uses RoBERTa for initial token representations and BiLSTMs to capture the state of the stack and buffer.
  • Contrastive-Augmented Optimization: To make action predictions more robust, the authors add a contrastive loss term. This "sharpens" the model's internal representations by pushing predicted action embeddings closer to their true counterparts in the embedding space.
  • Linear Complexity: Because the model processes the sequence in a single pass (with a finite number of actions per token), it operates in $O(n)$ time.

Datasets

The model was evaluated on four standard SemEval benchmarks:

  • 14lap: Laptop reviews (SemEval-2014).
  • 14res, 15res, 16res: Restaurant reviews (SemEval 2014, 2015, 2016).

The authors specifically highlight a "Combined-train" setting, where the model is trained on a mix of these datasets to see if it can learn universal parsing actions.

Key Insights and Ideas

  • Actions over Entities: Transition-based models learn how to connect things (the actions) rather than just memorizing what things look like (the tokens). This mitigates entity-level bias and allows the model to generalize better.
  • The "Train Once for All" Advantage: The most striking finding is that training on multiple domains (e.g., laptops + restaurants) significantly boosts performance on all of them. For example, adding restaurant data to the laptop training set catapulted the F1 score from ~51 to ~85.
  • Contextual Pairing: By performing extraction and pairing jointly through transitions, the model captures position-aware relationships more effectively than pipeline methods.

Key Results

  • Efficiency: Trans-ASTE has the smallest memory footprint and fastest training time per batch compared to top-tier baselines like MiniConGTS and BARTABSA.
  • State-of-the-Art (SOTA): In the combined training setting, the model achieved new SOTA results on all four datasets.
  • Performance Jumps: On the 14lap dataset (AOPE task), the model's F1 score jumped by roughly 20 points (from 60.43 to 85.94) when moving from single-dataset to multi-dataset training.
  • Ablation: The contrastive loss was shown to accelerate convergence and yield higher final accuracy compared to standard cross-entropy loss alone.

Limitations and Future Work

  • Data Hunger: The model's strength—learning action patterns—is also its weakness. It requires larger or more diverse datasets to learn a sufficiently robust set of actions. When trained on a single, small dataset, it sometimes trails behind $O(n^2)$ models.
  • Sentiment Transfer: While the model is excellent at transferring "aspect-opinion" structures across domains, transferring "sentiment-polarity" labels is more fragile. The authors noted a performance dip in sentiment tagging when evaluating on a domain (laptops) that was not well-represented in the sentiment-labeled training mix.
  • Future Directions: The authors suggest exploring these models in other sentiment-related tasks and improving the cross-domain transferability of the sentiment tagger specifically.

Summary updated

Abstract

Aspect-Opinion Pair Extraction (AOPE) and Aspect Sentiment Triplet Extraction (ASTE) have drawn growing attention in NLP. However, most existing approaches extract aspects and opinions independently, optionally adding pairwise relations, often leading to error propagation and high time complexity. To address these challenges and being inspired by transition-based dependency parsing, we propose the first transition-based model for AOPE and ASTE that performs aspect and opinion extraction jointly, which also better captures position-aware aspect-opinion relations and mitigates entity-level bias. By integrating contrastive-augmented optimization, our model delivers more accurate action predictions and jointly optimizes separate subtasks in linear time. Extensive experiments on four commonly used ASTE/AOPE datasets show that, our proposed transition-based model outperform previous models on two out of the four datasets when trained on a single dataset. When multiple training sets are used, our proposed method achieves new state-of-the-art results on all datasets. We show that this is partly due to our model’s ability to benefit from transition actions learned from multiple datasets and domains. Our code is available at https://github.com/Paparare/trans_aste. © 2025 Association for Computational Linguistics.
BibTeX
@misc{hou2024train,
  author = {Xinmeng Hou and Lingyue Fu and Chao Meng and Kounianhua Du and Hai Hu},
  title = {{Train Once for All: A Transitional Approach for Efficient Aspect Sentiment Triplet Extraction}},
  year = {2024},
  eprint = {2412.00208},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2412.00208},
}
Figure