Traditional sentiment analysis often treats text as a "bag of words" or evaluates sentences as completely isolated units. This independence assumption breaks down because human language is inherently structured and narrative. The emotional charge of a sentence does not exist in a vacuum; it is deeply influenced by its neighbors.
As noted in Sentiment identification by incorporating syntax, semantics and context information by Kunpeng Zhang et al., ignoring this contextual flow leads to systemic inaccuracies when interpreting complex, multi-sentence documents. When sentences are classified independently, models miss the thematic trajectory and contextual charge that define the overall document polarity.
The Principle of Context Coherency
Why does looking at adjacent sentences help? The core intuition relies on context coherency: the linguistic tendency for sentiment polarity to remain stable across neighboring clauses and sentences unless an explicit interruption occurs. In Fully Automatic Lexicon Expansion for Domain-oriented Sentiment Analysis, Hiroshi Kanayama et al. leverage this stability to automatically discover domain-specific sentiment words, demonstrating that sentiment naturally propagates through text.
This sequential dependency acts as a powerful regularizer. When a specific sentence is ambiguous or lacks explicit emotional keywords, its neighbors provide a contextual anchor. By formalizing these relationships, models can propagate sentiment labels from clear, high-confidence sentences to resolve nearby ambiguity, as demonstrated by Bishan Yang et al. in Context-aware Learning for Sentence-level Sentiment Analysis with Posterior Regularization.
Formalizing Flow via Sequence Models
To capture these dynamics mathematically, researchers shift from static classifiers to sequence models that treat sentiment as a series of dependent states.
- Markov Chains: Instead of viewing a document as an unordered collection of words, Fangtao Li et al. introduce a Markov chain approach in Sentiment Analysis with Global Topics and Local Dependency. Here, a transition variable explicitly determines the sentiment of the current word based on the state of the preceding word, capturing the natural flow of human expression.
- Conditional Random Fields (CRFs): At the sentence level, CRFs are widely used to map the structural flow of an entire document. In Isotonic Conditional Random Fields and Local Sentiment Flow, Yi Mao et al. enforce monotonicity constraints on CRF parameters to track how sentiment shifts sentence-by-sentence. Similarly, 47/2026-1 et al. use CRFs in Adding Redundant Features for CRFs-based Sentence Sentiment Classification to integrate label hierarchies, reducing error propagation across sequential predictions.
- Recurrent Neural Networks: Moving into deep learning, Bing Qin et al. employ gated neural networks in Document Modeling with Gated Recurrent Neural Network for Sentiment Classification to model the hierarchical semantic flow from sentences to documents, capturing discourse-level shifts natively within the network architecture.
Discourse Markers and Transition Dynamics
Sentiment does not just stay constant; it transitions logically. Discourse markers (e.g., "but", "however", "although") and valence shifters act as operators that flip, intensify, or weaken emotional states.
Sequence models excel at capturing these structural inflection points. For instance, in Emotion Classification in Microblog Texts Using Class Sequential Rules, Shiyang Wen et al. represent text as sequences of itemsets combining local sentiment labels with discourse conjunctions. This allows the model to learn explicit rules for how transitions occur. Furthermore, the authors show that the sequential order matters: emotions appearing toward the end of a narrative often carry significantly more weight in determining the global sentiment than those at the beginning.
Abstracting Rhetorical Structure
One of the most compelling reasons this approach works is that it allows models to abstract away from highly domain-specific lexical content. By transforming a text into a pure sequence of local sentiment states (e.g., Positive $\rightarrow$ Neutral $\rightarrow$ Negative), models can analyze the underlying rhetorical and argumentative structure of a document.
In Sentiment Flow - A General Model of Web Review Argumentation, Henning Wachsmuth et al. demonstrate that this structural abstraction enables robust cross-domain sentiment prediction. Because the fundamental flow of argumentation remains consistent—regardless of whether a user is reviewing a hotel or a movie—modeling the sequence of transitions proves far more resilient than relying on volatile, domain-dependent words.
Key Foundational Work
Isotonic Conditional Random Fields and Local Sentiment Flow (2006) — contributed 1 concept elements to this direction.
Adding Redundant Features for CRFs-based Sentence Sentiment Classification (2008) — contributed 1 concept elements to this direction.
Fully Automatic Lexicon Expansion for Domain-oriented Sentiment Analysis (2006) — contributed 1 concept elements to this direction.