Counting Who Agrees: Sarcasm-Aware, Multi-Faction Bridging Measurement

Studies of social media find that posts reaching a politically mixed audience get less engagement, and that users who cross ideological lines get fewer upvotes at home. Both findings rest on two measurement shortcuts. The first places everyone on a single left–right line. The second treats any interaction as approval. The second shortcut breaks most quietly on sarcasm, where someone writes "what a brilliant policy" and means the opposite. An out-group reader who mockingly replies to a post looks, under the usual measure, like evidence that the post "bridged" to that group.

This note proposes to rebuild bridging measurement on two corrected footings and then re-test the trade-off. Audiences are split into several factions instead of two poles. Each reply is counted as endorsement or opposition according to what it means, with sarcastic inversion handled explicitly, rather than according to its surface wording. The deliverable is a measurement study. It asks how much of the measured diversity–engagement trade-off, and how much of the "positive language bridges audiences" finding, survives once mockery is no longer counted as reach.

Core Claim

Bridging should be measured as the spread of endorsement across factions, not the spread of interaction across a single ideological axis. Under that measure, the share of apparent cross-faction reach that is actually cross-faction mockery is large enough to change conclusions about the diversity–engagement trade-off.

The test is concentrated on one place: literally positive text. Here sarcasm and genuine bridging look identical to sentiment and toxicity tools, and they should have opposite effects on who endorses a post.

The claim does not depend on any particular sarcasm model. It depends on getting the sign of each interaction right. The sarcasm component is therefore treated as one candidate way of getting signs right, and the experiments test whether it beats simpler signers.

Where This Sits in Prior Work

Three papers establish the phenomenon being re-measured.

Engaging Politically Diverse Audiences on Social Media has three relevant findings:

  • It defines a post's bridginess as the entropy of its retweeters' left–right alignments, which were inferred from the news domains those users share.
  • It finds that positive, specific language predicts higher diversity.
  • In field trials with PBS Frontline, high-bridginess tweets reached more diverse audiences in 7 of 10 cases but drew about 10% fewer clicks.

Political Discourse on Social Media: Echo Chambers, Gatekeepers, and the Price of Bipartisanship shows that cross-partisan sharers lose network centrality and receive fewer retweets and favorites.

Deliberate Exposure to Opposing Views and its Association with Behavior and Rewards on Political Communities matches Reddit users who also post in r/changemyview against similar users who do not. The matched bridge users receive 4.34% to 10.15% fewer upvotes in their home political subreddits.

These papers motivate the proposal, and each also uses one of the two shortcuts:

  • Saveski et al. use a single axis and an endorsement-only signal.
  • Efstratiou bins subreddits along a single left–right continuum.
  • Efstratiou measures hostility with toxicity scores, which do not see polite sarcasm.

The proposal keeps their engagement outcomes and replaces their audience measure.

Three papers constrain how factions should be modeled.

A Measure of Polarization on Social Media Networks Based on Community Boundaries shows that a standard clustering score can match across a hostile network and a pluralistic one. It also finds that in the Twitter gun-control debate, Liberals and Independents share a non-antagonistic boundary (P = −0.14) while Conservatives are antagonistic to both. A one-axis entropy cannot express that a post bridges two allied factions but not the third.

Robust Deep Signed Graph Clustering via Weak Balance Theory supplies the multi-faction clustering method used here, called DSGC. A signed graph is one where each edge is marked positive or negative. DSGC clusters such graphs under weak balance, the rule that "the enemy of my enemy need not be my friend." It reports about 90% accuracy on synthetic five-cluster graphs with 2% sign noise. However, it takes edge signs as given. Its own denoising step is built for scattered noise, not for the systematic, socially patterned errors that sarcasm creates between rival factions.

Quantifying the Echo Chamber Effect: An Embedding Distance-based Approach fuses text and retweet structure into a graph autoencoder and an echo-chamber score that allows any number of clusters. It treats interaction as proximity and text embeddings as literal, which is the failure mode at issue here.

Two papers supply the sign-correction idea.

Intermediate-Task Transfer Learning: Leveraging Sarcasm Detection for Stance Detection shows that stance classifiers mislabel sarcastic "against" text as "in favor." Pre-training on a sarcasm task first corrects 85% of those errors and reaches macro F1 of 0.775 on SemEval 2016 Task 6A. Its companion paper, Sarcasm Detection as a Catalyst, reports that this transfer holds across stance targets. Both papers classify isolated texts toward fixed targets. Neither builds edges between users, models factions, or touches engagement.

iSarcasm: A Dataset of Intended Sarcasm is the cautionary result. Models scoring up to 0.874 F on hashtag-labeled data fall to at most 0.364 on author-labeled sarcasm, and third-party humans reach only 0.616. The proposal therefore cannot assume that a sarcasm detector is reliable. It must measure sign accuracy on in-domain gold data.

The closest older attempt at turning text into signed relations is Detecting Subgroups in Online Discussions by Modeling Positive and Negative Relations among Participants. It infers positive and negative relations between forum participants from their language, using feature-based methods. It does not model inversion and does not connect to engagement.

Research Program

The setting is the Reddit Political Communities Corpus from Efstratiou. It contains about 48.2M comments from 799K authors across r/ChapoTrapHouse, r/SandersForPresident, r/Conservative and r/The_Donald, plus 10.2M r/changemyview comments from 2018. Reddit suits this study for three reasons:

  • Replies carry text and point to a specific parent.
  • Upvote scores give an engagement outcome.
  • Some authors mark their own sarcasm with "/s", which gives a partial in-domain signal of intended sarcasm, the same convention behind the SARC corpus.

Reddit vote totals are public but who cast them is not, so endorsement by faction must come from reply text. This is why the corpus requires solving the sign problem rather than reading votes.

The program has three stages.

Stage one: factions. Users are assigned to factions without forcing a binary split. Faction membership is estimated from where users post. DSGC is then run on the reply graph so that clusters can split or merge relative to subreddit labels. The question is whether, for instance, the two left subreddits behave as one faction or two.

Stage two: signed edges. Every cross-user reply is turned into a signed edge. The label reflects what the reply means toward its parent: endorse, oppose, or neutral. Several signers are compared:

  • a toxicity-threshold rule;
  • a stance-toward-parent classifier;
  • the same classifier with sarcasm intermediate training in the style of Nkhata and Gauch;
  • a prompted large language model.

All are scored against a newly annotated gold set. The gold set is a stratified sample of cross-faction reply pairs labeled for sign by annotators. A subset is enriched with author-marked "/s" replies so that intended sarcasm can be scored separately from sarcasm that annotators perceive.

Stage three: the measure. For a comment $c$, let $e_{c,k}$ be the number of endorsing replies it receives from users in faction $k$, for factions $k = 1, \dots, K$. Endorsement bridginess is the normalized entropy of where endorsement comes from:

$$B(c) = -\frac{1}{\log K}\sum_{k=1}^{K} p_{c,k}\log p_{c,k}, \qquad p_{c,k} = \frac{e_{c,k}}{\sum_j e_{c,j}}.$$

Mockery reach, $M(c)$, is the fraction of a comment's out-faction replies that are opposing but literally positive.

The naive measure, written $B_0$, applies the same entropy to all replies regardless of sign. It is computed both on $K$ factions and on a one-axis binning, which yields a two-by-two grid of measurements: one axis versus $K$ factions, crossed with unsigned versus signed. The analysis then re-runs the published associations under each cell of the grid:

  • engagement (upvotes and reply counts) against bridginess;
  • the bridge-user upvote penalty;
  • literal positive sentiment against diversity.

Effects are estimated within topic and with Efstratiou's matching on activity features. All claims are associational, as in the source studies.

Baselines

The naive reference point is the published measurement itself: entropy over all repliers' alignments on a single left–right axis, with every reply counted as approval. This is the Saveski-style measure transplanted to Reddit replies. If the proposed measure produces the same rankings of comments and the same trade-off slopes as this reference, the proposal has found nothing.

For edge signing, the strongest existing method is the sarcasm-pretrained stance classifier of Intermediate-Task Transfer Learning. It is a BERT/RoBERTa encoder with convolutional and recurrent layers, pre-trained on a sarcasm corpus and then fine-tuned for stance. It reports macro F1 of 0.775 on SemEval 2016 Task 6A and beats zero-shot ChatGPT by an average of 0.038 F1 there.

Here it is adapted to classify a reply's stance toward its parent. It is fine-tuned on the same Reddit gold training split as every other learned signer, with the same hyperparameter search budget. Both SARC (Reddit) and SARCTwitter are tried as the intermediate corpus, since that paper found Reddit-to-Twitter transfer degraded performance and this target domain is Reddit. There is no reported result on Lacuna for reply-to-parent sign classification on this corpus, so its number on the gold set is the bar to beat.

Beating it means one of two things. Either a proposed signer is higher in sign macro F1 on the sarcastic slice of the gold set, with a confidence interval from bootstrap resampling that excludes zero. Or, if no signer beats it, it simply becomes the signer used downstream.

For faction recovery, the strongest methods are DSGC on the signed reply graph and the EchoGAE embedding approach on the unsigned reply graph. Both are run at matched compute on the same graph, and both are scored against held-out subreddit membership and against the gold-set boundary labels. The comparison isolates the effect of edge signs. It runs DSGC on naive signs (all replies positive, or toxicity-signed) and on corrected signs, holding everything else fixed. DSGC's reported ~90% synthetic accuracy is under random noise. Whether it survives structured sarcastic noise is exactly what this comparison measures.

The key ablations are the two axes of the measurement grid, varied one at a time:

  • $K$ factions with unsigned edges;
  • one axis with signed edges;
  • both changes together.

On the sign side, a further ablation removes only the sarcasm intermediate training from the best signer. That tells whether inversion handling, rather than better stance modeling generally, is responsible for any change in the downstream conclusions.

Why not just…?

Why not just ask a large language model to label each reply as agreeing or disagreeing with its parent, and skip sarcasm modeling entirely? This is the most serious threat, and the proposal is built to absorb it rather than argue with it. The scientific claim concerns the measurement of bridging, so a prompted model is a first-class candidate signer.

There is existing evidence that it may fall short. Nkhata and Gauch report zero-shot ChatGPT trailing their sarcasm-pretrained model by 0.038 F1 on SemEval. iSarcasm shows that strong models collapse to 0.364 F on intended sarcasm. Both results are old relative to current models, however, and neither tests reply-toward-parent framing. The sarcastic slice of the gold set settles the question. If the language model matches the sarcasm-pretrained signer there, the paper's method section says so and the sarcasm-specific component is dropped. The faction and engagement findings stand or fall on sign accuracy regardless.

Why not just sign edges with a toxicity classifier, as Efstratiou did for hostility? Toxicity scores respond to insults and slurs, not to polite irony such as "what a brilliant idea to cut transit funding." The proposal's central quantity, mockery reach, is defined as opposing replies with literally positive wording, which is the region a toxicity rule cannot see. The gold set directly measures the toxicity rule's recall on opposing replies, split by whether they are sarcastic. If its recall on sarcastic opposition is close to that on overt opposition, this objection wins and the sarcasm thread of the proposal is unnecessary.

Why not just keep the one-axis entropy and add signs, since American politics is mostly two-sided? Guerra et al.'s gun-control result shows asymmetric three-way boundaries, and the four subreddits here plausibly contain two distinct left factions. Still, it is an empirical question whether $K$ matters for this corpus, so the measurement grid tests it. The decisive quantity is the rank agreement between one-axis-signed and $K$-faction-signed bridginess on the comments that drive the trade-off. If agreement is near perfect, the multi-faction claim is dropped for this corpus and reported as a negative result.

Proposed Experiments

Experiment 1: sign accuracy. This is a component check. All signers are scored on the annotated Reddit gold set, reporting macro F1 overall, on the author-marked "/s" slice, and on the annotator-perceived sarcastic slice. A secondary sanity check uses SemEval 2016 Task 6A and iSarcasm, to confirm that the reimplemented sarcasm-pretrained signer lands near the published 0.775 and that intended-sarcasm detection remains hard. The decisive check is whether any signer reaches usable accuracy on sarcastic opposition. If none does, the downstream measure must carry that uncertainty, which is done by propagating the signer's confusion rates into $B(c)$ through resampling.

Experiment 2: faction recovery under structured sign noise. DSGC and the EchoGAE embedding approach are run on reply graphs built with each signer, and recovered factions are compared with subreddit membership. Two diagnostics are specific to sarcasm. One is whether naive signing merges rival factions, for example through ironic "agreement" between r/ChapoTrapHouse and r/The_Donald. The other is whether DSGC's denoising step repairs these false positive edges or leaves them in place. A synthetic version plants sarcasm-like sign flips concentrated on edges between factions in signed block-model graphs. It contrasts that with the random 2% noise used by Zhao et al., to show whether structured flips are more damaging at equal rates.

Experiment 3: re-measuring the trade-off. This is the main result. Under each cell of the measurement grid, three published associations are re-estimated within topic and with Efstratiou's matching:

  • the slope of engagement on bridginess;
  • the bridge-user upvote penalty;
  • the association between literal positive sentiment and bridginess.

The decisive prediction is about the sentiment association, and it follows from treating sarcasm as faux-positive in-group signalling. Once literally positive comments are split into sincere and sarcastic, the sincere ones should keep or strengthen a positive association with $B$. The sarcastic ones should show low $B$, high mockery reach and high in-faction upvotes.

The headline numbers are two. The first is the fraction of naive cross-faction reach ($B_0$ minus $B$, summed over comments) attributable to opposing replies. The second is how much the engagement–bridginess slope changes between the naive and corrected measures.

Each possible outcome is informative. A large gap would mean published bridging metrics partly count mockery as reach. A negligible gap would mean the simpler measures were adequate and the field can stop worrying about this particular confound.