Pointing Instead of Thinking: Extractive Edit Plans for De-stigmatizing Clinical Text

Clinical notes often describe patients in stigmatizing terms such as "addict," "drug-seeking," or "non-compliant." A tool that rewrites this language into neutral, person-first wording would be useful. The same tool must not change a single dosage, lab value, or clinically relevant behavior. Two findings pull in opposite directions here. Having a model first explain why a sentence is offensive, and only then rewrite it, helps detoxification: this is chain-of-thought prompting, where the model writes intermediate reasoning before its answer (DetoxLLM). But in clinical text, chain-of-thought hurts 82 of 95 models. Longer reasoning makes models bring in outside medical knowledge and corrupt numbers, which the authors call the "length trap" (Why Chain of Thought Fails in Clinical Text Understanding).

We propose to resolve this tension by changing what the intermediate step is allowed to contain. The model does not reason in free text. It writes an extractive edit plan: a short record whose content is only quoted spans from the source note, each tagged with one of three fixed labels. "Stigmatizing framing" spans are rewritten. "Clinical fact" spans are copied verbatim. "Irreducible" spans are content that is negative because it is true, such as a documented threat to staff, and are kept and flagged. The rewrite is then decoded under a hard constraint that copies protected spans exactly. Our claim is that the benefit of deliberation in detoxification comes from locating spans, not from elaborating. A plan that can only point at the source should keep that benefit while making the length trap impossible by construction.

Core Claim

In professional-domain detoxification, the dominant failure is not leftover toxicity but over-sanitization: the system deletes or softens content that is clinically true, which is the domain version of the "generic safe text" problem. Direct prompting and word lists cannot tell a derogatory label ("opioid abuser") from a factual finding that shares vocabulary ("urine positive for opioids"). Free-form reasoning can tell them apart, but it drifts from the source.

We predict that extractive plans will match free chain-of-thought on stigma removal. We also predict they will match or beat direct prompting on fact preservation. The advantage should be concentrated on a contrast set where negative-sounding content is factual.

The idea departs from DetoxLLM in two ways. DetoxLLM's reasoning step is free-form explanation trained on jailbroken synthetic data from social media. Its meaning check is a general BERT paraphrase detector with 82.73% accuracy on general text, not on clinical text. Our intermediate step is restricted to source spans and closed labels, and we evaluate it on clinical text.

Research Program

The method has three components that can be tested separately. The first is the plan format. The model outputs quoted spans with labels drawn from the Link and Phelan stigma taxonomy used in Words Matter (labeling, stereotyping, separation, discrimination), plus the "clinical fact" and "irreducible" labels. We check mechanically that every quoted span appears in the source; plans that fail this check are regenerated.

The second component is the constrained rewrite. Spans labeled as clinical facts, together with all numbers, units, and abbreviations found by a clinical concept extractor, are forced to appear verbatim through lexically constrained decoding. The third component is a small open model (7–8B) fine-tuned on plans and rewrites. This supervision is produced by a larger model and then corrected by clinicians on a few hundred examples. We keep the corrected set small because ParaDetox showed that about 1,000 high-quality pairs are enough to beat unsupervised systems, and because clinical parallel data cannot be crowdsourced.

The labels also address the case where some content cannot be detoxified without losing its meaning, which DetoxLLM raised (DetoxLLM). Instead of a paraphrase classifier deciding after the fact that meaning was lost, the plan marks irreducible content before any rewriting happens.

Several papers constrain the design. The clinical chain-of-thought study tells us that unconstrained reasoning is the wrong tool for context-bound text, and "To CoT or not to CoT" reinforces this (To CoT or not to CoT?). Words Matter shows that direct prompts slide into a bland "corporate manual" tone unless given clinical guidelines and style cues, so our prompts include the NIDA guidance it used. The procedural templates in SoS1 and CLASS supply the method: a fixed step structure improves reliability. Our plan is a template of the same kind, applied to rewriting.

Data

No clinical de-stigmatization benchmark exists in the literature available to us, so building one is part of the work. We start from the 3,207 stigmatizing posts in the Words Matter substance-use corpus, focusing on the r/medicine and r/nursing posts, which are closest to clinician-written language. We add clinical notes drawn from the BRIDGE datasets whose licenses allow it (Why Chain of Thought Fails in Clinical Text Understanding). Clinicians will annotate stigmatizing spans and clinical-fact spans.

We also build a contrast set in which negative-sounding language is factual and must survive the rewrite: positive toxicology results, documented aggression, and missed-dose histories. For a general-domain sanity check we use ParaDetox.

Baselines

The naive reference point is the identity rewrite, which returns the note unchanged. It sets the ceiling for fact preservation and the floor for stigma removal. Every system is reported as a point on the trade-off between the two, not as a single score.

The simplest domain baseline replaces words from a NIDA person-first list with their preferred alternatives. We include it because it cannot hallucinate. Its expected weakness is context blindness, which is consistent with the gap between lexicon and neural systems on span detection in SemEval-2021 Task 5 (12.22% vs 70.83% character F1).

The strongest domain competitor is the Informed + Stylized prompt from Words Matter. This is direct rewriting with NIDA guidelines and author-style conditioning, and human raters judged it best on overall quality and faithfulness. We run it with the same backbone models as our method, and also with GPT-4 to match the original setup. We found no reported numeric result for this method on Lacuna; the paper reports human rankings only. Beating it means a statistically significant gain in clinical-fact exact-match preservation on the contrast set, with stigma removal no worse than it achieves as judged by clinicians.

The strongest chain-of-thought competitor is DetoxLLM-style reasoning: free-form explanation followed by a rewrite, trained on the same supervision budget and backbone as our method. No automatic scores for DetoxLLM were found on Lacuna beyond its paraphrase detector (82.73%). The strongest span-level competitor is XDetox, which masks tokens a classifier marks as toxic and fills them with an expert/anti-expert language model. We run its public pipeline unchanged.

Two ablations isolate our key ingredient. The first uses the copy constraint without any plan, which is direct prompting plus hard copying of numbers and concepts. The second uses the plan without the constraint. All learned systems get the same data, the same backbone, and the same hyperparameter search budget. We also report tokens generated and wall-clock time per note.

Why not just…?

Why not just prompt a frontier model directly with the clinical guidelines? This is the most serious threat, and the Words Matter results suggest it may already work well. Scale arguments cut both ways. AppealCase shows that frontier models remain below 50% F1 on specialized legal reasoning. NAP2 shows a fine-tuned T5 beating zero-shot GPT-4 on privacy rewriting, 93.81% vs 92.14% on its privacy-entailment metric. Still, neither result is about de-stigmatization. The contrast set settles the question. If GPT-4 with guidelines preserves factual negatives as well as our method, the plan adds nothing and we will report that.

Why not just add the copy constraint to direct prompting? This alternative could make the plan redundant, since the length trap mostly damages numbers and concepts, and those are exactly what the constraint protects. It is our first ablation. The plan earns its place only if it improves on the constraint alone for spans that are not numbers or named concepts, such as the difference between "refused medication" as documented behavior and "non-compliant" as a label. If the ablation closes the gap, the honest conclusion is that constrained decoding is enough.

Why not just use XDetox-style masking and infilling, or activation steering? XDetox locates spans with a classifier trained on social-media toxicity, and its infilling model has no clinical vocabulary. We expect it to miss implicit stigma and to fill masked spans with clinically inaccurate words, and its three-model pipeline adds latency. Activation steering methods, DAPI and TIDE, steer open-ended generation rather than rewrite a given text. They were validated only with general-text perplexity, and TIDE costs about 9 seconds per prompt. We exclude them from the main comparison. We will run one probe experiment in which DAPI is adapted to rewriting, to check whether it changes dosages while keeping perplexity low.

Decisive Experiments

The first experiment tests whether the length trap appears in rewriting at all. Using free chain-of-thought, we bin outputs by reasoning length and plot exact-match preservation of numbers and clinical concepts against length. If preservation does not fall as reasoning grows, the motivating tension is absent in this task, and the project reduces to a benchmark contribution.

The second experiment is the head-to-head comparison. It covers stigma removal as rated by clinicians, clinical-fact preservation (exact match plus concept alignment, following the clinical chain-of-thought study), fluency, and over-sanitization rate on the contrast set. The prediction is that extractive plans keep free chain-of-thought's stigma removal while cutting fact loss, and that the gap over direct prompting is concentrated on the contrast set.

The third experiment is a downstream "do no harm" test. We run BRIDGE extraction tasks on original versus rewritten notes. Any drop in extraction scores counts as fact damage, regardless of how clean the prose looks.

The fourth experiment checks transfer back to general text. On ParaDetox, the strongest reported result is the COUNT J score of 0.74 (COUNT), with BART-ParaDetox at 0.68. We do not need to beat these numbers. We need to show that the plan format does not make general detoxification worse than a same-backbone direct rewrite.