No article text was recorded for this version.
prompt sensitivity (instructional brittleness)
Version 2 of 22,471 papers3,054 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Brittlebench: Quantifying LLM robustness via prompt sensitivity
- Blog: Analyzing the Generalization and Reliability of Steering Vectors
- Blog: POSIX: A Prompt Sensitivity Index For Large Language Models
- Blog: Policy-as-Prompt: Rethinking Content Moderation in the Age of Large Language Models
- Blog: A Survey on Speech Large Language Models for Understanding
- Blog: Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models
- Blog: LLM Agents Are Hypersensitive to Nudges
- Blog: Is ChatGPT A Good Keyphrase Generator? A Preliminary Study
- Blog: Calibrate Before Use: Improving Few-Shot Performance of Language Models
- Blog: Calibrate Before Use: Improving Few-Shot Performance of Language Models
- Blog: LMentry: A Language Model Benchmark of Elementary Language Tasks
- Blog: RCScore: Quantifying Response Consistency in Large Language Models
- Blog: POSIX: A Prompt Sensitivity Index For Large Language Models
- Blog: Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
- Blog: PrExMe! Large Scale Prompt Exploration of Open Source LLMs for Machine Translation and Summarization Evaluation
- Blog: ReliableEval: A Recipe for Stochastic LLM Evaluation via Method of Moments
- Blog: Efficient multi-prompt evaluation of LLMs
- Blog: PromptSuite: A Task-Agnostic Framework for Multi-Prompt Generation
- Blog: Sentiment Analysis in the Era of Large Language Models: A Reality Check
- Blog: Benchmarking and Revisiting Code Generation Assessment: A Mutation-Based Approach
- Blog: Evaluating Chinese Large Language Models on Discipline Knowledge Acquisition via Memorization and Robustness Assessment
- Blog: Exploring the Feasibility of ChatGPT for Event Extraction
- Blog: The Turking Test: Can Language Models Understand Instructions?
- Blog: Geography According to ChatGPT -- How Generative AI Represents and Reasons about Geography
- Blog: Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification
- Blog: CrisisSense-LLM: Instruction Fine-Tuned Large Language Model for Multi-label Social Media Text Classification in Disaster Informatics
- Blog: Rethinking Hallucinations: Correctness, Consistency, and Prompt Multiplicity
- Blog: Language Model Behavior: A Comprehensive Survey
- Blog: StablePT: Towards Stable Prompting for Few-shot Learning via Input Separation
- Blog: Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models
- Blog: Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Models
- Blog: Factual Consistency of Multilingual Pretrained Language Models
- Blog: PAFT: Prompt-Agnostic Fine-Tuning
- Blog: ReliableEval: A Recipe for Stochastic LLM Evaluation via Method of Moments
- Blog: Efficiently Computing Susceptibility to Context in Language Models
- Blog: ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
- Blog: Robustness of large language models in moral judgements
- Blog: Systematic Evaluation of LLM-as-a-Judge in LLM Alignment Tasks: Explainable Metrics and Diverse Prompt Templates
- Blog: Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models
- Blog: Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Models
- Blog: Exploring the True Potential: Evaluating the Black-box Optimization Capability of Large Language Models
- Blog: SaulLM-7B: A pioneering Large Language Model for Law
- Blog: Sense and Sensitivity: Evaluating the simulation of social dynamics via Large Language Models
- Blog: Promptception: How Sensitive Are Large Multimodal Models to Prompts?
- Blog: The ICL Consistency Test
- Blog: RouterArena: An Open Platform for Comprehensive Comparison of LLM Routers
- Blog: Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs
- Blog: Structured Prompting Enables More Robust Evaluation of Language Models
- Blog: Diverse and Fine-Grained Instruction-Following Ability Exploration with Synthetic Data
- Blog: Mind Your Format: Towards Consistent Evaluation of In-Context Learning Improvements
- Blog: PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts
- Blog: A Study on Prompt-based Few-Shot Learning Methods for Belief State Tracking in Task-oriented Dialog Systems
- Blog: Rethinking Large Language Models in Mental Health Applications
- Blog: Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting
- Blog: Revise, Reason, and Recognize: LLM-Based Emotion Recognition via Emotion-Specific Prompts and ASR Error Correction
- Blog: Benchmarking and Revisiting Code Generation Assessment: A Mutation-Based Approach
- Blog: PHAnToM: Personality Has An Effect on Theory-of-Mind Reasoning in Large Language Models
- Blog: GenBen: A Generative Benchmark for LLM-Aided Design
- Blog: Taqyim: Evaluating Arabic NLP Tasks Using ChatGPT Models
- Blog: Evaluation is All You Need: Strategic Overclaiming of LLM Reasoning Capabilities Through Evaluation Design
Showing 60 of 2,471 papers.
History & citation
Current · Permanent link
- Mitigating Prompt Sensitivity in In-Context Learning merged into this direction (79% overlap)
- few-shot stabilization split from this direction (73% overlap)
- input sensitivity split from this direction (64% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_prompt_sensitivity_instructional_brittle_a98b39bb,
title = {prompt sensitivity (instructional brittleness)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/prompt-sensitivity-instructional-brittleness/rdr_a98b39bbdfc14446a6f8302a3dc8acd6},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-22},
}This exact version (version 2, frozen text):
@misc{lacuna_prompt_sensitivity_instructional_brittle_a98b39bb_v2,
title = {prompt sensitivity (instructional brittleness)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/prompt-sensitivity-instructional-brittleness/rdr_a98b39bbdfc14446a6f8302a3dc8acd6/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-22},
}