No article text was recorded for this version.
automated user simulation
Version 1 of 144 papers46 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Beyond Static Evaluation: A Dynamic Approach to Assessing AI Assistants' API Invocation Capabilities
- Blog: Report on CLEF 2018: Experimental IR Meets Multilinguality, Multimodality, and Interaction
- Blog: Advancing Clinical Chatbot Validation Using AI-Powered Evaluation With a New 3-Bot Evaluation System: Instrument Validation Study
- Blog: BASES: Large-scale Web Search User Simulation with Large Language Model based Agents
- Blog: LLMs Get Lost In Multi-Turn Conversation
- Blog: Multi-lingual Multi-turn Automated Red Teaming for LLMs
- Blog: Exploiting Simulated User Feedback for Conversational Search: Ranking, Rewriting, and Beyond
- Blog: A Generative Model of Contextual Integrity: Appropriate vs. Inappropriate Information Sharing
- Blog: Interactive Query Clarification and Refinement via User Simulation
- Blog: $\tau$-Knowledge: Evaluating Conversational Agents over Unstructured Knowledge
- Blog: Large Language Models Perform Diagnostic Reasoning
- Blog: PlatoLM: Teaching LLMs in Multi-Round Dialogue via a User Simulator
- Blog: UCL-Bench: A Chinese User-Centric Legal Benchmark for Large Language Models
- Blog: High-Quality Medical Dialogue Synthesis for Improving EMR Generation
- Blog: Proactive Agents for Multi-Turn Text-to-Image Generation Under Uncertainty
- Blog: UCFE: A User-Centric Financial Expertise Benchmark for Large Language Models
- Blog: ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models
- Blog: Large Language Models as Misleading Assistants in Conversation
- Blog: Evaluating large language models as agents in the clinic
- Blog: A LLM-based Controllable, Scalable, Human-Involved User Simulator Framework for Conversational Recommender Systems
- Blog: FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agents
- Blog: It's the Thought that Counts: Evaluating the Attempts of Frontier LLMs to Persuade on Harmful Topics
- Blog: ChatMatch: Evaluating Chatbots by Autonomous Chat Tournaments
- Blog: IQA-EVAL: Automatic Evaluation of Human-Model Interactive Question Answering
- Blog: LikeBench: Evaluating Subjective Likability in LLMs for Personalization
- Blog: Structured Dialogue System for Mental Health: An LLM Chatbot Leveraging the PM+ Guidelines
- Blog: Large Language Models as User-Agents for Evaluating Task-Oriented-Dialogue Systems
- Blog: Adversarial Negotiation Dynamics in Generative Language Models
- Blog: ChatBench: From Static Benchmarks to Human-AI Evaluation
- Blog: DEBATE: A Large-Scale Benchmark for Role-Playing LLM Agents in Multi-Agent, Long-Form Debates
- Blog: UserRL: Training Interactive User-Centric Agent via Reinforcement Learning
- Blog: PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistants
- Blog: CodeAssistBench (CAB): Dataset & Benchmarking for Multi-turn Chat-Based Code Assistance
- Blog: Agentic Feedback Loop Modeling Improves Recommendation and User Simulation
- Blog: {$\tau$}-bench: A Benchmark for \underline{T}ool-\underline{A}gent-\underline{U}ser Interaction in Real-World Domains
- Blog: AMemGym: Interactive Memory Benchmarking for Assistants in Long-Horizon Conversations
- Blog: Is Your Goal-Oriented Dialog Model Performing Really Well? Empirical Analysis of System-wise Evaluation
- Blog: BotSIM: An End-to-End Bot Simulation Framework for Commercial Task-Oriented Dialog Systems
- Blog: Information Retrieval Evaluation as Search Simulation
- Blog: MetaAgents: Large Language Model Based Agents for Decision-Making on Teaming
- Blog: Is MultiWOZ a Solved Task? An Interactive TOD Evaluation Framework with User Simulator
- Blog: An Evaluation Framework for Interactive Recommender Systems
- Blog: Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models
- Blog: Rethinking the Evaluation for Conversational Recommendation in the Era of Large Language Models
History & citation
Current · Permanent link
- This direction split from User Simulation for Dynamic Agent Evaluation (61% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_automated_user_simulation_80f75e06,
title = {automated user simulation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/automated-user-simulation/rdr_80f75e06c3804025961524a7f91a47b1},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_automated_user_simulation_80f75e06_v1,
title = {automated user simulation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/automated-user-simulation/rdr_80f75e06c3804025961524a7f91a47b1/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}