No article text was recorded for this version.
visual element tagging
Version 1 of 129 papers33 conceptsfrozen 2026-10-04
Papers in this version
- Blog: GUIPilot: A Consistency-based Mobile GUI Testing Approach for Detecting Application-specific Bugs
- Blog: ChartM3: Benchmarking Chart Editing with Multimodal Instructions
- Blog: OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use
- Blog: VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks
- Blog: BUMBLE: Unifying Reasoning and Acting with Vision-Language Models for Building-wide Mobile Manipulation
- Blog: Coding Agents with Multimodal Browsing are Generalist Problem Solvers
- Blog: AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Description
- Blog: A Multimodal Chain of Tools for Described Object Detection
- Blog: CPT: Colorful Prompt Tuning for pre-trained vision-language models
- Blog: VideoWebArena: Evaluating Long Context Multimodal Agents with Video Understanding Web Tasks
- Blog: Free-form language-based robotic reasoning and grasping
- Blog: Magma: A Foundation Model for Multimodal AI Agents
- Blog: Large Language Model-Brained GUI Agents: A Survey
- Blog: Enabling Conversational Interaction with Mobile UI using Large Language Models
- Blog: AOR: Anatomical Ontology-Guided Reasoning for Medical Large Multimodal Model in Chest X-Ray Interpretation
- Blog: AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents
- Blog: LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospects
- Blog: SDMatte: Grafting Diffusion Models for Interactive Matting
- Blog: Programming with Pixels: Can Computer-Use Agents do Software Engineering?
- Blog: LiveWeb-IE: A Benchmark For Online Web Information Extraction
- Blog: WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models
- Blog: A Comprehensive Survey of Agents for Computer Use: Foundations, Challenges, and Future Directions
- Blog: ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflows
- Blog: Towards General Computer Control: A Multimodal Agent for Red Dead Redemption II as a Case Study
- Blog: macOSWorld: A Multilingual Interactive Benchmark for GUI Agents
- Blog: REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environments
- Blog: ConText: Driving In-context Learning for Text Removal and Segmentation
- Blog: Embodied Scene Understanding for Vision Language Models via MetaVQA
- Blog: UFO: A UI-Focused Agent for Windows OS Interaction
History & citation
Current · Permanent link
- This direction split from Visual Element Tagging for Multimodal GUI Agents (62% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_visual_element_tagging_3ef2553a,
title = {visual element tagging},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/visual-element-tagging/rdr_3ef2553a3dba4d3aa98b83260235201f},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 1, frozen text):
@misc{lacuna_visual_element_tagging_3ef2553a_v1,
title = {visual element tagging},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/visual-element-tagging/rdr_3ef2553a3dba4d3aa98b83260235201f/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}