No article text was recorded for this version.
OCR-augmented multimodal fusion
Version 1 of 159 papers69 conceptsfrozen 2026-10-04
Papers in this version
- Blog: PerSRV: Personalized Sticker Retrieval with Vision-Language Model
- Blog: FLYPE: Multitask Prompt Tuning for Multimodal Human Understanding of Social Media
- Blog: Wildlife Product Trading in Online Social Networks: A Case Study on Ivory-Related Product Sales Promotion Posts
- Blog: TRINS: Towards Multimodal Language Models that Can Read
- Blog: Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake News
- Blog: Privacy in Image Datasets: A Case Study on Pregnancy Ultrasounds
- Blog: AskChart: Universal Chart Understanding through Textual Enhancement
- Blog: Twitter-COMMs: Detecting Climate, COVID, and Military Multimodal Misinformation
- Blog: VIT-Pro: Visual Instruction Tuning for Product Images
- Blog: MM-Claims: A Dataset for Multimodal Claim Detection in Social Media
- Blog: A Proposal of Printed Table Digitization Algorithm with Image Processing
- Blog: LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding
- Blog: Intelligent Reading for Multi-Scale Engineering Drawings based on Adaptive Object Detection and Optical Character Recognition
- Blog: It Takes Two to Tango: Combining Visual and Textual Information for Detecting Duplicate Video-Based Bug Reports
- Blog: Twitter100k: A Real-world Dataset for Weakly Supervised Cross-Media Retrieval
- Blog: EmoMeta: A Multimodal Dataset for Fine-grained Emotion Classification in Chinese Metaphors
- Blog: Multi-Modal Image Captioning for the Visually Impaired
- Blog: Towards VQA Models That Can Read
- Blog: PAM: Understanding Product Images in Cross Product Category Attribute Extraction
- Blog: Reddit financial image post sentiment dataset
- Blog: Mobile User Interface Element Detection Via Adaptively Prompt Tuning
- Blog: Application of Information Retrieval Technologies to Presentation Slides
- Blog: Social Meme-ing: Measuring Linguistic Variation in Memes
- Blog: CT2C-QA: Multimodal Question Answering over Chinese Text, Table and Chart
- Blog: Benchmarking Multi-Modal Entailment for Fact Verification (short paper)
- Blog: BanglaAbuseMeme: A Dataset for Bengali Abusive Meme Classification
- Blog: Modeling Intra and Inter-modality Incongruity for Multi-Modal Sarcasm Detection
- Blog: Introduction to the Special Issue. From Data to Heritage: Semantic Enrichment, Archives, and Digital Libraries
- Blog: From Laughter to Inequality: Annotated Dataset for Misogyny Detection in Tamil and Malayalam Memes
- Blog: StacMR: Scene-Text Aware Cross-Modal Retrieval
- Blog: Micromobility in Smart Cities: A Closer Look at Shared Dockless E-Scooters via Big Social Data
- Blog: Simple but Effective Raw-Data Level Multimodal Fusion for Composed Image Retrieval
- Blog: Confidence-aware Non-repetitive Multimodal Transformers for TextCaps
- Blog: Nice Perfume. How Long Did You Marinate in It? Multimodal Sarcasm Explanation
- Blog: Scene-Text Aware Image and Text Retrieval with Dual-Encoder
- Blog: Cultural Bias Matters: A Cross-Cultural Benchmark Dataset and Sentiment-Enriched Model for Understanding Multimodal Metaphors
- Blog: Visual Elements Mining as Prompts for Instruction Learning for Target-Oriented Multimodal Sentiment Classification
- Blog: Twitter-COMMs: Detecting Climate, COVID, and Military Multimodal Misinformation
- Blog: “Subverting the Jewtocracy”: Online Antisemitism Detection Using Multimodal Deep Learning
- Blog: An Automatic Sensitive Image Search System with Generative Artificial Intelligence to Identify Data Leaks on Internet
- Blog: SciCap+: A Knowledge Augmented Dataset to Study the Challenges of Scientific Figure Captioning
- Blog: From Training-Free to Adaptive: Empirical Insights into MLLMs' Understanding of Detection Information
- Blog: Overview of the CLEF-2023 CheckThat! Lab Task 1 on Check-Worthiness in Multimodal and Multigenre Content
- Blog: Exploring Hate Speech Detection in Multimodal Publications
- Blog: Multi-View Incongruity Learning for Multimodal Sarcasm Detection
- Blog: SPLIT: Stance and Persuasion Prediction with Multi-modal on Image and Textual Information
- Blog: Judge a Book by its Cover: Investigating Multi-Modal LLMs for Multi-Page Handwritten Document Transcription
- Blog: Detecting Visual Information Manipulation Attacks in Augmented Reality: A Multimodal Semantic Reasoning Approach
- Blog: Pula: Training Large Language Models for Setswana
- Blog: Bridging the Gap between Expression and Scene Text for Referring Expression Comprehension (Student Abstract)
- Blog: VGA: Vision and Graph Fused Attention Network for Rumor Detection
- Blog: Detecting Medical Misinformation on Social Media Using Multimodal Deep Learning
- Blog: MIT-10M: A Large Scale Parallel Corpus of Multilingual Image Translation
- Blog: Say It All: Feedback for Improving Non-Visual Presentation Accessibility
- Blog: Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Review
- Blog: Intelligent Online Selling Point Extraction for E-commerce Recommendation
- Blog: Mobile App Crowdsourced Test Report Consistency Detection via Deep Image-and-Text Fusion Understanding
- Blog: Lecture Presentations Multimodal Dataset: Towards Understanding Multimodality in Educational Videos
- Blog: Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots
History & citation
Current · Permanent link
- This direction split from Grounding Multimodal Models in Scene Text (71% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_ocr_augmented_multimodal_fusion_38a9abe5,
title = {OCR-augmented multimodal fusion},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/ocr-augmented-multimodal-fusion/rdr_38a9abe54620431ab494d5eadeae1ee6},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_ocr_augmented_multimodal_fusion_38a9abe5_v1,
title = {OCR-augmented multimodal fusion},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/ocr-augmented-multimodal-fusion/rdr_38a9abe54620431ab494d5eadeae1ee6/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}