No article text was recorded for this version.
computational cost of multimodal training
Version 1 of 1236 papers241 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Multimodal pretraining for unsupervised protein representation learning
- Blog: Is Extending Modality The Right Path Towards Omni-Modality?
- Blog: Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
- Blog: From Multimodal LLM to Human-level AI: Modality, Instruction, Reasoning, Efficiency and beyond
- Blog: A Comprehensive Review of Multimodal Large Language Models: Performance and Challenges Across Different Tasks
- Blog: Reformulating Vision-Language Foundation Models and Datasets Towards Universal Multimodal Assistants
- Blog: VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
- Blog: LITE: Modeling Environmental Ecosystems with Multimodal Large Language Models
- Blog: CoC: Chain-of-Cancer Based on Cross-Modal Autoregressive Traction for Survival Prediction
- Blog: WenLan: Bridging Vision and Language by Large-Scale Multi-Modal Pre-Training
- Blog: Expand BERT Representation with Visual Information via Grounded Language Learning with Multimodal Partial Alignment
- Blog: Semantic Autoencoder for Zero-Shot Learning
- Blog: SMAUG: Sparse Masked Autoencoder for Efficient Video-Language Pre-training
- Blog: QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
- Blog: Few-Shot Relation Extraction with Hybrid Visual Evidence
- Blog: Open Vocabulary Multi-label Video Classification
- Blog: Deep Multimodal Subspace Clustering Networks
- Blog: λ-ECLIPSE: Multi-Concept Personalized Text-to-Image Diffusion Models by Leveraging CLIP Latent Space
- Blog: Integrating Multimodal Electronic Health Records for Diagnosis Prediction
- Blog: Balancing Multimodal Learning via Online Logit Modulation
- Blog: PUMA: Layer-Pruned Language Model for Efficient Unified Multimodal Retrieval with Modality-Adaptive Learning
- Blog: M-FLAG: Medical Vision-Language Pre-training with Frozen Language Models and Latent Space Geometry Optimization
- Blog: MolFusion: Multimodal Fusion Learning for Molecular Representations via Multi-granularity Views
- Blog: Mini-DALLE3: Interactive Text to Image by Prompting Large Language Models
- Blog: RoadBench: A Vision-Language Foundation Model and Benchmark for Road Damage Understanding
- Blog: MAGMA - Multimodal Augmentation of Generative Models through Adapter-based Finetuning
- Blog: Exploring Unified Training Framework for Multimodal User Profiling
- Blog: Improving Fine-grained Visual Understanding in VLMs through Text-Only Training
- Blog: RAVEN: Query-Guided Representation Alignment for Question Answering over Audio, Video, Embedded Sensors, and Natural Language
- Blog: Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Driving
- Blog: Generating Hashtags for Short-form Videos with Guided Signals
- Blog: A New View of Multi-modal Language Analysis: Audio and Video Features as Text "Styles"
- Blog: From Unimodal to Multimodal: Scaling up Projectors to Align Modalities
- Blog: LLaVA-Interactive: An All-in-One Demo for Image Chat, Segmentation, Generation and Editing
- Blog: BRAVEn: Improving Self-Supervised Pre-training for Visual and Auditory Speech Recognition
- Blog: Compression then Matching: An Efficient Pre-training Paradigm for Multimodal Embedding
- Blog: Towards Reliable Advertising Image Generation Using Human Feedback
- Blog: Word-Aware Modality Stimulation for Multimodal Fusion
- Blog: Multi-Modality Expansion and Retention for LLMs through Parameter Merging and Decoupling
- Blog: Multimodal research in vision and language: A review of current and emerging trends
- Blog: BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
- Blog: OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows
- Blog: Mozart's Touch: A Lightweight Multi-modal Music Generation Framework Based on Pre-Trained Large Models
- Blog: BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
- Blog: LLM as A Robotic Brain: Unifying Egocentric Memory and Control
- Blog: Data-Juicer Sandbox: A Feedback-Driven Suite for Multimodal Data-Model Co-development
- Blog: Multimodal Pre-training Framework for Sequential Recommendation via Contrastive Learning
- Blog: Flash-Unified: A Training-Free and Task-Aware Acceleration Framework for Native Unified Models
- Blog: Multimodal Lego: Model Merging and Fine-Tuning Across Topologies and Modalities in Biomedicine
- Blog: ViBERTgrid: A Jointly Trained Multi-modal 2D Document Representation for Key Information Extraction from Documents
- Blog: VideoNSA: Native Sparse Attention Scales Video Understanding
- Blog: Face2VoiceSync: Lightweight Face-Voice Consistency for Text-Driven Talking Face Generation
- Blog: Coevolutionary Continuous Discrete Diffusion: Make Your Diffusion Language Model a Latent Reasoner
- Blog: Efficient Scaling for LLM-based ASR
- Blog: Time-Series Field Phenotyping of Soybean Growth Analysis by Combining Multimodal Deep Learning and Dynamic Modeling
- Blog: Mol2Lang-VLM: Vision- and Text-Guided Generative Pre-trained Language Models for Advancing Molecule Captioning through Multimodal Fusion
- Blog: Language Models Can See Better: Visual Contrastive Decoding For LLM Multimodal Reasoning
- Blog: ACE-BERT: Adversarial Cross-Modal Enhanced BERT for E-Commerce Retrieval
- Blog: Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language
- Blog: Continual Cross-Modal Generalization
Showing 60 of 236 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_computational_cost_of_multimodal_trainin_c7f000c7,
title = {computational cost of multimodal training},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/computational-cost-of-multimodal-training/rdr_c7f000c79e2948ee9d70916d69ec7794},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_computational_cost_of_multimodal_trainin_c7f000c7_v1,
title = {computational cost of multimodal training},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/computational-cost-of-multimodal-training/rdr_c7f000c79e2948ee9d70916d69ec7794/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}