No article text was recorded for this version.
sequential modality pre-training
Version 1 of 142 papers50 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Automatic Breast Lesion Classification by Joint Neural Analysis of Mammography and Ultrasound
- Blog: VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts
- Blog: ModDrop: Adaptive Multi-Modal Gesture Recognition
- Blog: InfoMAE: Pairing-Efficient Cross-Modal Alignment with Informational Masked Autoencoders for IoT Signals
- Blog: FusionViT: Hierarchical 3D Object Detection via LiDAR-Camera Vision Transformer Fusion
- Blog: Knowledge-Guided Dynamic Modality Attention Fusion Framework for Multimodal Sentiment Analysis
- Blog: Deep Multimodal Fusion for Surgical Feedback Classification
- Blog: Analysis of Deep Fusion Strategies for Multi-Modal Gesture Recognition
- Blog: Learning Optimal Multimodal Information Bottleneck Representations
- Blog: AstroCLIP: a cross-modal foundation model for galaxies
- Blog: Cross-Media Shared Representation by Hierarchical Learning with Multiple Deep Networks
- Blog: Multimodal deep learning approach for joint EEG-EMG data compression and classification
- Blog: MVPTR: Multi-Level Semantic Alignment for Vision-Language Pre-Training via Multi-Stage Learning
- Blog: Weak to Strong: VLM-Based Pseudo-Labeling as a Weakly Supervised Training Strategy in Multimodal Video-based Hidden Emotion Understanding Tasks
- Blog: VAEmo: Efficient Representation Learning for Visual-Audio Emotion with Knowledge Injection
- Blog: Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checking
- Blog: Motion Guided Attention for Video Salient Object Detection
- Blog: Should VLMs be Pre-trained with Image Data?
- Blog: Learning to Have an Ear for Face Super-Resolution
- Blog: Leaner and Faster: Two-Stage Model Compression for Lightweight Text-Image Retrieval
- Blog: Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data
- Blog: Image–Text Cross-Modal Retrieval with Instance Contrastive Embedding
- Blog: What Makes for Robust Multi-Modal Models in the Face of Missing Modalities?
- Blog: InfoMAE: Pair-Efficient Cross-Modal Alignment for Multimodal Time-Series Sensing Signals
- Blog: FLAVA: A Foundational Language And Vision Alignment Model
- Blog: Improving Discriminative Multi-Modal Learning with Large-Scale Pre-Trained Models
- Blog: Towards unified molecule-enhanced pathology image representation learning via integrating spatial transcriptomics
- Blog: MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition
- Blog: Training Vision-Language Models with Less Bimodal Supervision
- Blog: MP-GUI: Modality Perception with MLLMs for GUI Understanding
- Blog: Multimodal Turn-Taking Model Using Visual Cues for End-of-Utterance Prediction in Spoken Dialogue Systems
- Blog: Better Safe than Sorry: Pre-training CLIP against Targeted Data Poisoning and Backdoor Attacks
- Blog: Automatic Question Detection from Acoustic and Phonetic Features Using Feature-wise Pre-training
- Blog: MedFuse: Multi-modal fusion with clinical time-series data and chest X-ray images
- Blog: DF2Net: Discriminative Feature Learning and Fusion Network for RGB-D Indoor Scene Classification
- Blog: Bodyformer: Semantics-guided 3D Body Gesture Synthesis with Transformer
- Blog: Effective Multi-Modal Retrieval based on Stacked Auto-Encoders
- Blog: Towards Modality Generalization: A Benchmark and Prospective Analysis
- Blog: Toward Fully-End-to-End Listened Speech Decoding from EEG Signals
- Blog: CrossFuse: A novel cross attention mechanism based infrared and visible image fusion approach
- Blog: Multimodal Named Entity Recognition with Bottleneck Fusion and Contrastive Learning
- Blog: CustOmics: A versatile deep-learning based strategy for multi-omics integration
History & citation
Current · Permanent link
- This direction split from Decoupled Staged Training for Multimodal Fusion (81% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_sequential_modality_pre_training_879d2c3c,
title = {sequential modality pre-training},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/sequential-modality-pre-training/rdr_879d2c3c566a41efaa2607049304b0fb},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-22},
}This exact version (version 1, frozen text):
@misc{lacuna_sequential_modality_pre_training_879d2c3c_v1,
title = {sequential modality pre-training},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/sequential-modality-pre-training/rdr_879d2c3c566a41efaa2607049304b0fb/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-22},
}