No article text was recorded for this version.
cross-modal synergy (cross-modal representation learning)
Version 1 of 1137 papers153 conceptsfrozen 2026-10-04
Papers in this version
- Blog: VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts
- Blog: OmniSat: Self-supervised Modality Fusion for Earth Observation
- Blog: XModBench: Benchmarking Cross-Modal Capabilities and Consistency in Omni-Language Models
- Blog: Masking Modalities for Cross-modal Video Retrieval
- Blog: Weakly Paired Associative Learning for Sound and Image Representations via Bimodal Associative Memory
- Blog: CARDIAC-FM: A Multimodal Foundation Model for Cardiovascular Risk Prediction Using ECG and Cardiac MRI
- Blog: A Deep Step Pattern Representation for Multimodal Retinal Image Registration
- Blog: On Robustness in Multimodal Learning
- Blog: Learning Paired-associate Images with An Unsupervised Deep Learning Architecture
- Blog: Bridging Modalities: Knowledge Distillation and Masked Training for Translating Multi-Modal Emotion Recognition to Uni-Modal, Speech-Only Emotion Recognition
- Blog: Any2Policy: Learning Visuomotor Policy with Any-Modality
- Blog: Apprentissage contrastif multi-modal : Du pré-entrainement auto-supervisé à la classification supervisée.
- Blog: TENT: Connect Language Models with IoT Sensors for Zero-Shot Activity Recognition
- Blog: Audio Generation with Multiple Conditional Diffusion Model
- Blog: Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentation
- Blog: Multimodal Topic Labelling
- Blog: Human alignment of neural network representations
- Blog: MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance
- Blog: MIR-GAN: Refining Frame-Level Modality-Invariant Representations with Adversarial Network for Audio-Visual Speech Recognition
- Blog: Self-Supervised Unimodal Label Generation Strategy Using Recalibrated Modality Representations for Multimodal Sentiment Analysis
- Blog: CoRe-Sleep: A Multimodal Fusion Framework for Time Series Robust to Imperfect Modalities
- Blog: Maize Yield Prediction at an Early Developmental Stage Using Multispectral Images and Genotype Data for Preliminary Hybrid Selection
- Blog: Self-supervised Pre-training for Transferable Multi-modal Perception
- Blog: Audiovisual Masked Autoencoders
- Blog: HEALNet: Multimodal Fusion for Heterogeneous Biomedical Data
- Blog: CiTrus: Squeezing Extra Performance out of Low-data Bio-signal Transfer Learning
- Blog: SAE-V: Interpreting Multimodal Models for Enhanced Alignment
- Blog: MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
- Blog: Boosting 3D Point Cloud Registration by Transferring Multi-modality Knowledge
- Blog: UniteFormer: Unifying Node and Edge Modalities in Transformers for Vehicle Routing Problems
- Blog: Mutual Contrastive Learning to Disentangle Whole Slide Image Representations for Glioma Grading
- Blog: Cross-modal Features Interaction-and-Aggregation Network with Self-consistency Training for Speech Emotion Recognition
- Blog: A Theory of Multimodal Learning
- Blog: Developmental Predictive Coding Model for Early Infancy Mono and Bilingual Vocal Continual Learning
- Blog: A Multi-Modal Federated Learning Framework for Remote Sensing Image Classification
- Blog: DueT: Image-Text Contrastive Transfer Learning with Dual-adapter Tuning
- Blog: SAILViT: Towards Robust and Generalizable Visual Backbones for MLLMs via Gradual Feature Refinement
- Blog: MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions
- Blog: MultiMAE: Multi-modal Multi-task Masked Autoencoders
- Blog: USat: A Unified Self-Supervised Encoder for Multi-Sensor Satellite Imagery
- Blog: Siamese Network for RGB-D Salient Object Detection and Beyond
- Blog: MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learning
- Blog: Neural Shape Compiler: A Unified Framework for Transforming between Text, Point Cloud, and Program
- Blog: Rethinking Multimodal Content Moderation from an Asymmetric Angle with Mixed-modality
- Blog: Unified Multimodal Punctuation Restoration Framework for Mixed-Modality Corpus
- Blog: On the Comparison between Multi-modal and Single-modal Contrastive Learning
- Blog: Enhancing Few-Shot Class-Incremental Learning via Frozen Feature Augmentation
- Blog: MultiIoT: Towards Large-scale Multisensory Learning for the Internet of Things
- Blog: Cross-Modality Binary Code Learning via Fusion Similarity Hashing
- Blog: When Pedestrian Detection Meets Multi-modal Learning: Generalist Model and Benchmark Dataset
- Blog: UFO2: A unified pre-training framework for online and offline speech recognition
- Blog: Large-scale Multi-modal Pre-trained Models: A Comprehensive Survey
- Blog: Omni-Reward: Towards Generalist Omni-Modal Reward Modeling with Free-Form Preferences
- Blog: Multi-spectral Facial Landmark Detection
- Blog: Rethinking Multimodal Content Moderation from an Asymmetric Angle with Mixed-modality
- Blog: Representation Mixing for TTS Synthesis
- Blog: Joint multi-modal Self-Supervised pre-training in Remote Sensing: Application to Methane Source Classification
- Blog: Multi-modal Vision Pre-training for Medical Image Analysis
- Blog: Robustness in Multimodal Learning under Train-Test Modality Mismatch
- Blog: Multimodal Contrastive Learning with Hard Negative Sampling for Human Activity Recognition
Showing 60 of 137 papers.
History & citation
Current · Permanent link
- This direction split from Cross-Modal Synergy for Robust Internal Representations (82% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_cross_modal_synergy_cross_modal_represen_ed68bc9f,
title = {cross-modal synergy (cross-modal representation learning)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/cross-modal-synergy-cross-modal-representation-learning/rdr_ed68bc9f588045adac03a9f2ecdf17d4},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_cross_modal_synergy_cross_modal_represen_ed68bc9f_v1,
title = {cross-modal synergy (cross-modal representation learning)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/cross-modal-synergy-cross-modal-representation-learning/rdr_ed68bc9f588045adac03a9f2ecdf17d4/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}