No article text was recorded for this version.
self-supervised cross-modal alignment
Version 2 of 2399 papers538 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Look, Listen and Learn
- Blog: Look, Listen and Learn
- Blog: Audio-Visual Scene Analysis with Self-Supervised Multisensory Features
- Blog: AVLnet: Learning Audio-Visual Language Representations from Instructional Videos
- Blog: See the Sound, Hear the Pixels
- Blog: Localizing Visual Sounds the Easy Way
- Blog: Memory-augmented Contrastive Learning for Talking Head Generation
- Blog: Self-supervised object detection from audio-visual correspondence
- Blog: Cooperative Learning of Audio and Video Models from Self-Supervised Synchronization
- Blog: Egocentric Audio-Visual Object Localization
- Blog: Structure from Silence: Learning Scene Structure from Ambient Sound
- Blog: Locality-aware Cross-modal Correspondence Learning for Dense Audio-Visual Events Detection
- Blog: Objects that Sound
- Blog: Learning Sight from Sound: Ambient Sound Provides Supervision for Visual Learning.
- Blog: Unsupervised Audio-Visual Segmentation with Modality Alignment
- Blog: The Sound of Pixels
- Blog: Increasing Importance of Joint Analysis of Audio and Video in Computer Vision: A Survey
- Blog: Self-supervised Transformer for Deepfake Detection
- Blog: Disentangled Speech Embeddings Using Cross-Modal Self-Supervision
- Blog: CLASP: Cross-modal Salient Anchor-based Semantic Propagation for Weakly-supervised Dense Audio-Visual Event Localization
- Blog: CAD - Contextual Multi-modal Alignment for Dynamic AVQA
- Blog: The Sound of Pixels
- Blog: Structure from Silence: Learning Scene Structure from Ambient Sound
- Blog: Binaural Audio Generation via Multi-task Learning
- Blog: Frame-Subtitle Self-Supervision for Multi-Modal Video Question Answering
- Blog: Multi-Instrumentalist Net: Unsupervised Generation of Music from Body Movements
- Blog: STA-V2A: Video-to-Audio Generation with Semantic and Temporal Alignment
- Blog: OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attention
- Blog: SeCo: Separating Unknown Musical Visual Sounds with Consistency Guidance
- Blog: Look Who's Talking: Active Speaker Detection in the Wild
- Blog: Seeing voices and hearing voices: learning discriminative embeddings using cross-modal self-supervision
- Blog: Self-supervised Learning of Audio-Visual Objects from Video
- Blog: Coincidence, Categorization, and Consolidation: Learning to Recognize Sounds with Minimal Supervision
- Blog: AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection
- Blog: Selective Listening by Synchronizing Speech With Lips
- Blog: Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation
- Blog: Cross-modal Embeddings for Video and Audio Retrieval
- Blog: ViFiCon: Vision and Wireless Association Via Self-Supervised Contrastive Learning
- Blog: Unsupervised Sounding Pixel Learning
- Blog: Disentangled Speech Embeddings using Cross-modal Self-supervision
- Blog: Co-Separating Sounds of Visual Objects
- Blog: Look Before you Speak: Visually Contextualized Utterances
- Blog: Jointly Discovering Visual Objects and Spoken Words from Raw Sensory Input
- Blog: Co-Separating Sounds of Visual Objects
- Blog: Multi-Modal Perception Attention Network with Self-Supervised Learning for Audio-Visual Speaker Tracking
- Blog: Project MOSLA: Recording Every Moment of Second Language Acquisition
- Blog: Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Tasks
- Blog: Deep Video Inpainting Guided by Audio-Visual Self-Supervision
- Blog: Enhancing Sound Source Localization via False Negative Elimination
- Blog: Deep Multimodal Clustering for Unsupervised Audiovisual Learning
- Blog: Unsupervised Domain Adaptative Temporal Sentence Localization with Mutual Information Maximization
- Blog: End-to-End Active Speaker Detection
- Blog: AC-Foley: Reference-Audio-Guided Video-to-Audio Synthesis with Acoustic Transfer
- Blog: Telling Left from Right: Learning Spatial Correspondence of Sight and Sound
- Blog: LiRA: Learning Visual Speech Representations from Audio through Self-supervision
- Blog: Multimodal Emotion Recognition with Modality-Pairwise Unsupervised Contrastive Loss
- Blog: Self-Supervised Contrastive Learning for Audio-Visual Action Recognition
- Blog: Audio-Visual Scene Analysis with Self-Supervised Multisensory Features
- Blog: Audio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluation
- Blog: Weakly-supervised Audio-visual Sound Source Detection and Separation
Showing 60 of 399 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_self_supervised_cross_modal_alignment_10df7031,
title = {self-supervised cross-modal alignment},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/self-supervised-cross-modal-alignment/rdr_10df7031c6f1441fa845129861baa773},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 2, frozen text):
@misc{lacuna_self_supervised_cross_modal_alignment_10df7031_v2,
title = {self-supervised cross-modal alignment},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/self-supervised-cross-modal-alignment/rdr_10df7031c6f1441fa845129861baa773/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-20},
}