No article text was recorded for this version.
cross-modal identity synthesis
Version 2 of 254 papers79 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Hear Your Face: Face-based voice conversion with F0 estimation
- Blog: Seeing Voices and Hearing Faces: Cross-modal biometric matching
- Blog: From Faces to Voices: Learning Hierarchical Representations for High-quality Video-to-Speech
- Blog: Neural Dubber: Dubbing for Videos According to Scripts
- Blog: Face Reconstruction from Voice using Generative Adversarial Networks
- Blog: VisualVoice: Audio-Visual Speech Separation With Cross-Modal Consistency
- Blog: AnyoneNet: Synchronized Speech and Talking Head Generation for Arbitrary Persons
- Blog: Speaking Without Sound: Multi-speaker Silent Speech Voicing with Facial Inputs Only
- Blog: Face2Speech: Towards Multi-Speaker Text-to-Speech Synthesis Using an Embedding Vector Predicted from a Face Image
- Blog: Zero-shot personalized lip-to-speech synthesis with face image based voice control
- Blog: WAV2PIX: Speech-conditioned Face Generation using Generative Adversarial Networks.
- Blog: Imaginary Voice: Face-styled Diffusion Model for Text-to-Speech
- Blog: MultiActor-Audiobook: Zero-Shot Audiobook Generation with Faces and Voices of Multiple Speakers
- Blog: FVTTS : Face Based Voice Synthesis for Text-to-Speech
- Blog: Speech2Talking-Face: Inferring and Driving a Face with Synchronized Audio-Visual Representation
- Blog: Neural Dubber: Dubbing for Silent Videos According to Scripts
- Blog: Controlled AutoEncoders to Generate Faces from Voices
- Blog: FaceSpeak: Expressive and High-Quality Speech Synthesis from Human Portraits of Different Styles
- Blog: VoiceMe: Personalized voice generation in TTS
- Blog: Restoring Speaking Lips from Occlusion for Audio-Visual Speech Recognition
- Blog: On Learning Associations of Faces and Voices
- Blog: FaVoA: Face-Voice Association Favours Ambiguous Speaker Detection
- Blog: Imaginary Voice: Face-styled Diffusion Model for Text-to-Speech
- Blog: FaceChain-ImagineID: Freely Crafting High-Fidelity Diverse Talking Faces from Disentangled Audio
- Blog: HeadsetOff: Enabling Photorealistic Video Conferencing on Economical VR Headsets
- Blog: DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embedding
- Blog: Zero-shot personalized lip-to-speech synthesis with face image based voice control
- Blog: DiVISe: Direct Visual-Input Speech Synthesis Preserving Speaker Characteristics And Intelligibility
- Blog: Visual Speech Enhancement Without A Real Visual Stream
- Blog: Face-Driven Zero-Shot Voice Conversion with Memory-based Face-Voice Alignment
- Blog: GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks
- Blog: Speech Fusion to Face: Bridging the Gap Between Human's Vocal Characteristics and Facial Imaging
- Blog: Visually Guided Self Supervised Learning of Speech Representations
- Blog: Seeing Your Speech Style: A Novel Zero-Shot Identity-Disentanglement Face-based Voice Conversion
- Blog: Cross-modal Face- and Voice-style Transfer
- Blog: Robust One Shot Audio to Video Generation
- Blog: FaVoA: Face-Voice Association Favours Ambiguous Speaker Detection
- Blog: FaceFilter: Audio-Visual Speech Separation Using Still Images
- Blog: FaceChain-ImagineID: Freely Crafting High-Fidelity Diverse Talking Faces from Disentangled Audio
- Blog: LipSound: Neural Mel-Spectrogram Reconstruction for Lip Reading
- Blog: Utterance independent bimodal emotion recognition in spontaneous communication
- Blog: Audiovisual speaker conversion: jointly and simultaneously transforming facial expression and acoustic characteristics
- Blog: LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading
- Blog: Learnable PINs: Cross-modal Embeddings for Person Identity
- Blog: Multimodal Target Speech Separation with Voice and Face References
- Blog: Can Current Detectors Catch Face-to-Voice Deepfake Attacks?
- Blog: Realistic Speech-to-Face Generation with Speech-Conditioned Latent Diffusion Model with Face Prior
- Blog: Residual-guided Personalized Speech Synthesis based on Face Image
- Blog: Audio-Visual Speaker Recognition with a Cross-Modal Discriminative Network
- Blog: Some Research Problems in Biometrics: The Future Beckons
- Blog: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image Generation
- Blog: What Does Your Face Sound Like? 3D Face Shape towards Voice
- Blog: SVTS: Scalable Video-to-Speech Synthesis
- Blog: Attention-based Residual Speech Portrait Model for Speech to Face Generation
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_cross_modal_identity_synthesis_29041022,
title = {cross-modal identity synthesis},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/cross-modal-identity-synthesis/rdr_2904102258294bd68032ed474eb8337f},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 2, frozen text):
@misc{lacuna_cross_modal_identity_synthesis_29041022_v2,
title = {cross-modal identity synthesis},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/cross-modal-identity-synthesis/rdr_2904102258294bd68032ed474eb8337f/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-20},
}