Multimodal processing of language

Articulation GAN: Unsupervised modeling of articulatory learning

DAIS: THE DELFT DATABASE OF EEG RECORDINGS OF DUTCH ARTICULATED AND IMAGINED SPEECH

MULTILEVEL TRANSFORMER FOR MULTIMODAL EMOTION RECOGNITION

MGAT: Multi-granularity Attention based Transformers for Multi-modal Emotion Recognition

Learning Cross-modal Audiovisual Representations with Ladder Networks for Emotion Recognition

PREFIX TUNING FOR AUTOMATED AUDIO CAPTIONING

M2-CTTS: End-to-End Multi-scale Multi-modal Conversational Text-to-Speech Synthesis

Toward a Multimodal Approach for Disfluency Detection and Categorization

Cross-Modal Audio-Visual Co-learning for Text-independent Speaker Verification

Multi-Scale Receptive Field Graph Model for Emotion Recognition in Conversations

LA-VocE: Low-SNR Audio-visual Speech Enhancement using Neural Vocoders

Auxiliary Pooling Layer For Spoken Language Understanding