Pinned Loading

1. Dr-SHAP-AV Dr-SHAP-AV Public

   Official Pytorch implementation of "Dr. SHAP-AV: Decoding Relative Modality Contributions via Shapley Attribution in Audio-Visual Speech Recognition" [Interspeech 2026, Long Track].

   Python 7

2. Llama-AVSR Llama-AVSR Public

   Official Pytorch implementation of "Large Language Models are Strong Audio-Visual Speech Recognition Learners" [ICASSP 2025] and "Mitigating Attention Sinks and Massive Activations in Audio-Visual …

   Python 63 8

3. Omni-AVSR Omni-AVSR Public

   Official Pytorch implementation of "Omni-AVSR: Towards Unified Multimodal Speech Recognition with Large Language Models" [IEEE ICASSP 2026].

   Python 37 3

4. PETL_AST PETL_AST Public

   This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" [IEEE MLSP 2024] and "Efficient Fine-tuning of Audio Spectrogram Transformers…

   Python 41 4

5. CL_SLU CL_SLU Public

   "An Investigation of the Combination of Rehearsal and Knowledge Distillation in Continual Learning for Spoken Language Understanding", accepted at INTERSPEECH 2023.

   Python 8