🪐 HelixWorld: real-time interactive audio-visual world model.
-
Updated
Sep 3, 2026 - Python
#
audio-visual
Here are 62 public repositories matching this topic...
ACM MM 2021: 'Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection'
-
Updated
Oct 23, 2023 - Python
Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
-
Updated
Sep 15, 2025 - Python
[AAAI 2024] The official PyTorch implementation of "Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptation"
deep-learning pytorch audio-visual diffusion-models ai-art audio-to-video generative-ai video-synthesis modelscope
-
Updated
May 18, 2026 - Python
Implementation of "EPIC-Fusion: Audio-Visual Temporal Binding for Egocentric Action Recognition, ICCV, 2019" in PyTorch
-
Updated
Jan 25, 2021 - Python
OmniAgent (ICML 2026): the first native omni-modal agent for active video perception — a 7B agent that beats Qwen2.5-VL-72B with 73% fewer frames on LVBench.
agent reinforcement-learning video-understanding multimodal audio-visual video-question-answering temporal-grounding mllm vision-language-model llm-agent long-video-understanding qwen multimodal-llm icml2026 omni-modal
-
Updated
Sep 18, 2026 - Python
Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
-
Updated
Jan 29, 2024 - Python
ICLR 2026 Oral: WAVE: Learning Unified & Versatile Audio-Visual Embeddings with Multimodal LLM
-
Updated
Jul 30, 2026 - Python
Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"
-
Updated
Oct 11, 2024 - Python
[CVPR 2023] Collecting Cross-Modal Presence-Absence Evidence for Weakly-Supervised Audio-Visual Event Perception
-
Updated
Jun 17, 2023 - Python
Official Implementation of "Open-Vocabulary Audio-Visual Semantic Segmentation" [ACM MM 2024 Oral].
deep-learning transformer video-processing semantic-segmentation sound-localization audio-visual open-vocabulary
-
Updated
Nov 2, 2024 - Python
[🏆 IJCV 2025 & ACCV 2024 Best Paper Honorable Mention] Official pytorch implementation of the paper "High-Quality Visually-Guided Sound Separation from Diverse Categories"
-
Updated
Mar 30, 2026 - Python
Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scoring" in CVPR23
-
Updated
Jun 20, 2023 - Python
[ECCV 2022] Joint-Modal Label Denoising for Weakly-Supervised Audio-Visual Video Parsing
-
Updated
Jul 15, 2022 - Python
-
Updated
May 4, 2020 - Python
Transformer-based online speech recognition system with TensorFlow 2
python online deep-learning tensorflow transformer speech-recognition audio-visual-speech-recognition speech-recognizer multimodal multimodal-deep-learning mahcine-learning audio-visual tensorflow2 live-caption taris
-
Updated
Jan 22, 2021 - Python
Audio-Visual Generalized Zero-Shot Learning using Large Pre-Trained Models
learning clip clap zero-shot-learning audio-visual generalized-zero-shot-learning gzsl zsl audio-visual-learning audio-visual-generalized-zero-shot-learning
-
Updated
Apr 15, 2024 - Python
Code for CVPR 2021 paper Exploring Heterogeneous Clues for Weakly-Supervised Audio-Visual Video Parsing
-
Updated
Dec 29, 2021 - Python
Audio-visual diarization pipeline used for creating VoxConverse dataset
-
Updated
Jun 6, 2025 - Python
Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Model" (AVLIT)
lightweight pytorch multi-modal iterative speech-separation speech-enhancement audio-visual pytorch-lightning
-
Updated
Aug 20, 2026 - Python
Add this topic to your repo
To associate your repository with the audio-visual topic, visit your repo's landing page and select "manage topics."