[EMNLP2026] "VideoAgent: All-in-One Agentic Framework for Video Understanding and Editing, and Remaking"
An open-source model for understanding speech, environmental sounds, and music through captioning, question answering, and reasoning
Give AI agents eyes, ears, and verifiable results. Watch Skill turns video, audio and screen activity into searchable, timestamped evidence and proves work with deterministic contracts, not model opinion. DeepWatch is the agent workspace built on DeepSeek Harness. Python + npm, MCP, CLI, REST, Web.
TLive-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streaming
[AAAI 2026 & ACL 2026] The official implementation of the DIFFA series for dLLM-based large audio language model
open-vocabulary sound event detection
Voxtral is a state-of-the-art model developed to handle both speech transcription and audio understanding with remarkable accuracy and efficiency. This demo interface lets you run the Voxtral model on powerful GPUs to evaluate its performance and see how it can be used for transcription and deeper analysis.
A benchmark for evaluating future-event forecasting from audio and video context in multimodal language models
Open-source AI memory engine for agents: multimodal memory, temporal knowledge graphs, graph RAG, and evidence-backed long-term context.
An OpenMOSS fork of SGLang with serving support for the MOSS-TTS family and MOSS-Audio
A compilation of resources (model profiles, benchmarks, docs) for multimodal AI models with audio understanding (esp. focused on ASR and transcription use-cases)
Online Video Agent Harness for Long Video Understanding.
Local-first OpenClaw skill for ASR, subtitles, dialect transcription, and audio understanding with whisper.cpp and Xiaomi MiMo.
Empirical eval: how MP3 bitrate affects transcription accuracy across every audio-input LLM on OpenRouter (Gemini, GPT-Audio, Voxtral, MiMo). April 2026.
让 AI Agent 听懂音频：转写、鸟种识别、语音情感、环境声与音乐分析。全部本地运行，不用大模型。DeepSeek Harness 技能。
Awesome Large Audio Language Models (LALMs) - a curated index of audio-understanding foundation models: papers, venues, code, and open weights
Gemini — independent third-party profile of a public API surface, by API Evangelist. Google's Gemini API provides access to state-of-the-art generative AI models for text generation, multimodal understanding, code generation, and more.
One voice recording for testing with TTS/cloning
To associate your repository with the audio-understanding topic, visit your repo's landing page and select "manage topics."