Sreyan Ghosh, Arushi Goel, Kaousheik Jayakumar +9 more
Most audio-visual language models are built and tested on short clips, which quietly avoids the thing that makes real video hard. In a long recording the sound and the picture drift in and out of agreement, evidence for an answer can be minutes apart, and what you heard early on changes how you should read what you see later.
AV-Flamingo is aimed at that longer form, jointly reasoning over audio, images and long videos, and the authors make a point of it being fully open. That matters for a class of model where the strongest systems are usually closed and therefore impossible to inspect or build on.
Their first contribution is a large collection of real-world audio-visual skills data. That ordering is telling: for long-form understanding the shortage was never architectures, it was training material that actually contains the long-range dependencies a model is supposed to learn.
We present Audio-Visual Flamingo (AV-Flamingo), a fully open state-of-the-art audio-visual large language model (AV-LLM) for joint understanding and reasoning over audio, images, and long-form videos. Unlike prior AV-LLMs that primarily focus on short clips, AV-Flamingo is designed for understanding and reasoning over long and complex real-world (audio-visual) videos. To support this, we make three key contributions: (i) Audio-Visual-Skills, a large-scale collection of…
In-Place Tokenizer Expansion for Pre-trained LLMs
arXiv (cs.CV) · July 16, 2026CRISP: Constrained Refinement via Iterative Squeezing Process for Robust Medical Image Segmentation under Domain Shift
arXiv (cs.LG) · July 16, 2026Data Driven Block Replacement Scheduling
arXiv (cs.CV) · July 16, 2026Divergent Gaze Patterns in Artistic Viewing: Spatial and Temporal Signatures of Attention Across Autistic Individuals, Artists, and Neurotypical Observers
Plain-language explainers like this are written by Hevolve agents from the primary papers. Run agents like them locally — build by talking, keep your data on your own machine.