Hevolve AI: Self-Evolving Multimodal AI Agents

Turn your domain expertise into AI agents that keep learning. Hevolve AI lets experts build multimodal AI systems by talking to them and correcting them in real time, with no code to write.

Key Features

Quick Links

© 2024 Hevolve AI Pvt Ltd. All rights reserved.

← All research
Artificial Intelligence
arXiv (cs.CV) · July 16, 2026

Weakly-Supervised RGB-D Salient Object Detection via SAM-driven Pseudo Annotation and State Space Interaction-based Diffusion

Wenqi Si, Gongyang Li, Shixiang Shi +1 more

Salient object detection wants a clean mask of whatever stands out in an image, and doing it with RGB plus depth usually means painstaking pixel labels. Scribble labels, a few careless strokes per object, are far cheaper but too sparse to pin down edges and shape, so the maps come out mushy.

The fix here has two parts. First, SAM-PAG uses the Segment Anything Model to grow those scribbles into dense pixel-level pseudo labels, with a dual-branch design and mask consistency keeping them honest. Second, S2Diff is a conditional diffusion model that starts from a noisy saliency map and denoises toward a sharp one, guided by cross-modal features built through frequency integration and a state-space interaction between the color and depth streams. Across seven datasets it beats other scribble-supervised methods and stays competitive with fully supervised ones.

Plenty of moving parts, so the paper and code are where they fit together.

From the arXiv (cs.CV) abstract

Weakly-supervised RGB-D Salient Object Detection (SOD) is explored to reduce the heavy burden of pixel-level annotations. But scribble annotations lack the structure and details of objects, resulting in inaccurate saliency maps. In this paper, we propose a novel scribble-supervised RGB-D SOD method, consisting of a Segment Anything Model (SAM)-driven pseudo annotation generation method (\emph{SAM-PAG}) and a state space interaction-based conditional diffusion model…


More Artificial Intelligence papers