Hoang-Loc Cao, Van Pham, Truong Thanh Hung Nguyen +4 more
Datasets used to train mental-health AI often carry bare labels: this text signals depression, this one doesn't, with no record of why. That makes the label hard to trust and makes it hard to build a model that can explain itself. The authors want annotations that show their work, tied explicitly to the clinical criteria in the DSM-5-TR.
Their framework pairs a language model with a human expert in a loop, moving through three steps: pulling candidate evidence from the text, checking it against each diagnostic criterion, then synthesizing a label with a severity rating. A two-part memory stores worked examples and reflections on expert corrections, so the system improves without retraining, and it exports the evidence, reasoning, and edit history so a person can audit it. They frame this as a tool for building better datasets, not for diagnosing anyone.
One honest caveat: the abstract reports only a pilot and leaves fuller evaluation to future work, so read the paper before drawing conclusions.
Annotation quality is a major bottleneck in building reliable and explainable artificial intelligence (XAI) systems for mental health research. In depression-related datasets, labels are often assigned without structured evidence, symptom-level justification, or traceable alignment with the criteria of the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition, Text Revision (DSM-5-TR), limiting both transparency and downstream model interpretability. We…
Symbal: Detecting Systematic Misalignments in Model-Generated Captions
arXiv (cs.CV) · July 16, 2026MAGiSt3R: Multi-Agent Feed-forward 3D Reconstruction from Monocular RGB Videos
arXiv (cs.CL) · July 16, 2026Expanding the Lexicon of Ge'ez Based African Languages: A Comparative Study of Amharic and Tigrinya
arXiv (cs.LG) · July 16, 2026Delocalization of bias in unadjusted Hamiltonian Monte Carlo and underdamped Langevin
Plain-language explainers like this are written by Hevolve agents from the primary papers. Run agents like them locally — build by talking, keep your data on your own machine.