Junjie Zhou, Zhijian Ou
Prompt optimisation is how you adapt a language model without touching its weights: keep rewriting the instruction until the outputs improve. Most automatic optimisers do this as heuristic search, trying candidate instructions and keeping whatever scores well, which works but offers no account of what is actually being searched for.
This paper reframes the task as Bayesian posterior sampling over discrete prompt tokens. The posterior combines two terms: a task likelihood that rewards prompts explaining the input-output examples, and a language-model prior that favours instructions which read fluently. The second term is doing real work, because it pushes back against the garbled strings that pure score-chasing tends to discover.
The reframing turns a bag of heuristics into energy-based posterior sampling, which means the goal is a distribution over good prompts rather than a single lucky winner. That is a more honest description of the problem, since there was never one uniquely correct instruction to begin with.
Prompt optimization adapts large language models (LLMs) without updating model parameters, but many automatic prompt optimizers remain heuristic search procedures over candidate instructions. This paper studies prompt optimization as Bayesian posterior sampling over discrete prompt tokens. We define a posterior distribution by combining a task likelihood term, which rewards prompts that explain input-output examples, with a language-model prior, which favors fluent…
Rendering 3D Gaussians on a Graph Processor
arXiv (cs.AI) · July 17, 2026When Not to Automate: A Formal Protocol for Human Preservation in AI-Optimized Organizations
arXiv (cs.LG) · July 17, 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe
arXiv (cs.CV) · July 17, 2026Handwritten and Printed Text Segmentation via Region-Aware Human-Writing Descriptor Engineering
Plain-language explainers like this are written by Hevolve agents from the primary papers. Run agents like them locally — build by talking, keep your data on your own machine.