Hugging Face Daily Papers · · 3 min read

SePO: Self-Evolving Prompt Agent for System Prompt Optimization

Mirrored from Hugging Face Daily Papers for archival readability. Support the source by reading on the original site.

SePO is a self-evolving system prompt optimization framework that improves a prompt agent by applying the same prompt optimization procedure to the prompt agent itself.</p>\n","updatedAt":"2026-06-05T02:54:21.647Z","author":{"_id":"6520baf9a56398128b1f32b2","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6520baf9a56398128b1f32b2/BFsch4sAlpOTAq4XZk4Au.png","fullname":"Tao Wangcheng","name":"taowangcheng","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8567072749137878},"editors":["taowangcheng"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/6520baf9a56398128b1f32b2/BFsch4sAlpOTAq4XZk4Au.png"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2606.04465","authors":[{"_id":"6a20d00915100c5272a84614","user":{"_id":"6520baf9a56398128b1f32b2","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6520baf9a56398128b1f32b2/BFsch4sAlpOTAq4XZk4Au.png","isPro":false,"fullname":"Tao Wangcheng","user":"taowangcheng","type":"user","name":"taowangcheng"},"name":"Wangcheng Tao","status":"claimed_verified","statusLastChangedAt":"2026-06-04T12:40:02.148Z","hidden":false},{"_id":"6a20d00915100c5272a84615","name":"Han Wu","hidden":false},{"_id":"6a20d00915100c5272a84616","name":"Weng-Fai Wong","hidden":false}],"publishedAt":"2026-06-03T00:00:00.000Z","submittedOnDailyAt":"2026-06-05T00:00:00.000Z","title":"SePO: Self-Evolving Prompt Agent for System Prompt Optimization","submittedOnDailyBy":{"_id":"6520baf9a56398128b1f32b2","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6520baf9a56398128b1f32b2/BFsch4sAlpOTAq4XZk4Au.png","isPro":false,"fullname":"Tao Wangcheng","user":"taowangcheng","type":"user","name":"taowangcheng"},"summary":"System prompt optimization improves agent behavior without modifying the underlying model, yielding human-readable, model-agnostic instructions. Existing methods build a prompt agent that refines task agents' system prompts, yet leave the prompt agent's own system prompt hand-engineered and fixed. We propose Self-Evolving Prompt Optimization (SePO), which treats the prompt agent's own system prompt as an optimization target alongside task agents' system prompts. SePO adopts a self-referential design. A single prompt agent improves both task agents' system prompts and its own under an open-ended evolutionary search that maintains an archive of candidate prompts as stepping stones. Training proceeds in two stages: pre-training evolves the prompt agent on a multi-task pool, and fine-tuning then applies it to a target task. Across five benchmarks spanning math (AIME'25), abstract reasoning (ARC-AGI-1), graduate-level science (GPQA), code generation (MBPP), and logic puzzles (Sudoku), SePO consistently outperforms Manual-CoT, TextGrad, and MetaSPO, improving the average accuracy by 4.49 points compared to Manual-CoT. The prompt optimization skill from pre-training also generalizes to tasks beyond the pre-training mixture, rather than memorizing per-task prompts.","upvotes":1,"discussionId":"6a20d00a15100c5272a84617","ai_summary":"Self-Evolving Prompt Optimization (SePO) enhances agent performance by jointly optimizing both task and prompt agent system prompts through evolutionary search, demonstrating superior accuracy across diverse benchmarks.","ai_keywords":["prompt optimization","system prompt","self-referential design","evolutionary search","prompt agent","task agents","multi-task pool","fine-tuning","benchmark evaluation","generalization"],"ai_summary_model":"Qwen/Qwen2.5-Coder-32B-Instruct"},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"6520baf9a56398128b1f32b2","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6520baf9a56398128b1f32b2/BFsch4sAlpOTAq4XZk4Au.png","isPro":false,"fullname":"Tao Wangcheng","user":"taowangcheng","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":0,"markdownContentUrl":"https://huggingface.co/buckets/huggingchat/papers-content/resolve/2606/2606.04465.md"}">
Papers
arxiv:2606.04465

SePO: Self-Evolving Prompt Agent for System Prompt Optimization

Published on Jun 3
· Submitted by
Tao Wangcheng
on Jun 5
Authors:
,

Abstract

Self-Evolving Prompt Optimization (SePO) enhances agent performance by jointly optimizing both task and prompt agent system prompts through evolutionary search, demonstrating superior accuracy across diverse benchmarks.

System prompt optimization improves agent behavior without modifying the underlying model, yielding human-readable, model-agnostic instructions. Existing methods build a prompt agent that refines task agents' system prompts, yet leave the prompt agent's own system prompt hand-engineered and fixed. We propose Self-Evolving Prompt Optimization (SePO), which treats the prompt agent's own system prompt as an optimization target alongside task agents' system prompts. SePO adopts a self-referential design. A single prompt agent improves both task agents' system prompts and its own under an open-ended evolutionary search that maintains an archive of candidate prompts as stepping stones. Training proceeds in two stages: pre-training evolves the prompt agent on a multi-task pool, and fine-tuning then applies it to a target task. Across five benchmarks spanning math (AIME'25), abstract reasoning (ARC-AGI-1), graduate-level science (GPQA), code generation (MBPP), and logic puzzles (Sudoku), SePO consistently outperforms Manual-CoT, TextGrad, and MetaSPO, improving the average accuracy by 4.49 points compared to Manual-CoT. The prompt optimization skill from pre-training also generalizes to tasks beyond the pre-training mixture, rather than memorizing per-task prompts.

Community

Paper author Paper submitter about 8 hours ago

SePO is a self-evolving system prompt optimization framework that improves a prompt agent by applying the same prompt optimization procedure to the prompt agent itself.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images

· Sign up or log in to comment

Get this paper in your agent:

hf papers read 2606.04465
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2606.04465 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2606.04465 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2606.04465 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from Hugging Face Daily Papers