Hugging Face Daily Papers · · 3 min read

SWE-Explore: Benchmarking How Coding Agents Explore Repositories

Mirrored from Hugging Face Daily Papers for archival readability. Support the source by reading on the original site.

Is your coding agent good at exploring repositories?</p>\n","updatedAt":"2026-06-09T02:14:24.732Z","author":{"_id":"645b0c3ec35da9c7afd95421","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/645b0c3ec35da9c7afd95421/vYBrCDagHsXAo6J2p-uG0.jpeg","fullname":"Yuling","name":"YerbaPage","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":105,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7718518376350403},"editors":["YerbaPage"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/645b0c3ec35da9c7afd95421/vYBrCDagHsXAo6J2p-uG0.jpeg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2606.07297","authors":[{"_id":"6a26b590e4c258a0294923e5","name":"Shaoqiu Zhang","hidden":false},{"_id":"6a26b590e4c258a0294923e6","name":"Yuhang Wang","hidden":false},{"_id":"6a26b590e4c258a0294923e7","name":"Jialiang Liang","hidden":false},{"_id":"6a26b590e4c258a0294923e8","name":"Yuling Shi","hidden":false},{"_id":"6a26b590e4c258a0294923e9","name":"Wenhao Zeng","hidden":false},{"_id":"6a26b590e4c258a0294923ea","name":"Maoquan Wang","hidden":false},{"_id":"6a26b590e4c258a0294923eb","name":"Shilin He","hidden":false},{"_id":"6a26b590e4c258a0294923ec","name":"Ningyuan Xu","hidden":false},{"_id":"6a26b590e4c258a0294923ed","name":"Siyu Ye","hidden":false},{"_id":"6a26b590e4c258a0294923ee","name":"Kai Cai","hidden":false},{"_id":"6a26b590e4c258a0294923ef","name":"Xiaodong Gu","hidden":false}],"publishedAt":"2026-06-05T00:00:00.000Z","submittedOnDailyAt":"2026-06-09T00:00:00.000Z","title":"SWE-Explore: Benchmarking How Coding Agents Explore Repositories","submittedOnDailyBy":{"_id":"645b0c3ec35da9c7afd95421","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/645b0c3ec35da9c7afd95421/vYBrCDagHsXAo6J2p-uG0.jpeg","isPro":false,"fullname":"Yuling","user":"YerbaPage","type":"user","name":"YerbaPage"},"summary":"Repository-level coding benchmarks such as SWE-bench have driven a rapid surge in the capabilities of coding agents. Yet they usually treat coding tasks as a holistic, binary prediction problem (e.g., resolved or unresolved), neglecting fine-grained agent capabilities such as repository understanding, context retrieval, code localization, and bug diagnosis. In this paper, we introduce SWE-Explore, a benchmark that isolates the evaluation of repository exploration, a critical capability of coding agents. Given a repository and an issue, SWE-Explore asks an explorer to return a ranked list of relevant code regions under a fixed line budget. SWE-Explore covers 848 issues across 10 programming languages and 203 open-source repositories. For each instance, we derive line-level ground truth from independent agent trajectories that successfully solved the same issue, distilling the specific code regions their solution paths actually consulted. We evaluate exploration along coverage, ranking, and context-efficiency dimensions, showing that these metrics strongly track downstream repair behavior. Across a broad set of retrieval methods, general coding agents, and specialized localizers, we find that agentic explorers form a clear tier above classical retrieval. While file-level localization is already strong for modern methods, line-level coverage and efficient ranking remain the key axes differentiating state-of-the-art explorers.","upvotes":82,"discussionId":"6a26b590e4c258a0294923f0","projectPage":"https://huggingface.co/datasets/SWE-Explore-Bench/SWE-Explore-Bench","githubRepo":"https://github.com/Qiushao-E/SWE-Explore-Bench","githubRepoAddedBy":"user","ai_summary":"SWE-Explore introduces a benchmark for evaluating coding agents' repository exploration capabilities by requiring ranked lists of relevant code regions within line budgets, demonstrating that agentic exploration outperforms traditional retrieval methods.","ai_keywords":["repository exploration","coding agents","SWE-bench","SWE-Explore","line budget","code localization","context retrieval","repository understanding","bug diagnosis","retrieval methods","agentic explorers","line-level coverage","ranking","context-efficiency"],"ai_summary_model":"Qwen/Qwen2.5-Coder-32B-Instruct","githubStars":5,"organization":{"_id":"63e5ef7bf2e9a8f22c515654","name":"SJTU","fullname":"Shanghai Jiao Tong University","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/1676013394657-63e5ee22b6a40bf941da0928.png"}},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"69fc640733be62588621c3f5","avatarUrl":"/avatars/77cd4fa6d7c099e7f7c968706f0d0fca.svg","isPro":false,"fullname":"SWE-Explore-Bench","user":"SWE-Explore-Bench","type":"user"},{"_id":"65db54e5ab2f64915c0b9cf0","avatarUrl":"/avatars/d451523cad8c17cda603eea2961c50ad.svg","isPro":false,"fullname":"Shaoqiu Zhang","user":"qiushao","type":"user"},{"_id":"635f9e75d813a1833dd1605b","avatarUrl":"/avatars/02b151a0a6103959d126d28f54113f68.svg","isPro":false,"fullname":"kk","user":"hopcookie","type":"user"},{"_id":"65684c80a9a1a6a50d779f58","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/65684c80a9a1a6a50d779f58/it534ZdH5LxRub1M_o3uM.jpeg","isPro":false,"fullname":"Silin Chen","user":"Silin-Chen","type":"user"},{"_id":"6946402dc5169b10be407101","avatarUrl":"/avatars/aaca47fb4c7e54fc09da2d3ffef69df7.svg","isPro":false,"fullname":"莊孟潔","user":"Lumos55660","type":"user"},{"_id":"68b9405bc6bdb23cfbd73a8f","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/A9wQmyLIC7vkAkjsaOHFz.png","isPro":false,"fullname":"Haowen Gong","user":"Foreverdream","type":"user"},{"_id":"64bd46d1cf4f379eeb9f8f3d","avatarUrl":"/avatars/65a841a7d3d272fab3799240941b995a.svg","isPro":false,"fullname":"jingkuan wang","user":"jkKing","type":"user"},{"_id":"68e2570e6ecc8f79ab4577ec","avatarUrl":"/avatars/408e8683b6947b1315c9eb41da5b4a34.svg","isPro":false,"fullname":"aa","user":"Disaaad","type":"user"},{"_id":"663388cd7aa1d2abc7204e7a","avatarUrl":"/avatars/c4c6ad5db1ea4d3406ecc005947d2a2b.svg","isPro":false,"fullname":"Six Seven","user":"Six7","type":"user"},{"_id":"6579e083bd9ea8b29c4901cb","avatarUrl":"/avatars/d60e0c32340ce2adc7ac84eeb63669a0.svg","isPro":false,"fullname":"xxxxxz","user":"xxx405","type":"user"},{"_id":"645b0c3ec35da9c7afd95421","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/645b0c3ec35da9c7afd95421/vYBrCDagHsXAo6J2p-uG0.jpeg","isPro":false,"fullname":"Yuling","user":"YerbaPage","type":"user"},{"_id":"69df58c25a803bdfc44bd84b","avatarUrl":"/avatars/1351290380044e3b4dc583a970277498.svg","isPro":false,"fullname":"Yiyang Jin","user":"sjtuAmos","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":1,"organization":{"_id":"63e5ef7bf2e9a8f22c515654","name":"SJTU","fullname":"Shanghai Jiao Tong University","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/1676013394657-63e5ee22b6a40bf941da0928.png"},"markdownContentUrl":"https://huggingface.co/buckets/huggingchat/papers-content/resolve/2606/2606.07297.md"}">
Papers
arxiv:2606.07297

SWE-Explore: Benchmarking How Coding Agents Explore Repositories

Published on Jun 5
· Submitted by
Yuling
on Jun 9
#1 Paper of the day
Authors:
,
,
,
,
,
,
,
,
,
,

Abstract

SWE-Explore introduces a benchmark for evaluating coding agents' repository exploration capabilities by requiring ranked lists of relevant code regions within line budgets, demonstrating that agentic exploration outperforms traditional retrieval methods.

Repository-level coding benchmarks such as SWE-bench have driven a rapid surge in the capabilities of coding agents. Yet they usually treat coding tasks as a holistic, binary prediction problem (e.g., resolved or unresolved), neglecting fine-grained agent capabilities such as repository understanding, context retrieval, code localization, and bug diagnosis. In this paper, we introduce SWE-Explore, a benchmark that isolates the evaluation of repository exploration, a critical capability of coding agents. Given a repository and an issue, SWE-Explore asks an explorer to return a ranked list of relevant code regions under a fixed line budget. SWE-Explore covers 848 issues across 10 programming languages and 203 open-source repositories. For each instance, we derive line-level ground truth from independent agent trajectories that successfully solved the same issue, distilling the specific code regions their solution paths actually consulted. We evaluate exploration along coverage, ranking, and context-efficiency dimensions, showing that these metrics strongly track downstream repair behavior. Across a broad set of retrieval methods, general coding agents, and specialized localizers, we find that agentic explorers form a clear tier above classical retrieval. While file-level localization is already strong for modern methods, line-level coverage and efficient ranking remain the key axes differentiating state-of-the-art explorers.

Community

Paper submitter about 6 hours ago

Is your coding agent good at exploring repositories?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images

· Sign up or log in to comment

Get this paper in your agent:

hf papers read 2606.07297
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2606.07297 in a model README.md to link it from this page.

Datasets citing this paper 1

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2606.07297 in a Space README.md to link it from this page.

Collections including this paper 1

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from Hugging Face Daily Papers