OpenComputer provides a framework for creating verifiable software environments and benchmarks to evaluate computer-use agents through precise, state-aware task verification across diverse desktop applications.</p>\n","updatedAt":"2026-05-20T02:19:56.466Z","author":{"_id":"6039478ab3ecf716b1a5fd4d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6039478ab3ecf716b1a5fd4d/_Thy4E7taiSYBLKxEKJbT.jpeg","fullname":"taesiri","name":"taesiri","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":301,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8441310524940491},"editors":["taesiri"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/6039478ab3ecf716b1a5fd4d/_Thy4E7taiSYBLKxEKJbT.jpeg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2605.19769","authors":[{"_id":"6a0d1a3e65eb30f20d962bf6","name":"Jinbiao Wei","hidden":false},{"_id":"6a0d1a3e65eb30f20d962bf7","name":"Qianran Ma","hidden":false},{"_id":"6a0d1a3e65eb30f20d962bf8","name":"Yilun Zhao","hidden":false},{"_id":"6a0d1a3e65eb30f20d962bf9","name":"Xiao Zhou","hidden":false},{"_id":"6a0d1a3e65eb30f20d962bfa","name":"Kangqi Ni","hidden":false},{"_id":"6a0d1a3e65eb30f20d962bfb","name":"Guo Gan","hidden":false},{"_id":"6a0d1a3e65eb30f20d962bfc","name":"Arman Cohan","hidden":false}],"publishedAt":"2026-05-19T00:00:00.000Z","submittedOnDailyAt":"2026-05-20T00:00:00.000Z","title":"OpenComputer: Verifiable Software Worlds for Computer-Use Agents","submittedOnDailyBy":{"_id":"6039478ab3ecf716b1a5fd4d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6039478ab3ecf716b1a5fd4d/_Thy4E7taiSYBLKxEKJbT.jpeg","isPro":true,"fullname":"taesiri","user":"taesiri","type":"user","name":"taesiri"},"summary":"We present OpenComputer, a verifier-grounded framework for constructing verifiable software worlds for computer-use agents. OpenComputer integrates four components: (1) app-specific state verifiers that expose structured inspection endpoints over real applications, (2) a self-evolving verification layer that improves verifier reliability using execution-grounded feedback, (3) a task-generation pipeline that synthesizes realistic and machine-checkable desktop tasks, and (4) an evaluation harness that records full trajectories and computes auditable partial-credit rewards. In its current form, OpenComputer covers 33 desktop applications and 1,000 finalized tasks spanning browsers, office tools, creative software, development environments, file managers, and communication applications. Experiments show that OpenComputer's hard-coded verifiers align more closely with human adjudication than LLM-as-judge evaluation, especially when success depends on fine-grained application state. Frontier agents struggle with end-to-end completion despite partial progress, and open-source models exhibit sharp drops from their OSWorld-Verified scores, exposing a persistent gap in robust computer automation.","upvotes":45,"discussionId":"6a0d1a3e65eb30f20d962bfd","githubRepo":"https://github.com/echo0715/OpenComputer","githubRepoAddedBy":"user","ai_summary":"OpenComputer presents a framework for creating verifiable software environments for computer-use agents through integrated state verification, self-improving layers, task synthesis, and evaluation systems across multiple desktop applications.","ai_keywords":["verifier-grounded framework","state verifiers","self-evolving verification layer","task-generation pipeline","evaluation harness","desktop applications","machine-checkable tasks","partial-credit rewards","human adjudication","LLM-as-judge evaluation","computer automation"],"githubStars":3},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"683c642b02c1a474a867964e","avatarUrl":"/avatars/63e44a9cf788ee7b3ad236407700ceca.svg","isPro":false,"fullname":"Jinbiao Wei","user":"mikeweii","type":"user"},{"_id":"62f662bcc58915315c4eccea","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/62f662bcc58915315c4eccea/zOAQLONfMP88zr70sxHK-.jpeg","isPro":true,"fullname":"Yilun Zhao","user":"yilunzhao","type":"user"},{"_id":"638f1803c67af472d317a922","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/638f1803c67af472d317a922/9BMVXqHa-AsdZPmBprcbd.jpeg","isPro":false,"fullname":"siyue zhang","user":"siyue","type":"user"},{"_id":"6461226c933afb0106a9cd46","avatarUrl":"/avatars/5b0f20526446713aba938e1a05ad5814.svg","isPro":false,"fullname":"Kangqi (Kevin) Ni","user":"kangqi-ni","type":"user"},{"_id":"65dfeee3d16fb170031df293","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/65dfeee3d16fb170031df293/2VbNuqcpN3XrWB18NfzRQ.jpeg","isPro":false,"fullname":"gan","user":"guo9","type":"user"},{"_id":"685b93ba200d37039025b89d","avatarUrl":"/avatars/e8963b6ab8e6a248d701891e5cedd43e.svg","isPro":false,"fullname":"Xiao Zhou","user":"rebeccazzzz","type":"user"},{"_id":"66af69222f4c59963afc874f","avatarUrl":"/avatars/034ca7688282bdbeddbd4f03e54dead7.svg","isPro":false,"fullname":"Ray","user":"Raywithyou","type":"user"},{"_id":"64dc29d9b5d625e0e9a6ecb9","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/QxGBsnk1cNsBEPqSx4ae-.jpeg","isPro":false,"fullname":"Tingyu Song","user":"songtingyu","type":"user"},{"_id":"68084d54aca60e6178b3afb5","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/SfVotCbn0rUVtcUq65Npn.png","isPro":false,"fullname":"fu","user":"minuzero","type":"user"},{"_id":"69c4f2430b8e19faf9082483","avatarUrl":"/avatars/9b89764016620c675889e84b76358653.svg","isPro":false,"fullname":"zhou","user":"jack234dsaffsdf","type":"user"},{"_id":"69c4f3cb0b8e19faf9084411","avatarUrl":"/avatars/d3709c1d43709695466fe827a136eab8.svg","isPro":false,"fullname":"afdfjl","user":"jojf23423424","type":"user"},{"_id":"69c543346d459ab5301e71f9","avatarUrl":"/avatars/f2167e81a961815ce580d6a0afcbbaeb.svg","isPro":false,"fullname":"Spider","user":"feng9998","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":1,"markdownContentUrl":"https://huggingface.co/buckets/huggingchat/papers-content/resolve/2605/2605.19769.md"}">

Get this paper in your agent:

Don't have the latest CLI?

Cite arxiv.org/abs/2605.19769 in a model README.md to link it from this page.

Cite arxiv.org/abs/2605.19769 in a dataset README.md to link it from this page.

Cite arxiv.org/abs/2605.19769 in a Space README.md to link it from this page.