PACE is a novel dataset for evaluating whether personalized assistants can recognize hidden conflicts between seemingly reasonable user requests and contextual information stored in a user-specific knowledge base. These conflicts arise when relevant user context makes a request unsuitable to carry out as given. We also introduce PaceMaker, a multi-agent framework designed to retrieve relevant evidence and support conflict-aware reasoning.</p>\n","updatedAt":"2026-09-04T05:39:27.717Z","author":{"_id":"6527f3f27ad7a346021075a7","avatarUrl":"/avatars/8f9e154b9426be73d7f4320ce4c6f342.svg","fullname":"Jihyoung Jang","name":"jihyoung","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":2,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9020935297012329},"editors":["jihyoung"],"editorAvatarUrls":["/avatars/8f9e154b9426be73d7f4320ce4c6f342.svg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2609.03293","authors":[{"_id":"6a9a21788f7c3b75572393fd","user":{"_id":"68ad2794d356d54cf64d4cc0","avatarUrl":"/avatars/e49ec584da0e1dce1d1dbb050a5c5fbf.svg","isPro":false,"fullname":"Yoojin Kim","user":"p2chp2t","type":"user","name":"p2chp2t"},"name":"Yoojin Kim","status":"claimed_verified","statusLastChangedAt":"2026-09-04T08:45:04.237Z","hidden":false},{"_id":"6a9a21788f7c3b75572393fe","user":{"_id":"6527f3f27ad7a346021075a7","avatarUrl":"/avatars/8f9e154b9426be73d7f4320ce4c6f342.svg","isPro":false,"fullname":"Jihyoung Jang","user":"jihyoung","type":"user","name":"jihyoung"},"name":"Jihyoung Jang","status":"claimed_verified","statusLastChangedAt":"2026-09-04T08:45:04.232Z","hidden":false},{"_id":"6a9a21788f7c3b75572393ff","name":"Hyounghun Kim","hidden":false}],"publishedAt":"2026-09-03T00:00:00.000Z","submittedOnDailyAt":"2026-09-04T00:00:00.000Z","title":"PACE: Towards Surfacing Hidden Conflicts in User Requests","submittedOnDailyBy":{"_id":"6527f3f27ad7a346021075a7","avatarUrl":"/avatars/8f9e154b9426be73d7f4320ce4c6f342.svg","isPro":false,"fullname":"Jihyoung Jang","user":"jihyoung","type":"user","name":"jihyoung"},"summary":"Personalized assistants should not only comply with user requests but also assess whether those requests are appropriate given the user's current circumstances. However, prior work has primarily focused on accurately executing requests, overlooking the need for assistants to account for context and engage in conflict-based refusal. Furthermore, while existing work on conflict or safety detection relies on explicitly provided factors, real-world scenarios often involve implicit factors that must be retrieved from a knowledge base (KB). To this end, we introduce Personalized Assistants for Conflict Evaluation (PACE), a dataset for evaluating whether models can identify latent constraints, expressed as egocentric knowledge or events, that render seemingly reasonable user requests inappropriate. PACE pairs user requests grounded in well-defined personas with egocentric KB facts, requiring models to integrate contextual evidence to determine whether a request is conflicting. This implicit retrieval setting hinders the direct association between user requests and conflict-inducing knowledge, making it difficult for existing models to identify relevant user-specific facts. To address this challenge, we further propose PaceMaker, a multi-agent framework in which specialized agents coordinate across query reformulation, multi-hop graph traversal, and conflict-aware filtering to retrieve contextually decisive evidence. Experiments on PACE evaluate both evidence retrieval quality and conflict decision accuracy, showing that PaceMaker consistently outperforms existing approaches.","upvotes":6,"discussionId":"6a9a21798f7c3b7557239400","ai_summary":"PaceMaker uses coordinated agents to retrieve implicit contextual evidence and evaluate whether personalized requests conflict with hidden user constraints.","ai_keywords":["multi-agent framework","query reformulation","multi-hop graph traversal","conflict-aware filtering","egocentric knowledge","implicit retrieval"],"ai_summary_model":"thinkingmachines/Inkling-Small","organization":{"_id":"62459012e1b9dab15a3e6674","name":"POSTECH","fullname":"Pohang University of Science and Technology","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648726022705-62458f43d5895bdf34ee7d56.jpeg"}},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"6527f3f27ad7a346021075a7","avatarUrl":"/avatars/8f9e154b9426be73d7f4320ce4c6f342.svg","isPro":false,"fullname":"Jihyoung Jang","user":"jihyoung","type":"user"},{"_id":"65c48332610030bb4b4da045","avatarUrl":"/avatars/c20afefd592148600e809f3a6a734205.svg","isPro":false,"fullname":"Jongyeop Hyun","user":"mldljyh","type":"user"},{"_id":"68ad2794d356d54cf64d4cc0","avatarUrl":"/avatars/e49ec584da0e1dce1d1dbb050a5c5fbf.svg","isPro":false,"fullname":"Yoojin Kim","user":"p2chp2t","type":"user"},{"_id":"64e5b256529dfcfebe903a8f","avatarUrl":"/avatars/0a9a98e1a3c3b7a8cfd37f48e7bb74ae.svg","isPro":false,"fullname":"gyuwon12","user":"gyuwon12","type":"user"},{"_id":"669f6a7ff5f50bb9351b3843","avatarUrl":"/avatars/bf085740407d65f5e5b4e64b4223724a.svg","isPro":false,"fullname":"GunYoung Kwak","user":"HelloGY","type":"user"},{"_id":"63ac5701c21e60a3e9b58aa7","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63ac5701c21e60a3e9b58aa7/g6EX7diOpuA94R2ab-rZC.png","isPro":true,"fullname":"Dipankar Sarkar","user":"dipankarsarkar","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":0,"organization":{"_id":"62459012e1b9dab15a3e6674","name":"POSTECH","fullname":"Pohang University of Science and Technology","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648726022705-62458f43d5895bdf34ee7d56.jpeg"},"markdownContentUrl":"https://huggingface.co/buckets/huggingchat/papers-content/resolve/2609/2609.03293.md","query":{}}">
PACE: Towards Surfacing Hidden Conflicts in User Requests
Abstract
PaceMaker uses coordinated agents to retrieve implicit contextual evidence and evaluate whether personalized requests conflict with hidden user constraints.
Personalized assistants should not only comply with user requests but also assess whether those requests are appropriate given the user's current circumstances. However, prior work has primarily focused on accurately executing requests, overlooking the need for assistants to account for context and engage in conflict-based refusal. Furthermore, while existing work on conflict or safety detection relies on explicitly provided factors, real-world scenarios often involve implicit factors that must be retrieved from a knowledge base (KB). To this end, we introduce Personalized Assistants for Conflict Evaluation (PACE), a dataset for evaluating whether models can identify latent constraints, expressed as egocentric knowledge or events, that render seemingly reasonable user requests inappropriate. PACE pairs user requests grounded in well-defined personas with egocentric KB facts, requiring models to integrate contextual evidence to determine whether a request is conflicting. This implicit retrieval setting hinders the direct association between user requests and conflict-inducing knowledge, making it difficult for existing models to identify relevant user-specific facts. To address this challenge, we further propose PaceMaker, a multi-agent framework in which specialized agents coordinate across query reformulation, multi-hop graph traversal, and conflict-aware filtering to retrieve contextually decisive evidence. Experiments on PACE evaluate both evidence retrieval quality and conflict decision accuracy, showing that PaceMaker consistently outperforms existing approaches.
Community
PACE is a novel dataset for evaluating whether personalized assistants can recognize hidden conflicts between seemingly reasonable user requests and contextual information stored in a user-specific knowledge base. These conflicts arise when relevant user context makes a request unsuitable to carry out as given. We also introduce PaceMaker, a multi-agent framework designed to retrieve relevant evidence and support conflict-aware reasoning.
Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images
Cite arxiv.org/abs/2609.03293 in a model README.md to link it from this page.
Cite arxiv.org/abs/2609.03293 in a Space README.md to link it from this page.
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.