Hugging Face Daily Papers · · 4 min read

PACE: Towards Surfacing Hidden Conflicts in User Requests

Mirrored from Hugging Face Daily Papers for archival readability. Support the source by reading on the original site.

PACE is a novel dataset for evaluating whether personalized assistants can recognize hidden conflicts between seemingly reasonable user requests and contextual information stored in a user-specific knowledge base. These conflicts arise when relevant user context makes a request unsuitable to carry out as given. We also introduce PaceMaker, a multi-agent framework designed to retrieve relevant evidence and support conflict-aware reasoning.</p>\n","updatedAt":"2026-09-04T05:39:27.717Z","author":{"_id":"6527f3f27ad7a346021075a7","avatarUrl":"/avatars/8f9e154b9426be73d7f4320ce4c6f342.svg","fullname":"Jihyoung Jang","name":"jihyoung","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":2,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9020935297012329},"editors":["jihyoung"],"editorAvatarUrls":["/avatars/8f9e154b9426be73d7f4320ce4c6f342.svg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2609.03293","authors":[{"_id":"6a9a21788f7c3b75572393fd","user":{"_id":"68ad2794d356d54cf64d4cc0","avatarUrl":"/avatars/e49ec584da0e1dce1d1dbb050a5c5fbf.svg","isPro":false,"fullname":"Yoojin Kim","user":"p2chp2t","type":"user","name":"p2chp2t"},"name":"Yoojin Kim","status":"claimed_verified","statusLastChangedAt":"2026-09-04T08:45:04.237Z","hidden":false},{"_id":"6a9a21788f7c3b75572393fe","user":{"_id":"6527f3f27ad7a346021075a7","avatarUrl":"/avatars/8f9e154b9426be73d7f4320ce4c6f342.svg","isPro":false,"fullname":"Jihyoung Jang","user":"jihyoung","type":"user","name":"jihyoung"},"name":"Jihyoung Jang","status":"claimed_verified","statusLastChangedAt":"2026-09-04T08:45:04.232Z","hidden":false},{"_id":"6a9a21788f7c3b75572393ff","name":"Hyounghun Kim","hidden":false}],"publishedAt":"2026-09-03T00:00:00.000Z","submittedOnDailyAt":"2026-09-04T00:00:00.000Z","title":"PACE: Towards Surfacing Hidden Conflicts in User Requests","submittedOnDailyBy":{"_id":"6527f3f27ad7a346021075a7","avatarUrl":"/avatars/8f9e154b9426be73d7f4320ce4c6f342.svg","isPro":false,"fullname":"Jihyoung Jang","user":"jihyoung","type":"user","name":"jihyoung"},"summary":"Personalized assistants should not only comply with user requests but also assess whether those requests are appropriate given the user's current circumstances. However, prior work has primarily focused on accurately executing requests, overlooking the need for assistants to account for context and engage in conflict-based refusal. Furthermore, while existing work on conflict or safety detection relies on explicitly provided factors, real-world scenarios often involve implicit factors that must be retrieved from a knowledge base (KB). To this end, we introduce Personalized Assistants for Conflict Evaluation (PACE), a dataset for evaluating whether models can identify latent constraints, expressed as egocentric knowledge or events, that render seemingly reasonable user requests inappropriate. PACE pairs user requests grounded in well-defined personas with egocentric KB facts, requiring models to integrate contextual evidence to determine whether a request is conflicting. This implicit retrieval setting hinders the direct association between user requests and conflict-inducing knowledge, making it difficult for existing models to identify relevant user-specific facts. To address this challenge, we further propose PaceMaker, a multi-agent framework in which specialized agents coordinate across query reformulation, multi-hop graph traversal, and conflict-aware filtering to retrieve contextually decisive evidence. Experiments on PACE evaluate both evidence retrieval quality and conflict decision accuracy, showing that PaceMaker consistently outperforms existing approaches.","upvotes":6,"discussionId":"6a9a21798f7c3b7557239400","ai_summary":"PaceMaker uses coordinated agents to retrieve implicit contextual evidence and evaluate whether personalized requests conflict with hidden user constraints.","ai_keywords":["multi-agent framework","query reformulation","multi-hop graph traversal","conflict-aware filtering","egocentric knowledge","implicit retrieval"],"ai_summary_model":"thinkingmachines/Inkling-Small","organization":{"_id":"62459012e1b9dab15a3e6674","name":"POSTECH","fullname":"Pohang University of Science and Technology","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648726022705-62458f43d5895bdf34ee7d56.jpeg"}},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"6527f3f27ad7a346021075a7","avatarUrl":"/avatars/8f9e154b9426be73d7f4320ce4c6f342.svg","isPro":false,"fullname":"Jihyoung Jang","user":"jihyoung","type":"user"},{"_id":"65c48332610030bb4b4da045","avatarUrl":"/avatars/c20afefd592148600e809f3a6a734205.svg","isPro":false,"fullname":"Jongyeop Hyun","user":"mldljyh","type":"user"},{"_id":"68ad2794d356d54cf64d4cc0","avatarUrl":"/avatars/e49ec584da0e1dce1d1dbb050a5c5fbf.svg","isPro":false,"fullname":"Yoojin Kim","user":"p2chp2t","type":"user"},{"_id":"64e5b256529dfcfebe903a8f","avatarUrl":"/avatars/0a9a98e1a3c3b7a8cfd37f48e7bb74ae.svg","isPro":false,"fullname":"gyuwon12","user":"gyuwon12","type":"user"},{"_id":"669f6a7ff5f50bb9351b3843","avatarUrl":"/avatars/bf085740407d65f5e5b4e64b4223724a.svg","isPro":false,"fullname":"GunYoung Kwak","user":"HelloGY","type":"user"},{"_id":"63ac5701c21e60a3e9b58aa7","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63ac5701c21e60a3e9b58aa7/g6EX7diOpuA94R2ab-rZC.png","isPro":true,"fullname":"Dipankar Sarkar","user":"dipankarsarkar","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":0,"organization":{"_id":"62459012e1b9dab15a3e6674","name":"POSTECH","fullname":"Pohang University of Science and Technology","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648726022705-62458f43d5895bdf34ee7d56.jpeg"},"markdownContentUrl":"https://huggingface.co/buckets/huggingchat/papers-content/resolve/2609/2609.03293.md","query":{}}">
Papers
arxiv:2609.03293

PACE: Towards Surfacing Hidden Conflicts in User Requests

Published on Sep 3
· Submitted by
Jihyoung Jang
on Sep 4

Abstract

PaceMaker uses coordinated agents to retrieve implicit contextual evidence and evaluate whether personalized requests conflict with hidden user constraints.

Personalized assistants should not only comply with user requests but also assess whether those requests are appropriate given the user's current circumstances. However, prior work has primarily focused on accurately executing requests, overlooking the need for assistants to account for context and engage in conflict-based refusal. Furthermore, while existing work on conflict or safety detection relies on explicitly provided factors, real-world scenarios often involve implicit factors that must be retrieved from a knowledge base (KB). To this end, we introduce Personalized Assistants for Conflict Evaluation (PACE), a dataset for evaluating whether models can identify latent constraints, expressed as egocentric knowledge or events, that render seemingly reasonable user requests inappropriate. PACE pairs user requests grounded in well-defined personas with egocentric KB facts, requiring models to integrate contextual evidence to determine whether a request is conflicting. This implicit retrieval setting hinders the direct association between user requests and conflict-inducing knowledge, making it difficult for existing models to identify relevant user-specific facts. To address this challenge, we further propose PaceMaker, a multi-agent framework in which specialized agents coordinate across query reformulation, multi-hop graph traversal, and conflict-aware filtering to retrieve contextually decisive evidence. Experiments on PACE evaluate both evidence retrieval quality and conflict decision accuracy, showing that PaceMaker consistently outperforms existing approaches.

Community

Paper author Paper submitter about 3 hours ago

PACE is a novel dataset for evaluating whether personalized assistants can recognize hidden conflicts between seemingly reasonable user requests and contextual information stored in a user-specific knowledge base. These conflicts arise when relevant user context makes a request unsuitable to carry out as given. We also introduce PaceMaker, a multi-agent framework designed to retrieve relevant evidence and support conflict-aware reasoning.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images

· Sign up or log in to comment

Get this paper in your agent:

hf papers read 2609.03293
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper

No model linking this paper

Cite arxiv.org/abs/2609.03293 in a model README.md to link it from this page.

Datasets citing this paper

Spaces citing this paper

No Space linking this paper

Cite arxiv.org/abs/2609.03293 in a Space README.md to link it from this page.

Collections including this paper

No Collection including this paper

Add this paper to a collection to link it from this page.

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from Hugging Face Daily Papers