r/LocalLLaMA · · 1 min read

JSON string errors caused by 4-bit quant or KV Cachce quant?

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

500 Failed to parse tool call arguments as JSON: [json.exception.parse_error.101] parse error at line 1, column 64: syntax error while parsing value - invalid string: missing closing quote; last read

That's the error that's been haunting me. But I don't really know the cause, it only seems to occur when the context has grown very large, like a very long vibe coding session.

submitted by /u/Civil_Fee_7862
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA