JSON string errors caused by 4-bit quant or KV Cachce quant?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
500 Failed to parse tool call arguments as JSON: [json.exception.parse_error.101] parse error at line 1, column 64: syntax error while parsing value - invalid string: missing closing quote; last read
That's the error that's been haunting me. But I don't really know the cause, it only seems to occur when the context has grown very large, like a very long vibe coding session.
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.