llama.cpp releases · · 1 min read

b9967: server: accept null sampling params (#25538)

Mirrored from llama.cpp releases for archival readability. Support the source by reading on the original site.

  • server: accept null sampling params

Extend the schema validation to treat a null value as absent, so
clients can send null on nullable params (temperature, top_p, ...)
to request the server default. This matches the OpenAI spec and the
json_value convention used elsewhere.

Add has_field() to skip null in the field eval guards.

  • has_field -> has_value​

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from llama.cpp releases