llama.cpp releases · · 1 min read

b10398: common: add system-level config file (#26118)

Mirrored from llama.cpp releases for archival readability. Support the source by reading on the original site.

  • common: Add CLI > ENV > models-presets > INI precedence
  1. CLI flags have the highest precedence
  2. ENV vars have the second-highest precedence
  3. System and User configs have the lowest precedence
    • Linux/BSD/Mac
      • /etc/llama.cpp/config.ini < ${XDG_CONFIG_HOME:-~/.config}/llama.cpp/config.ini
    • Windows
      • %PROGRAMDATA%\llama.cpp\config.ini < %APPDATA%\llama.cpp\config.ini
  • fix UB

  • use common_get_env

  • ignore_unknown_keys

  • nits

  • add docs


Co-authored-by: Xuan Son Nguyen [email protected]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from llama.cpp releases