r/LocalLLaMA · · 1 min read

Gemma4_31b_fp8 keeping up with Sonnet_4.6_medium in my harness.

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Gemma4_31b_fp8 keeping up with Sonnet_4.6_medium in my harness.

https://preview.redd.it/9t0qvx6k5z5h1.png?width=1400&format=png&auto=webp&s=88dd83cdd6aa484dcf102bf078f7a80bebb4f7a2

  • Cypher queries for graph traversal (neo4j)
  • Entity extraction from text chunks (web query, graph query, vectors)
  • Agentic tool calling (Skills selection / successful running in Pi)
  • Code writing (Python)
  • Synthesis/summarization of multi-vector-retrieval

Gemma/Qwen in FP8.

This brought me joy

submitted by /u/knob-0u812
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA