It would be really cool to have an official 3D-print engineering benchmark/leaderboard like this
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| Someone prompted different LLMs to generate CAD code for a bridge under fixed constraints (2-foot span, under 500g filament, 18-hour print limit), printed them, and load-tested them to failure. The results were quite varied: some models couldn't even design parts that fit together, while the winner held over 100 lbs. Most benchmarks don't really capture physical intuition, spatial reasoning, and functional code generation at the same time. I would love a standardized benchmark and leaderboard for this. [link] [comments] |
More from r/LocalLLaMA
-
Basalt: Flash-Next at 665 tok/s structured, 354 prose on a 5090 + 5060 Ti (2.6x Strata)
Oct 10
-
What does LocalLLaMA think of REA?
Oct 10
-
SlopSoup TV. A live, never-ending 24/7 pixel-art TV network inspired by old-school late night Adult Swim. No human makes any of it.
Oct 9
-
My "Anthropic/ChatGPT in a box" is... now open source and publicly hosted on Github.
Oct 9
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.