https://bergstrom.org/tags/llama.cpp/Llama.cpp - Tag - Jorgen BergstromHugo -- gohugo.ioen-usJorgen BergstromWed, 07 Oct 2026 00:00:00 -0400https://bergstrom.org/posts/mmlu_local_llms/Wed, 07 Oct 2026 00:00:00 -0400Jorgen Bergstromhttps://bergstrom.org/posts/mmlu_local_llms/Introduction I have a collected a handful of GGUF models sitting in ~/.cache/llama.cpp. I wanted a straight answer to the simple question: how good are these local models at recalling facts and doing simple reasoning? So I built a small harness that runs my local models against the full MMLU test set (14,042 questions across 57 subjects) using llama.cpp, one model at a time, and records every single prediction. This post covers what MMLU is, how to get the questions, how the benchmark works, the example questions, and the results.