Local LLM: LFM2.5 on a Laptop CPU (llama.cpp)

The same prompt through llama.cpp with a Q4_K_M quantization: 34.8 tokens per second, 137 for prefill.

Last updated 2026-08-05 14:16 UTC · made on claude.ai

Model, effort and cost weren't recorded for this one: it was made on claude.ai, which doesn't keep them with the page.