$ vishctl get notes -l topic=llama-cpp

#llama-cpp

1 note

Pixel art terminal and build gear connected to a chip containing a llama

Running llama.cpp on a 32 GB MacBook Air: A Direct Comparison with Ollama

Compile llama.cpp with Metal support on Apple Silicon, serve local GGUF models, and benchmark prompt eval and generation speeds head-to-head against Ollama.