
oMLX vs Ollama vs vMLX vs MLX-LM: Local LLMs on Apple Silicon
My local LLM picks for Apple Silicon: oMLX first, Ollama second, vMLX third, and official MLX-LM fourth. Setup commands and the benefits of each.
$ vishctl get notes -l topic=apple-silicon

My local LLM picks for Apple Silicon: oMLX first, Ollama second, vMLX third, and official MLX-LM fourth. Setup commands and the benefits of each.

Compile llama.cpp with Metal support on Apple Silicon, serve local GGUF models, and benchmark prompt eval and generation speeds head-to-head against Ollama.

Install Ollama, pull and run local models, and call the local API on a 32 GB Apple-silicon MacBook Air.