
Hermes Agent + LM Studio Bionic: Running Gemma 4 Locally
A Windows walkthrough of Hermes Agent connected to LM Studio Bionic with Gemma 4 E4B: local inference, custom endpoint settings, tool use, and the checks that confirm it works.
$ vishctl get notes -l topic=homelab

A Windows walkthrough of Hermes Agent connected to LM Studio Bionic with Gemma 4 E4B: local inference, custom endpoint settings, tool use, and the checks that confirm it works.

Testing FreeToken on an RTX 4070 Laptop GPU: running Qwen 3.6 35B-A3B NVFP4 across 8 GB VRAM and 32 GB RAM with hierarchical memory offloading.

Install Ollama, pull and run local models, and call the local API on a 32 GB Apple-silicon MacBook Air.

A quick intro to vishctl, my background in Kubernetes and AI infra, and why this blog exists.