Run vLLM on Kubernetes with Minikube, WSL2 and NVIDIA GPU
A practical guide to running vLLM on Kubernetes in WSL2 with Minikube, configuring NVIDIA GPU passthrough, and serving an OpenAI-compatible API.
$ vishctl get notes -l topic=wsl2
#wsl2
$ vishctl get notes -l topic=wsl2