$ vishctl get notes -l topic=freetoken

#freetoken

1 note

Pixel art laptop sharing model data between host RAM and GPU memory

Running a 35B MoE Model on an 8 GB Laptop GPU: Testing FreeToken

Testing FreeToken on an RTX 4070 Laptop GPU: running Qwen 3.6 35B-A3B NVFP4 across 8 GB VRAM and 32 GB RAM with hierarchical memory offloading.