Pixel art GPU server packing memory pages and serving many parallel token streams

Why vLLM Is Dominating the AI Inference Market

In January 2026, the maintainers of vLLM launched a company called Inferact and raised a $150 million seed round at an $800 million valuation, co-led by Andreessen Horowitz and Lightspeed. That is a remarkable outcome for a project that began with a memory-management idea in a UC Berkeley research paper. It also says something about where the industry believes the next bottleneck sits. Training gets the headlines. Inference gets the bills. ...

September 15, 2026 · 8 min