vllm

1 post. See everything

2026

12 Mar 2026Leaving ChatGPT for a box on my deskA month with a DGX Spark. How I serve models on it, the memory-bandwidth maths that decides which models are usable, and why I cancelled one subscription but not the other.