Posts
Operator-perspective notes on AI infrastructure.
- EvoQuality: a model that grades AI-generated images so you don't ship the broken ones
We released the first GGUF version of EvoQuality — a small model that rates image quality on a 1-5 scale. It runs at 200+ tokens per second on a single consumer GPU and tells you when your AI-generated picture is broken. Six size variants from 4 GB to 14 GB. Use it to filter training data, gate diffusion outputs, or score image collections.
- Sleep mode on Blackwell, part 2: catching CUDA error 700 live + a generic Triton shmem-budget helper
Brought a frontier model we had retired in April back into production. Upstream landed the one-line fix this week; we validated it on our cluster and the model is back in the live rotation. Also upstreaming a Triton helper that solves the "kernel too big for the GPU" class of problems.
- Three frontier AI models on four GPUs: hot-swapping at 4.5 seconds
Hot-swap three frontier AI models on the same four consumer GPUs in under five seconds. Used to take fifty. Plain-language breakdown of what changed, why it matters, and a short engineering note for the curious.