AI Boxes Should Be as Boring as Routers
Edge devices shouldn't chase large models. Run TTS on the GPU, OCR on the NPU, stuff it full of auxiliary small models, make it a Mac mini on steroids, and leave it running 24/7 in a corner. Like a router: boring is the point.
4 min read