AI Boxes Should Be Boring Like Routers
Edge devices shouldn't try to compete on large models. Use GPU for TTS, NPU for OCR, pack a bunch of auxiliary small models inside, make it a beefed-up Mac mini, and leave it running 24/7 in a corner. Boring, like a router—that's the way it should be.
4 min read