ASUS UGen300 USB AI Accelerator: Overview
The ASUS UGen300 is a pocket-size USB accelerator that adds local AI processing to laptops, mini PCs, and other devices. It runs both classic and generative AI models.
- Hailo-10H chip: It delivers up to 40 TOPS (INT4) on about 2.5W of typical power, for fast inference on little power.
- Generative AI support: With 8 GB of LPDDR4 memory, it runs large language and vision-language models locally, so your data stays private.
- Faster than older sticks: ASUS tests show up to 7x the frame rate of Google Edge TPU and 10x that of Intel Myriad X.
- Works across platforms: It supports Windows, Linux, and Android on x86 and ARM hosts, from laptops and NAS devices to smartphones.
- Familiar frameworks: Plus, it works with TensorFlow, Keras, PyTorch, and ONNX, and an online model zoo offers ready-made models.
Check out the ASUS UGen300 if you want to run AI models locally over a single USB-C connection.
