π₯οΈ Supported Devices
NPU models are supported on Qualcomm Neural Processing Units (NPUs):- Nexa CLI: Qualcomm Snapdragon NPU PC
- NexaML: Any Qualcomm NPU device (contact us to request access)
βοΈ Prerequisites
- If you havenβt already, install the nexa-SDK.
- All NPU models require an access token before usage:
- Create an account at sdk.nexa.ai
- Generate a token: Go to Deployment β Create Token
- Activate your SDK: Run the following command in your terminal (replace with your token):
bash
LLM - Language Models
π Language models in NPU format. Try out this quick example: Try it out:bash
β¨οΈ Once model loads, type or paste multi-line text directly into the CLI to chat with the model.
LMM - Multimodal Models
πΌοΈ Language models that also accept vision and/or audio inputs. LMM in NPU formats. Try out this quick example:bash
β¨οΈ Drag photos or audio clips directly into the CLI β you can even drop multiple images at once!