Introducing nexaSDK beta release (July 22). More updates coming soon.
Features
- Device Support: CPU, GPU (CUDA, Metal, Vulkan), NPU (Qualcomm)
- Input Type Support: Text, Image, Audio
- Server: OpenAI-compatible API, JSON schema for function calling and streaming support
- Model Format Support: GGUF, MLX
Get Started
Install nexaSDK on your operating system and run your first models on device.Was this page helpful?