Skip to main content

Requirements

  • Windows 10/11 x64
  • Python 3.10+
  • Optional: NVIDIA GPU with CUDA

Install

python -m venv .venv
.\.venv\Scripts\Activate.ps1
pip install nexaai

Quick Test

from nexaai import LLM, ModelConfig
llm = LLM.from_(model="NexaAI/Qwen3-0.6B-GGUF", config=ModelConfig())
print(llm.generate("Hello", None).text)