> ## Documentation Index
> Fetch the complete documentation index at: https://docs.nexa.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Run NexaSDK in Docker containers for easy deployment and consistent environments on Linux ARM64.

<img src="https://mintcdn.com/nexaai/0Bh2MiZtOacPTTJ2/Mintlify-image/docker.jpeg?fit=max&auto=format&n=0Bh2MiZtOacPTTJ2&q=85&s=da6adadcc259105109f137696c406941" alt="NexaSDK Docker Architecture" style={{ borderRadius: '0.5rem' }} width="1920" height="1080" data-path="Mintlify-image/docker.jpeg" />

## **Linux Docker Solution**

NexaSDK Docker enables you to run AI models in containerized environments on Linux ARM64 systems, optimized for Qualcomm NPU devices like Dragonwing IQ9. This solution provides a consistent, isolated environment for running inference workloads with support for both server mode (REST API) and interactive CLI usage.

## **Video Understanding on IQ9**

<iframe className="w-full aspect-video rounded-xl" src="https://www.youtube.com/embed/mB7h9zfRiUA" title="Video Understanding (Video RAG) on IQ9" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowFullScreen />

## **Key Features**

* **Containerized Deployment**: Run NexaSDK in isolated Docker containers
* **NPU Acceleration**: Optimized for Qualcomm NPU on Linux ARM64 (Dragonwing IQ9)
* **Dual Modes**: Support for both server mode (REST API) and interactive CLI
* **Easy Setup**: Simple pull and run commands
* **Multiple Model Types**: Support for LLM, Embeddings, Reranking, Computer Vision, and ASR models

## **Supported Models**

The following models are supported on Linux ARM64 with NPU acceleration (Dragonwing IQ9):

| Modality      | Model                                                                                                                                                              |
| ------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| **LLM**       | [`NexaAI/LFM2-1.2B-npu`](https://huggingface.co/NexaAI/LFM2-1.2B-npu)<br />[`NexaAI/Granite-4.0-h-350M-NPU`](https://huggingface.co/NexaAI/Granite-4.0-h-350M-NPU) |
| **VLM**       | [`NexaAI/OmniNeural-4B`](https://huggingface.co/NexaAI/OmniNeural-4B)                                                                                              |
| **Embedding** | [`NexaAI/embeddinggemma-300m-npu`](https://huggingface.co/NexaAI/embeddinggemma-300m-npu)<br />[`NexaAI/EmbedNeural`](https://huggingface.co/NexaAI/EmbedNeural)   |
| **Rerank**    | [`NexaAI/jina-v2-rerank-npu`](https://huggingface.co/NexaAI/jina-v2-rerank-npu)                                                                                    |
| **CV**        | [`NexaAI/yolov12-npu`](https://huggingface.co/NexaAI/yolov12-npu)<br />[`NexaAI/convnext-tiny-npu-IoT`](https://huggingface.co/NexaAI/convnext-tiny-npu-IoT)       |
| **ASR**       | [`NexaAI/parakeet-tdt-0.6b-v3-npu`](https://huggingface.co/NexaAI/parakeet-tdt-0.6b-v3-npu)                                                                        |

## **Docker Hub**

The NexaSDK Docker image is available on Docker Hub:

<Card title="Docker Hub Repository" href="https://hub.docker.com/r/nexa4ai/nexasdk/tags" icon="docker">
  View available tags and pull the latest NexaSDK Docker image
</Card>

## **Get Started**

<Card title="Quickstart for Docker" href="/en/nexa-sdk-docker/quickstart" icon="rocket">
  Get started with NexaSDK Docker in minutes. Learn how to pull the image, run in server mode, and use the CLI.
</Card>

<br />

<div class="feedback-wrapper">
  <span class="feedback-label">Was this page helpful?</span>

  <div class="feedback-toggle">
    <input type="radio" name="feedback" id="feedback-yes" class="feedback-input" />

    <label for="feedback-yes" class="feedback-button">
      <img src="https://mintcdn.com/nexaai/g8-zBYnunEyVtcK3/Images/FeedBack/thumbs-up.svg?fit=max&auto=format&n=g8-zBYnunEyVtcK3&q=85&s=0b57c51c8db9940403e7552956e5c30e" alt="Thumbs up" class="feedback-icon" noZoom width="14" height="14" data-path="Images/FeedBack/thumbs-up.svg" />

      Yes
    </label>

    <input type="radio" name="feedback" id="feedback-no" class="feedback-input" />

    <label for="feedback-no" class="feedback-button">
      <img src="https://mintcdn.com/nexaai/g8-zBYnunEyVtcK3/Images/FeedBack/thumbs-down.svg?fit=max&auto=format&n=g8-zBYnunEyVtcK3&q=85&s=ebacf61d57c8259c6df243d329b548b3" alt="Thumbs down" class="feedback-icon" noZoom width="14" height="14" data-path="Images/FeedBack/thumbs-down.svg" />

      No
    </label>
  </div>
</div>
