Blog

/

Guides

/

How to Run Local AI on NVIDIA RTX Spark

How to Run Local AI on NVIDIA RTX Spark

Atomic Chat runs on NVIDIA RTX Spark using its Windows ARM64 build. You can run local models and generate images directly on the device.

How to Run Local AI on NVIDIA RTX Spark
Alex Shapiro
Alex Shapiro
Calendar icon

October 16, 2026

Table of Contents

RTX Spark is a Windows PC platform with NVIDIA Blackwell RTX acceleration, a Grace CPU and the NVIDIA AI software stack. It's built for personal agents, AI-powered creation, development and gaming.

RTX Spark can also serve a loaded model to other apps through Atomic Chat's OpenAI-compatible API. The guide covers local chat, the API connection and image generation.

Download Atomic Chat

Download the latest Atomic Chat release for Windows ARM64 and install it on your RTX Spark.

Download a chat model

  1. Open Model Hub in the sidebar and select Text models.
  2. Search for a model and use the format filter to choose GGUF or another compatible format.
  3. For GGUF models, choose a build under Download Options. Select Download and wait for it to finish.
Model Hub sidebar, model search and model format filter in Atomic Chat
1: Model Hub in the sidebar. 2: Search. 3: Choose GGUF or another compatible format.
GGUF build selection and Download button in Atomic Chat
1: Choose a build. 2: Select Download. Separate details from the same screen.

Check compatibility and the memory requirement for the exact build in Model Hub before downloading. Our GGUF guide explains how to choose a build.

Start a local chat

  1. Select New Chat in the sidebar.
  2. Choose your downloaded model in the model selector.
  3. Enter a message and send it. The model answers locally on RTX Spark.
New Chat sidebar and downloaded model selector in Atomic Chat
1: New Chat in the sidebar. 2: Choose the downloaded model. Separate details from the same screen.

Try this prompt:

Plan three product photos of a silver desk lamp for a design magazine. Return a table with two columns, Shot and Camera, and keep each row under 12 words.

NVFP4 support

Atomic Chat supports compatible NVFP4 checkpoints.

NVFP4 is NVIDIA's 4-bit floating-point format for model weights and activations.

Check compatibility and the memory requirement for the exact NVFP4 checkpoint in Model Hub before downloading.

Use the Local API Server

The Local API Server exposes your loaded chat model through an OpenAI-compatible endpoint.

  1. Keep a chat model loaded and select API in the sidebar.
  2. Select Start server if it is stopped, then check Status: Ready.
  3. Copy the Base URL shown by the app. In your API client, use the exact loaded model ID returned by /models.
  4. If authentication is enabled, use the API key configured in Atomic Chat.
API sidebar and Base URL with Ready status in Atomic Chat
1: API in the sidebar. 2: Copy the Base URL.

For an API client on the same RTX Spark, use these settings:

FieldValue
Base URLCopy the Base URL shown in Atomic Chat
Model IDThe exact loaded model ID returned by /models
API keyYour configured key, when authentication is enabled
Chat endpoint/chat/completions, appended to the Base URL

Send a short request and check that the model returns a reply. Keep the model loaded and the server running while using the endpoint.

Media generation on RTX Spark

The media engine also supports local video generation.

Generate images

  1. Select Images in the sidebar.
  2. Select Download model and choose a compatible image model. Wait for the download to finish.
  3. Set Mode to Create images.
  4. Open the model selector above Prompt and choose your downloaded model.
  5. Enter a Prompt describing the image you want, then select Generate.
  6. Open the result's Details to view its settings. Use Save as… to save the image.
Images sidebar, model selector and Generate button in Atomic Chat
1: Images in the sidebar. 2: Choose the downloaded model. 3: Select Generate.

For other models, see our local AI image generator guide.

Frequently asked questions

Does Atomic Chat run on RTX Spark with Windows?

Yes. Use the Windows ARM64 build for RTX Spark.

Which model formats can I use?

Choose a compatible GGUF build in Model Hub. Atomic Chat also supports compatible NVFP4 checkpoints.

How do I choose a model that fits?

Check compatibility and the memory requirement for the exact build in Model Hub. A compatible format can still exceed available memory.

Can another app use the local model?

Yes. Use the Local API Server's Base URL and the exact model ID returned by /models, with the configured API key when authentication is enabled.

Can I generate images on RTX Spark?

Yes. Download a compatible image model in Images, then use Create images with your prompt and select Generate.

Best Local AI Video Generators Compared on Quality, Speed and VRAM

Best Local AI Video Generators Compared on Quality, Speed and VRAM

Compare local AI video generators on quality, speed and VRAM, with RTX 4090 benchmarks, example clips and an Atomic Chat setup guide.

10/9/26

16 min

Best Local LLMs for 12GB VRAM in 2026

Best Local LLMs for 12GB VRAM in 2026

Eight local LLMs for 12GB VRAM: exact GGUF files, RTX 3080 Ti speed and memory figures, plus Snake and physics tests on an RTX 4070.

9/30/26

15 min

Claude Sonnet 5.5 Alternatives Compared

Claude Sonnet 5.5 Alternatives Compared

Compare Claude Sonnet 5.5 with Opus, Fable and GPT-6 Astra, then choose a local Qwen, Ornith or Bonsai model for your hardware.

9/29/26

13 min

Jev 1.13: Can You Run It Locally? Laya Setup Guide

Jev 1.13: Can You Run It Locally? Laya Setup Guide

Can you run Jev 1.13 locally? Learn how it works, see our Jev vs Laya Tetris demo, and set up Laya as an independent local alternative.

9/25/26

12 min