Open WebUI is a self-hosted chat application that you can run entirely on your DGX Spark. This gives you privacy and security because everything stays on your system. The Open WebUI application operates offline, and your queries go to a model running on your Spark.
Open WebUI is browser based, so you can use it to chat with a model on a Spark from your laptop, or directly on the Spark itself as a desktop.
This playbook shows you two different paths to run Open WebUI.
Both paths lead to the same outcome: chatting with a model running on your DGX Spark through Open WebUI.
You will download an Open WebUI container image with Ollama onto your Spark, run the container and then use the Open WebUI browser interface to download and run a model. Then, you will chat with it.
The container setup includes integrated Ollama for model management, persistent data storage, and GPU acceleration for model inference.