7,752
stars
+0+7+718
1,102
forks
47
watchers
–
prs
–
issues
8
releases
–
discussions
README
ODS V3 Pre-Release
Osmantic Deployment System
Public testing and refinement ahead of the official V3 launch.
Turn your PC, Mac, or Linux box into a private AI server.
AI server and homelab setup is rapidly becoming a solved problem.
It should feel that way for everyone.
ODS installs and wires together everything you need to run AI locally, so you do not have to assemble Ollama, Open WebUI, n8n, ComfyUI, and privacy tools by hand:
- Local model inference — run open models on your own hardware
- ChatGPT-style web UI — talk to your models from any browser
- Control dashboard — manage models, services, setup, GPU status, and extensions from one place
- Voice, agents, and workflows — build automations that can listen, speak, call tools, and get work done
- RAG and search — connect local documents, private search, and retrieval workflows
- Image generation — run local image tools without sending prompts to a hosted API
- Privacy and ops — keep service auth, secrets, observability, and diagnostics in one local stack
No cloud required. No subscriptions required. Inference, chat history and your files stay on your machine, and ODS collects no telemetry. By default it goes online only to download models and container images, to check GitHub for ODS releases, and to run web searches the Portal agent makes for you; the FAQ explains each one and how to turn it off. Cloud and hybrid API modes are optional when you want them.
Status: V3 pre-release. The installers below install the current main
branch, which receives fixes continuously and is not a signed release; the
verified installer preview stays
separate until a signed release passes end-to-end testing.
Existing installations pick up code fixes by re-running the installer
(how); ods update refreshes
container images only. v3.0.0 is the latest published source release; check the
security advisories before
pinning it. Known limits and validation
status: V3 release notes,
Release Validation,
Release Channels and
Installer Trust.
The repository root holds this README, the installers, the security policy and
CI workflows; ods/ is the product: services, installer phases, compose files,
dashboard, CLI, tests and operator docs.
Get Started
Choose your system, copy the block, run it in a normal terminal. ODS installs the stack, picks a model for your hardware, starts the services, and gives you the local web UI.
Linux or macOS
bash
curl -fsSL https://install.osmantic.com/ods.sh | bash
Windows PowerShell — guided Ubuntu/WSL2 setup with Pixel/Portal
powershell
& {
$ErrorActionPreference = 'Stop'
$ProgressPreference = 'SilentlyContinue'
$odsSrc = Join-Path $env:TEMP ('ods-install-' + [guid]::NewGuid().ToString('N'))
$odsZip = Join-Path $odsSrc 'ods-main.zip'
New-Item -ItemType Directory -Path $odsSrc | Out-Null
Invoke-WebRequest -UseBasicParsing 'https://github.com/Osmantic/ODS/archive/refs/heads/main.zip' -OutFile $odsZip
Expand-Archive