ODS
ODS 部署:Docker、GPU、端口与恢复检查
覆盖 Linux、Windows/WSL2、macOS、云模式和生产运维。

你将学会
- Choose the correct ODS platform path
- Verify GPU, ports, and cloud trade-offs
- Design recovery and operations checks
开始前需要
- Basic Git and command-line usage
- Comfort reading a project README
You can explain the project, run its documented first step, and decide what to verify before adopting it.
先看结论
- ODS has distinct Linux, Windows/WSL2, and Apple Silicon deployment paths.
- Ports, GPU passthrough, and cloud mode change the operational contract.
- Pin releases, inspect installers, test recovery, and protect the dashboard.
Choose the platform path
ODS 为 Linux、Windows/WSL2 和 Apple Silicon 提供不同安装路径。部署验证要同时检查 Docker、GPU、端口、模型、RAG/媒体流程、重启恢复和云模式成本。
Inspect the bootstrap source before running it, especially when using the hosted Linux/macOS endpoint that proxies repository main. Keep a local copy of the release receipt, installer hash, and support matrix so an upgrade can be explained or rolled back.
GPU, ports, and cloud fallback
The README separates NVIDIA/AMD/Intel paths on Linux, Docker GPU passthrough on Windows, and native Metal inference on macOS. Open WebUI is available on localhost:3000; inference endpoints vary by platform and can be overridden in `.env.example`. Test the effective ports from the host and from containers rather than assuming localhost means the same thing everywhere.
Machines without suitable hardware can use `./install.sh --cloud` with OpenAI, Anthropic, or Together APIs. Cloud mode changes the privacy and cost model, so keep it explicit in deployment metadata and add provider quotas and spend alerts.
Operate and recover
After install, run a small chat, model download, RAG query, and one optional voice or image flow. Then restart Docker, inspect service health, and verify that configuration and model manifests survive. Record logs, effective environment, GPU driver, model revision, and the exact ODS command when diagnosing a failure.
Test the documented uninstall path in a disposable environment and keep backups of configuration and user data. Port conflicts should be handled with environment overrides such as `WEBUI_PORT=9090`, not by editing generated compose files without a rollback plan.
Production gate
Treat ODS as an integrated appliance: restrict dashboard access to a trusted network, rotate secrets, pin release channels, monitor disk/GPU/container health, and rehearse recovery before storing sensitive prompts or documents. A green installation is not the same as a production SLA.
如何选择
| 比较维度 | 方案 A | 方案 B |
|---|---|---|
| Best when | You need predictable behavior and easy auditing | You need adaptive optimization and have reliable telemetry |
| Main risk | May leave performance on the table | Can become difficult to explain or debug |
实施步骤
- 1
Choose a platform path and pin a release.
- 2
Verify Docker, GPU drivers, storage, and effective ports.
- 3
Run chat/RAG/media smoke tests and restart recovery.
- 4
Apply network, secret, monitoring, backup, and rollback controls.
可复制示例
# Linux/macOS after reviewing the pinned installer
curl -fsSL https://install.osmantic.com/ods.sh | bash
# Cloud fallback from a checked-out release
./install.sh --cloud
# Port override
WEBUI_PORT=9090 ./install.sh常见问题
Can I run ODS on Windows without WSL2?
The README documents Docker Desktop with the WSL2 backend as the supported Windows path.
Where is the web UI?
Open WebUI is documented on localhost:3000; verify the release's environment file for inference ports and overrides.
资料来源
- ODS README (captured 2026-08-31)来源核查 2026-08-31
- ODS repository来源核查 2026-08-31