xorbitsai /inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

★ 9,649⑂ 898
PythonCreated 2023-06-14inference.readthedocs.io
9,649
stars
898
forks
–
watchers
–
prs
–
issues
–
releases
–
discussions

Snapshot: 2026-11-10T09:35:25Z · Data license Apache-2.0 · JSON