Tiiny-AI /PowerInfer

High-speed Large Language Model Serving for Local Deployment

★ 9,874⑂ 618
C++Created 2023-12-15
9,874
stars
618
forks
–
watchers
–
prs
–
issues
–
releases
–
discussions

Snapshot: 2026-11-10T09:35:25Z · Data license Apache-2.0 · JSON