FMInference /FlexLLMGen
Running large language models on a single GPU for throughput-oriented scenarios.
★ 9,340⑂ 588
9,340
stars
588
forks
–
watchers
–
prs
–
issues
–
releases
–
discussions
Running large language models on a single GPU for throughput-oriented scenarios.