jzhang38 /TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

★ 9,004⑂ 633
PythonCreated 2023-09-02
9,004
stars
633
forks
–
watchers
–
prs
–
issues
–
releases
–
discussions

Snapshot: 2026-11-10T09:35:25Z · Data license Apache-2.0 · JSON