README

transcribe.cpp

C/C++ speech-to-text inference library. Runs diverse STT model families via GGUF models on the ggml runtime, with Metal, Vulkan, and CUDA backends for fast GPU inference plus a tinyBLAS-accelerated CPU path.

16 model families and 60+ variants, streaming and batch. Every transcription model we publish under handy-computer is numerically verified and WER-tested against its reference implementation

Supported models:


| Family | Variants | Available capabilities | Docs |
| --- | --- | --- | --- |
| Canary | canary-180m-flash, canary-1b, canary-1b-flash, canary-1b-v2 | translate | docs/models/canary.md |
| Canary-Qwen 2.5B | canary-qwen-2.5b | - | docs/models/canary-qwen-2.5b.md |
| Cohere Transcribe | cohere-transcribe-03-2026, cohere-transcribe-arabic-07-2026 | - | docs/models/cohere.md |
| Fun-ASR-Nano | fun-asr-mlt-nano-2512, fun-asr-nano-2512 | - | docs/models/fun-asr-nano.md |
| GigaAM-v3 | gigaam-v3-ctc, gigaam-v3-e2e-ctc, gigaam-v3-e2e-rnnt, gigaam-v3-rnnt | token timestamps | docs/models/gigaam.md |
| Granite Speech 4 / 4.1 | granite-4.0-1b-speech, granite-speech-4.1-2b, granite-speech-4.1-2b-nar, granite-speech-4.1-2b-plus | diarize, translate, word timestamps | docs/models/granite-speech.md |
| Granite Speech 5.0 TurboCTC | granite-speech-5.0-470m-turboctc, granite-speech-5.0-470m-turboctc-nc | - | docs/models/granite-speech-5.0-turboctc.md |
| MedASR | medasr | token timestamps | docs/models/medasr.md |
| Moonshine | moonshine-base, moonshine-base-ar, moonshine-base-ja, moonshine-base-ko, moonshine-base-uk, moonshine-base-vi, moonshine-base-zh, moonshine-tiny, moonshine-tiny-ar, moonshine-tiny-ja, moonshine-tiny-ko, moonshine-tiny-uk, moonshine-tiny-vi, moonshine-tiny-zh | - | docs/models/moonshine.md |
| Moonshine Streaming | moonshine-streaming-medium, moonshine-streaming-small, moonshine-streaming-tiny | streaming | docs/models/moonshine-streaming.md |
| MOSS-Transcribe-Diarize | moss-transcribe-diarize | diarize, segment timestamps | docs/models/moss-transcribe-diarize.md |
| Multitalker Parakeet Streaming 0.6B v1 | multitalker-parakeet-streaming-0.6b-v1 | diarize, streaming, token timestamps | docs/models/multitalker-parakeet-streaming-0.6b-v1.md |
| Nemotron 3.5 ASR Streaming 0.6B | nemotron-3.5-asr-streaming-0.6b | streaming, token timestamps | docs/models/nemotron-3.5-asr-streaming-0.6b.md |
| Nemotron Speech Streaming EN 0.6B | nemotron-speech-streaming-en-0.6b | streaming, token timestamps | docs/models/nemotron-speech-streaming-en-0.6b.md |
| Parakeet | parakeet-ctc-0.6b, parakeet-ctc-1.1b, parakeet-primeline, parakeet-rnnt-0.6b, parakeet-rnnt-1.1b, parakeet-tdt-0.6b-v2, parakeet-tdt-0.6b-v3, parakeet-tdt-1.1b, parakeet-tdt_ctc-1.1b, parakeet-tdt_ctc-110m, parakeet-ultra, parakeet-unified-en-0.6b, orukeet, phonon-2 | streaming, token timestamps | docs/models/parakeet.md |
| Qwen3-ASR | qwen3-asr-0.6b, qwen3-asr-1.7b | - | docs/models/qwen3-asr.md |
| SenseVoice Small | sensevoice-small | - | docs/models/sensev