{"v":1,"id":"model:hf:handy-computer/multitalker-parakeet-streaming-0.6b-v1-gguf","slug":"model-handy-computer-multitalker-parakeet-streaming-0-6b-v1-gguf","kind":"model","category":"speech","title":"multitalker-parakeet-streaming-0.6b-v1-gguf","summary":"multitalker-parakeet-streaming-0.6b-v1: transcribe.cpp GGUF","source":{"provider":"hf","ref":"handy-computer/multitalker-parakeet-streaming-0.6b-v1-gguf","url":"https://huggingface.co/handy-computer/multitalker-parakeet-streaming-0.6b-v1-gguf","rev":"a9a7208d8f205b5816770a6f7fb83afc81a7691b","fetchedAt":"2026-10-02T21:00:25.532Z","etag":"W/\"ef6-sxXgWTN0tlrRjrPMmGeBngzO+cc\""},"author":{"name":"handy-computer","url":"https://huggingface.co/handy-computer"},"license":{"spdx":null,"raw":"other","url":"https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/","open":null,"note":"custom license: read it at the source before installing"},"metrics":{"downloads":32992,"likes":2,"takenAt":"2026-10-02T21:00:25.532Z"},"tags":["transcribe.cpp","gguf","asr","speech-to-text","parakeet","conformer","rnnt","streaming","cache-aware","diarization","multitalker","sortformer","automatic-speech-recognition","en"],"pipeline":"automatic-speech-recognition","links":{"github":"NVIDIA-NeMo/NeMo"},"updatedAt":"2026-09-15T07:05:40.000Z","collectedAt":"2026-10-02T21:00:25.532Z","review":{"numbers":["32,992 downloads on Hugging Face","2 likes","license other","0.6 GB for bundle/multitalker-parakeet-streaming-0.6b-v1-Q4_K_M.gguf"],"log":null},"trust":"unlabeled","health":{"status":"alive","checkedAt":"2026-10-02T21:00:25.532Z","http":200},"description":"# multitalker-parakeet-streaming-0.6b-v1: transcribe.cpp GGUF\n\nGGUF conversions of [nvidia/multitalker-parakeet-streaming-0.6b-v1](https://huggingface.co/nvidia/multitalker-parakeet-streaming-0.6b-v1) for use\nwith [transcribe.cpp](https://github.com/handy-computer/transcribe.cpp).\n\nPorted from upstream commit\n[8749fc7](https://huggingface.co/nvidia/multitalker-parakeet-streaming-0.6b-v1/commit/8749fc7),\npinned 2026-07-12.\nValidated against the NeMo reference at transcribe.cpp commit\n[3083021](https://github.com/handy-computer/transcribe.cpp/tree/3083021)\non 2026-08-03.\n\nOffline and cache-aware streaming English speech-to-text with punctuation and capitalization. A 0.6B-parameter cache-aware streaming FastConformer encoder with an RNN-T transducer decoder, fine-tuned from nvidia/nemotron-speech-streaming-en-0.6b. Plain GGUFs run the single_speaker_mode ASR path, while bundle GGUFs under `bundle/` embed nvidia/diar_streaming_sortformer_4spk-v2.1 and, with `--diarize`, transcribe up to four overlapping speakers into a speaker-tagged transcript. The encoder preserves the upstream att_context_size=[70, 13] (1.12s) cache-aware attention mask; all four latency lookahead settings are selectable.\n\n## Downloads\n\n| Quantization | Download | Size | WER (LibriSpeech test-clean, offline) |\n| --- | --- | ---: | ---: |\n| F32 | [bundle/multitalker-parakeet-streaming-0.6b-v1-F32.gguf](https://huggingface.co/handy-computer/multitalker-parakeet-streaming-0.6b-v1-gguf/resolve/main/bundle/multitalker-parakeet-streaming-0.6b-v1-F32.gguf) | 2.96 GB | 2.19% |\n| F16 | [bundle/multitalker-parakeet-streaming-0.6b-v1-F16.gguf](https://huggingface.co/handy-computer/multitalker-parakeet-streaming-0.6b-v1-gguf/resolve/main/bundle/multitalker-parakeet-streaming-0.6b-v1-F16.gguf) | 1.48 GB | 2.19% |\n| Q8_0 | [bundle/multitalker-parakeet-streaming-0.6b-v1-Q8_0.gguf](https://huggingface.co/handy-computer/multit…\n\nSource: https://huggingface.co/handy-computer/multitalker-parakeet-streaming-0.6b-v1-gguf","install":{"kind":"model","hfId":"handy-computer/multitalker-parakeet-streaming-0.6b-v1-gguf","gated":false,"format":"gguf","files":[{"name":"bundle/multitalker-parakeet-streaming-0.6b-v1-F16.gguf","size":1482674272,"quant":"F16","sha256":"18116241c595891bccf44cd0207cd749e9ba9e6025ee73ab59606633ec730304"},{"name":"bundle/multitalker-parakeet-streaming-0.6b-v1-F32.gguf","size":2960100448,"quant":"F32","sha256":"1ae09d63777dc4ae061f1f92b8aa0f7336f51bd995860946cc1f120b7e010f16"},{"name":"bundle/multitalker-parakeet-streaming-0.6b-v1-Q4_K_M.gguf","size":617132160,"quant":"Q4_K_M","sha256":"d24307ac22e9e691c146a7e2339891638a44a8492a765e4b6c11cff8960cd998"},{"name":"bundle/multitalker-parakeet-streaming-0.6b-v1-Q5_K_M.gguf","size":681209984,"quant":"Q5_K_M","sha256":"38c98bc0715ee95b4271952630661050a8c3c37f64b8b178c62b8b699668cbdb"},{"name":"bundle/multitalker-parakeet-streaming-0.6b-v1-Q6_K.gguf","size":743197824,"quant":"Q6_K","sha256":"d8db95ba257e370d910f42e8197dfc65fb5b879e09e4b13aefaac06af3555fa1"},{"name":"bundle/multitalker-parakeet-streaming-0.6b-v1-Q8_0.gguf","size":873443456,"quant":"Q8_0","sha256":"cf83cedc6777d2528a4d2a8a4bf476174ef7e5c65b86bc6c955f4cc9f5951ac5"}],"totalBytes":7357758144,"suggestedFile":"bundle/multitalker-parakeet-streaming-0.6b-v1-Q4_K_M.gguf","requirements":{"ramGb":2,"diskBytes":617132160,"note":"estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models"},"runWith":["whisper.cpp"],"command":"lsh models install hf:handy-computer/multitalker-parakeet-streaming-0.6b-v1-gguf"}}