Store › model › Speech

nemotron-3.5-asr-streaming-0.6b-gguf

Name: nemotron-3.5-asr-streaming-0.6b-gguf
Author: handy-computer

by handy-computer · source Hugging Face · updated 2026-09-15

other473 MB~2 GB RAMsource aliveunlabeled

nemotron-3.5-asr-streaming-0.6b: transcribe.cpp GGUF

Add to LogiShell Open in the web IDE

The button opens LogiShell with this card; nothing installs from a link by itself. Inside the app the install goes through lsh models install hf:handy-computer/nemotron-3.5-asr-streaming-0.6b-gguf and its progress lives in the Resource Center.

Source and license

Source: https://huggingface.co/handy-computer/nemotron-3.5-asr-streaming-0.6b-gguf
License: other (custom license: read it at the source before installing) · text
Requirements: about 2 GB of RAM, 473 MB on disk (estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models). Runs with whisper.cpp.
Tags: transcribe.cpp gguf asr speech-to-text parakeet conformer rnnt streaming cache-aware multilingual automatic-speech-recognition en es fr it pt

Numbers

1,796,437 downloads on Hugging Face
12 likes
license other
0.5 GB for nemotron-3.5-asr-streaming-0.6b-Q4_K_M.gguf

Numbers as of 2026-10-02 21:01 UTC, from the source API.

Summary

Summary not ready yet: the numbers are here, the text is not. It is written by the collector through the LogiShell model facade when a provider key is present.

Reviews

No reviews yet. Reviews are written inside LogiShell: open this card in the app.

Files

file	quant	size
`nemotron-3.5-asr-streaming-0.6b-F16.gguf`	F16	1.2 GB
`nemotron-3.5-asr-streaming-0.6b-F32.gguf`	F32	2.4 GB
`nemotron-3.5-asr-streaming-0.6b-Q4_K_M.gguf`	Q4_K_M	473 MB
`nemotron-3.5-asr-streaming-0.6b-Q5_K_M.gguf`	Q5_K_M	534 MB
`nemotron-3.5-asr-streaming-0.6b-Q6_K.gguf`	Q6_K	593 MB
`nemotron-3.5-asr-streaming-0.6b-Q8_0.gguf`	Q8_0	716 MB

From the source README

nemotron-3.5-asr-streaming-0.6b: transcribe.cpp GGUF

GGUF conversions of nvidia/nemotron-3.5-asr-streaming-0.6b for use
with transcribe.cpp.

Ported from upstream commit
24b151a,
pinned 2026-06-08.
Validated against the NeMo reference at transcribe.cpp commit
909e94e
on 2026-06-08.

Multilingual speech-to-text across 32 supported language-locales (the model's tokenizer recognizes 40, but 8 are adaptation-ready and need fine-tuning) with punctuation and capitalization. A 0.6B-parameter cache-aware streaming FastConformer encoder with a prompt-conditioned RNN-T transducer decoder; the target language is selected per call (--language en-US, fr-FR, de-DE, ...) and an auto mode emits a tag. Ships both the offline path (att_context_size=[56, 13], 1.12s, headline accuracy) and runtime-selectable chunked streaming (--stream-chunk-ms 1120 --stream-att-right {0,3,6,13}).

Downloads

| Quantization | Download | Size | WER (FLEURS test en (en-US), offline att_context_size=[56, 13]) |
| --- | --- | ---: | ---: |
| F32 | nemotron-3.5-asr-streaming-0.6b-F32.gguf | 2.55 GB | 7.97% |
| F16 | nemotron-3.5-asr-streaming-0.6b-F16.gguf | 1.28 GB | 7.97% |
| Q8_0 | nemotron-3.5-asr-streaming-0.6b-Q8_0.gguf | 751 MB | 7.88% |
| Q6_K | [nemotron-3.5-asr…

Source: https://huggingface.co/handy-computer/nemotron-3.5-asr-streaming-0.6b-gguf

Card id model:hf:handy-computer/nemotron-3.5-asr-streaming-0.6b-gguf · collected 2026-10-02 21:01 UTC · JSON