Store › model › Speech

granite-speech-4.1-2b-gguf

Name: granite-speech-4.1-2b-gguf
Author: handy-computer

by handy-computer · source Hugging Face · updated 2026-09-27

apache-2.01.5 GB~3 GB RAMsource aliveunlabeled

granite-speech-4.1-2b: transcribe.cpp GGUF

Add to LogiShell Open in the web IDE

The button opens LogiShell with this card; nothing installs from a link by itself. Inside the app the install goes through lsh models install hf:handy-computer/granite-speech-4.1-2b-gguf and its progress lives in the Resource Center.

Source and license

Source: https://huggingface.co/handy-computer/granite-speech-4.1-2b-gguf
License: apache-2.0
Requirements: about 3 GB of RAM, 1.5 GB on disk (estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models). Runs with whisper.cpp.
Tags: transcribe.cpp gguf asr speech-to-text granite granite-speech audio-llm multilingual automatic-speech-recognition en fr de es pt ja conversational

Numbers

35,838 downloads on Hugging Face
0 likes
license apache-2.0
1.5 GB for granite-speech-4.1-2b-Q4_K_M.gguf
15,195 npm downloads a week for nodejs-whisper
latest nodejs-whisper@0.3.1

Numbers as of 2026-10-02 21:00 UTC, from the source API.

Summary

Summary not ready yet: the numbers are here, the text is not. It is written by the collector through the LogiShell model facade when a provider key is present.

Reviews

No reviews yet. Reviews are written inside LogiShell: open this card in the app.

Files

file	quant	size
`granite-speech-4.1-2b-BF16.gguf`	BF16	4.3 GB
`granite-speech-4.1-2b-F16.gguf`	F16	4.3 GB
`granite-speech-4.1-2b-Q4_K_M.gguf`	Q4_K_M	1.5 GB
`granite-speech-4.1-2b-Q5_K_M.gguf`	Q5_K_M	1.7 GB
`granite-speech-4.1-2b-Q6_K.gguf`	Q6_K	1.9 GB
`granite-speech-4.1-2b-Q8_0.gguf`	Q8_0	2.4 GB

From the source README

granite-speech-4.1-2b: transcribe.cpp GGUF

GGUF conversions of ibm-granite/granite-speech-4.1-2b for use
with transcribe.cpp.

Ported from upstream commit
8f4bb5f,
pinned 2026-05-17.
Validated against the Transformers reference at transcribe.cpp commit
275332d
on 2026-05-17.

Offline multilingual speech-to-text. IBM Granite Speech 4.1-2b is an
audio-LLM with the same architecture as 4.0-1b (Conformer encoder with
block-local Shaw attention, BLIP-2 Q-Former projector, Granite-4.0-1b-base
autoregressive LLM decoder) and improved punctuation and casing over 4.0-1b.
Takes a 16 kHz mono WAV and produces a transcript. Transcribes English,
French, German, Spanish, Portuguese, and Japanese. Translates between
English and each of those five other languages in either direction
(en ↔ fr, en ↔ de, en ↔ es, en ↔ pt, en ↔ ja) — always via English, no
direct fr↔de etc.

Downloads

| Quantization | Download | Size | WER (LibriSpeech test-clean) |
| --- | --- | ---: | ---: |
| BF16 | granite-speech-4.1-2b-BF16.gguf | 4.63 GB | 1.31% |
| F16 | granite-speech-4.1-2b-F16.gguf | 4.63 GB | 1.32% |
| Q8_0 | granite-speech-4.1-2b-Q8_0.gguf | 2.56 GB | 1.32% |
| Q6_K | granite-speech-4.1-2b-Q6_K.gguf | 2.02 GB | 1.29% |
|…

Source: https://huggingface.co/handy-computer/granite-speech-4.1-2b-gguf

Card id model:hf:handy-computer/granite-speech-4.1-2b-gguf · collected 2026-10-02 21:00 UTC · JSON