Open models to add in one click

Collected from Hugging Face, GitHub and npm: open LLMs in GGUF, speech models like Whisper, embedding models. Every card links to its source, repeats the license and the numbers, and adds a short summary. One button adds it to LogiShell; without the app it leads to the install and brings you back.

Qwen3-ASR-1.7B-gguf

model · Speech · by handy-computer

GGUF conversions of Qwen/Qwen3-ASR-1.7B for use with transcribe.cpp.

apache-2.01.2 GB~2 GB RAMsource alive

195K downloads · 3 likes · numbers as of 2026-10-02
snowflake-arctic-embed-m-v1.5

model · Embeddings · by Snowflake

embedding model by Snowflake, gguf files on Hugging Face.

apache-2.0112 MB~1 GB RAMsource alive

176K downloads · 73 likes · numbers as of 2026-10-02
Qwen3-ASR-0.6B-gguf

model · Speech · by handy-computer

GGUF conversions of Qwen/Qwen3-ASR-0.6B for use with transcribe.cpp.

apache-2.0562 MB~2 GB RAMsource alive

141K downloads · 3 likes · numbers as of 2026-10-02
All-MiniLM-L6-v2-Embedding-GGUF

model · Embeddings · by second-state

embedding model by second-state, gguf files on Hugging Face.

apache-2.020 MB~1 GB RAMsource alive

125K downloads · 25 likes · numbers as of 2026-10-02
parakeet-tdt-0.6b-v2-gguf

model · Speech · by handy-computer

parakeet-tdt-0.6b-v2: transcribe.cpp GGUF

cc-by-4.0453 MB~2 GB RAMsource alive

124K downloads · 1 likes · numbers as of 2026-10-02
Qwen3-0.6B-GGUF

model · LLM · by unsloth

See our collection for all versions of Qwen3 including GGUF, 4-bit & 16-bit formats.

apache-2.0378 MB~1 GB RAMsource alive

118K downloads · 141 likes · numbers as of 2026-10-02
jina-embeddings-v5-text-small-text-matching

model · Embeddings · by jinaai

jina-embeddings-v5-text-small-text-matching: Text-Matching-Targeted Embedding Distillation

cc-by-nc-4.0378 MB~1 GB RAMsource alive

117K downloads · 13 likes · numbers as of 2026-10-02
jina-embeddings-v5-text-small-retrieval

model · Embeddings · by jinaai

jina-embeddings-v5-text-small-retrieval: Retrieval-Targeted Embedding Distillation

cc-by-nc-4.0378 MB~1 GB RAMsource alive

111K downloads · 30 likes · numbers as of 2026-10-02
Nemotron-3-Embed-1B-Q4_K_M-GGUF

model · Embeddings · by zenmagnets

An independently converted and quantized GGUF of NVIDIA's nvidia/Nemotron-3-Embed-1B-BF16, prepared for local embedding inference in LM Studio and llama.cpp-compatible runtimes.

openmdw-1.1715 MB~2 GB RAMsource alive

103K downloads · 5 likes · numbers as of 2026-10-02
Voxtral-Small-24B-2507-gguf

model · Speech · by handy-computer

Voxtral-Small-24B-2507: transcribe.cpp GGUF

apache-2.013 GB~16 GB RAMsource alive

95K downloads · 0 likes · numbers as of 2026-10-02
canary-1b-v2-gguf

model · Speech · by handy-computer

GGUF conversions of nvidia/canary-1b-v2 for use with transcribe.cpp.

cc-by-4.0701 MB~2 GB RAMsource alive

90K downloads · 1 likes · numbers as of 2026-10-02
jina-embeddings-v5-text-nano-retrieval

model · Embeddings · by jinaai

jina-embeddings-v5-text: Task-Targeted Embedding Distillation

cc-by-nc-4.0150 MB~1 GB RAMsource alive

82K downloads · 19 likes · numbers as of 2026-10-02
gigaam-v3-e2e-rnnt-gguf

model · Speech · by handy-computer

GGUF conversions of ai-sage/GigaAM-v3 for use with transcribe.cpp.

mit175 MB~1 GB RAMsource alive

75K downloads · 2 likes · numbers as of 2026-10-02
sentence-bert-swedish-cased

model · Embeddings · by KBLab

This is a sentence-transformers model: It maps Swedish sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. This model is a bil…

apache-2.0239 MB~1 GB RAMsource alive

69K downloads · 36 likes · numbers as of 2026-10-02
VibeVoice-ASR-Streaming-7B-GGUF

model · Speech · by audio-cpp

VibeVoice ASR Streaming 7B GGUF for audio.cpp

mit9.2 GB~12 GB RAMsource alive

68K downloads · 3 likes · numbers as of 2026-10-02
bge-m3-GGUF

model · Embeddings · by gpustack

Model creator: BAAI Original model: bge-m3 GGUF quantization: based on llama.cpp release 61408e7f

mit417 MB~1 GB RAMsource alive

67K downloads · 57 likes · numbers as of 2026-10-02
Fun-ASR-Nano-2512-GGUF

model · Speech · by FunAudioLLM

Standalone audio.cpp GGUF builds of FunAudioLLM/Fun-ASR-Nano-2512-hf. Each file embeds the model configuration, processor configuration, tokenizer, chat template, and the audio.cpp model package spec…

other997 MB~2 GB RAMsource alive

63K downloads · 8 likes · numbers as of 2026-10-02
VibeVoice-ASR-BitNet

model · Speech · by microsoft

VibeVoice-ASR-BitNet is a compressed variant of VibeVoice-ASR optimized for real-time inference on edge CPUs — no GPU required. Through heterogeneous quantization, the model is compressed from 4.62 G…

mit947 MB~2 GB RAMsource alive

61K downloads · 202 likes · numbers as of 2026-10-02
canary-qwen-2.5b-gguf

model · Speech · by handy-computer

GGUF conversions of nvidia/canary-qwen-2.5b for use with transcribe.cpp.

cc-by-4.01.6 GB~3 GB RAMsource alive

56K downloads · 1 likes · numbers as of 2026-10-02
nemotron-speech-streaming-en-0.6b-gguf

model · Speech · by handy-computer

nemotron-speech-streaming-en-0.6b: transcribe.cpp GGUF

other453 MB~2 GB RAMsource alive

46K downloads · 0 likes · numbers as of 2026-10-02
whisper-small-gguf

model · Speech · by handy-computer

GGUF conversions of openai/whisper-small for use with transcribe.cpp.

apache-2.0164 MB~1 GB RAMsource alive

46K downloads · 0 likes · numbers as of 2026-10-02
nomic-embed-text-v2-moe-GGUF

model · Embeddings · by nomic-ai

Llama.cpp Quantizations of nomic-embed-text-v2-moe: Multilingual Mixture of Experts Text Embeddings

apache-2.0328 MB~1 GB RAMsource alive

42K downloads · 80 likes · numbers as of 2026-10-02
embeddinggemma-300m-qat-q8_0-GGUF

model · Embeddings · by ggml-org

Alternatively, the llama-embedding command line tool can be used: sh llama-embedding -hf ggml-org/embeddinggemma-300m-qat-q80-GGUF --verbose-prompt -p "Hello embeddings"

gemma313 MB~1 GB RAMsource alive

40K downloads · 21 likes · numbers as of 2026-10-02
granite-speech-4.1-2b-nar-gguf

model · Speech · by handy-computer

granite-speech-4.1-2b-nar: transcribe.cpp GGUF

apache-2.01.5 GB~3 GB RAMsource alive

39K downloads · 0 likes · numbers as of 2026-10-02