Store › model › LLM
Qwen3-0.6B-GGUF
by MaziyarPanahi · source Hugging Face · updated 2025-04-28
license unknown462 MB~2 GB RAMsource aliveunlabeled
MaziyarPanahi/Qwen3-0.6B-GGUF - Model creator: Qwen - Original model: Qwen/Qwen3-0.6B
Add to LogiShell Open in the web IDE
The button opens LogiShell with this card; nothing installs from a link by itself. Inside the app the install goes through lsh models install hf:MaziyarPanahi/Qwen3-0.6B-GGUF and its progress lives in the Resource Center.
Source and license
- Source: https://huggingface.co/MaziyarPanahi/Qwen3-0.6B-GGUF
- License: not named by the source (the source did not name a license)
- Requirements: about 2 GB of RAM, 462 MB on disk (estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models). Runs with llama.cpp, ollama.
- Tags:
ggufmistralquantized2-bit3-bit4-bit5-bit6-bit8-bitGGUFtext-generationconversational
Numbers
- 289,113 downloads on Hugging Face
- 15 likes
- license not named
- 0.5 GB for Qwen3-0.6B.Q4_K_M.gguf
- 327,838 npm downloads a week for node-llama-cpp
- latest node-llama-cpp@3.22.1
Numbers as of 2026-10-02 21:01 UTC, from the source API.
Summary
Summary not ready yet: the numbers are here, the text is not. It is written by the collector through the LogiShell model facade when a provider key is present.
Reviews
No reviews yet. Reviews are written inside LogiShell: open this card in the app.
Files
| file | quant | size |
|---|---|---|
Qwen3-0.6B.Q2_K.gguf | Q2_K | 331 MB |
Qwen3-0.6B.Q3_K_L.gguf | Q3_K_L | 415 MB |
Qwen3-0.6B.Q3_K_M.gguf | Q3_K_M | 395 MB |
Qwen3-0.6B.Q4_K_M.gguf | Q4_K_M | 462 MB |
Qwen3-0.6B.Q5_K_M.gguf | Q5_K_M | 526 MB |
Qwen3-0.6B.Q6_K.gguf | Q6_K | 594 MB |
Qwen3-0.6B.fp16.gguf | 1.4 GB |
From the source README
# MaziyarPanahi/Qwen3-0.6B-GGUF
- Model creator: Qwen
- Original model: Qwen/Qwen3-0.6B
## Description
MaziyarPanahi/Qwen3-0.6B-GGUF contains GGUF format model files for Qwen/Qwen3-0.6B.
About GGUF
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
Here is an incomplete list of clients and libraries that are known to support GGUF:
- llama.cpp. The source project for GGUF. Offers a CLI and a server option.
- llama-cpp-python, a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
- LM Studio, an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
- text-generation-webui, the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
- KoboldCpp, a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
- GPT4All, a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
- LoLLMS Web UI, a great web UI with many interesting and unique features, including a full model library for easy model selection.
- Faraday.dev, an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acc…
Source: https://huggingface.co/MaziyarPanahi/Qwen3-0.6B-GGUF
Card id model:hf:MaziyarPanahi/Qwen3-0.6B-GGUF · collected 2026-10-02 21:01 UTC · JSON