{"v":1,"id":"model:hf:unsloth/Qwen3-0.6B-GGUF","slug":"model-unsloth-qwen3-0-6b-gguf","kind":"model","category":"llm","title":"Qwen3-0.6B-GGUF","summary":"See our collection for all versions of Qwen3 including GGUF, 4-bit & 16-bit formats. Learn to run Qwen3 correctly - Read our Guide.","source":{"provider":"hf","ref":"unsloth/Qwen3-0.6B-GGUF","url":"https://huggingface.co/unsloth/Qwen3-0.6B-GGUF","rev":"50968a4468ef4233ed78cd7c3de230dd1d61a56b","fetchedAt":"2026-10-02T20:54:10.963Z","etag":"W/\"3817-wNr7vkQqA/rc3h34GPuGJjScKVg\""},"author":{"name":"unsloth","url":"https://huggingface.co/unsloth"},"license":{"spdx":"apache-2.0","raw":"apache-2.0","url":"https://huggingface.co/Qwen/Qwen3-0.6B/blob/main/LICENSE","open":true},"metrics":{"downloads":118197,"downloadsWeek":327838,"likes":141,"stars":27665,"openIssues":68,"pushedAt":"2026-01-09T03:05:47Z","takenAt":"2026-10-02T20:54:10.963Z"},"tags":["transformers","gguf","qwen3","text-generation","qwen","unsloth","en","endpoints_compatible","conversational"],"pipeline":"text-generation","links":{"github":"QwenLM/Qwen3","npm":"node-llama-cpp"},"updatedAt":"2025-06-23T00:26:15.000Z","collectedAt":"2026-10-02T20:54:10.963Z","review":{"numbers":["118,197 downloads on Hugging Face","141 likes","license apache-2.0","0.4 GB for Qwen3-0.6B-Q4_K_M.gguf","27,665 stars on QwenLM/Qwen3","68 open issues and PRs","327,838 npm downloads a week for node-llama-cpp","latest node-llama-cpp@3.22.1"],"log":null},"trust":"unlabeled","health":{"status":"alive","checkedAt":"2026-10-02T20:54:10.963Z","http":200},"description":"See our collection for all versions of Qwen3 including GGUF, 4-bit & 16-bit formats.\n  \n  \n    Learn to run Qwen3 correctly - Read our Guide.\n  \n\n    Unsloth Dynamic 2.0 achieves superior accuracy & outperforms other leading quants.\n  \n  \n    \n      \n    \n    \n      \n    \n    \n      \n    \n  \n✨ Run & Fine-tune Qwen3 with Unsloth!\n\n- Fine-tune Qwen3 (14B) for free using our Google [Colab notebook here](https://docs.unsloth.ai/get-started/unsloth-notebooks)!\n- Read our Blog about Qwen3 support: [unsloth.ai/blog/qwen3](https://unsloth.ai/blog/qwen3)\n- View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).\n- Run & export your fine-tuned model to Ollama, llama.cpp or HF.\n\n| Unsloth supports          |    Free Notebooks                                                                                           | Performance | Memory use |\n|-----------------|--------------------------------------------------------------------------------------------------------------------------|-------------|----------|\n| **Qwen3 (14B)**      | [▶️ Start on Colab](https://docs.unsloth.ai/get-started/unsloth-notebooks)               | 3x faster | 70% less |\n| **GRPO with Qwen3 (8B)**      | [▶️ Start on Colab](https://docs.unsloth.ai/get-started/unsloth-notebooks)               | 3x faster | 80% less |\n| **Llama-3.2 (3B)**      | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(1B_and_3B)-Conversational.ipynb)               | 2.4x faster | 58% less |\n| **Llama-3.2 (11B vision)**      | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(11B)-Vision.ipynb)               | 2x faster | 60% less |\n| **Qwen2.5 (7B)**      | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_(7B)-Alpaca.ipynb)               | 2x faster | 60% less |\n| **P…\n\nSource: https://huggingface.co/unsloth/Qwen3-0.6B-GGUF","install":{"kind":"model","hfId":"unsloth/Qwen3-0.6B-GGUF","gated":false,"format":"gguf","files":[{"name":"Qwen3-0.6B-BF16.gguf","size":1198182848,"quant":"BF16","sha256":"f9c9f1d3c1e21755b82d4e165f88dbbbd4355646d632fb5d6cef7c66ed4ee04e"},{"name":"Qwen3-0.6B-IQ4_NL.gguf","size":381566656,"quant":"IQ4_NL","sha256":"f1b14e28a6de64f21672ddf2c8f24736c389da4c64ebf024b1204f4f43a4fd71"},{"name":"Qwen3-0.6B-IQ4_XS.gguf","size":367804096,"quant":"IQ4_XS","sha256":"dacc1fe1dc6f4799f366ac3385299f71c7e02c58b8702448a174f14d91b1c64d"},{"name":"Qwen3-0.6B-Q2_K.gguf","size":296238784,"quant":"Q2_K","sha256":"26d035ea15c4a2853e8d20ffc56a76f6164e17dbb6c9e532c5766700c404519d"},{"name":"Qwen3-0.6B-Q2_K_L.gguf","size":296238784,"quant":"Q2_K_L","sha256":"26d035ea15c4a2853e8d20ffc56a76f6164e17dbb6c9e532c5766700c404519d"},{"name":"Qwen3-0.6B-Q3_K_M.gguf","size":347127488,"quant":"Q3_K_M","sha256":"30bb9f9222cf58c076277879881a24e7127a10be32076d76d8c70f8defc01f5d"},{"name":"Qwen3-0.6B-Q3_K_S.gguf","size":323075776,"quant":"Q3_K_S","sha256":"1d61e10a443e3e335a979eecde30bab6c2489a1e876632e22e0695178d368b67"},{"name":"Qwen3-0.6B-Q4_0.gguf","size":382156480,"quant":"Q4_0","sha256":"33bcc57074ec7b6eada5a90651ee546ec0c2b271002c22baf9f1b2dd1e8f75cb"},{"name":"Qwen3-0.6B-Q4_1.gguf","size":409091776,"quant":"Q4_1","sha256":"ddaf05402c668540464a91efc607d732f41f108401533fe69de874bfc9653688"},{"name":"Qwen3-0.6B-Q4_K_M.gguf","size":396705472,"quant":"Q4_K_M","sha256":"ac2d97712095a558e31573f62f466a3f9d93990898b0ec79d7c974c1780d524a"},{"name":"Qwen3-0.6B-Q4_K_S.gguf","size":383270592,"quant":"Q4_K_S","sha256":"3e5495288a45c7891d32afeb4e7a1ed58a9a22fab83f8903b561204a89aae363"},{"name":"Qwen3-0.6B-Q5_K_M.gguf","size":444415680,"quant":"Q5_K_M","sha256":"03c6e2127d155b89c21a512954010486b1e00e1a9eebdfad650d03b53ab4c74a"},{"name":"Qwen3-0.6B-Q5_K_S.gguf","size":436616896,"quant":"Q5_K_S","sha256":"222acaa0376ffd371c5673a98ff896d7aa82428a4fab92e4b858e7eb281467ad"},{"name":"Qwen3-0.6B-Q6_K.gguf","size":495107776,"quant":"Q6_K","sha256":"1c15a88244c9e852516e5ba0e394fc97f2182f1f2757413fb99fe6a9214c033b"},{"name":"Qwen3-0.6B-Q8_0.gguf","size":639447744,"quant":"Q8_0","sha256":"e150ed544dfe6016930c026a93913a5e3184181ebfe6ab2223ae01dd0491784c"},{"name":"Qwen3-0.6B-UD-IQ1_M.gguf","size":220754624,"quant":"IQ1_M","sha256":"7b3e7f1ba1b743d9f97c4c8fe926cf92b0ac1902cb4a99309fe58b3bdd30d33b"},{"name":"Qwen3-0.6B-UD-IQ1_S.gguf","size":214643392,"quant":"IQ1_S","sha256":"fcb165efedaee2cfbdefe02bd3bbf22c80cfdb728915fbbe54fa809a8556710a"},{"name":"Qwen3-0.6B-UD-IQ2_M.gguf","size":268702400,"quant":"IQ2_M","sha256":"2c473f73f162dae9e09de4cec78eb6569ac7e78aa65dfcd71e40939e52fcf69b"},{"name":"Qwen3-0.6B-UD-IQ2_XXS.gguf","size":234074816,"quant":"IQ2_XXS","sha256":"55e0d0b88ae021edf15d2f0cec5ab2c47552b6a5f388dfab869f1e67240263c3"},{"name":"Qwen3-0.6B-UD-IQ3_XXS.gguf","size":282088128,"quant":"IQ3_XXS","sha256":"0ed6dab036349ba8198324c70002a15397e8bdeb06748eee5c631f872e1eaf2f"},{"name":"Qwen3-0.6B-UD-Q2_K_XL.gguf","size":301727424,"quant":"Q2_K_XL","sha256":"93a7ae9c1ddbebc9d754d855aa623c8109dad5ac2952de71300160122c1044b0"},{"name":"Qwen3-0.6B-UD-Q3_K_XL.gguf","size":356622016,"quant":"Q3_K_XL","sha256":"401c23cd33883cb9403f14a941c0cb04b8d5bdbc240f0f9008b574a5dcb75b5e"},{"name":"Qwen3-0.6B-UD-Q4_K_XL.gguf","size":405372608,"quant":"Q4_K_XL","sha256":"ed2dd561f8aa5651cfb198be583269779e26ca6e28c40dba94fc2da4432bde2a"},{"name":"Qwen3-0.6B-UD-Q5_K_XL.gguf","size":446381760,"quant":"Q5_K_XL","sha256":"23604893990250423a7f1a08e9a8d16da71eaeb560352020f533c9e62e14badd"},{"name":"Qwen3-0.6B-UD-Q6_K_XL.gguf","size":576467648,"quant":"Q6_K_XL","sha256":"d7df206be8dfac0267b24b97b6f062b31a8655ef770a74e82a38c262efb570ba"},{"name":"Qwen3-0.6B-UD-Q8_K_XL.gguf","size":844288704,"quant":"Q8_K_XL","sha256":"523982b2bb2ce75857aa0de6763c41e46ef2be5f79c26867f73be143f2ba8bad"}],"totalBytes":10948170368,"suggestedFile":"Qwen3-0.6B-Q4_K_M.gguf","requirements":{"ramGb":1,"diskBytes":396705472,"note":"estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models"},"runWith":["llama.cpp","ollama"],"command":"lsh models install hf:unsloth/Qwen3-0.6B-GGUF"}}