{"v":1,"id":"model:hf:unsloth/Qwen3-4B-GGUF","slug":"model-unsloth-qwen3-4b-gguf","kind":"model","category":"llm","title":"Qwen3-4B-GGUF","summary":"See our collection for all versions of Qwen3 including GGUF, 4-bit & 16-bit formats. Learn to run Qwen3 correctly - Read our Guide.","source":{"provider":"hf","ref":"unsloth/Qwen3-4B-GGUF","url":"https://huggingface.co/unsloth/Qwen3-4B-GGUF","rev":"22c9fc8a8c7700b76a1789366280a6a5a1ad1120","fetchedAt":"2026-10-02T20:53:31.215Z","etag":"W/\"3587-5H3h/PoMf9wD7L7UXpT0xFW2yMQ\""},"author":{"name":"unsloth","url":"https://huggingface.co/unsloth"},"license":{"spdx":"apache-2.0","raw":"apache-2.0","url":"https://huggingface.co/Qwen/Qwen3-4B/blob/main/LICENSE","open":true},"metrics":{"downloads":442310,"downloadsWeek":327838,"likes":246,"stars":27665,"openIssues":68,"pushedAt":"2026-01-09T03:05:47Z","takenAt":"2026-10-02T20:53:31.215Z"},"tags":["transformers","gguf","qwen3","text-generation","qwen","unsloth","en","endpoints_compatible","conversational"],"pipeline":"text-generation","links":{"github":"QwenLM/Qwen3","npm":"node-llama-cpp"},"updatedAt":"2025-06-08T08:08:49.000Z","collectedAt":"2026-10-02T20:53:31.215Z","review":{"numbers":["442,310 downloads on Hugging Face","246 likes","license apache-2.0","2.3 GB for Qwen3-4B-Q4_K_M.gguf","27,665 stars on QwenLM/Qwen3","68 open issues and PRs","327,838 npm downloads a week for node-llama-cpp","latest node-llama-cpp@3.22.1"],"log":null},"trust":"unlabeled","health":{"status":"alive","checkedAt":"2026-10-02T20:53:31.215Z","http":200},"description":"See our collection for all versions of Qwen3 including GGUF, 4-bit & 16-bit formats.\n  \n  \n    Learn to run Qwen3 correctly - Read our Guide.\n  \n\n    Unsloth Dynamic 2.0 achieves superior accuracy & outperforms other leading quants.\n  \n  \n    \n      \n    \n    \n      \n    \n    \n      \n    \n  \n✨ Run & Fine-tune Qwen3 with Unsloth!\n\n- Fine-tune Qwen3 (14B) for free using our Google [Colab notebook here](https://docs.unsloth.ai/get-started/unsloth-notebooks)!\n- Read our Blog about Qwen3 support: [unsloth.ai/blog/qwen3](https://unsloth.ai/blog/qwen3)\n- View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).\n- Run & export your fine-tuned model to Ollama, llama.cpp or HF.\n\n| Unsloth supports          |    Free Notebooks                                                                                           | Performance | Memory use |\n|-----------------|--------------------------------------------------------------------------------------------------------------------------|-------------|----------|\n| **Qwen3 (14B)**      | [▶️ Start on Colab](https://docs.unsloth.ai/get-started/unsloth-notebooks)               | 3x faster | 70% less |\n| **GRPO with Qwen3 (8B)**      | [▶️ Start on Colab](https://docs.unsloth.ai/get-started/unsloth-notebooks)               | 3x faster | 80% less |\n| **Llama-3.2 (3B)**      | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(1B_and_3B)-Conversational.ipynb)               | 2.4x faster | 58% less |\n| **Llama-3.2 (11B vision)**      | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(11B)-Vision.ipynb)               | 2x faster | 60% less |\n| **Qwen2.5 (7B)**      | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_(7B)-Alpaca.ipynb)               | 2x faster | 60% less |\n| **Phi…\n\nSource: https://huggingface.co/unsloth/Qwen3-4B-GGUF","install":{"kind":"model","hfId":"unsloth/Qwen3-4B-GGUF","gated":false,"format":"gguf","files":[{"name":"Qwen3-4B-BF16.gguf","size":8051285536,"quant":"BF16","sha256":"f59dbdf0a0131f4bafe257e5eaf25137a88c89c7a009e9418b0e447accda58a8"},{"name":"Qwen3-4B-IQ4_NL.gguf","size":2381344032,"quant":"IQ4_NL","sha256":"51fa8380d1c9a7dd47876dbed6c963fffeceec54a0065feeb6a8f3c113e1a562"},{"name":"Qwen3-4B-IQ4_XS.gguf","size":2270752032,"quant":"IQ4_XS","sha256":"82aa8394fd5b43eea0c287c88ae932b22f90e192e1288cff94bc39e2d5a97c01"},{"name":"Qwen3-4B-Q2_K.gguf","size":1669500192,"quant":"Q2_K","sha256":"a5f2398927fa06fe12074aa39086004300185b82de53a1d2623b0f015e3881b0"},{"name":"Qwen3-4B-Q2_K_L.gguf","size":1669500192,"quant":"Q2_K_L","sha256":"a5f2398927fa06fe12074aa39086004300185b82de53a1d2623b0f015e3881b0"},{"name":"Qwen3-4B-Q3_K_M.gguf","size":2075618592,"quant":"Q3_K_M","sha256":"e78ff54a67f3b3f57e637fbf0770d5b73c1e215ea7c0153980f1e8140c2b2486"},{"name":"Qwen3-4B-Q3_K_S.gguf","size":1886997792,"quant":"Q3_K_S","sha256":"0f16e5ebc31514dbdb0e0c736ed6d28c2b086de689afb0f1ab1f7a2ad2eff43e"},{"name":"Qwen3-4B-Q4_0.gguf","size":2375773472,"quant":"Q4_0","sha256":"92f4a83cdfe691b216a949f915e47f35f0ed85b833aa03490c719160ac5cdf7a"},{"name":"Qwen3-4B-Q4_1.gguf","size":2596629792,"quant":"Q4_1","sha256":"deb1db47d2e12a719e3473a1b48d6474a48dc05c097650eab292058180be765a"},{"name":"Qwen3-4B-Q4_K_M.gguf","size":2497281312,"quant":"Q4_K_M","sha256":"f6f851777709861056efcdad3af01da38b31223a3ba26e61a4f8bf3a2195813a"},{"name":"Qwen3-4B-Q4_K_S.gguf","size":2383310112,"quant":"Q4_K_S","sha256":"78cea0ccfd5fd7af5761f7dfdeebd2ec8f04328be0f1e6f70e2213a6f1309bc9"},{"name":"Qwen3-4B-Q5_K_M.gguf","size":2889514272,"quant":"Q5_K_M","sha256":"37edbd37f5b7a4d4e7a766400c57def1f790e809de03513b86bf11bb06979695"},{"name":"Qwen3-4B-Q5_K_S.gguf","size":2823712032,"quant":"Q5_K_S","sha256":"7bc3b33f8439ef774adc4665f61c8c31132056a8616db6227a6664397a42563a"},{"name":"Qwen3-4B-Q6_K.gguf","size":3306261792,"quant":"Q6_K","sha256":"002b8b61c298976afc2c9c3ca65f9dbb28deba22c4b6381853dfaa92b5690022"},{"name":"Qwen3-4B-Q8_0.gguf","size":4280405792,"quant":"Q8_0","sha256":"eed555233267a33c7e8ee31682762cc7751b3f6d224039086e0e846f05fffa5d"},{"name":"Qwen3-4B-UD-IQ1_M.gguf","size":1143484192,"quant":"IQ1_M","sha256":"be85300f9bee244206991b46631eb937ff46917a241ad5e396fcb8beee4fc55b"},{"name":"Qwen3-4B-UD-IQ1_S.gguf","size":1083150112,"quant":"IQ1_S","sha256":"bdc1138cb754d50dd4cc226597d307dd1f011710a8ddf8c68bb25e7fd215e470"},{"name":"Qwen3-4B-UD-IQ2_M.gguf","size":1532931872,"quant":"IQ2_M","sha256":"c9ae27462f4edf0fdce39d41f6c129be7907d1c4ebe26c1298b30bc1bbac6c9f"},{"name":"Qwen3-4B-UD-IQ2_XXS.gguf","size":1255345952,"quant":"IQ2_XXS","sha256":"2c41173a2bcd7a5c1f53524cb0efef1f5ee647523d8c1988be71a943d9a70e5c"},{"name":"Qwen3-4B-UD-IQ3_XXS.gguf","size":1674376992,"quant":"IQ3_XXS","sha256":"f288d0748fca57526304df6e4648b126f7e900ef48b4adbea4ac553063593306"},{"name":"Qwen3-4B-UD-Q2_K_XL.gguf","size":1695724832,"quant":"Q2_K_XL","sha256":"a09c9695db755e5f3896b20323f16eb79554be6ad4637ef9787245bc212b53d7"},{"name":"Qwen3-4B-UD-Q3_K_XL.gguf","size":2131692832,"quant":"Q3_K_XL","sha256":"fd11f2a0741a8bad10d6892bac438326460844c09d8eaeb27419fb89360c8f55"},{"name":"Qwen3-4B-UD-Q4_K_XL.gguf","size":2546341152,"quant":"Q4_K_XL","sha256":"f6e3fb6c2cdc869d16e66c719e94f2c02095d195967230e759a2d77fe814c71f"},{"name":"Qwen3-4B-UD-Q5_K_XL.gguf","size":2905253152,"quant":"Q5_K_XL","sha256":"bf8683da9e517b872859fdc8a0704a599021305380f5c08780c209b07ba26fe6"},{"name":"Qwen3-4B-UD-Q6_K_XL.gguf","size":3658223392,"quant":"Q6_K_XL","sha256":"ac0767b5e9c9f16efe57ce422253a33747970c166c3131c4d4d59d20511f07e1"},{"name":"Qwen3-4B-UD-Q8_K_XL.gguf","size":5056700192,"quant":"Q8_K_XL","sha256":"93bc18247eac98a8265c80c78b1322a96cc9c83218351f5a6922fb9e6f8fb242"}],"totalBytes":67841111616,"suggestedFile":"Qwen3-4B-Q4_K_M.gguf","requirements":{"ramGb":4,"diskBytes":2497281312,"note":"estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models"},"runWith":["llama.cpp","ollama"],"command":"lsh models install hf:unsloth/Qwen3-4B-GGUF"}}