{"v":1,"id":"model:hf:unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF","slug":"model-unsloth-qwen3-coder-30b-a3b-instruct-gguf","kind":"model","category":"llm","title":"Qwen3-Coder-30B-A3B-Instruct-GGUF","summary":"See our collection for all versions of Qwen3 including GGUF, 4-bit & 16-bit formats. Learn to run Qwen3-Coder correctly - Read our Guide.","source":{"provider":"hf","ref":"unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF","url":"https://huggingface.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF","rev":"b17cb02dd882d5b6ab62fc777ad2995f19668350","fetchedAt":"2026-10-02T20:54:13.989Z","etag":"W/\"407b-lXflMaeFHq6AI/qViaFi0CFBiC8\""},"author":{"name":"unsloth","url":"https://huggingface.co/unsloth"},"license":{"spdx":"apache-2.0","raw":"apache-2.0","url":"https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B-Instruct/blob/main/LICENSE","open":true},"metrics":{"downloads":8649679,"downloadsWeek":327838,"likes":1099,"stars":27665,"openIssues":68,"pushedAt":"2026-01-09T03:05:47Z","takenAt":"2026-10-02T20:54:13.989Z"},"tags":["transformers","gguf","unsloth","qwen3","qwen","text-generation","endpoints_compatible","imatrix","conversational"],"pipeline":"text-generation","links":{"github":"QwenLM/Qwen3","npm":"node-llama-cpp"},"updatedAt":"2026-01-30T06:29:38.000Z","collectedAt":"2026-10-02T20:54:13.989Z","review":{"numbers":["8,649,679 downloads on Hugging Face","1,099 likes","license apache-2.0","17 GB for Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf","27,665 stars on QwenLM/Qwen3","68 open issues and PRs","327,838 npm downloads a week for node-llama-cpp","latest node-llama-cpp@3.22.1"],"log":null},"trust":"unlabeled","health":{"status":"alive","checkedAt":"2026-10-02T20:54:13.989Z","http":200},"description":"See our collection for all versions of Qwen3 including GGUF, 4-bit & 16-bit formats.\n  \n  \n    Learn to run Qwen3-Coder correctly - Read our Guide.\n  \n\n   See Unsloth Dynamic 2.0 GGUFs for our quantization benchmarks.\n  \n  \n    \n      \n    \n    \n      \n    \n    \n      \n    \n  \n✨ Read our Qwen3-Coder Guide here!\n\n- Fine-tune Qwen3 (14B) for free using our Google [Colab notebook](https://docs.unsloth.ai/get-started/unsloth-notebooks)!\n- Read our Blog about Qwen3 support: [unsloth.ai/blog/qwen3](https://unsloth.ai/blog/qwen3)\n- View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).\n| Unsloth supports          |    Free Notebooks                                                                                           | Performance | Memory use |\n|-----------------|--------------------------------------------------------------------------------------------------------------------------|-------------|----------|\n| **Qwen3 (14B)**      | [▶️ Start on Colab](https://docs.unsloth.ai/get-started/unsloth-notebooks)               | 3x faster | 70% less |\n| **GRPO with Qwen3 (8B)**      | [▶️ Start on Colab](https://docs.unsloth.ai/get-started/unsloth-notebooks)               | 3x faster | 80% less |\n| **Llama-3.2 (3B)**      | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(1B_and_3B)-Conversational.ipynb)               | 2.4x faster | 58% less |\n| **Llama-3.2 (11B vision)**      | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(11B)-Vision.ipynb)               | 2x faster | 60% less |\n| **Qwen2.5 (7B)**      | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_(7B)-Alpaca.ipynb)               | 2x faster | 60% less |\n\n# Qwen3-Coder-30B-A3B-Instruct\n\n    \n\n## Highlights\n\n**Qwen3-Coder** is ava…\n\nSource: https://huggingface.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF","install":{"kind":"model","hfId":"unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF","gated":false,"format":"gguf","files":[{"name":"BF16/Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002.gguf","size":49655154016,"quant":"BF16","sha256":"c432d5b64272ae30f0df02326619557a1994b034c40139c6e8d7dce928142845"},{"name":"BF16/Qwen3-Coder-30B-A3B-Instruct-BF16-00002-of-00002.gguf","size":11440652032,"quant":"BF16","sha256":"cd36c4d1dc4be366aec7fa9597920e16adb7aed06c7e85ca857695b76ef11737"},{"name":"Qwen3-Coder-30B-A3B-Instruct-IQ4_NL.gguf","size":17310784672,"quant":"IQ4_NL","sha256":"27f17516dacc1576ddc8a5e31a33d9c7829fb15dfa502fb208e50b1e70612b56"},{"name":"Qwen3-Coder-30B-A3B-Instruct-IQ4_XS.gguf","size":16378076320,"quant":"IQ4_XS","sha256":"26cd4fef3ada9de84c6c59c4b93f9bc5df4d69a71e18cfe8a17369c2f8374ce7"},{"name":"Qwen3-Coder-30B-A3B-Instruct-Q2_K.gguf","size":11258612896,"quant":"Q2_K","sha256":"6db9853d31fdb928a731666c9d44e8cdebf52f62f4810cb0908c6c677e6c84b5"},{"name":"Qwen3-Coder-30B-A3B-Instruct-Q2_K_L.gguf","size":11331542176,"quant":"Q2_K_L","sha256":"7add73b0607b498f79157a5f4e4ccddc14ad7afd61d76655e064e1e92476267e"},{"name":"Qwen3-Coder-30B-A3B-Instruct-Q3_K_M.gguf","size":14711850144,"quant":"Q3_K_M","sha256":"30c83da425db2324444b6a6cecaf4c410038a2ec73a78de2436879dc0316a371"},{"name":"Qwen3-Coder-30B-A3B-Instruct-Q3_K_S.gguf","size":13292471456,"quant":"Q3_K_S","sha256":"17d51f5310e9a598e5ac914d30f401fb2d1bc3b6a06a846919099eac09364ae1"},{"name":"Qwen3-Coder-30B-A3B-Instruct-Q4_0.gguf","size":17379990688,"quant":"Q4_0","sha256":"cf9ea0572e8759348ef7f8cd899fbfecba5110929fc1aa620d18bb6d91e62700"},{"name":"Qwen3-Coder-30B-A3B-Instruct-Q4_1.gguf","size":19192503456,"quant":"Q4_1","sha256":"7e3ca03775ad2e3ddffe3380a391c34cf675590a54ef27bcaf94a38787bb06a8"},{"name":"Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf","size":18556689568,"quant":"Q4_K_M","sha256":"fadc3e5f8d42bf7e894a785b05082e47daee4df26680389817e2093056f088ad"},{"name":"Qwen3-Coder-30B-A3B-Instruct-Q4_K_S.gguf","size":17456012448,"quant":"Q4_K_S","sha256":"56a7d00783419bcb0ae566253c371bcb3678261bb79881a553539f5679864db4"},{"name":"Qwen3-Coder-30B-A3B-Instruct-Q5_K_M.gguf","size":21725584544,"quant":"Q5_K_M","sha256":"4b78837bbec5ee248e4a5642bf608b6793721af41b92589e40c8da0bce58b907"},{"name":"Qwen3-Coder-30B-A3B-Instruct-Q5_K_S.gguf","size":21080513696,"quant":"Q5_K_S","sha256":"a1a93585e669f77ac0b5f3aaf18241e051028a6c467c4eac376fd7d1c7a1ebca"},{"name":"Qwen3-Coder-30B-A3B-Instruct-Q6_K.gguf","size":25092535456,"quant":"Q6_K","sha256":"100b5121d09553fb1af3b873b21fb3ec3da5c306fc5cb09bd338c48e21b10875"},{"name":"Qwen3-Coder-30B-A3B-Instruct-Q8_0.gguf","size":32483935392,"quant":"Q8_0","sha256":"4ff1cff607804037bf6d2168249c570baa4e1621292b159c0e06591e0d7c3066"},{"name":"Qwen3-Coder-30B-A3B-Instruct-UD-IQ1_M.gguf","size":9627540640,"quant":"IQ1_M","sha256":"87ddf47ea7be2311968f49c4585f1c12cb9a4400f1112b849449ce27e0732d0f"},{"name":"Qwen3-Coder-30B-A3B-Instruct-UD-IQ1_S.gguf","size":8914328736,"quant":"IQ1_S","sha256":"2dc573a4748d9d9cd45482e03dc786b4151f9174d66f5f982fda64a5b346dc52"},{"name":"Qwen3-Coder-30B-A3B-Instruct-UD-IQ2_M.gguf","size":10837007520,"quant":"IQ2_M","sha256":"7055a02d4d974fd68b26b095a9c676f099507aed1171f89a47275025df3f521d"},{"name":"Qwen3-Coder-30B-A3B-Instruct-UD-IQ2_XXS.gguf","size":10333691040,"quant":"IQ2_XXS","sha256":"51d0a284dc26f11102032b7aa8eca28619b8c399478afc5a0ab7180cd711bf13"},{"name":"Qwen3-Coder-30B-A3B-Instruct-UD-IQ3_XXS.gguf","size":12848766112,"quant":"IQ3_XXS","sha256":"d6b85d2b6633c55be3751848acc74fab40d28d93b27dabacd96ceabe10962057"},{"name":"Qwen3-Coder-30B-A3B-Instruct-UD-Q2_K_XL.gguf","size":11788590240,"quant":"Q2_K_XL","sha256":"3dee4686d756e8842aec638c5725666c76584edce76d71088732b52d2c5d7a45"},{"name":"Qwen3-Coder-30B-A3B-Instruct-UD-Q3_K_XL.gguf","size":13806312608,"quant":"Q3_K_XL","sha256":"69cd7578d77dffc0b17e34bad9ef998d08ae0e20ccceef21bad4e7eb3d8c553b"},{"name":"Qwen3-Coder-30B-A3B-Instruct-UD-Q4_K_XL.gguf","size":17665334432,"quant":"Q4_K_XL","sha256":"2841aa314d916434860cfb8990347528dcdfe5c350dbcb9d1461dbee88ff2533"},{"name":"Qwen3-Coder-30B-A3B-Instruct-UD-Q5_K_XL.gguf","size":21740305568,"quant":"Q5_K_XL","sha256":"eb331a4eee8eb6b5a8eb25f44f96f45c71b8d10f553c0a456190dd590a7ef77d"},{"name":"Qwen3-Coder-30B-A3B-Instruct-UD-Q6_K_XL.gguf","size":26340328608,"quant":"Q6_K_XL","sha256":"b09fcc58fd27cd43dacdf6840c5829125c8ed9463b2a386ce2667395b1292f63"},{"name":"Qwen3-Coder-30B-A3B-Instruct-UD-Q8_K_XL.gguf","size":35989947552,"quant":"Q8_K_XL","sha256":"c867adc2a5f823ce64f5aa0717af3c4b660959c3f16c23c5f70f7bf8ba795e28"},{"name":"Qwen3-Coder-30B-A3B-Instruct-UD-TQ1_0.gguf","size":8005213344,"quant":"TQ1_0","sha256":"fcb403c1d7a98bc0ffbe98ec7fbfafe1cdd0050af808ba4af8cd6dcaa807f8d9"}],"totalBytes":506244275360,"suggestedFile":"Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf","requirements":{"ramGb":21,"diskBytes":18556689568,"note":"estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models"},"runWith":["llama.cpp","ollama"],"command":"lsh models install hf:unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF"}}