{"v":1,"id":"model:hf:mradermacher/Qwen3-Embedding-0.6B-GGUF","slug":"model-mradermacher-qwen3-embedding-0-6b-gguf","kind":"model","category":"embedding","title":"Qwen3-Embedding-0.6B-GGUF","summary":"static quants of https://huggingface.co/Qwen/Qwen3-Embedding-0.6B","source":{"provider":"hf","ref":"mradermacher/Qwen3-Embedding-0.6B-GGUF","url":"https://huggingface.co/mradermacher/Qwen3-Embedding-0.6B-GGUF","rev":"8c605f43dcb0b43cf6e4afc7203888d912a67ace","fetchedAt":"2026-10-09T19:01:10.061Z","etag":"W/\"21b2-PzI5HfivduCuAgvSDD5C/D4LNGU\""},"author":{"name":"mradermacher","url":"https://huggingface.co/mradermacher"},"license":{"spdx":"apache-2.0","raw":"apache-2.0","open":true},"metrics":{"downloads":1827,"downloadsWeek":297971,"likes":2,"stars":27659,"openIssues":68,"pushedAt":"2026-01-09T03:05:47Z","takenAt":"2026-10-09T19:01:10.061Z"},"tags":["transformers","gguf","sentence-transformers","sentence-similarity","feature-extraction","text-embeddings-inference","en","endpoints_compatible","conversational"],"pipeline":"feature-extraction","links":{"github":"QwenLM/Qwen3","npm":"node-llama-cpp"},"updatedAt":"2026-04-23T23:48:32.000Z","collectedAt":"2026-10-09T19:01:10.061Z","review":{"numbers":["1,827 downloads on Hugging Face","2 likes","license apache-2.0","0.4 GB for Qwen3-Embedding-0.6B.Q4_K_M.gguf","27,659 stars on QwenLM/Qwen3","68 open issues and PRs","297,971 npm downloads a week for node-llama-cpp","latest node-llama-cpp@3.22.1"],"log":null},"trust":"unlabeled","health":{"status":"alive","checkedAt":"2026-10-09T19:01:10.061Z","http":200},"description":"## About\n\nstatic quants of https://huggingface.co/Qwen/Qwen3-Embedding-0.6B\n\n***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-Embedding-0.6B-GGUF).***\n\nweighted/imatrix quants are available at https://huggingface.co/mradermacher/Qwen3-Embedding-0.6B-i1-GGUF\n## Usage\n\nIf you are unsure how to use GGUF files, refer to one of [TheBloke's\nREADMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for\nmore details, including on how to concatenate multi-part files.\n\n## Provided Quants\n\n(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)\n\n| Link | Type | Size/GB | Notes |\n|:-----|:-----|--------:|:------|\n| [GGUF](https://huggingface.co/mradermacher/Qwen3-Embedding-0.6B-GGUF/resolve/main/Qwen3-Embedding-0.6B.Q2_K.gguf) | Q2_K | 0.4 |  |\n| [GGUF](https://huggingface.co/mradermacher/Qwen3-Embedding-0.6B-GGUF/resolve/main/Qwen3-Embedding-0.6B.Q3_K_S.gguf) | Q3_K_S | 0.4 |  |\n| [GGUF](https://huggingface.co/mradermacher/Qwen3-Embedding-0.6B-GGUF/resolve/main/Qwen3-Embedding-0.6B.Q3_K_M.gguf) | Q3_K_M | 0.4 | lower quality |\n| [GGUF](https://huggingface.co/mradermacher/Qwen3-Embedding-0.6B-GGUF/resolve/main/Qwen3-Embedding-0.6B.Q3_K_L.gguf) | Q3_K_L | 0.5 |  |\n| [GGUF](https://huggingface.co/mradermacher/Qwen3-Embedding-0.6B-GGUF/resolve/main/Qwen3-Embedding-0.6B.IQ4_XS.gguf) | IQ4_XS | 0.5 |  |\n| [GGUF](https://huggingface.co/mradermacher/Qwen3-Embedding-0.6B-GGUF/resolve/main/Qwen3-Embedding-0.6B.Q4_K_S.gguf) | Q4_K_S | 0.5 | fast, recommended |\n| [GGUF](https://huggingface.co/mradermacher/Qwen3-Embedding-0.6B-GGUF/resolve/main/Qwen3-Embedding-0.6B.Q4_K_M.gguf) | Q4_K_M | 0.5 | fast, recommended |\n| [GGUF](https://huggingface.co/mradermacher/Qwen3-Embedding-0.6B-GGUF/resolve/main/Qwen3-Embedding-0.6B.Q5_K_S.gguf) | Q5_K_S | 0.5 |  |\n| [GGUF](https://huggingface.co/mradermac…\n\nSource: https://huggingface.co/mradermacher/Qwen3-Embedding-0.6B-GGUF","install":{"kind":"model","hfId":"mradermacher/Qwen3-Embedding-0.6B-GGUF","gated":false,"format":"gguf","files":[{"name":"Qwen3-Embedding-0.6B.IQ4_XS.gguf","size":369048224,"quant":"IQ4_XS","sha256":"19347e406810106479934129bf9881826ea17f46a669f4634947aaa6a274b2de"},{"name":"Qwen3-Embedding-0.6B.Q2_K.gguf","size":296008352,"quant":"Q2_K","sha256":"47678b87277899f78fef8cfe4ed1b401f4b53b4d4087836a007087d71b48f0f1"},{"name":"Qwen3-Embedding-0.6B.Q3_K_L.gguf","size":368261792,"quant":"Q3_K_L","sha256":"9b8db3b9fdc5a477014cbb30e39c24522d737a56d1533e23848b85cbe11ee4d2"},{"name":"Qwen3-Embedding-0.6B.Q3_K_M.gguf","size":346897056,"quant":"Q3_K_M","sha256":"aaa3c659c4f41759de9a2d9fa03119e76a88755b38f0aed0246a66512f9dad4c"},{"name":"Qwen3-Embedding-0.6B.Q3_K_S.gguf","size":322845344,"quant":"Q3_K_S","sha256":"3b2240d193c25f0ead6b0cec2e8166d75e0f864251a0fe3a7d691105de40effe"},{"name":"Qwen3-Embedding-0.6B.Q4_K_M.gguf","size":396475040,"quant":"Q4_K_M","sha256":"793cb15c8e0da4fe29f32ae0b3d604a92a9b1ecf5048cbfd65107faa38108b83"},{"name":"Qwen3-Embedding-0.6B.Q4_K_S.gguf","size":383040160,"quant":"Q4_K_S","sha256":"08c568383f5a59ad58bac097e672785911a3b9928213381e5206d6b2a6c62d14"},{"name":"Qwen3-Embedding-0.6B.Q5_K_M.gguf","size":444185248,"quant":"Q5_K_M","sha256":"0398c26f2b46584d3c02a0745c320e98c6b70fc7468e1dc68b8270bcf7606aa9"},{"name":"Qwen3-Embedding-0.6B.Q5_K_S.gguf","size":436386464,"quant":"Q5_K_S","sha256":"d7af2802ac56792f0b29f4eabd4549ffe4ea45c7ad27f4041dae9bf0e92d9c3d"},{"name":"Qwen3-Embedding-0.6B.Q6_K.gguf","size":494877344,"quant":"Q6_K","sha256":"82a1ed61bb9e4e5377690b59061aaff81b5ed80029c4081bf0cb86b339c837e5"},{"name":"Qwen3-Embedding-0.6B.Q8_0.gguf","size":639151072,"quant":"Q8_0","sha256":"e40d4a708d0b324fc133bae547bd64dec79edb885410ef262c1e5c2efb2050b3"},{"name":"Qwen3-Embedding-0.6B.f16.gguf","size":1197630112,"quant":"F16","sha256":"0454f6247afaed405fb6b9abc07cb4f24bf467e6bf908f9a824de23c44b323b4"}],"totalBytes":5694806208,"suggestedFile":"Qwen3-Embedding-0.6B.Q4_K_M.gguf","requirements":{"ramGb":1,"diskBytes":396475040,"note":"estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models"},"runWith":["llama.cpp"],"command":"lsh models install hf:mradermacher/Qwen3-Embedding-0.6B-GGUF"}}