{"v":1,"id":"model:hf:bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF","slug":"model-bartowski-kwaipilot-kat-coder-v2-5-dev-gguf","kind":"model","category":"llm","title":"Kwaipilot_KAT-Coder-V2.5-Dev-GGUF","summary":"Llamacpp imatrix Quantizations of KAT-Coder-V2.5-Dev by Kwaipilot","source":{"provider":"hf","ref":"bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF","url":"https://huggingface.co/bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF","rev":"d8f684f08d2950ea9d2db6a35ef7dada0707858b","fetchedAt":"2026-10-02T21:01:07.613Z","etag":"W/\"427a-g0RpeYSJkEa0sop3uGC77T5WEMQ\""},"author":{"name":"bartowski","url":"https://huggingface.co/bartowski"},"license":{"spdx":"apache-2.0","raw":"apache-2.0","open":true},"metrics":{"downloads":313246,"downloadsWeek":327838,"likes":138,"takenAt":"2026-10-02T21:01:07.613Z"},"tags":["gguf","code","agent","agentic-coding","moe","coding","text-generation","en","zh","endpoints_compatible","imatrix","conversational"],"pipeline":"text-generation","links":{"github":"ggml-org/llama.cpp","npm":"node-llama-cpp"},"updatedAt":"2026-07-24T02:46:59.000Z","collectedAt":"2026-10-02T21:01:07.613Z","review":{"numbers":["313,246 downloads on Hugging Face","138 likes","license apache-2.0","20 GB for Kwaipilot_KAT-Coder-V2.5-Dev-Q4_K_M.gguf","327,838 npm downloads a week for node-llama-cpp","latest node-llama-cpp@3.22.1"],"log":null},"trust":"unlabeled","health":{"status":"alive","checkedAt":"2026-10-02T21:01:07.613Z","http":200},"description":"## Llamacpp imatrix Quantizations of KAT-Coder-V2.5-Dev by Kwaipilot\n\nUsing llama.cpp release b10087 for quantization.\n\nOriginal model: https://huggingface.co/Kwaipilot/KAT-Coder-V2.5-Dev\n\nAll quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/82ae9b520227f57d79ba04add13d0d0d)\n\nRun them in your choice of tools:\n\n- [llama.cpp](https://github.com/ggml-org/llama.cpp)\n- [ramalama](https://github.com/containers/ramalama)\n- [LM Studio](https://lmstudio.ai/)\n- [koboldcpp](https://github.com/LostRuins/koboldcpp)\n- [Jan AI](https://www.jan.ai/)\n- [Text Generation Web UI](https://github.com/oobabooga/text-generation-webui)\n- [LoLLMs](https://github.com/ParisNeo/lollms)\n- [Atomic Chat](https://atomic.chat/)\n\nNote: if it's a newly supported model, you may need to wait for an update from the developers.\n\n## Prompt format\n\n```\nsystem\n{system_prompt}\nuser\n{prompt}\nassistant\n\n```\n\n## Download a file (not the whole branch) from below:\n\n| Filename | Quant type | File Size | Split | Description |\n| -------- | ---------- | --------- | ----- | ----------- |\n| [Kwaipilot_KAT-Coder-V2.5-Dev-bf16.gguf](https://huggingface.co/bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF/tree/main/Kwaipilot_KAT-Coder-V2.5-Dev-bf16) | bf16 | 69.38GB | true | Full BF16 weights. |\n| [Kwaipilot_KAT-Coder-V2.5-Dev-Q8_0.gguf](https://huggingface.co/bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF/blob/main/Kwaipilot_KAT-Coder-V2.5-Dev-Q8_0.gguf) | Q8_0 | 36.91GB | false | Extremely high quality, generally unneeded but max available quant. |\n| [Kwaipilot_KAT-Coder-V2.5-Dev-Q6_K_L.gguf](https://huggingface.co/bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF/blob/main/Kwaipilot_KAT-Coder-V2.5-Dev-Q6_K_L.gguf) | Q6_K_L | 30.30GB | false | Uses Q8_0 for embed and output weights. Very high quality, near perfect, *recommended*. |\n| [Kwaipilot_KAT-Coder-V2.5-Dev-Q6_K.gguf](https://huggingface.co/bartowski/Kwaipil…\n\nSource: https://huggingface.co/bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF","install":{"kind":"model","hfId":"bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF","gated":false,"format":"gguf","files":[{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-IQ2_M.gguf","size":12066716064,"quant":"IQ2_M","sha256":"b58333ee1762e8247fcab88e3d3f27b4cf2e5eb361caf1d93766d0252f6bbc92"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-IQ2_S.gguf","size":11010275744,"quant":"IQ2_S","sha256":"f0d8cf1cdd9281370c1867fa41f5979873b035f1bb3997fbf698cc37bb36caac"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-IQ2_XS.gguf","size":10797144480,"quant":"IQ2_XS","sha256":"0a3ae2e515a18ef1a95b059b15f9eeec92381a9601d3ad17fcbea37285879f22"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-IQ2_XXS.gguf","size":9778452896,"quant":"IQ2_XXS","sha256":"43a084de380dbba2aad32a6adff5395f47f7434a5a57294b8d113bb09228961f"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-IQ3_M.gguf","size":16900258208,"quant":"IQ3_M","sha256":"9069711f640b655473044fcf71988d5e9fb3fbce729396b35d2ade22655c3ba8"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-IQ3_XS.gguf","size":16218683808,"quant":"IQ3_XS","sha256":"e33635c98d1330e44bc9076db45598f441a6715c8a9e4db305a0d5efb5a9b61f"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-IQ3_XXS.gguf","size":14870829472,"quant":"IQ3_XXS","sha256":"80453a60bfbd277ae6110413d5b7a4fef07d69997ef88e42adfe3cd650373f79"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-IQ4_NL.gguf","size":19861346720,"quant":"IQ4_NL","sha256":"e04d06968587d2d4ec1aaf376d654de3610e3ac36f32e90120bf8aa1a213da6b"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-IQ4_XS.gguf","size":18806446496,"quant":"IQ4_XS","sha256":"e35e23219a81590b9d4174eea4717d716dd62676c8c434f6b708f49a07310e1a"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q2_K.gguf","size":12617079200,"quant":"Q2_K","sha256":"64dbb30f9683242dfa03af9578b1276ddf55dd1ccb33c0aa5151b9b4989d255d"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q2_K_L.gguf","size":13113719200,"quant":"Q2_K_L","sha256":"54eccbdf3608c14f95222a30222ab8a35bdc23b1afd51053a6a044b59259afe7"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q3_K_L.gguf","size":16886495648,"quant":"Q3_K_L","sha256":"57c544ff2e03397724e6dd04d4ce32b58e1d1e2b56a17a5c29de54fe6c420139"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q3_K_M.gguf","size":16226548128,"quant":"Q3_K_M","sha256":"fe37b5585ad0abdce30e84872c9e664d7863bfb5b1f82baf7598a91e5f8c7010"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q3_K_S.gguf","size":15513516448,"quant":"Q3_K_S","sha256":"8782b8e05d2c5882dde7cfb73e03d99c993c727000f0d7e15a850df028fec287"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q3_K_XL.gguf","size":17331485088,"quant":"Q3_K_XL","sha256":"a53ef27d9229988d80a907768620642e47cbd8f5ba37e7ba20d2cfc138dd256b"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q4_0.gguf","size":19942611360,"quant":"Q4_0","sha256":"aa7d33c9de35e5b172fd7896485597e358fafbaa9681ac467f92ca5b082d8920"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q4_1.gguf","size":21973768608,"quant":"Q4_1","sha256":"0c16a872ef5eb0b155177dfca176a14f9d85fff8b6baff100fb2a9feb3765b4a"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q4_K_L.gguf","size":21768894880,"quant":"Q4_K_L","sha256":"bb0441b81a7cac064ae2fc139e6d4d0ef53dbdc8916ba117605070b7c03e455e"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q4_K_M.gguf","size":21391448480,"quant":"Q4_K_M","sha256":"4221c26e5663502d1c96fc901c9967d0e70ce2dcfaa5a9fb9280a46bd19e3c07"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q4_K_S.gguf","size":20592728480,"quant":"Q4_K_S","sha256":"72ca8ce08a77aab687a834be9760e10f7b513fff228d26b65cddc927dc62d89a"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q5_K_L.gguf","size":25331333536,"quant":"Q5_K_L","sha256":"10c8d39d35e2f69c347b3917472e2d64881eb0440fb2025854a7036aa640556f"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q5_K_M.gguf","size":25017457056,"quant":"Q5_K_M","sha256":"9f0fe03348f6214a9487ee1e0634d345050d9b4a5be3cea37a878121c2790106"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q5_K_S.gguf","size":24156150176,"quant":"Q5_K_S","sha256":"0b38450cdafac1a4550debfe3608c6cc1dc9908e3f59e995b2f6746d0f9d2563"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q6_K.gguf","size":30053415328,"quant":"Q6_K","sha256":"f681d948ce46c988b17a24e1c59b14fab0e1dd7e769ea7bb46890d7252ae5d78"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q6_K_L.gguf","size":30299748768,"quant":"Q6_K_L","sha256":"a21089bfe6e6fe794b7db2dcadde0da91e0e791bfd7ab0eb75de2f7636e48397"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-Q8_0.gguf","size":36914690464,"quant":"Q8_0","sha256":"5fa510f44779b0e3d38a6678985f417a1c65e3000405ca5d6dcf7fd065e47a15"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-bf16/Kwaipilot_KAT-Coder-V2.5-Dev-bf16-00001-of-00002.gguf","size":39682772768,"quant":"BF16","sha256":"e0e02441a3678c218ff5bcf02477fa128a5ce1eddbaec1afb27fc45d9f9d142f"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-bf16/Kwaipilot_KAT-Coder-V2.5-Dev-bf16-00002-of-00002.gguf","size":29693864480,"quant":"BF16","sha256":"2c6f5fd88b18eed88adb662ac5e4578ffbac475af64206eeeac5b6e3c2068723"},{"name":"Kwaipilot_KAT-Coder-V2.5-Dev-imatrix.gguf","size":192223904,"sha256":"f5727113280b24cbacc2f5308c970ab5efc8adb15d3ac4feb0e27ae1ac469c7c"}],"totalBytes":569010105888,"suggestedFile":"Kwaipilot_KAT-Coder-V2.5-Dev-Q4_K_M.gguf","requirements":{"ramGb":24,"diskBytes":21391448480,"note":"estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models"},"runWith":["llama.cpp","ollama"],"command":"lsh models install hf:bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF"}}