LogiShell store Open app

Store › model › LLM

Kwaipilot_KAT-Coder-V2.5-Dev-GGUF

by bartowski · source Hugging Face · updated 2026-07-24

apache-2.020 GB~24 GB RAMsource aliveunlabeled

Llamacpp imatrix Quantizations of KAT-Coder-V2.5-Dev by Kwaipilot

Add to LogiShell Open in the web IDE

The button opens LogiShell with this card; nothing installs from a link by itself. Inside the app the install goes through lsh models install hf:bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF and its progress lives in the Resource Center.

Source and license

Numbers

Numbers as of 2026-10-02 21:01 UTC, from the source API.

Summary

Summary not ready yet: the numbers are here, the text is not. It is written by the collector through the LogiShell model facade when a provider key is present.

Reviews

No reviews yet. Reviews are written inside LogiShell: open this card in the app.

Files

filequantsize
Kwaipilot_KAT-Coder-V2.5-Dev-IQ2_M.ggufIQ2_M11 GB
Kwaipilot_KAT-Coder-V2.5-Dev-IQ2_S.ggufIQ2_S10 GB
Kwaipilot_KAT-Coder-V2.5-Dev-IQ2_XS.ggufIQ2_XS10 GB
Kwaipilot_KAT-Coder-V2.5-Dev-IQ2_XXS.ggufIQ2_XXS9.1 GB
Kwaipilot_KAT-Coder-V2.5-Dev-IQ3_M.ggufIQ3_M16 GB
Kwaipilot_KAT-Coder-V2.5-Dev-IQ3_XS.ggufIQ3_XS15 GB
Kwaipilot_KAT-Coder-V2.5-Dev-IQ3_XXS.ggufIQ3_XXS14 GB
Kwaipilot_KAT-Coder-V2.5-Dev-IQ4_NL.ggufIQ4_NL18 GB
Kwaipilot_KAT-Coder-V2.5-Dev-IQ4_XS.ggufIQ4_XS18 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q2_K.ggufQ2_K12 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q2_K_L.ggufQ2_K_L12 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q3_K_L.ggufQ3_K_L16 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q3_K_M.ggufQ3_K_M15 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q3_K_S.ggufQ3_K_S14 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q3_K_XL.ggufQ3_K_XL16 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q4_0.ggufQ4_019 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q4_1.ggufQ4_120 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q4_K_L.ggufQ4_K_L20 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q4_K_M.ggufQ4_K_M20 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q4_K_S.ggufQ4_K_S19 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q5_K_L.ggufQ5_K_L24 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q5_K_M.ggufQ5_K_M23 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q5_K_S.ggufQ5_K_S22 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q6_K.ggufQ6_K28 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q6_K_L.ggufQ6_K_L28 GB
Kwaipilot_KAT-Coder-V2.5-Dev-Q8_0.ggufQ8_034 GB
Kwaipilot_KAT-Coder-V2.5-Dev-bf16/Kwaipilot_KAT-Coder-V2.5-Dev-bf16-00001-of-00002.ggufBF1637 GB
Kwaipilot_KAT-Coder-V2.5-Dev-bf16/Kwaipilot_KAT-Coder-V2.5-Dev-bf16-00002-of-00002.ggufBF1628 GB
Kwaipilot_KAT-Coder-V2.5-Dev-imatrix.gguf183 MB

From the source README

Llamacpp imatrix Quantizations of KAT-Coder-V2.5-Dev by Kwaipilot

Using llama.cpp release b10087 for quantization.

Original model: https://huggingface.co/Kwaipilot/KAT-Coder-V2.5-Dev

All quants made using imatrix option with dataset from here

Run them in your choice of tools:

  • llama.cpp
  • ramalama
  • LM Studio
  • koboldcpp
  • Jan AI
  • Text Generation Web UI
  • LoLLMs
  • Atomic Chat

Note: if it's a newly supported model, you may need to wait for an update from the developers.

Prompt format

system
{system_prompt}
user
{prompt}
assistant

Download a file (not the whole branch) from below:

| Filename | Quant type | File Size | Split | Description |
| -------- | ---------- | --------- | ----- | ----------- |
| Kwaipilot_KAT-Coder-V2.5-Dev-bf16.gguf | bf16 | 69.38GB | true | Full BF16 weights. |
| Kwaipilot_KAT-Coder-V2.5-Dev-Q8_0.gguf | Q8_0 | 36.91GB | false | Extremely high quality, generally unneeded but max available quant. |
| Kwaipilot_KAT-Coder-V2.5-Dev-Q6_K_L.gguf | Q6_K_L | 30.30GB | false | Uses Q8_0 for embed and output weights. Very high quality, near perfect, *recommended*. |
| [Kwaipilot_KAT-Coder-V2.5-Dev-Q6_K.gguf](https://huggingface.co/bartowski/Kwaipil…

Source: https://huggingface.co/bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF

Card id model:hf:bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF · collected 2026-10-02 21:01 UTC · JSON