{"v":1,"id":"model:hf:second-state/jina-embeddings-v2-base-code-GGUF","slug":"model-second-state-jina-embeddings-v2-base-code-gguf","kind":"model","category":"embedding","title":"jina-embeddings-v2-base-code-GGUF","summary":"embedding model by second-state, gguf files on Hugging Face.","source":{"provider":"hf","ref":"second-state/jina-embeddings-v2-base-code-GGUF","url":"https://huggingface.co/second-state/jina-embeddings-v2-base-code-GGUF","rev":"5a9d2a5183c6a23a30d98741ffe3a594feeb10aa","fetchedAt":"2026-10-11T08:21:44.300Z","etag":"W/\"1512-hxQDlyCelR9GHiadwNbjvNKwjRw\""},"author":{"name":"second-state","url":"https://huggingface.co/second-state"},"license":{"spdx":"apache-2.0","raw":"apache-2.0","open":true},"metrics":{"downloads":1964,"downloadsWeek":275712,"likes":5,"stars":130798,"openIssues":2512,"lastRelease":{"tag":"v0.6.0","at":"2026-10-05T16:56:22Z"},"pushedAt":"2026-10-10T19:31:18Z","takenAt":"2026-10-11T08:21:44.300Z"},"tags":["sentence-transformers","gguf","bert","fill-mask","feature-extraction","sentence-similarity","mteb","transformers","transformers.js","custom_code","en"],"pipeline":"feature-extraction","links":{"github":"ggml-org/llama.cpp","npm":"node-llama-cpp"},"updatedAt":"2024-12-11T02:42:36.000Z","collectedAt":"2026-10-11T08:21:44.300Z","review":{"numbers":["1,964 downloads on Hugging Face","5 likes","license apache-2.0","0.1 GB for jina-embeddings-v2-base-code-Q4_K_M.gguf","130,798 stars on ggml-org/llama.cpp","2,512 open issues and PRs","last release v0.6.0 on 2026-10-05","275,712 npm downloads a week for node-llama-cpp","latest node-llama-cpp@3.22.1"],"log":null},"trust":"unlabeled","health":{"status":"alive","checkedAt":"2026-10-11T08:21:44.300Z","http":200},"description":"# jina-embeddings-v2-base-code-GGUF\n\n## Original Model\n\n[jinaai/jina-embeddings-v2-base-code](https://huggingface.co/jinaai/jina-embeddings-v2-base-code)\n\n## Run with LlamaEdge\n\n- LlamaEdge version: [v0.14.17](https://github.com/LlamaEdge/LlamaEdge/releases/tag/0.14.17)\n\n- Prompt template\n\n  - Prompt type: `embedding`\n\n- Context size: `8192`\n\n- Embedding dim: `768`\n\n- Run as LlamaEdge service\n\n  ```bash\n  wasmedge --dir .:. --nn-preload default:GGML:AUTO:jina-embeddings-v2-base-code-f16.gguf \\\n    llama-api-server.wasm \\\n    --prompt-template embedding \\\n    --ctx-size 8192 \\\n    --model-name jina-embeddings-v2-base-code\n  ```\n\n## Quantized GGUF Models\n\n| Name | Quant method | Bits | Size | Use case |\n| ---- | ---- | ---- | ---- | ----- |\n| [jina-embeddings-v2-base-code-Q2_K.gguf](https://huggingface.co/second-state/jina-embeddings-v2-base-code-GGUF/blob/main/jina-embeddings-v2-base-code-Q2_K.gguf)     | Q2_K   | 2 | 82.7 MB| smallest, significant quality loss - not recommended for most purposes |\n| [jina-embeddings-v2-base-code-Q3_K_L.gguf](https://huggingface.co/second-state/jina-embeddings-v2-base-code-GGUF/blob/main/jina-embeddings-v2-base-code-Q3_K_L.gguf) | Q3_K_L | 3 | 101 MB| small, substantial quality loss |\n| [jina-embeddings-v2-base-code-Q3_K_M.gguf](https://huggingface.co/second-state/jina-embeddings-v2-base-code-GGUF/blob/main/jina-embeddings-v2-base-code-Q3_K_M.gguf) | Q3_K_M | 3 | 95.6 MB| very small, high quality loss |\n| [jina-embeddings-v2-base-code-Q3_K_S.gguf](https://huggingface.co/second-state/jina-embeddings-v2-base-code-GGUF/blob/main/jina-embeddings-v2-base-code-Q3_K_S.gguf) | Q3_K_S | 3 | 89.8 MB| very small, high quality loss |\n| [jina-embeddings-v2-base-code-Q4_0.gguf](https://huggingface.co/second-state/jina-embeddings-v2-base-code-GGUF/blob/main/jina-embeddings-v2-base-code-Q4_0.gguf)     | Q4_0   | 4 | 105 MB| legacy; small, very high quality loss - prefer…\n\nSource: https://huggingface.co/second-state/jina-embeddings-v2-base-code-GGUF","install":{"kind":"model","hfId":"second-state/jina-embeddings-v2-base-code-GGUF","gated":false,"format":"gguf","files":[{"name":"jina-embeddings-v2-base-code-Q2_K.gguf","size":82660768,"quant":"Q2_K","sha256":"ce478633d7c2caec2b3ba1720f8b495473a1334badfea8e02930fdf007012eda"},{"name":"jina-embeddings-v2-base-code-Q3_K_L.gguf","size":100797856,"quant":"Q3_K_L","sha256":"eef3d2d2c0298d5a3fe4f27264e2818f5860cda042ba508c5b98e5cb4cb8d3a6"},{"name":"jina-embeddings-v2-base-code-Q3_K_M.gguf","size":95636896,"quant":"Q3_K_M","sha256":"525401b14ed4e488dce86d1ede254a620652a7c94079f7aed2b106fb890cb7bc"},{"name":"jina-embeddings-v2-base-code-Q3_K_S.gguf","size":89849248,"quant":"Q3_K_S","sha256":"3bc5ab23ed353ca32c56850bd32fc33a9d3f8abd571c17e51f5ee400dd9d49f3"},{"name":"jina-embeddings-v2-base-code-Q4_0.gguf","size":104889760,"quant":"Q4_0","sha256":"60d83303704c8f97fcf98666109f8f4fb30ce67c9f3a1e177ddda781f7ab2b8f"},{"name":"jina-embeddings-v2-base-code-Q4_K_M.gguf","size":109451680,"quant":"Q4_K_M","sha256":"cc1b9c936e806c5b3a4fa437903cd538ff9839e948870cb44be49825fe00fee1"},{"name":"jina-embeddings-v2-base-code-Q4_K_S.gguf","size":105479584,"quant":"Q4_K_S","sha256":"d63131375b716c245e84303823d2a37d01c4ef2dca9dc456923c9b59f195110f"},{"name":"jina-embeddings-v2-base-code-Q5_0.gguf","size":119045536,"quant":"Q5_0","sha256":"7419ce1e26007877e1822a20d77db719c2b1de0889d1f6bd70d9d9c60bf5fe28"},{"name":"jina-embeddings-v2-base-code-Q5_K_M.gguf","size":121395616,"quant":"Q5_K_M","sha256":"4fb1c5f15462f12a083e19721c7a43e9eddfe6377dc845fa73bedf2461089919"},{"name":"jina-embeddings-v2-base-code-Q5_K_S.gguf","size":119045536,"quant":"Q5_K_S","sha256":"a221a5a47f3c13945a8c0b64eccd53ed1a4f8cd75bbabb3e8b241e495511a53c"},{"name":"jina-embeddings-v2-base-code-Q6_K.gguf","size":134086048,"quant":"Q6_K","sha256":"fd684de5dc9a516edcf2091969016664c8e1c84ada20cfa9eae32353895afdfc"},{"name":"jina-embeddings-v2-base-code-Q8_0.gguf","size":172869280,"quant":"Q8_0","sha256":"3bd1722f09350209aa3ada93df55882666c58194bfbbbe81c30545d731cb4e7a"},{"name":"jina-embeddings-v2-base-code-f16.gguf","size":322997920,"quant":"F16","sha256":"ca9829b369c715e486e9fdf7ec9bee3f91ad91028d867220bb686732947b65a5"}],"totalBytes":1678205728,"suggestedFile":"jina-embeddings-v2-base-code-Q4_K_M.gguf","requirements":{"ramGb":1,"diskBytes":109451680,"note":"estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models"},"runWith":["llama.cpp"],"command":"lsh models install hf:second-state/jina-embeddings-v2-base-code-GGUF"}}