{"v":1,"id":"model:hf:ggml-org/jina-embeddings-v2-base-code-Q8_0-GGUF","slug":"model-ggml-org-jina-embeddings-v2-base-code-q8-0-gguf","kind":"model","category":"embedding","title":"jina-embeddings-v2-base-code-Q8_0-GGUF","summary":"ngxson/jina-embeddings-v2-base-code-Q80-GGUF This model was converted to GGUF format from jinaai/jina-embeddings-v2-base-code using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the origin…","source":{"provider":"hf","ref":"ggml-org/jina-embeddings-v2-base-code-Q8_0-GGUF","url":"https://huggingface.co/ggml-org/jina-embeddings-v2-base-code-Q8_0-GGUF","rev":"05e79e9a6c8b99491e92ebb28d753268f8601e3c","fetchedAt":"2026-10-02T21:00:14.373Z","etag":"W/\"676-eBJhpyH8VUXrCUBZDH8vndLxdmg\""},"author":{"name":"ggml-org","url":"https://huggingface.co/ggml-org"},"license":{"spdx":"apache-2.0","raw":"apache-2.0","open":true},"metrics":{"downloads":2099,"downloadsWeek":327838,"likes":2,"takenAt":"2026-10-02T21:00:14.373Z"},"tags":["sentence-transformers","gguf","feature-extraction","sentence-similarity","mteb","llama-cpp","gguf-my-repo","en","dataset:allenai/c4"],"pipeline":"feature-extraction","links":{"github":"ggml-org/llama.cpp","npm":"node-llama-cpp"},"updatedAt":"2024-12-12T17:37:10.000Z","collectedAt":"2026-10-02T21:00:14.373Z","review":{"numbers":["2,099 downloads on Hugging Face","2 likes","license apache-2.0","0.2 GB for jina-embeddings-v2-base-code-q8_0.gguf","327,838 npm downloads a week for node-llama-cpp","latest node-llama-cpp@3.22.1"],"log":null},"trust":"unlabeled","health":{"status":"alive","checkedAt":"2026-10-02T21:00:14.373Z","http":200},"description":"# ngxson/jina-embeddings-v2-base-code-Q8_0-GGUF\nThis model was converted to GGUF format from [`jinaai/jina-embeddings-v2-base-code`](https://huggingface.co/jinaai/jina-embeddings-v2-base-code) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.\nRefer to the [original model card](https://huggingface.co/jinaai/jina-embeddings-v2-base-code) for more details on the model.\n\n## Use with llama.cpp\nInstall llama.cpp through brew (works on Mac and Linux)\n\n```bash\nbrew install llama.cpp\n\n```\nInvoke the llama.cpp server or the CLI.\n\n### CLI:\n```bash\nllama-cli --hf-repo ngxson/jina-embeddings-v2-base-code-Q8_0-GGUF --hf-file jina-embeddings-v2-base-code-q8_0.gguf -p \"The meaning to life and the universe is\"\n```\n\n### Server:\n```bash\nllama-server --hf-repo ngxson/jina-embeddings-v2-base-code-Q8_0-GGUF --hf-file jina-embeddings-v2-base-code-q8_0.gguf -c 2048\n```\n\nNote: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.\n\nStep 1: Clone llama.cpp from GitHub.\n```\ngit clone https://github.com/ggerganov/llama.cpp\n```\n\nStep 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).\n```\ncd llama.cpp && LLAMA_CURL=1 make\n```\n\nStep 3: Run inference through the main binary.\n```\n./llama-cli --hf-repo ngxson/jina-embeddings-v2-base-code-Q8_0-GGUF --hf-file jina-embeddings-v2-base-code-q8_0.gguf -p \"The meaning to life and the universe is\"\n```\nor\n```\n./llama-server --hf-repo ngxson/jina-embeddings-v2-base-code-Q8_0-GGUF --hf-file jina-embeddings-v2-base-code-q8_0.gguf -c 2048\n```\n\nSource: https://huggingface.co/ggml-org/jina-embeddings-v2-base-code-Q8_0-GGUF","install":{"kind":"model","hfId":"ggml-org/jina-embeddings-v2-base-code-Q8_0-GGUF","gated":false,"format":"gguf","files":[{"name":"jina-embeddings-v2-base-code-q8_0.gguf","size":172869280,"quant":"Q8_0","sha256":"3bd1722f09350209aa3ada93df55882666c58194bfbbbe81c30545d731cb4e7a"}],"totalBytes":172869280,"suggestedFile":"jina-embeddings-v2-base-code-q8_0.gguf","requirements":{"ramGb":1,"diskBytes":172869280,"note":"estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models"},"runWith":["llama.cpp"],"command":"lsh models install hf:ggml-org/jina-embeddings-v2-base-code-Q8_0-GGUF"}}