{"v":1,"id":"model:hf:jinaai/jina-embeddings-v5-omni-nano-retrieval-GGUF","slug":"model-jinaai-jina-embeddings-v5-omni-nano-retrieval-gguf","kind":"model","category":"embedding","title":"jina-embeddings-v5-omni-nano-retrieval-GGUF","summary":"jina-embeddings-v5-omni-nano-retrieval-GGUF: Retrieval-Targeted Omni Embedding (Nano) — GGUF","source":{"provider":"hf","ref":"jinaai/jina-embeddings-v5-omni-nano-retrieval-GGUF","url":"https://huggingface.co/jinaai/jina-embeddings-v5-omni-nano-retrieval-GGUF","rev":"d88747133a88c1ebb884d60392a25be08b8042f7","fetchedAt":"2026-10-11T15:33:31.585Z","etag":"W/\"37db-J/2OJAK+q97cJ78DccY/IICHZb4\""},"author":{"name":"jinaai","url":"https://huggingface.co/jinaai"},"license":{"spdx":"cc-by-nc-4.0","raw":"cc-by-nc-4.0","open":false,"note":"restricted license: terms at the source apply"},"metrics":{"downloads":1829,"downloadsWeek":261158,"likes":1,"stars":130822,"openIssues":2517,"lastRelease":{"tag":"v0.6.0","at":"2026-10-05T16:56:22Z"},"pushedAt":"2026-10-11T14:46:19Z","takenAt":"2026-10-11T15:33:31.585Z"},"tags":["llama.cpp","gguf","embedding","qwen3","jina-embeddings-v5","feature-extraction","sentence-transformers","multimodal","vision","audio","video","vllm","llama-cpp","image-feature-extraction","audio-feature-extraction","video-feature-extraction","sentence-similarity","multilingual","conversational"],"pipeline":"feature-extraction","links":{"github":"ggml-org/llama.cpp","npm":"node-llama-cpp"},"updatedAt":"2026-05-12T20:42:29.000Z","collectedAt":"2026-10-11T15:33:31.585Z","review":{"numbers":["1,829 downloads on Hugging Face","1 likes","license cc-by-nc-4.0","0.1 GB for jina-embeddings-v5-omni-nano-retrieval-Q4_K_M.gguf","130,822 stars on ggml-org/llama.cpp","2,517 open issues and PRs","last release v0.6.0 on 2026-10-05","261,158 npm downloads a week for node-llama-cpp","latest node-llama-cpp@3.22.1"],"log":null},"trust":"unlabeled","health":{"status":"alive","checkedAt":"2026-10-11T15:33:31.585Z","http":200},"description":"### **jina-embeddings-v5-omni-nano-retrieval-GGUF**: Retrieval-Targeted Omni Embedding (Nano) — GGUF\n\n[ArXiv](https://arxiv.org/abs/2605.08384) | [Blog](https://www.elastic.co/search-labs/blog/jina-embeddings-v5-omni-all-media-one-index)\n\n*Average score vs. parameter count across image (MIEB-Lite), video (MMEB-V), and audio (MAEB) benchmarks — `jina-v5-omni-nano` and `jina-v5-omni-small` define the open-weight frontier (Table 1 in the [ArXiv report](https://arxiv.org/abs/2605.08384)).*\n\n### Model Overview\n\nGGUF + multimodal-projector build of\n[`jinaai/jina-embeddings-v5-omni-nano-retrieval`](https://huggingface.co/jinaai/jina-embeddings-v5-omni-nano-retrieval) for\n[`llama.cpp`](https://github.com/ggml-org/llama.cpp). Accepts **text,\nimages, video, and audio** and produces 768-dim embeddings in the\nsame vector space as the torch reference and as\n[`jinaai/jina-embeddings-v5-text-nano-retrieval`](https://huggingface.co/jinaai/jina-embeddings-v5-text-nano-retrieval) at the same task —\nindex with text and query with any modality, no reindexing. For higher performance at a larger size, see [`jinaai/jina-embeddings-v5-omni-small-retrieval-GGUF`](https://huggingface.co/jinaai/jina-embeddings-v5-omni-small-retrieval-GGUF).\n\nThis is the **retrieval-targeted** variant of the `jina-embeddings-v5-omni-nano` GGUF family. The umbrella with all GGUF variants and cross-repo benchmarks is [`jina-ai/jina-embeddings-v5-omni-gguf`](https://github.com/jina-ai/jina-embeddings-v5-omni-gguf).\n\n| Feature | Value |\n| --- | --- |\n| Parameters | ~0.95B (text + vision + audio towers) |\n| Embedding Dimension | 768 |\n| Supported Tasks | `retrieval` |\n| Max Sequence Length | 8192 |\n| Pooling Strategy | Last-token |\n| Supported Inputs | text, image, video, audio |\n| Supported File Types | images: `.jpg`, `.jpeg`, `.png`, `.gif`, `.webp`, `.bmp`, `.tif`, `.tiff`, `.avif`, `.heic`, `.svg`; video: `.mp4`, `.avi`, `.mov`…\n\nSource: https://huggingface.co/jinaai/jina-embeddings-v5-omni-nano-retrieval-GGUF","install":{"kind":"model","hfId":"jinaai/jina-embeddings-v5-omni-nano-retrieval-GGUF","gated":false,"format":"gguf","files":[{"name":"jina-embeddings-v5-omni-nano-retrieval-F16.gguf","size":431409536,"quant":"F16","sha256":"c2cc484bfb4a27556d122f254d85be365b73744cb6c17f5af3fe462a573c9c6a"},{"name":"jina-embeddings-v5-omni-nano-retrieval-IQ1_M.gguf","size":101712640,"quant":"IQ1_M","sha256":"fbef3d0adf7f695d378cbe244dfee46068ea173fc3cc6e17a7fa6a99361450bc"},{"name":"jina-embeddings-v5-omni-nano-retrieval-IQ1_S.gguf","size":99445504,"quant":"IQ1_S","sha256":"c22e5b13298ff49ef92d0ac62097ffd322dff0e596212d85f0cef658949b4139"},{"name":"jina-embeddings-v5-omni-nano-retrieval-IQ2_M.gguf","size":113711872,"quant":"IQ2_M","sha256":"3f51baf13aaa93a68763ada7567b986f66e9c451f692273d1cb280634956993d"},{"name":"jina-embeddings-v5-omni-nano-retrieval-IQ2_XXS.gguf","size":105491200,"quant":"IQ2_XXS","sha256":"0b5901e6c2bb59273b5a15ea107281f5adaf034c92390393df08f7a988b0f762"},{"name":"jina-embeddings-v5-omni-nano-retrieval-IQ4_NL.gguf","size":152414880,"quant":"IQ4_NL","sha256":"1f4f1c5a9475eb55b5aef66b066fc2b0f9ebf400771b6cd3a9f946eb72c9ea89"},{"name":"jina-embeddings-v5-omni-nano-retrieval-IQ4_XS.gguf","size":148875936,"quant":"IQ4_XS","sha256":"e895c587af24eac3ebb889309a1cde83b412b307184505441118dd80d3b7283b"},{"name":"jina-embeddings-v5-omni-nano-retrieval-Q2_K.gguf","size":130185888,"quant":"Q2_K","sha256":"cdd7a8c4a10b87d707549f4d525cb400c74b15337cde667db6d7855acb16c7bc"},{"name":"jina-embeddings-v5-omni-nano-retrieval-Q3_K_M.gguf","size":143162016,"quant":"Q3_K_M","sha256":"39854c317d1e4b381e2e3d88b51c688b36c2487f76f07f86f1d85a9724207b04"},{"name":"jina-embeddings-v5-omni-nano-retrieval-Q4_K_M.gguf","size":156976800,"quant":"Q4_K_M","sha256":"e8e093de56541f6895fe643068dc46d34e96ab81f2ee4e10303a34510e155bfa"},{"name":"jina-embeddings-v5-omni-nano-retrieval-Q5_K_M.gguf","size":168920736,"quant":"Q5_K_M","sha256":"ef315c602d4c4366b8fc4ff428cefe58389d1782f455964e04fb02320fb82291"},{"name":"jina-embeddings-v5-omni-nano-retrieval-Q5_K_S.gguf","size":166570656,"quant":"Q5_K_S","sha256":"ccec5bde6dad2370b4d408f55bc9787adea7473f226465af03a3869994a33353"},{"name":"jina-embeddings-v5-omni-nano-retrieval-Q6_K.gguf","size":181611168,"quant":"Q6_K","sha256":"21d7879447a7cd89db82d3978a139825dfe60d8d474e6969f70c1b4231abd2dc"},{"name":"jina-embeddings-v5-omni-nano-retrieval-Q8_0.gguf","size":232894336,"quant":"Q8_0","sha256":"effc48f467d4eedf8c5f246633a69b3446d1b9df0a21158e0895f86c2a50e9c7"},{"name":"jina-embeddings-v5-omni-nano-retrieval-audio-mmproj-F16.gguf","size":1280768288,"quant":"F16","sha256":"8ff2f45b2f1f682ef4d35bdb8b74726a24e3fe4ae0c333bb4f0e1a5b4facd83b"},{"name":"jina-embeddings-v5-omni-nano-retrieval-vision-mmproj-F16.gguf","size":203412960,"quant":"F16","sha256":"1dcd1cf7e8abe55b4c0f78979896d4b01ec28f51091cf74de7098c05864dd1d3"}],"totalBytes":3817564416,"suggestedFile":"jina-embeddings-v5-omni-nano-retrieval-Q4_K_M.gguf","requirements":{"ramGb":1,"diskBytes":156976800,"note":"estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models"},"runWith":["llama.cpp"],"command":"lsh models install hf:jinaai/jina-embeddings-v5-omni-nano-retrieval-GGUF"}}