Store › model › Embeddings
jina-embeddings-v5-omni-small-retrieval-GGUF
by jinaai · source Hugging Face · updated 2026-05-12
cc-by-nc-4.0378 MB~1 GB RAMsource aliveunlabeled
jina-embeddings-v5-omni-small-retrieval-GGUF: Retrieval-Targeted Omni Embedding (Small) — GGUF
Add to LogiShell Open in the web IDE
The button opens LogiShell with this card; nothing installs from a link by itself. Inside the app the install goes through lsh models install hf:jinaai/jina-embeddings-v5-omni-small-retrieval-GGUF and its progress lives in the Resource Center.
Source and license
- Source: https://huggingface.co/jinaai/jina-embeddings-v5-omni-small-retrieval-GGUF
- License: cc-by-nc-4.0 (restricted license: terms at the source apply)
- Requirements: about 1 GB of RAM, 378 MB on disk (estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models). Runs with llama.cpp.
- Tags:
llama.cppggufembeddingqwen3jina-embeddings-v5feature-extractionsentence-transformersmultimodalvisionaudiovideovllmllama-cppimage-feature-extractionaudio-feature-extractionvideo-feature-extraction
Numbers
- 2,231 downloads on Hugging Face
- 7 likes
- license cc-by-nc-4.0
- 0.4 GB for jina-embeddings-v5-omni-small-retrieval-Q4_K_M.gguf
- 327,838 npm downloads a week for node-llama-cpp
- latest node-llama-cpp@3.22.1
Numbers as of 2026-10-02 21:00 UTC, from the source API.
Summary
Summary not ready yet: the numbers are here, the text is not. It is written by the collector through the LogiShell model facade when a provider key is present.
Reviews
No reviews yet. Reviews are written inside LogiShell: open this card in the app.
Files
| file | quant | size |
|---|---|---|
jina-embeddings-v5-omni-small-retrieval-F16.gguf | F16 | 1.1 GB |
jina-embeddings-v5-omni-small-retrieval-IQ1_M.gguf | IQ1_M | 206 MB |
jina-embeddings-v5-omni-small-retrieval-IQ1_S.gguf | IQ1_S | 198 MB |
jina-embeddings-v5-omni-small-retrieval-IQ2_M.gguf | IQ2_M | 252 MB |
jina-embeddings-v5-omni-small-retrieval-IQ2_XXS.gguf | IQ2_XXS | 219 MB |
jina-embeddings-v5-omni-small-retrieval-IQ4_NL.gguf | IQ4_NL | 364 MB |
jina-embeddings-v5-omni-small-retrieval-IQ4_XS.gguf | IQ4_XS | 351 MB |
jina-embeddings-v5-omni-small-retrieval-Q2_K.gguf | Q2_K | 282 MB |
jina-embeddings-v5-omni-small-retrieval-Q3_K_M.gguf | Q3_K_M | 331 MB |
jina-embeddings-v5-omni-small-retrieval-Q4_K_M.gguf | Q4_K_M | 378 MB |
jina-embeddings-v5-omni-small-retrieval-Q5_K_M.gguf | Q5_K_M | 424 MB |
jina-embeddings-v5-omni-small-retrieval-Q5_K_S.gguf | Q5_K_S | 416 MB |
jina-embeddings-v5-omni-small-retrieval-Q6_K.gguf | Q6_K | 472 MB |
jina-embeddings-v5-omni-small-retrieval-Q8_0.gguf | Q8_0 | 610 MB |
jina-embeddings-v5-omni-small-retrieval-audio-mmproj-F16.gguf | F16 | 1.2 GB |
jina-embeddings-v5-omni-small-retrieval-vision-mmproj-F16.gguf | F16 | 629 MB |
From the source README
jina-embeddings-v5-omni-small-retrieval-GGUF: Retrieval-Targeted Omni Embedding (Small) — GGUF
ArXiv | Blog
*Average score vs. parameter count across image (MIEB-Lite), video (MMEB-V), and audio (MAEB) benchmarks — `jina-v5-omni-nano` and `jina-v5-omni-small` define the open-weight frontier (Table 1 in the ArXiv report).*
Model Overview
GGUF + multimodal-projector build of
`jinaai/jina-embeddings-v5-omni-small-retrieval` for
`llama.cpp`. Accepts text,
images, video, and audio and produces 1024-dim embeddings in the
same vector space as the torch reference and as
`jinaai/jina-embeddings-v5-text-small-retrieval` at the same task —
index with text and query with any modality, no reindexing. For a more compact alternative, see `jinaai/jina-embeddings-v5-omni-nano-retrieval-GGUF`.
This is the retrieval-targeted variant of the `jina-embeddings-v5-omni-small` GGUF family. The umbrella with all GGUF variants and cross-repo benchmarks is `jina-ai/jina-embeddings-v5-omni-gguf`.
| Feature | Value |
| --- | --- |
| Parameters | ~1.56B (text + vision + audio towers) |
| Embedding Dimension | 1024 |
| Supported Tasks | `retrieval` |
| Max Sequence Length | 32768 |
| Pooling Strategy | Last-token |
| Supported Inputs | text, image, video, audio |
| Supported File Types | images: `.jpg`, `.jpeg`, `.png`, `.gif`, `.webp`, `.bmp`, `.tif`, `.tiff`, `.avif`, `.heic`, `.svg`; video: `.mp4`, `.avi`, `.mov`…
Source: https://huggingface.co/jinaai/jina-embeddings-v5-omni-small-retrieval-GGUF
Card id model:hf:jinaai/jina-embeddings-v5-omni-small-retrieval-GGUF · collected 2026-10-02 21:00 UTC · JSON