Store › model › Embeddings
gte-large-gguf
by ChristianAzinn · source Hugging Face · updated 2024-04-07
mit206 MB~1 GB RAMsource aliveunlabeled
General Text Embeddings (GTE) model. Towards General Text Embeddings with Multi-stage Contrastive Learning
Add to LogiShell Open in the web IDE
The button opens LogiShell with this card; nothing installs from a link by itself. Inside the app the install goes through lsh models install hf:ChristianAzinn/gte-large-gguf and its progress lives in the Resource Center.
Source and license
- Source: https://huggingface.co/ChristianAzinn/gte-large-gguf
- License: mit
- Requirements: about 1 GB of RAM, 206 MB on disk (estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models). Runs with llama.cpp.
- Tags:
sentence-transformersggufmtebbertsentence-similaritySentence Transformersfeature-extractionendeploy:azure
Numbers
- 2,891 downloads on Hugging Face
- 1 likes
- license mit
- 0.2 GB for gte-large.Q4_K_M.gguf
- 327,838 npm downloads a week for node-llama-cpp
- latest node-llama-cpp@3.22.1
Numbers as of 2026-10-02 20:59 UTC, from the source API.
Summary
Summary not ready yet: the numbers are here, the text is not. It is written by the collector through the LogiShell model facade when a provider key is present.
Reviews
No reviews yet. Reviews are written inside LogiShell: open this card in the app.
Files
| file | quant | size |
|---|---|---|
gte-large.Q2_K.gguf | Q2_K | 138 MB |
gte-large.Q3_K_L.gguf | Q3_K_L | 189 MB |
gte-large.Q3_K_M.gguf | Q3_K_M | 173 MB |
gte-large.Q3_K_S.gguf | Q3_K_S | 152 MB |
gte-large.Q4_0.gguf | Q4_0 | 190 MB |
gte-large.Q4_K_M.gguf | Q4_K_M | 206 MB |
gte-large.Q4_K_S.gguf | Q4_K_S | 194 MB |
gte-large.Q5_0.gguf | Q5_0 | 226 MB |
gte-large.Q5_K_M.gguf | Q5_K_M | 234 MB |
gte-large.Q5_K_S.gguf | Q5_K_S | 226 MB |
gte-large.Q6_K.gguf | Q6_K | 265 MB |
gte-large.Q8_0.gguf | Q8_0 | 342 MB |
gte-large_fp16.gguf | 639 MB | |
gte-large_fp32.gguf | 1.2 GB |
From the source README
gte-large-gguf
Model creator: thenlper
Original model: gte-large
Original Description
General Text Embeddings (GTE) model. Towards General Text Embeddings with Multi-stage Contrastive Learning
The GTE models are trained by Alibaba DAMO Academy. They are mainly based on the BERT framework and currently offer three different sizes of models, including GTE-large, GTE-base, and GTE-small. The GTE models are trained on a large-scale corpus of relevance text pairs, covering a wide range of domains and scenarios. This enables the GTE models to be applied to various downstream tasks of text embeddings, including information retrieval, semantic textual similarity, text reranking, etc.
Description
This repo contains GGUF format files for the gte-large embedding model.
These files were converted and quantized with llama.cpp PR 5500, commit 34aa045de, on a consumer RTX 4090.
This model supports up to 512 tokens of context.
Compatibility
These files are compatible with llama.cpp as of commit 4524290e8, as well as LM Studio as of version 0.2.19.
Card id model:hf:ChristianAzinn/gte-large-gguf · collected 2026-10-02 20:59 UTC · JSON