embedder_collection

A practical introduction to embedding models and local RAG

This repository contains more than 25 different types of embedding models, together with practical information about embeddings, document retrieval, chunking, context length, and local RAG (Retrieval-Augmented Generation).

The most important point is this:

An embedding model is only one part of a good RAG system.

A good result depends on several things working together:

• the quality and structure of your source documents
• how the documents are converted to text
• how the text is split into chunks
• the embedding model
• the vector database and retrieval settings
• optional keyword or reranking steps
• the context given to the main LLM
• the main LLM itself
• the system prompt

Changing only the embedding model therefore does not automatically make a RAG system better.

At the end of the file list on this repo, click the button shown below to see all files:

Table of Contents

• Testing and software compatibility
• My short practical impression
• German and more complex documents
• Toxic-content models
• Practical starting settings for a local RAG system
• What do these numbers actually mean?
• Characters, words and tokens
• VRAM and context length
• Vector size (dimensions)
• Vector count
• Chunk length
• How embedding and retrieval actually work
• Embedding search is not the same as keyword search
• Why the most relevant snippets matter
• [Chunk size…

Source: https://huggingface.co/kalle07/embedder_collection