rag-engineer

Optimize embedding, indexing, and retrieval strategies for RAG systems.

Updated Dec 10, 2024
One-click install
npx skills add https://github.com/melikhanmutlu/web_ar --skill rag-engineer-melikhanmutlu
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: rag-engineer
Source: https://github.com/melikhanmutlu/web_ar/tree/main/skills-extra/rag-engineer
Command: npx skills add https://github.com/melikhanmutlu/web_ar --skill rag-engineer-melikhanmutlu

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Retrieval quality in LLM workflows is critical to accuracy; this skill addresses the gap by optimizing how documents are embedded, chunked, and retrieved for use in RAG systems.

Core Features & Use Cases

  • Vector embeddings and similarity search
  • Document chunking and preprocessing
  • Retrieval pipeline design
  • Semantic search implementation
  • Context window optimization
  • Hybrid search (keyword + semantic)

Quick Start

Configure embeddings and a retrieval pipeline to run a RAG workflow on your documents.

Frequently Asked Questions about rag-engineer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a RAG pipeline with semantic search for my documents?

Build a RAG pipeline by optimizing document chunking, generating vector embeddings, and configuring semantic search retrieval. This skill guides embedding model selection and indexing strategies to improve retrieval quality across diverse document types.

What is the best way to chunk documents for a retrieval pipeline?

Effective document chunking splits text into manageable segments to preserve context for embedding models. This skill provides chunking strategies that optimize semantic search accuracy and ensure relevant information is retrieved within context window limits.

How does hybrid search improve retrieval quality in LLM workflows?

Hybrid search improves retrieval quality by combining keyword and semantic search methods. This approach captures both exact term matches and conceptual meaning, enhancing the accuracy of retrieval pipelines and providing better context for LLMs.

Can I use this to integrate a vector database with my semantic search pipeline?

Yes, you can integrate vector databases into your semantic search pipeline. The skill supports scalable vector database integration, allowing you to store embeddings and execute fast similarity searches across large document collections.

Why does my semantic search return irrelevant results from my vector database?

Irrelevant semantic search results often stem from poor embedding model selection or suboptimal chunking strategies. This skill addresses retrieval quality gaps by optimizing how documents are embedded, indexed, and retrieved in RAG systems.

Do I need a specific embedding model to optimize my context window for retrieval?

You need to select an appropriate embedding model that aligns with your document types and retrieval goals. This skill helps configure embeddings and context window optimization to ensure efficient and accurate retrieval pipeline performance.