What problem does it solve?
Retrieval-augmented generation (RAG) systems often fail to provide accurate, grounded answers because language models lack access to up-to-date or domain-specific documents; this Skill provides a practical blueprint to load, chunk, embed, index, retrieve, and surface external context for LLMs to improve relevance and factuality.
Core Features & Use Cases
- Document ingestion: Examples and patterns for loading PDFs, web pages, and directories into document objects.
- Text splitting: Guidance on RecursiveCharacterTextSplitter configurations to create context-aware chunks with appropriate overlap.
- Embeddings & vector stores: Integration examples for OpenAI embeddings and vector stores including InMemory, Chroma, FAISS, and Pinecone with notes on persistence and deserialization.
- Retrieval & agents: Retrieval strategies (similarity, MMR, metadata filtering) and using retrieved documents within LLM prompts or as a tool for agents.
- Use Case: Build a searchable knowledge base from company docs to power an LLM-backed Q&A assistant that cites source documents.
Quick Start
Use this skill to ingest a set of documents, split them into chunks, index with OpenAI embeddings into a persistent vector store, and run a similarity search to answer a user question.