haystack

What problem does it solve?

Haystack helps you build reliable retrieval-augmented generation (RAG) and search pipelines that combine document retrieval, optional reranking, and LLM generation for production use.

Core Features & Use Cases

• Production RAG pipeline building: Compose end-to-end flows for retrieve → (rerank/join) → prompt → generate.
• Hybrid retrieval and reranking: Combine keyword/BM25 and embedding-based retrieval, then rerank with models like cross-encoders.
• Evaluation-driven development: Measure relevance and faithfulness to improve retrieval and generation behavior.

Example: You have a large enterprise document corpus and need accurate document Q&A with improved answers. Use Haystack to retrieve relevant passages, rerank them, and generate grounded responses, while also running evaluation to validate faithfulness and context relevance.

Quick Start

Install haystack-ai and tell your AI agent to create a basic pipeline that retrieves documents and uses an LLM to answer questions from the retrieved context.