skills.rest
acertainKnight
acertainKnightCOMMUNITY
Explore all skills by this author →
GitHub

RAG System Administration

Manage and optimize RAG systems through reindexing, search tuning, and custom index creation.

12|7|Updated Mar 10, 2025
Search Tags:#rag#retrieval-augmented-generation#vector-store#settings-management#reindexing#search-optimization#custom-indexes
One-click install
npx skills add https://github.com/acertainKnight/project-thoth --skill rag-system-administration
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: RAG System Administration
Source: https://github.com/acertainKnight/project-thoth/tree/main/src/thoth/.skills/rag-administration
Command: npx skills add https://github.com/acertainKnight/project-thoth --skill rag-system-administration

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill helps administrators efficiently manage and optimize the Retrieval-Augmented Generation (RAG) system that powers knowledge-base searching, retrieval, and indexing. It addresses the complexity of maintaining high-quality search results across large document collections.

Core Features & Use Cases

  • Reindex the vector store to refresh embeddings after model or data changes.
  • Optimize search parameters to improve relevance, recall, and performance.
  • Create and manage custom indexes for topic-focused retrieval.
  • View and update global RAG settings to align with organizational needs.
  • Use cases: a data team that needs faster, more relevant search across thousands of articles; an AI assistant that must reconfigure RAG behavior for a new project.

Quick Start

View current RAG settings with view_settings(section="rag"), then adjust parameters with update_settings(section="rag", updates={...}), reindex the collection with reindex_collection(force=true, batch_size=50), and monitor progress with get_task_status(task_type="reindex").

Frequently Asked Questions about RAG System Administration

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I reindex a vector store after updating embeddings or data?▼

Reindexing refreshes embeddings across your document collection. Use reindex_collection(force=true, batch_size=50) to rebuild the vector store after model changes or data updates, then monitor progress with get_task_status(task_type="reindex").

What's the best way to improve search relevance in a RAG system?▼

Search relevance improves through parameter tuning and custom indexing. Optimize search settings with update_settings(section="rag", updates={...}), then create topic-focused indexes using create_custom_index() to target high-value retrieval paths.

Can I create custom indexes for specific topics in my knowledge base?▼

Yes, custom indexes enable topic-focused retrieval. Use create_custom_index() to build specialized indexes, then query them with search_custom_index() to retrieve relevant documents faster from large collections.

How do I view and update RAG configuration settings?▼

Access your RAG settings with view_settings(section="rag") to inspect current parameters. Modify them using update_settings(section="rag", updates={...}) to align search behavior and performance with organizational requirements.

When should I reindex versus optimize search parameters?▼

Reindex when embeddings or source data change significantly; optimize search parameters for immediate relevance and speed improvements without regenerating vectors. Combine both for comprehensive RAG tuning across large document collections.

What happens if search performance degrades on a large knowledge base?▼

Performance degradation typically stems from unoptimized parameters or outdated embeddings. Run optimize_search() to tune retrieval settings, reindex with appropriate batch sizes, and use custom indexes to partition high-volume collections into focused retrieval paths.

Related Skills

Explore More Data & Analytics Skills→
ai-kitchen-incai-kitchen-inc
2

data-layer

Chunk documents, generate embeddings, and index vectors in Pinecone for RAG.

Community
Intermediate
JFrangelJFrangel

rag-optimizer

Optimize RAG pipelines with chunking, hybrid search, RRF scoring, and RAGAS evaluation.

Community
Advanced
mahg-esmahg-es
3

vector-search

Configure HNSW/IVF indices and perform ANN search with vector embeddings.

Official
Advanced
jg-chalk-iojg-chalk-io

moai-ml-rag

Build RAG pipelines with vector databases, embeddings, and LLM generation.

Community
Advanced