site-architecture

Configures WebStorm's TypeScript, including type checking and module resolution for projects.

Updated Feb 8, 2026

Search Tags:#web performance #sitemap #seo #meta tags #robots.txt #technical seo #ai crawlers

Ready to run

npx skills add https://github.com/AdigunQ/ralph-smart --skill site-architecture-adigunq

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: site-architecture
Source: https://github.com/AdigunQ/ralph-smart/tree/main/knowledges/bootstrap_skills/site-architecture
Command: npx skills add https://github.com/AdigunQ/ralph-smart --skill site-architecture-adigunq

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill ensures your website's technical structure is optimized for both traditional search engines and emerging AI crawlers, making your content easily discoverable and accessible.

Core Features & Use Cases

Search Engine Optimization (SEO): Implement best practices for robots.txt, sitemaps, and meta tags to improve search engine rankings.
AI Crawler Visibility: Configure your site to be properly indexed by AI bots like GPTBot, ClaudeBot, and PerplexityBot.
Use Case: A new e-commerce site needs to ensure its product pages and blog content are found by Google and can be understood by AI assistants for potential inclusion in summaries or answers. This skill provides the exact configurations needed.

Quick Start

Configure the robots.txt file for your website to allow search engines and AI bots while disallowing specific sensitive paths.

Frequently Asked Questions about site-architecture

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I configure robots.txt to allow AI crawlers like GPTBot and ClaudeBot?▼

To allow AI crawlers, configure robots.txt by explicitly setting User-agent directives for GPTBot, ClaudeBot, and PerplexityBot while disallowing sensitive paths. This ensures your site's content is properly indexed by emerging AI assistants alongside traditional search engines.

What is technical SEO for AI crawler discoverability?▼

Technical SEO for AI crawler discoverability is the process of optimizing website structure, sitemaps, and meta tags so search engines and AI bots can easily access and understand content. It addresses indexing challenges by adhering to web standards for URL structure and performance metrics.

How do I optimize sitemaps and meta tags for better search engine rankings?▼

Optimize sitemaps and meta tags by implementing technical SEO best practices that align with web standards for URL structure and Core Web Vitals. This configuration improves search engine rankings by making your product pages and blog content easily discoverable.

Does this technical SEO approach work for new e-commerce sites?▼

Yes, this technical SEO approach works for new e-commerce sites by providing exact configurations needed to ensure product pages and blog content are found by Google and indexed by AI bots like GPTBot and PerplexityBot for inclusion in AI summaries.

What are the limitations of configuring robots.txt for AI bots?▼

Limitations of configuring robots.txt for AI bots include the necessity to adhere strictly to web standards for URL structure, Core Web Vitals, and security headers. Failing to maintain these performance metrics can prevent search engines and AI bots from properly indexing your content.