skills.rest
AdigunQ
AdigunQCOMMUNITY
Explore all skills by this author →
𝕏@adigunq_adigunGitHub

site-architecture

Configures WebStorm's TypeScript, including type checking and module resolution for projects.

Updated Feb 8, 2026
Search Tags:#web performance#sitemap#seo#meta tags#robots.txt#technical seo#ai crawlers
One-click install
npx skills add https://github.com/AdigunQ/ralph-smart --skill site-architecture-adigunq
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: site-architecture
Source: https://github.com/AdigunQ/ralph-smart/tree/main/knowledges/bootstrap_skills/site-architecture
Command: npx skills add https://github.com/AdigunQ/ralph-smart --skill site-architecture-adigunq

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill ensures your website's technical structure is optimized for both traditional search engines and emerging AI crawlers, making your content easily discoverable and accessible.

Core Features & Use Cases

  • Search Engine Optimization (SEO): Implement best practices for robots.txt, sitemaps, and meta tags to improve search engine rankings.
  • AI Crawler Visibility: Configure your site to be properly indexed by AI bots like GPTBot, ClaudeBot, and PerplexityBot.
  • Use Case: A new e-commerce site needs to ensure its product pages and blog content are found by Google and can be understood by AI assistants for potential inclusion in summaries or answers. This skill provides the exact configurations needed.

Quick Start

Configure the robots.txt file for your website to allow search engines and AI bots while disallowing specific sensitive paths.

Frequently Asked Questions about site-architecture

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I configure robots.txt to allow AI crawlers like GPTBot and ClaudeBot?▼

To allow AI crawlers, configure robots.txt by explicitly setting User-agent directives for GPTBot, ClaudeBot, and PerplexityBot while disallowing sensitive paths. This ensures your site's content is properly indexed by emerging AI assistants alongside traditional search engines.

What is technical SEO for AI crawler discoverability?▼

Technical SEO for AI crawler discoverability is the process of optimizing website structure, sitemaps, and meta tags so search engines and AI bots can easily access and understand content. It addresses indexing challenges by adhering to web standards for URL structure and performance metrics.

How do I optimize sitemaps and meta tags for better search engine rankings?▼

Optimize sitemaps and meta tags by implementing technical SEO best practices that align with web standards for URL structure and Core Web Vitals. This configuration improves search engine rankings by making your product pages and blog content easily discoverable.

Does this technical SEO approach work for new e-commerce sites?▼

Yes, this technical SEO approach works for new e-commerce sites by providing exact configurations needed to ensure product pages and blog content are found by Google and indexed by AI bots like GPTBot and PerplexityBot for inclusion in AI summaries.

What are the limitations of configuring robots.txt for AI bots?▼

Limitations of configuring robots.txt for AI bots include the necessity to adhere strictly to web standards for URL structure, Core Web Vitals, and security headers. Failing to maintain these performance metrics can prevent search engines and AI bots from properly indexing your content.

Related Skills

Explore More Marketing & Sales Skills→
roycolumbia-coderoycolumbia-code

seo-technical

Audit a URL for crawlability, indexability, security, and Core Web Vitals.

Community
Advanced
coopersimson96coopersimson96
12

seo-geo

Optimize content for AI search engines across multiple platforms.

Community
Intermediate
luanrodriguesluanrodrigues
2

bee:dev-frontend-performance

Validate Core Web Vitals, Lighthouse scores, and bundle size against defined thresholds.

Community
Advanced
KylerDKylerD
14

web-discoverability

Configure SEO meta tags, OpenGraph, sitemaps, and robots.txt for web discoverability.

Community
Intermediate