seo-firecrawl

You can crawl an entire website for SEO analysis by running the 'seo firecrawl crawl <url>' command, which executes a thorough crawl to gather page content, metadata, and links from the target site.

Mapping a website's structure without fetching content is done by discovering all URLs on the site. This technique quickly identifies the entire site structure, removing the need to scrape full page content during discovery.

Yes, Firecrawl supports full JavaScript rendering during a single-page deep scrape. This allows you to extract content from dynamic web pages that rely on client-side scripts to load page elements.

Yes, you can perform a site-scoped search to find specific content within a website without crawling everything. This allows you to query targeted information directly rather than mapping or scraping the entire site structure.

To use Firecrawl for website scraping, you need the Firecrawl MCP server to be operational and installed. This prerequisite environment setup allows the Skill to execute crawling, mapping, and scraping commands.

You should use site mapping instead of a full-site crawl when you only need to identify all URLs and discover the website structure. Mapping skips fetching page content, making it faster when you do not need metadata or full text extraction.