crawler

Crawl web applications to discover entry points for penetration testing.

Updated May 16, 2026
One-click install
npx skills add https://github.com/Chid0k/claude-marketplace --skill crawler-chid0k
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: crawler
Source: https://github.com/Chid0k/claude-marketplace/tree/main/plugins/vuln-detect-plugin/skills/crawler
Command: npx skills add https://github.com/Chid0k/claude-marketplace --skill crawler-chid0k

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, curl, burp-mcp, and includes scripts (resource) and references (resource) components.

What problem does it solve?

The crawler Skill solves the challenge of identifying and mapping potential entry points in web applications before comprehensive penetration testing begins, saving time and resources in vulnerability identification.

Core Features & Use Cases

  • Application Enumeration: Discovers entry points by crawling and analyzing the structure and logic of the application.
  • Attack Surface Mapping: Identifies potential attack surfaces by inspecting the structure of web applications.
  • Use Case: When preparing for a pentest on an e-commerce website, this Skill helps map the application structure, discover hidden endpoints, and uncover areas that need to be thoroughly tested.

Quick Start

Use the crawler skill to identify all potential entry points for the target application 'https://example.com'.

Frequently Asked Questions about crawler

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I map web application attack surfaces before penetration testing?

Application enumeration discovers entry points by crawling and analyzing the structure and logic of web applications. It inspects the application structure to identify potential attack surfaces, saving time and resources in vulnerability identification before thorough penetration testing begins.

Can I use Playwright browser automation to discover hidden web application endpoints?

Using Playwright for penetration testing preparation involves automating browser interactions to crawl target applications and capture network traffic. This automated approach maps application structure, discovers hidden endpoints, and identifies areas needing thorough security testing.

What's the best way to identify entry points in an e-commerce website for security testing?

Identifying entry points in an e-commerce website involves crawling the application structure to map hidden endpoints and uncover areas requiring thorough testing. Automated browsing and network capture reveal misconfigurations and potential attack surfaces for comprehensive vulnerability identification.

Does browser automation work with Burp Suite for network capture during attack surface mapping?

Browser automation works alongside Burp Suite network capture to map attack surfaces by simulating user behavior while intercepting traffic. This combination reveals hidden features and application entry points, providing comprehensive data for vulnerability analysis and penetration testing preparation.