skills.rest
AeonDave
AeonDaveCOMMUNITY
Explore all skills by this author →
GitHub

hakrawler

Crawl web applications to discover URLs, endpoints, and JavaScript files.

15|1|Updated Feb 12, 2026
Search Tags:#javascript#reconnaissance#osint#web crawler#url discovery#hakrawler
One-click install
npx skills add https://github.com/AeonDave/malskill --skill hakrawler
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: hakrawler
Source: https://github.com/AeonDave/malskill/tree/main/offensive-tools/recon/hakrawler
Command: npx skills add https://github.com/AeonDave/malskill --skill hakrawler

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill automates the process of crawling web applications to discover URLs, endpoints, and JavaScript files, building a comprehensive inventory for further analysis.

Core Features & Use Cases

  • Web Crawling: Efficiently crawls websites to find linked resources.
  • URL Inventory: Generates a list of URLs for fuzzing or OSINT.
  • JS File Discovery: Identifies JavaScript files present on a web application.
  • Use Case: When performing reconnaissance on a target's web infrastructure, use this Skill to map out all accessible pages and scripts before initiating vulnerability scanning or fuzzing.

Quick Start

Crawl the target domain https://target.com with a depth of 3 and include subdomains.

Frequently Asked Questions about hakrawler

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I discover URLs and JavaScript files for web application reconnaissance?▼

Web application reconnaissance discovers URLs and JavaScript files by crawling a target domain to build a comprehensive URL inventory. This Skill automates that crawling process to map accessible pages and scripts before vulnerability scanning.

What's the best way to crawl a website and build a URL inventory for fuzzing?▼

Crawling a website for a URL inventory involves mapping linked resources across the target domain. This Skill executes deterministic crawling tasks to generate a list of URLs and endpoints ready for fuzzing or OSINT analysis.

Do I need Go and hakrawler installed to crawl web endpoints?▼

Yes, you need Go and the hakrawler tool installed to execute crawling tasks. This Skill requires both dependencies to run deterministic web crawling and discover endpoints on the target infrastructure.

Can I crawl subdomains when performing OSINT on web infrastructure?▼

Yes, you can include subdomains when crawling a target domain. The Skill supports crawling web infrastructure with configurable depth and subdomain inclusion to expand the scope of URL discovery.

How does JavaScript file discovery work during web crawling?▼

JavaScript file discovery works by crawling the web application and identifying linked script resources. This Skill scans the target to locate JS files present, adding them to the inventory for further security assessment.

When should I use a web crawler for security assessments instead of manual mapping?▼

Use a web crawler for security assessments when you need to efficiently map all accessible pages and scripts on a target. It automates URL discovery before initiating vulnerability scanning or fuzzing, saving time over manual mapping.

Related Skills

Explore More Software Engineering Skills→
robomotioniorobomotionio
2

tavily

Automate web search, content extraction, and site mapping with Tavily.

Official
Advanced
NickCrewNickCrew
29

owasp-top-10

Identify OWASP Top 10 security vulnerabilities in web applications.

Community
Advanced
salmanabdurrahmansalmanabdurrahman

client-spa-endpoints

Extract API endpoints, hostnames, and routes from JavaScript bundles via static analysis.

Community
Advanced
aurumorincaurumorinc

crawl4ai

Configure adaptive crawlers, seed URLs, and perform asynchronous web crawling.

Official
Advanced