crawl-report

Generate an interactive HTML dashboard from crawl metrics JSONL files.

1|1|Updated Mar 27, 2026
One-click install
npx skills add https://github.com/jadecli/researchers --skill crawl-report
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: crawl-report
Source: https://github.com/jadecli/researchers/tree/main/claude-code/.claude/skills/crawl-report
Command: npx skills add https://github.com/jadecli/researchers --skill crawl-report

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill addresses the challenge of turning raw crawl metrics into an accessible, visual quality dashboard that teams can rely on for rapid insights.

Core Features & Use Cases

  • Generate an interactive HTML dashboard from crawl metrics.
  • Aggregate per-spider metrics across iterations and data types to show trends.
  • Output a self-contained HTML file to data/crawl-report.html for sharing and archiving.

Quick Start

Run the crawl-report generator to produce data/crawl-report.html from your crawl metrics.

Frequently Asked Questions about crawl-report

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate a crawl quality dashboard from spider metrics?

To generate a crawl quality dashboard, run the crawl-report generator to read improvements/*.jsonl and data/*.jsonl files, compute key metrics, and output an interactive HTML dashboard to data/crawl-report.html.

What is the best way to visualize selector success rates across multiple spider iterations?

Visualizing selector success rates across multiple spider iterations requires aggregating per-spider metrics across iterations and data types to show trends, which the crawl-report generator computes directly into an interactive HTML dashboard.

Can I use crawl metrics from multiple spiders to monitor coverage improvement trajectories?

Yes, crawl metrics from multiple spiders are applicable for monitoring coverage improvement trajectories, as the generator aggregates per-spider metrics across iterations and data types to display trends.

Does the crawl-report dashboard require any external dependencies to run?

No external dependencies are required to run the crawl-report dashboard, as it outputs a self-contained HTML file to data/crawl-report.html that can be shared and archived without additional frameworks.

What file formats do I need to prepare before generating a crawl-quality dashboard?

Before generating a crawl-quality dashboard, you need to prepare crawl metrics stored in JSONL format, specifically within the improvements/*.jsonl and data/*.jsonl directories for the generator to read and compute.