skills.rest
Gimpy666
Gimpy666COMMUNITY
Explore all skills by this author →
GitHub

scraped_docs

Convert Tribot JavaDoc HTML pages into per-class Markdown files and a consolidated reference.

1|Updated Sep 11, 2025
Search Tags:#documentation#markdown#javascript#LLM#web-scraping#tribot#javaDoc
One-click install
npx skills add https://github.com/Gimpy666/tribot-docs-scraper --skill scraped-docs
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scraped_docs
Source: https://github.com/Gimpy666/tribot-docs-scraper/tree/main/scraped_docs
Command: npx skills add https://github.com/Gimpy666/tribot-docs-scraper --skill scraped-docs

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, beautifulsoup4, lxml, markdownify, tqdm.

What problem does it solve?

This Skill automates the extraction and Markdown conversion of Tribot JavaDoc pages into a structured documentation set, enabling AI-friendly consumption and quick lookup.

Core Features & Use Cases

  • Converts each Tribot API class/interface page into an individual Markdown file with class name, package, description, and content.
  • Generates a consolidated reference file ALL_TRIBOT_DOCS.md containing all pages with a navigable table of contents.
  • Provides class/package metadata extraction (names, packages, URLs) for downstream indexing and search.

Quick Start

Run the scraper to pull the Tribot JavaDoc pages and generate Markdown outputs, or examine ALL_TRIBOT_DOCS.md for a complete reference.

Frequently Asked Questions about scraped_docs

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert JavaDoc HTML to Markdown for LLM workflows?▼

You convert JavaDoc HTML to Markdown by using Python with requests, BeautifulSoup4, lxml, and markdownify to fetch, parse, and transform HTML pages into structured Markdown files for AI prompts and knowledge bases.

What's the best way to scrape Tribot API documentation into a single reference file?▼

Scraping Tribot API documentation into a single reference file involves extracting 224 class pages into individual Markdown files and consolidating them into a navigable ALL_TRIBOT_DOCS.md file with a table of contents.

Do I need Python and BeautifulSoup4 to automate web scraping for Markdown conversion?▼

Yes, you need Python and BeautifulSoup4 along with requests, lxml, markdownify, and tqdm to automate fetching, parsing, and converting web scraping outputs into Markdown format.

Can I extract class and package metadata from JavaDoc pages for downstream indexing?▼

Yes, you can extract class and package metadata such as names, packages, and URLs from JavaDoc pages during the scraping process to provide structured data for downstream indexing and search.

How many API pages can be processed when building a consolidated Markdown reference?▼

When building a consolidated Markdown reference, the scraper processes 224 Tribot API pages, converting each into an individual Markdown file before aggregating them into a complete navigable document.

Related Skills

Explore More Software Engineering Skills→
dy9759dy9759

web-importer

Fetch webpages and convert content into WPS-friendly notes with formatting and images.

Community
Advanced
Lucius646Lucius646

karpathy-llm-wiki

Manage Markdown-based knowledge bases with LLM-driven ingestion, querying, and maintenance.

Community
Intermediate
BenAIOSBenAIOS

seo-images

Analyze web page images for SEO and performance optimization.

Official
Advanced
zephyrwang6zephyrwang6
333

web-scraper

Fetch web page content and convert HTML to clean Markdown.

Community
Intermediate