extract

Extract web page content into Markdown or text via Tavily's API.

Updated Feb 2, 2026
One-click install
npx skills add https://github.com/drillan/marketschema --skill extract
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: extract
Source: https://github.com/drillan/marketschema/tree/main/.claude/skills/extract
Command: npx skills add https://github.com/drillan/marketschema --skill extract

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires jq, curl, and includes scripts (resource) components.

What problem does it solve?

This Skill fetches content from specific URLs using Tavily's extraction API and returns clean Markdown or text, enabling rapid content retrieval without writing code.

Core Features & Use Cases

  • Extract content from single or multiple URLs via Tavily's API into Markdown or text.
  • Support focused extraction with optional query and per-source chunks for long articles.
  • Use Case: consolidate multiple articles into a single readable document for summaries or archiving.

Quick Start

Use the provided script to extract content from URLs:

  • Use ./scripts/extract.sh with a JSON payload containing urls. Examples:
  • ./scripts/extract.sh '{"urls": ["https://example.com/article"]}'
  • ./scripts/extract.sh '{"urls": ["https://example.com/page1","https://example.com/page2"]}'
  • ./scripts/extract.sh '{"urls": ["https://example.com/docs"], "query": "authentication API", "chunks_per_source": 3}'
  • ./scripts/extract.sh '{"urls": ["https://app.example.com"], "extract_depth": "advanced", "timeout": 60}'

Frequently Asked Questions about extract

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract clean content from a URL into Markdown without writing code?

To extract clean content from a URL into Markdown without writing code, use a shell script that calls the Tavily extraction API and returns a JSON payload containing the raw text or Markdown for the specified web pages.

Can I extract web content from multiple URLs at the same time?

Yes, you can extract web content from multiple URLs at the same time by passing a JSON payload with an array of URLs to the extraction script, which processes single or batch requests through the Tavily API.

Do I need a Tavily API key to extract web page content?

Yes, you need a Tavily API key to extract web page content, along with internet access to the Tavily API, the curl dependency, and the provided shell script to execute the extraction workflow.

How do I extract specific information from a long web article?

To extract specific information from a long web article, pass a focused query and set the chunks per source parameter in your JSON payload, allowing the Tavily extraction API to segment and return only the relevant content.

What is the best way to fetch and convert article content from URLs into text?

The best way to fetch and convert article content from URLs into text is using an API-driven extraction script that retrieves raw web content and converts it into clean Markdown or text without requiring custom code.

Does URL content extraction work for pages requiring advanced processing?

Yes, URL content extraction works for pages requiring advanced processing by setting the extract depth parameter to advanced and adjusting the timeout in the JSON payload to handle complex web content retrieval.