skills.rest
mitchellvandusen-cell
mitchellvandusen-cellCOMMUNITY
Explore all skills by this author →
GitHub

tavily-extract

Extract text from web pages using the Tavily CLI.

Updated Dec 12, 2025
Search Tags:#web scraping#text extraction#URL extraction#javascript handling#query-focused
One-click install
npx skills add https://github.com/mitchellvandusen-cell/Flask-Webhook --skill tavily-extract-mitchellvandusen-cell
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: tavily-extract
Source: https://github.com/mitchellvandusen-cell/Flask-Webhook/tree/main/.claude/skills/tavily-extract
Command: npx skills add https://github.com/mitchellvandusen-cell/Flask-Webhook --skill tavily-extract-mitchellvandusen-cell

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires tvly, and includes scripts (resource) components.

What problem does it solve?

Extracts clean markdown or text content from URLs, handling JavaScript-rendered pages and supporting query-focused chunking for targeted extraction.

Core Features & Use Cases

  • URL Content Extraction: Extracts text from specific URLs.
  • JavaScript Handling: Handles JavaScript-rendered pages.
  • Query-Focused Extraction: Supports targeted extraction based on queries.
  • Use Case: Ideal for users who need to extract text from web pages for research or analysis.

Quick Start

Extract text from the URL 'https://example.com' using the tavily-extract skill.

Frequently Asked Questions about tavily-extract

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract text from a URL that uses JavaScript rendering?▼

To extract text from JavaScript-rendered pages, this skill uses the Tavily CLI to process the URL and output clean markdown content. It handles dynamic content loading automatically to retrieve the rendered text.

Can I extract specific text from a web page based on a search query?▼

Yes, you can perform query-focused extraction by providing a specific query alongside the URL. The skill supports targeted text chunking to extract only the information relevant to your search query.

Do I need to install any dependencies to extract text from URLs?▼

Yes, you must install the Tavily CLI and complete authentication before extracting text. The skill requires the 'tvly' dependency to interface with the extraction service and process web pages.

What is the best way to get clean markdown from web pages for analysis?▼

The best way to get clean markdown is using a query-focused text extraction tool that handles dynamic content. This skill extracts text from URLs via the Tavily CLI, yielding clean markdown for research.

Why does my web scraping return empty content for dynamic URLs?▼

Dynamic URLs often return empty content when basic scrapers fail to execute JavaScript. This skill handles JavaScript-rendered content, ensuring the fully loaded text is extracted instead of empty HTML.

Related Skills

Explore More Data & Analytics Skills→
robomotioniorobomotionio
2

tavily

Automate web search, content extraction, and site mapping with Tavily.

Official
Advanced
u9401066u9401066

pdf-reader

Extract text, figures, and citations from PDFs into Markdown.

Community
Intermediate
vut08905vut08905

tavily

Search the web and extract markdown-friendly text from URLs via Tavily.

Community
Intermediate
rubysrubys
36

render-page

Render Rails pages from a local database and extract or search HTML.

Community
Intermediate