skills.rest
DotNetAge
DotNetAgeCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

open_url

Fetch webpage content by URL and return title, body text, and references as JSON.

32|9|Updated Feb 12, 2026
Search Tags:#webpage#scrape#content-extraction#headless-browser#title-extraction#open_url
One-click install
npx skills add https://github.com/DotNetAge/mindx --skill open-url-dotnetage
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: open_url
Source: https://github.com/DotNetAge/mindx/tree/main/skills/open_url
Command: npx skills add https://github.com/DotNetAge/mindx --skill open-url-dotnetage

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires jq.

What problem does it solve?

Quickly obtain the essential content from any webpage by opening a URL and extracting the page title and main body text, saving time on manual scraping.

Core Features & Use Cases

  • Headless browser rendering to capture dynamically loaded content.
  • Extracts title, main content, and reference links for quick summaries.
  • Supports proxy configuration and robust error handling for unreliable networks.
  • Use Case: Research a topic by pulling key passages and cited URLs from a news or article page.

Quick Start

Open a URL like "https://example.com/article" and get back a structured JSON with title, url, content, and refs.

Frequently Asked Questions about open_url

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract webpage content and title from dynamic pages rendered with JavaScript?▼

Fetching webpage content from dynamic pages requires a headless browser to fully render JavaScript before extraction. This approach captures the loaded body text, title, and references, returning a structured JSON output for ingestion.

Can I scrape dynamically loaded content and reference links from a news article for research?▼

Yes, scraping dynamically loaded content and reference links from a news article is supported. The headless browser renders the page so you can extract the main body text and cited URLs, providing a quick summary for research purposes.

Do I need jq installed to fetch webpage content and return structured JSON?▼

Yes, you need jq installed as a dependency to fetch webpage content and return structured JSON. It is required to process the extracted output containing the title, url, content, refs, and elapsed_ms fields.

What is the best way to get structured JSON output from a headless browser webpage scrape?▼

The best way to get structured JSON output from a headless browser webpage scrape is to request the target URL directly. The extraction processes the rendered page and returns specific fields like title, url, content, refs, and elapsed_ms.

Does webpage content extraction support proxy configuration for unreliable networks?▼

Yes, webpage content extraction supports proxy configuration and robust error handling for unreliable networks. This ensures you can successfully fetch page titles and body text even when network conditions are unstable.

Related Skills

Explore More Content & Communication Skills→
icyzhicyzh
1

gif-search

Search the Tenor API for GIF media URLs using curl and jq.

Community
Basic
42atom42atom

twitter-media

Extract tweet text, author, and media from Twitter/X URLs via fxTwitter API.

Community
Intermediate
okbest2024okbest2024

autoglm-open-link

Fetch complete webpage text content via the AutoGLM Open Link API.

Community
Advanced
zhayujiezhayujie
46.4k

web-fetch

Fetch web page HTML and extract title and readable text.

Community
Basic