brave-search

Search the web and extract URL content as Markdown via the Brave Search API.

Updated Jan 22, 2024
One-click install
npx skills add https://github.com/nathankoerschner/dotfiles --skill brave-search-nathankoerschner
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: brave-search
Source: https://github.com/nathankoerschner/dotfiles/tree/main/agent-skills/_shared-skills/brave-search
Command: npx skills add https://github.com/nathankoerschner/dotfiles --skill brave-search-nathankoerschner

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires @mozilla/readability, jsdom, turndown, turndown-plugin-gfm, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides a fast and efficient way to search the web and extract content from web pages without needing to open a browser, saving time and reducing context switching.

Core Features & Use Cases

  • Web Search: Quickly find information, documentation, or facts using Brave Search.
  • Content Extraction: Extract the main content from any given URL as Markdown.
  • Use Case: You need to find the latest documentation for a specific JavaScript function. Use this Skill to search for "javascript async await documentation" and get direct links and summaries.

Quick Start

Search the web for 'what is the weather today in london'.

Frequently Asked Questions about brave-search

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract web page content as Markdown using Node.js?

To extract web page content as Markdown, this Skill fetches URLs and parses the HTML using Readability and Turndown. It delivers clean Markdown text suitable for documentation and research tasks without requiring a browser.

Can I perform automated web searches without opening a browser?

Yes, you can perform automated web searches without a browser by calling the Brave Search API. This Skill queries the web directly via Node.js to retrieve facts, links, and summaries for quick information retrieval.

How do I search for API documentation and retrieve the main text?

You can search for API documentation by providing a query string to the Brave Search API. The Skill then extracts the main content from the resulting URLs, converting the web pages into readable Markdown text.

Do I need an API key to use Brave Search for web scraping and content extraction?

Yes, you need a BRAVE_API_KEY environment variable to authenticate web search requests. You also need npm packages like jsdom and turndown-plugin-gfm installed to handle HTML parsing and content extraction.

What is the best way to summarize web pages for fact-checking tasks?

The best way to summarize web pages for fact-checking is fetching the URL and extracting its primary content. This Skill isolates the main article text using Readability and converts it to Markdown for quick review.

Are there limitations when extracting content from web pages using Readability and jsdom?

A limitation is that Readability and jsdom only extract the primary content, missing dynamically loaded JavaScript data. This approach works best for static documentation pages rather than highly interactive web applications.