search-web

Searches the web, Wikipedia, and scholarly indexes and extracts readable page text.

2|2|Updated Jun 21, 2026
One-click install
npx skills add https://github.com/BTreeMap/SKILLs --skill search-web-btreemap
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: search-web
Source: https://github.com/BTreeMap/SKILLs/tree/main/search-web
Command: npx skills add https://github.com/BTreeMap/SKILLs --skill search-web-btreemap

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires ddgs, trafilatura, httpx, pydantic, btm-corekit, and includes scripts (resource) components.

What problem does it solve? When your agent harness has no built-in search or fetch tool, you cannot answer current, encyclopedic, or research questions with grounded sources. This Skill provides keyless access to web search, Wikipedia, and scholarly indexes (OpenAlex, Crossref, arXiv), plus readable-text extraction from any page, all returning structured JSON with source attribution. ## Core Features & Use Cases - Five search channels: web for open questions, instant for definitions, wiki for encyclopedic summaries, scholar for papers with DOI, year, and citation counts, and fetch for the readable text of one page. - Scholarly source selection: Choose OpenAlex for cross-field coverage, Crossref for DOI registry lookups, or arXiv for preprints with fielded queries. - Caching and safety: Repeated queries are answered from a local cache, fetched content is treated as untrusted data, and prompt-injection text found in pages is reported rather than followed. - Use Case: Ask your agent to find recent papers on a topic by DOI, then fetch the full text of the most relevant result to verify a claim before citing it. ## Quick Start Ask the agent to search the scholarly record for papers on your topic and fetch the full text of the top result.

Frequently Asked Questions about search-web

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I search the web from an AI agent without an API key?

Use the web channel, which queries multiple search engines through the ddgs library with automatic fallback between backends. Results return as JSON with title, URL, snippet, and source fields, and no API key is required.

How to find research papers by DOI using OpenAlex, Crossref, or arXiv?

Run the scholar channel with --source set to openalex, crossref, or arxiv. OpenAlex spans every field and is the default, Crossref is the DOI registry, and arXiv covers preprints and ranks fielded queries like all:"exact phrase" better than bare terms.

Can I extract readable text from a web page for an LLM?

Yes, the fetch channel extracts the main article text from a page using trafilatura. It refuses PDFs, paywalled pages, listings, and JavaScript-rendered pages rather than returning empty or mangled output.

Does this search tool work with PDF documents?

No, fetch explicitly refuses PDF URLs and directs you to the read-pdf skill instead. Use a dedicated PDF extraction skill to pull text and metadata from PDF files with page-cited evidence.

Why does web search return empty results sometimes?

The web channel uses unofficial, rate-limited backends, so empty results can occur under throttling. The skill suggests retrying later or switching to the wiki or scholar channels, which use official keyless APIs.

What are the limitations of Wikipedia search results as citations?

Wikipedia rows are tertiary summaries suitable for orientation but never acceptable as citations. Each wiki result includes the page summary, and claims should be verified against primary sources found via scholar or fetch.