Scrape web articles into formatted markdown notes for Obsidian.
npx skills add https://github.com/ethan-rio/skills --skill ingest-article
Please help me install this Agent Skill. Skill: ingest-article Source: https://github.com/ethan-rio/skills/tree/main/skills/personal_agent/ingest-article Command: npx skills add https://github.com/ethan-rio/skills --skill ingest-article
Manually saving web articles to Obsidian is tedious, often results in messy formatting, and fails for JS-rendered pages that don't expose clean text. This Skill automates the entire process of clipping online articles into your Obsidian vault as properly formatted, ready-to-read markdown notes.
Article -- 2024-05-20 -- aws-lambda-best-practices.md ready for you to read and annotate later.Paste a non-YouTube, non-PDF article URL into the chat to have it automatically scraped and saved to your Obsidian Inbox as a formatted markdown note.
High-intent search queries and answers about installing and using this skill.
You can clip web articles to Obsidian by scraping the URL to extract clean markdown text, which is then saved as a formatted note with a dated, slugged filename in your Obsidian Inbox.
Yes, JavaScript-rendered blog posts can be scraped into your personal knowledge base using Firecrawl, which handles dynamic page rendering to extract clean markdown that standard scrapers miss.
The best way to convert dynamic web content to markdown for knowledge management is automating the extraction process to bypass JavaScript rendering issues, directly capturing the article text and metadata for standardized notes.
Yes, you need the Firecrawl scraping tool to handle dynamic page rendering and the jq utility to extract page metadata, ensuring the clipped web pages are properly formatted as standardized Obsidian inbox notes.
Copying and pasting web content into Obsidian results in messy formatting because manual methods fail to bypass JavaScript rendering and strip excess HTML, making automated markdown conversion necessary for clean text extraction.
Limitations when scraping web articles for markdown conversion include the inability to process YouTube videos or PDF files, restricting the clipping workflow to standard public web articles, blog posts, and documentation pages.
daanteijema-beepExtract clean web content from URLs into Markdown using Firecrawl CLI.
cafe3310Creates Obsidian knowledge base documents with YAML frontmatter and tags.
overviewlabsRead, search, and create Markdown notes in an Obsidian vault.
kevinnftExtract structured data from static HTML, JS-rendered pages, and hybrid sites.