wechat-article-spider

Run the main.py script with the article URL as an argument, optionally followed by an output directory. The script fetches the article, downloads its images, and writes a Markdown file with relative image paths.

The script extracts all img tags from the article HTML and downloads each image into an images subdirectory using requests. Image filenames include a URL hash to avoid duplicates, and Markdown references use relative paths.

The script requires requests for HTTP fetching, beautifulsoup4 for HTML parsing, and lxml as the parser backend. Install them with pip using the provided requirements.txt file.

WeChat may apply anti-scraping measures that block requests, and dynamically loaded images may not appear in the initial HTML. Retry later when fetching fails and review the generated Markdown for missing content.

Yes, pass a second command-line argument after the article URL to set the output directory. Without it, the script writes to a default docs directory relative to the workspace.