skills.rest
Yusufkotavom
YusufkotavomCOMMUNITY
Explore all skills by this author →
GitHub

crawling-social-media

Crawl social media URLs to download videos and images with metadata.

Updated Mar 26, 2026
Search Tags:#video#metadata#download#extraction#social-media#crawl#platform-patterns
One-click install
npx skills add https://github.com/Yusufkotavom/AiToEarn --skill crawling-social-media
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: crawling-social-media
Source: https://github.com/Yusufkotavom/AiToEarn/tree/main/project/aitoearn-backend/apps/aitoearn-ai/src/core/agent/skills/crawling-social-media
Command: npx skills add https://github.com/Yusufkotavom/AiToEarn --skill crawling-social-media

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill solves the tedious, manual effort of finding, downloading, and extracting media content and metadata from popular social platforms, enabling faster content gathering and repurposing.

Core Features & Use Cases

  • Download videos and images from platforms like Bilibili, YouTube, TikTok, Douyin, Instagram, Twitter, and Xiaohongshu.
  • Extract metadata such as titles, descriptions, tags, and cover media for archiving or re-publishing.
  • Use cases include content curation, research, competitive analysis, and social media content archiving.

Quick Start

Provide a social media URL and let this skill crawl, download the media, and extract metadata for reuse.

Frequently Asked Questions about crawling-social-media

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I download videos and extract metadata from social media platforms?▼

To download videos and extract metadata from social media, provide a platform-specific URL to crawl media content, titles, descriptions, and tags for archiving or repurposing across supported networks like YouTube, TikTok, and Instagram.

Can I extract content and tags from Xiaohongshu and Douyin URLs?▼

Yes, you can extract content and tags from Xiaohongshu and Douyin URLs. The skill recognizes platform-specific URL patterns to fetch associated media, titles, descriptions, and tags for analysis or redistribution.

What is the best way to archive social media images and videos for competitive analysis?▼

The best way to archive social media images and videos for competitive analysis is using a crawling tool that downloads media and extracts metadata like titles and tags from multiple platforms into a structured format for reuse.

Does this social media crawler work with Bilibili and Twitter?▼

Yes, this social media crawler works with Bilibili and Twitter. It applies platform-specific URL pattern recognition to fetch media URLs and extract associated metadata for content curation and research.

Do I need any dependencies to crawl and extract social media content?▼

No, you do not need any dependencies to crawl and extract social media content. The skill operates without requiring additional modules, allowing you to quickly gather videos, images, and metadata by providing a URL.

Related Skills

Explore More Content & Communication Skills→
LeoyishouLeoyishou
27

social-media

Automate cross-platform social media download, publishing, and copywriting workflows.

Community
Advanced
yikartyikart
24.9k

crawling-social-media

Crawl social media URLs to download videos and extract metadata.

Official
Intermediate
darblexdarblex

Video & Media Production Automation

Automates video production tasks including creation, editing, and thumbnail generation.

Community
Advanced
TeamWiseFlowTeamWiseFlow
8.4k

highlight-clipper

Identify and clip high-value video moments using ASR transcription and text analysis.

Official
Intermediate