skills.rest
yikart
yikartOFFICIAL
Explore all skills by this author →
WebsiteGitHub

crawling-social-media

Crawl social media URLs to download videos and extract metadata.

24.9k|4.0k|Updated Feb 24, 2025
Search Tags:#social media#content extraction#content automation#video download#metadata retrieval#platform crawling
One-click install
npx skills add https://github.com/yikart/AiToEarn --skill crawling-social-media-yikart
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: crawling-social-media
Source: https://github.com/yikart/AiToEarn/tree/main/project/aitoearn-backend/apps/aitoearn-ai/src/core/agent/skills/crawling-social-media
Command: npx skills add https://github.com/yikart/AiToEarn --skill crawling-social-media-yikart

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill enables users to crawl, download, and extract videos, images, and metadata from popular social media platforms, simplifying content collection workflows.

Core Features & Use Cases

  • Content Downloading: Save videos and images from platforms like YouTube, TikTok, Douyin, Instagram, and Xiaohongshu.
  • Content Extraction: Retrieve video titles, descriptions, tags, and cover images for re-publishing or analysis.
  • Use Case: Suppose a user wants to compile a collection of TikTok videos for content repurposing; they can provide URLs and use this Skill to download and extract relevant data efficiently.

Quick Start

Submit a social media URL, then wait for the crawling process to finish and retrieve the media and metadata for your use.

Frequently Asked Questions about crawling-social-media

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I download videos and extract metadata from social media platforms like TikTok and Instagram?▼

To download videos and extract metadata, submit the specific post URL to the crawling-social-media Skill. It handles platform-specific crawling workflows with status polling to retrieve media, titles, descriptions, and tags efficiently.

What social media platforms are supported for content extraction and video downloading?▼

Content extraction and video downloading support popular social media platforms including YouTube, TikTok, Douyin, Instagram, and Xiaohongshu. You can retrieve videos, images, cover images, and associated metadata from these services.

Can I use automated social media crawling to collect content for republishing?▼

Yes, automated social media crawling is suitable for content curators needing content republishing. By providing post URLs, the Skill extracts video titles, descriptions, and cover images, simplifying collection workflows for repurposing.

What is the process to retrieve video titles, descriptions, and tags from a social media post?▼

Retrieving video titles, descriptions, and tags requires providing the post URL. The Skill then initiates platform-specific crawling workflows with status polling to extract and return the requested metadata for analysis.

Do I need any specific dependencies or environment setup to start crawling social media content?▼

No specific dependencies or environment setup are required to start crawling social media content. You simply need to submit the target social media URL and wait for the crawling process to finish.

Related Skills

Explore More Content & Communication Skills→
mifunedevmifunedev
28

post-bridge

Create, schedule, and publish social media posts via the Post Bridge API.

Official
Advanced
shynlee04shynlee04

web-search

Search the web and extract content via Tavily and Exa using the inference.sh CLI.

Community
Intermediate
ongspxmongspxm
1

meagent-update-blog

Trigger and monitor GitLab CI/CD pipelines for blog content rendering.

Community
Intermediate
RoxabiRoxabi
9

scrape

Extract structured content and metadata from URLs as JSON.

Official
Intermediate