crawling-social-media

To extract video content and metadata from a social media URL, submit the link to initiate a crawl task. The system processes the URL and retrieves the media files along with associated metadata for archiving or re-publishing.

Media crawling supports multiple platforms including Bilibili, YouTube, TikTok, Douyin, Xiaohongshu, and Kuaishou. The system uses URL pattern matching to identify the source platform and retrieve the corresponding videos, images, and metadata.

To know when your social media crawl task is complete, poll the system status after submitting the URL. The system utilizes status polling to ensure complete data acquisition, allowing you to access downloaded media once the task finishes successfully.

Yes, you can retrieve titles, descriptions, tags, and cover images for re-publishing. The content extraction process pulls comprehensive metadata from the provided social media URL alongside the primary downloaded video media.

Downloading videos from TikTok and Douyin does not require special setup beyond providing the correct URL. The Skill handles the crawl task creation and data extraction internally without needing additional dependencies or environment configurations.