skills.rest
deepInTheData
deepInTheDataCOMMUNITY
Explore all skills by this author →
GitHub

quiz-crawler

Crawls quiz funnels to extract questions, answers, and redirect URLs into Notion.

Updated Jul 26, 2023
Search Tags:#data collection#notion#lead generation#marketing automation#quiz#crawler#r2 storage
One-click install
npx skills add https://github.com/deepInTheData/dev_dotfiles --skill quiz-crawler
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: quiz-crawler
Source: https://github.com/deepInTheData/dev_dotfiles/tree/main/ai/skills/quiz-crawler
Command: npx skills add https://github.com/deepInTheData/dev_dotfiles --skill quiz-crawler

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill automates the process of collecting questions, answer options, and final offer details from online marketing quiz funnels, creating a valuable swipe database.

Core Features & Use Cases

  • Crawl & Capture: Navigates quiz funnels, automatically handling popups and filling forms with dummy data.
  • Artifact Storage: Saves screenshots, HTML snapshots, and results to a specified output directory.
  • Data Synchronization: Uploads captured artifacts to R2 (S3-compatible storage).
  • Notion Publishing: Extracts questions and answers using OCR and DOM scraping, then publishes them to a Notion page.
  • Use Case: A marketer wants to build a library of competitor quiz offers. They provide a quiz URL, and this Skill crawls it, saves all assets, and creates a structured Notion page with the questions and final offer details.

Quick Start

Use the quiz-crawler skill to crawl the provided quiz URL 'https://example.com/quiz'.

Frequently Asked Questions about quiz-crawler

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape marketing quiz funnels to extract questions and final offers?▼

Scraping marketing quiz funnels requires navigating multi-step forms, handling popups, and extracting questions. This process uses Playwright to crawl URLs, fill dummy data, and capture final redirect offers for a structured swipe database.

Can I automate lead generation quiz crawling and publish results directly to Notion?▼

Automating lead generation quiz crawling and publishing to Notion is supported. The process extracts questions and answers via OCR and DOM scraping, then uploads screenshots, HTML snapshots, and structured data directly to a Notion page.

Do I need Tesseract OCR and Playwright to capture quiz funnel questions and answer options?▼

Tesseract OCR and Playwright are required dependencies. Node.js runs the scripts, Playwright handles browser automation and form filling, while Tesseract OCR extracts questions and answer options from images or rendered text.

What's the best way to store crawled quiz funnel artifacts and HTML snapshots for marketing analysis?▼

Storing crawled quiz funnel artifacts involves saving screenshots and HTML snapshots to a local output directory, then synchronizing them to R2 S3-compatible storage to ensure your marketing analysis assets are preserved and accessible.

How does automated form filling handle popups when crawling online quiz funnels?▼

Automated form filling handles popups during quiz crawling by utilizing Playwright to interact with and dismiss popup elements, allowing the crawler to proceed through the funnel and capture all questions and final redirect URLs.

Why use OCR for quiz question extraction instead of only DOM scraping?▼

OCR is used alongside DOM scraping because some marketing quiz funnels render questions as images rather than selectable text. Tesseract OCR extracts this visual question data, ensuring a complete capture of the quiz funnel content.

Related Skills

Explore More Marketing & Sales Skills→
The1nkThe1nk
2

tesseract

Recognize text from screen captures using the Tesseract OCR engine.

Community
Intermediate
neon-pilotneon-pilot

ads-competitors

Analyze competitor advertising across Meta, Google, LinkedIn, and TikTok.

Community
Advanced
ollieb89ollieb89

rclone

Transfer and sync files between local systems and cloud storage providers.

Community
Intermediate
koreatskoreats

Exam Solver Skill

Extract quiz questions from images and answer them using course materials.

Community
Intermediate