skills.rest
UnionStreetAI
UnionStreetAIOFFICIAL
Explore all skills by this author →
GitHub

competitor-profiling

Generates structured competitor profile markdown files from URLs using site scraping and SEO data.

Updated May 6, 2026
Search Tags:#firecrawl#competitive intelligence#web scraping#market research#competitor analysis#seo#dataforseo
One-click install
npx skills add https://github.com/UnionStreetAI/unionstreet --skill competitor-profiling-unionstreetai
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: competitor-profiling
Source: https://github.com/UnionStreetAI/unionstreet/tree/main/plugins/gtm/skills/competitor-profiling
Command: npx skills add https://github.com/UnionStreetAI/unionstreet --skill competitor-profiling-unionstreetai

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Researching competitors manually means visiting dozens of pages, pulling SEO metrics, and reading reviews, then assembling it all into a comparable format. This Skill automates that research pipeline, turning a list of competitor URLs into consistent, evidence-backed competitor profile documents. ## Core Features & Use Cases - Automated Site Research: Maps and scrapes competitor homepages, pricing, features, customers, and changelog pages with Firecrawl, saving raw data to disk for auditing. - SEO & Market Intelligence: Pulls domain rank, backlinks, ranked keywords, traffic estimates, and organic competitor discovery via DataForSEO MCP tools. - Standardized Profiles & Summaries: Produces one structured markdown profile per competitor plus a cross-competitor summary with comparison tables and positioning maps. - Use Case: Give the Skill five competitor URLs and request a deep profile; it scrapes each site, gathers SEO metrics and review data, and outputs five comparable profiles plus a landscape summary highlighting gaps and opportunities. ## Quick Start Profile these competitors at quick-scan depth and save the results to the competitor-profiles directory: https://competitor-a.com and https://competitor-b.com.

Frequently Asked Questions about competitor-profiling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I research competitors from their website URLs?▼

Provide a list of competitor URLs and the Skill maps each site with Firecrawl, scrapes key pages like homepage and pricing, pulls SEO metrics from DataForSEO, and synthesizes everything into a structured markdown profile per competitor.

What data sources are used for competitor analysis?▼

The Skill uses Firecrawl for scraping competitor pages and review sites like G2 and Capterra, plus DataForSEO for domain rank, backlinks, ranked keywords, traffic estimates, and organic competitor discovery.

What is the difference between quick scan and deep profile?▼

Quick scan scrapes only the homepage and pricing page with basic SEO metrics, producing an abbreviated profile. Deep profile scrapes all key pages plus review sites and runs full backlink and keyword intelligence for a complete profile.

Where are competitor profiles and raw data saved?▼

Profiles are saved as markdown files in a competitor-profiles directory, with raw scrapes, SEO JSON responses, and review data stored under raw/<competitor-slug>/<date> subfolders so snapshots can be audited and diffed over time.

What happens when DataForSEO returns no data for a domain?▼

If DataForSEO returns no data, the domain is likely too new or too small to have measurable organic presence. The Skill notes insufficient data in the profile rather than fabricating metrics.

Can I update an existing competitor profile later?▼

Yes. Re-run the Skill to refresh pricing pages, SEO metrics, and changelogs, then update the Generated date and record changes in a Change Log section at the bottom of the profile.

Related Skills

Explore More Marketing & Sales Skills→
hybrid-npmhybrid-npm
17

product-marketing-context

Create or update a centralized product marketing context document.

Official
Intermediate
claude-office-skillsclaude-office-skills
368

competitive-analysis

Generate competitive intelligence reports comparing products, features, pricing, and positioning.

Official
Advanced
JasonColapietroJasonColapietro
123

suede-customer-research

Synthesize interviews, tickets, and reviews into evidence-backed personas and quote banks.

Community
Advanced
dxxxdxxx

competitor-profiling

Scrape competitor websites and analyze SEO data to create competitor profiles.

Community
Advanced