cold-email-ab-testing

Generates cold email A/B variants and analyzes winners with z-test statistics.

Updated Mar 26, 2026
One-click install
npx skills add https://github.com/LGJ-Jonathan/Jonathan_Global_Claude_Skills --skill cold-email-ab-testing-lgj-jonathan
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: cold-email-ab-testing
Source: https://github.com/LGJ-Jonathan/Jonathan_Global_Claude_Skills/tree/main/cold-email-ab-testing
Command: npx skills add https://github.com/LGJ-Jonathan/Jonathan_Global_Claude_Skills --skill cold-email-ab-testing-lgj-jonathan

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Cold email campaigns often launch with untested single-variant copy or get optimized on gut feel instead of statistics. This Skill enforces minimum variant counts before launch and applies rigorous significance testing after launch so every campaign decision is data-driven. ## Core Features & Use Cases - Pre-Launch Variant Generation: Creates body and subject line variants for all 4 email positions (Pitch, Nudge, Pivot, Breakup) meeting 3/2/2/2 minimums, with platform-correct spintax for Email Bison or Instantly and a mandatory verification gate. - Post-Launch Winner Analysis: Fetches campaign analytics from Email Bison or Instantly APIs, runs two-proportion z-tests (100+ sends, 95% confidence), and declares winners, trending variants, or insufficient-data states. - Optimization Recommendations: Produces specific, data-backed actions (deactivate losers, scale winners) plus cross-campaign pattern tracking for subject lines, openers, CTAs, and angles. - Use Case: After two weeks of sending, ask which variant is winning; the Skill computes z-scores per position, flags that the Pain Dagger opener leads at 3.46% vs 1.63%, and recommends deactivating the losing variant. ## Quick Start Generate A/B test variants for my 4-email cold outreach sequence and verify each position meets the minimum variant counts.

Frequently Asked Questions about cold-email-ab-testing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I A/B test cold email subject lines and body copy?

Generate at least 3 body variants for the first email and 2 for each follow-up position, changing only one variable per position such as angle or hook. Label each variant descriptively so results are interpretable, then run a z-test after 100+ sends per variant.

How many variants should a cold email sequence have?

Use a 3/2/2/2 minimum: 3 variants for the opening pitch email and 2 each for the nudge, pivot, and breakup emails, totaling at least 9 steps. Fewer variants wastes sending volume on untested copy.

What is the minimum sample size for cold email A/B test significance?

Each variant needs at least 100 sends and the test should run at least 7 days at 95% confidence. Below that threshold, results are reported as trending or insufficient data rather than declaring a winner.

Does spintax format differ between Email Bison and Instantly?

Yes. Email Bison uses single curly braces like {Hi|Hey|Hello} with {FIRST_NAME}, while Instantly uses double braces like {{RANDOM | Hi | Hey}} with {{firstName}}. Never mix formats within a campaign.

When should I pause or stop a cold email campaign?

Stop if bounce rate exceeds 5%, pause if reply rate falls below 0.5% after 200+ sends per variant, and reduce volume if warmup scores drop under 85. A reply rate drop of more than 1 percentage point versus the previous snapshot warrants investigation.