positive-reply-scoring

Classifies Smartlead campaign replies with Claude and computes positive reply rate metrics.

Updated Aug 2, 2026
One-click install
npx skills add https://github.com/Pinkycherry/newbusinessideas3 --skill positive-reply-scoring-pinkycherry
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: positive-reply-scoring
Source: https://github.com/Pinkycherry/newbusinessideas3/tree/main/.claude/skills/positive-reply-scoring
Command: npx skills add https://github.com/Pinkycherry/newbusinessideas3 --skill positive-reply-scoring-pinkycherry

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve? Raw reply rate hides whether a cold email campaign is actually working — a 5% reply rate full of unsubscribes and "not a fit" responses is worse than a 1% reply rate from interested buyers. This Skill classifies every reply from a Smartlead campaign and computes the positive reply rate, the metric that actually predicts pipeline. ## Core Features & Use Cases - Reply Classification: Fetches all replies from a Smartlead campaign via its API and classifies each into 11 labels (positive_interested, positive_soft, positive_referral, neutral, negative, unsubscribe, OOO, bounce, etc.) using Claude. - Rate Aggregation: Computes positive reply rate, positive share of replies, hostile rate, and unsubscribe rate, excluding OOO and bounces from denominators, with B2B benchmarks for interpretation. - Action Flagging: Surfaces positive replies needing immediate human response, referrals to follow up, and hostile replies that signal deliverability risk. - Use Case: After a campaign has run 14+ days, score it to decide whether to scale, iterate, or kill it — and compare two experiment variants using the same cutoff date. ## Quick Start Ask the AI to score the replies for Smartlead campaign 12345 and report the positive reply rate with a breakdown by classification.

Frequently Asked Questions about positive-reply-scoring

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I measure positive reply rate for a cold email campaign?

Fetch all replies from the campaign, classify each as positive, neutral, negative, unsubscribe, OOO, or bounce, then divide positive replies by total emails sent. This Skill automates that flow against the Smartlead API using Claude for classification.

How to classify cold email replies with Claude?

Export replies to JSON, then prompt Claude in batches of 20-30 with an 11-label schema covering positive_interested, positive_soft, positive_referral, neutral, negative, unsubscribe, OOO, and bounce. Replies with confidence below 0.7 are labeled as other.

What is a good positive reply rate for B2B cold email?

A positive reply rate of 1% or higher is considered good and 2% or higher is great for B2B cold email. Hostile replies above 0.3% or unsubscribes above 2% indicate deliverability risk and the campaign should be paused.

Does this work with Smartlead's built-in AI reply categorization?

Smartlead has built-in AI categorization, but this Skill classifies replies directly with Claude instead for transparency and prompt-tunable control over the label schema. It uses the Smartlead API only to fetch leads and message histories.

When should I not trust positive reply rate results?

Below roughly 500 emails sent, the positive reply rate has too much statistical noise to declare winners or losers. Also wait at least 14 days after a campaign starts, and only classify the first reply per lead since later messages are conversation, not signal.