positive-reply-scoring

Classifies Smartlead campaign replies with Claude and computes positive reply rate metrics.

Updated May 28, 2025
One-click install
npx skills add https://github.com/meloShaya/insteltech --skill positive-reply-scoring-meloshaya
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: positive-reply-scoring
Source: https://github.com/meloShaya/insteltech/tree/main/crm/library/skills/positive-reply-scoring
Command: npx skills add https://github.com/meloShaya/insteltech --skill positive-reply-scoring-meloshaya

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve? Raw reply rate hides whether a cold email campaign is actually working — a 5% reply rate full of unsubscribes and hostile replies is worse than a 1% reply rate from interested buyers. This Skill classifies every reply from a Smartlead campaign and computes the positive reply rate, the metric that shows whether a campaign generates real demand. ## Core Features & Use Cases - Reply Fetching: Pulls all leads with replies and their first inbound message from the Smartlead API, with pagination, retry logic, and optional date filtering. - Claude-Based Classification: Labels each reply as positive_interested, positive_soft, positive_referral, neutral, negative, unsubscribe, OOO, bounce, or other using a tunable prompt. - Rate Aggregation & Benchmarks: Computes positive reply rate, hostile rate, and unsubscribe rate against B2B cold email benchmarks, excluding OOO and bounces from denominators. - Use Case: After a campaign has run for two weeks, score its replies to decide whether to scale it, kill it, or run a deliverability audit — and surface the positive replies that need an immediate human response. ## Quick Start Score the replies for Smartlead campaign 12345 and tell me the positive reply rate plus which leads need a response right now.

Frequently Asked Questions about positive-reply-scoring

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I measure positive reply rate for a cold email campaign?

Fetch all replies from the campaign, classify each into labels like positive_interested, positive_soft, and positive_referral, then divide total positive replies by total emails sent. This Skill automates that flow against the Smartlead API and benchmarks the result against B2B norms.

How to classify Smartlead campaign replies with Claude?

Run the fetch script to export replies to JSON, then have Claude classify each reply in batches of 20-30 using the provided 11-label prompt. Replies with classification confidence below 0.7 are labeled as other.

What is a good positive reply rate for B2B cold email?

A positive reply rate of 1% or higher is considered good, and 2% or higher is great. Hostile replies above 0.3% or unsubscribes above 2% signal deliverability risk and the campaign should be paused.

Does this work with Smartlead's built-in AI reply categorization?

Smartlead has built-in AI categorization, but this Skill classifies replies directly with Claude instead. That gives full transparency and a tunable classification prompt rather than a black-box label.

When should I not trust positive reply rate results?

Below roughly 500 emails sent, the sample is too small and the rate is noisy. Also wait at least 14 days after a campaign starts, and only classify each lead's first reply since later messages are conversation, not signal.