self-evaluation

Compare AI agent predictions against seven-day content performance data.

Updated Feb 24, 2026
One-click install
npx skills add https://github.com/teodorboev/socialai --skill self-evaluation
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: self-evaluation
Source: https://github.com/teodorboev/socialai/tree/main/.opencode/skills/self-evaluation
Command: npx skills add https://github.com/teodorboev/socialai --skill self-evaluation

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the challenge of AI agents operating in a vacuum, making predictions without learning from actual outcomes, leading to stagnant performance and persistent errors.

Core Features & Use Cases

  • Automated Post-Mortem Analysis: Compares agent predictions against real-world post performance after a set period (7 days).
  • Agent-Specific Feedback: Identifies which agents were accurate and which were not, providing specific lessons for improvement.
  • Continuous Calibration: Feeds discrepancies and learnings back into the system, enabling all agents to become smarter over time.
  • Use Case: After a social media post is published and gathers data for a week, this Skill analyzes its performance, determines if the predicted engagement was accurate, if the hashtags used were effective, and if the visual style resonated, then provides actionable feedback to the respective agents.

Quick Start

Initiate a post-mortem evaluation for a recently published piece of content.

Frequently Asked Questions about self-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate AI agent predictions against actual content performance data?

Evaluating AI agent predictions against actual content performance data requires automating a post-mortem analysis that compares predicted engagement with real-world results collected over a seven-day period. This identifies discrepancies and quantifies agent accuracy.

What is automated post-mortem analysis for machine learning agents?

Automated post-mortem analysis for machine learning agents is a process that compares agent predictions against actual post performance after a set period. It identifies which agents were accurate and generates specific lessons for continuous calibration.

Can I use continuous improvement feedback loops with content publishing platforms?

Continuous improvement feedback loops require integration with content publishing platforms and performance data APIs. The system feeds discrepancies and learnings back into the pipeline, enabling all agents to become smarter over time.

How do I start a self-evaluation cycle for social media post engagement predictions?

Starting a self-evaluation cycle involves initiating a post-mortem evaluation for a recently published piece of content. After gathering data for a week, the system analyzes performance, determines prediction accuracy, and provides actionable feedback to agents.

What is the best way to automate feedback loops for AI agent continuous improvement?

The best way to automate feedback loops for AI agent continuous improvement is using a system that identifies discrepancies between predictions and outcomes, then automatically feeds those learnings back into the entire agent pipeline for continuous calibration.

Do I need performance data APIs to analyze AI agent accuracy over a seven-day period?

Performance data APIs are required to analyze AI agent accuracy over a seven-day period. The evaluation process depends on integrating with these APIs to collect actual content performance data and compare it against agent predictions.