pa-eval

Evaluate AI personal assistant performance with structured scoring and owner feedback.

5|1|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/netanel-abergel/pa-skills --skill pa-eval
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: pa-eval
Source: https://github.com/netanel-abergel/pa-skills/tree/main/skills/pa-eval
Command: npx skills add https://github.com/netanel-abergel/pa-skills --skill pa-eval

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

PA agents need regular, objective performance reviews to identify gaps, track improvements, and ensure reliable operation for owners.

Core Features & Use Cases

  • Structured scoring across ten dimensions with daily, weekly, and monthly aggregation.
  • Automated cron setup for self‑evaluation and alerting when scores drop below thresholds.
  • Generates markdown and JSONL reports, logs owner feedback signals, and maps low scores to actionable skill improvements.
  • Use cases include nightly self‑eval, owner‑initiated performance checks, and monthly summary reports for continuous PA optimization.

Quick Start

Ask the PA to run the pa‑eval skill and produce today’s performance evaluation.

Frequently Asked Questions about pa-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I systematically score and evaluate my AI personal assistant's performance?

You can systematically score your AI personal assistant's performance by applying structured scoring rubrics across ten dimensions. This generates daily, weekly, and monthly aggregation reports to identify operational gaps and track improvements.

How do I automate daily self-evaluations and alerts for my AI PA agent?

You can automate daily self-evaluations and alerts for your AI PA agent by setting up an automated cron. The system triggers self-evaluations and sends alerts when performance scores drop below predefined thresholds.

Can I generate monthly performance reports for my AI PA agent in markdown and JSONL?

Yes, you can generate monthly performance reports in markdown and JSONL formats. The evaluation process writes these files directly to your workspace, logging owner feedback signals and mapping low scores to actionable improvements.

What do I need to set up performance scoring and owner feedback for a personal assistant?

To set up performance scoring and owner feedback, you need access to evaluation templates and scoring rubrics. The workspace must also support the ability to write JSONL and markdown files for generating reports.

Does automated PA evaluation work for continuous optimization without manual checks?

Automated PA evaluation supports continuous optimization through nightly self-evaluations and automated cron setups. It maps low scores to actionable skill improvements and logs owner feedback, reducing the need for manual performance checks.

What is the best way to map low performance scores to actionable skill improvements for an AI agent?

The best way to map low performance scores to actionable skill improvements is through structured evaluation templates. The system logs owner feedback signals and automatically translates low scores into targeted optimization actions.