skills.rest
dimagi-internal
dimagi-internalOFFICIAL
Explore all skills by this author →
GitHub

solicitation-create-eval

Score published solicitations against their source Project Design Document across weighted dimensions.

1|2|Updated Apr 1, 2026
Search Tags:#pdd fidelity#solicitation evaluation#respondability#procurement quality#opportunity lifecycle#solicitation grading
One-click install
npx skills add https://github.com/dimagi-internal/ace --skill solicitation-create-eval
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: solicitation-create-eval
Source: https://github.com/dimagi-internal/ace/tree/main/skills/solicitation-create-eval
Command: npx skills add https://github.com/dimagi-internal/ace --skill solicitation-create-eval

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Published solicitations often drift from their source Project Design Document (PDD), lack required fields, have unrealistic deadlines, use generic evaluation criteria, or ask applicants for information only internal teams can provide—leading to failed procurements, no valid responses, or wasted time for all parties. This Skill identifies these gaps before solicitations are shared with potential Local Lead Organizations (LLOs).

Core Features & Use Cases

  • Multi-dimensional quality scoring: Evaluates solicitations across 5 weighted dimensions (PDD fidelity, field completeness, deadline sanity, criteria alignment, and out-of-chain respondability) to produce a holistic quality rating.
  • Critical issue flagging: Automatically detects hard blockers like unanswerable response template questions, past or >90 day deadlines, missing publish metadata, or criteria that don't reflect PDD requirements.
  • Standardized output: Writes a consistent YAML verdict file that can be aggregated with other evaluation results for full opportunity quality tracking.
  • Use case: A Connect opportunity team that has drafted and published a solicitation can run this eval to confirm the listing is faithful to the PDD, answerable by real LLOs, and ready for applicant review.

Quick Start

Run the solicitation-create-eval skill for the current Connect opportunity to generate a quality verdict for the published solicitation.

Frequently Asked Questions about solicitation-create-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate a solicitation for PDD alignment and procurement quality?▼

Solicitation evaluation checks published drafts against their source Project Design Document to catch scope drift, missing fields, and unrealistic deadlines before procurement launch. It scores across five weighted dimensions including PDD fidelity and applicant respondability.

What is out-of-chain respondability in procurement grading?▼

Out-of-chain respondability measures whether solicitation questions are answerable by real applicants. It flags hard blockers when response templates ask for information only internal teams can provide, ensuring Local Lead Organizations can submit valid responses.

How do I detect scope drift between a published solicitation and source PDD?▼

Detect scope drift by grading the published solicitation against the upstream Project Design Document artifact. The evaluation checks PDD fidelity and criteria alignment to identify deviations from original requirements before applicants review the listing.

Does solicitation grading catch unrealistic deadline settings and missing fields?▼

Yes, solicitation grading evaluates deadline sanity and field completeness as weighted dimensions. It automatically flags hard blockers for past or greater than 90 day deadlines, ensuring procurement timelines are realistic before launch.

What format is used for standardized solicitation evaluation verdicts?▼

Solicitation evaluation produces a standardized YAML verdict file containing weighted scores, hard blocker flags, and pass, warn, or fail dispositions. This format supports aggregating quality tracking data across full opportunity lifecycles.

When should I run a solicitation quality check in the opportunity lifecycle?▼

Run a solicitation quality check after drafting and publishing but before sharing with potential Local Lead Organizations. This confirms the listing is faithful to the PDD, answerable by applicants, and ready for review.

Related Skills

Explore More Product & Management Skills→
dimagi-internaldimagi-internal
1

synthetic-summary-eval

Grade synthetic Connect opportunity summaries against rubric dimensions and source documents.

Official
Advanced
jjacksonjjackson
1

opp-eval

Aggregate per-skill eval verdicts into run-level scorecards with weighted category scores.

Community
Advanced
dimagi-internaldimagi-internal
1

solicitation-create

Generate schema-compliant Connect Labs solicitation payloads from program design documents.

Official
Advanced
deveshkumarsdeveshkumars

review

Compare a branch diff against the base branch to detect scope drift and missing changes.

Community
Advanced