scorecards

Run pup scorecards rules create with a name, description, target scorecard, and enabled flag. New rules should start disabled, be tested, then enabled. Creating rules requires the apm_service_catalog_write scope on your application key.

Run pup scorecards outcomes list with the --state=fail filter to see all failing evaluations. You can also filter by service name or rule ID, and add --include-rule to see full rule details alongside each outcome.

Listing rules and outcomes requires an application key with the apm_service_catalog_read scope. Creating or updating rules and outcomes requires apm_service_catalog_write. You also need DD_API_KEY and DD_SITE environment variables set.

No, built-in scorecard rules cannot be deleted; they can only be disabled. Only custom rules you created can be removed with pup scorecards rules delete, which requires explicit confirmation due to data loss.

Fail means the service does not meet the rule criteria, while skip means the rule is not applicable to that service. Use skip to exclude services from specific rules without lowering their overall scorecard score.

A 403 error means your Datadog application key lacks the required scope. Ensure the key has apm_service_catalog_read for listing operations or apm_service_catalog_write for creating and updating rules and outcomes.