railguard-benchmark

Name: railguard-benchmark
Availability: InStock
Author: Netflix-Skunkworks

Store security scan findings in SQLite and compare runs against answer sheets.

76|9|Updated Feb 27, 2026

Search Tags:#automation #reporting #sqlite #comparison #benchmark #security-scan

Ready to run

npx skills add https://github.com/Netflix-Skunkworks/railguard-skill --skill railguard-benchmark

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: railguard-benchmark
Source: https://github.com/Netflix-Skunkworks/railguard-skill/tree/main/.claude/skills/railguard-benchmark
Command: npx skills add https://github.com/Netflix-Skunkworks/railguard-skill --skill railguard-benchmark

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill stores security scan findings in SQLite and provides tooling to compare results against ground-truth answer sheets or across multiple scan runs, enabling objective benchmarking of detector quality.

Core Features & Use Cases

Persist findings to a local SQLite database for auditability and dashboards.
Compare a scan run against an answer sheet or against other runs to measure recall and precision.
Generate dashboards and trends to monitor benchmark performance over time.

Quick Start

After a scan completes, run the store-and-compare workflow to persist findings and review benchmark results.

Frequently Asked Questions about railguard-benchmark

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I benchmark security scan accuracy against ground-truth answer sheets?▼

To benchmark security scan accuracy, store scan findings in a local SQLite database and compare them against ground-truth answer sheets to measure recall and precision across multiple repos and models.

What is the best way to compare security scan results across multiple runs?▼

Comparing security scan results across multiple runs is best done by persisting findings to a local SQLite database, enabling objective comparison of recall and precision between scan runs over time.

Do I need Python 3 and sqlite3 to store and compare scan findings?▼

Yes, you need Python 3 and sqlite3 to run the scripts that store security scan findings in a local SQLite database and compare results against answer sheets or prior runs.

Can I measure recall and precision for orchestrated and nofp scan variants?▼

Yes, you can measure recall and precision for orchestrated, nofp, and other scan variants by storing their findings in SQLite and comparing them against ground-truth answer sheets.

How does storing scan findings in SQLite improve security benchmark reporting?▼

Storing scan findings in SQLite improves benchmark reporting by providing auditability and enabling dashboards that track detector quality trends and compare accuracy across multiple runs.