simulation-validator

Validate simulation pre-flight, runtime, and post-flight checks with Python 3.8.

61|4|Updated Dec 24, 2025
One-click install
npx skills add https://github.com/HeshamFS/materials-simulation-skills --skill simulation-validator
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: simulation-validator
Source: https://github.com/HeshamFS/materials-simulation-skills/tree/main/skills/simulation-workflow/simulation-validator
Command: npx skills add https://github.com/HeshamFS/materials-simulation-skills --skill simulation-validator

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Validate simulations before, during, and after execution. Use for pre-flight checks, runtime monitoring, post-run validation, diagnosing failed simulations, checking convergence, detecting NaN/Inf, or verifying mass/energy conservation.

Core Features & Use Cases

  • Preflight checks: verify config, resources, and ranges before start.
  • Runtime monitoring: track convergence and dt stability during execution.
  • Post-run validation: assess mass, energy, bounds, and NaN/Inf to validate results.
  • Failure diagnosis: quick interpretation of logs for root causes.

Quick Start

Run preflight and runtime checks: python3 scripts/preflight_checker.py --config simulation.json --json python3 scripts/runtime_monitor.py --log simulation.log --json

Frequently Asked Questions about simulation-validator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate simulation results before they fail?

Pre-flight validation checks your simulation configuration, resources, and parameter ranges before execution starts. Run preflight_checker.py on your config file to catch mismatches, resource constraints, and invalid settings early, preventing failed runs and wasted compute time.

Can I monitor simulation convergence and stability during runtime?

Runtime monitoring tracks convergence metrics and timestep stability while your simulation executes. The runtime_monitor.py script processes your log files to detect divergence, dt instability, and other runtime anomalies in real time, producing JSON-formatted alerts.

What validation checks run after simulation completes?

Post-run validation assesses mass conservation, energy balance, NaN/Inf detection, and result bounds. The result_validator.py script inspects metrics and log outputs to confirm physical correctness and data integrity, returning a confidence_score for result reliability.

How do I diagnose why a simulation failed?

The failure_diagnoser.py module interprets simulation logs to identify root causes—configuration errors, numerical instability, resource exhaustion, or convergence breakdown. It produces structured JSON output mapping failure symptoms to likely causes for rapid troubleshooting.

Does this work on Linux, macOS, and Windows?

Yes. The validation suite runs on Linux, macOS, and Windows with Python 3.8+ and no external dependencies, making it portable across development and HPC environments without additional setup or compatibility layers.

Can I integrate validation results into automated pipelines?

Yes. All validation outputs produce JSON-ready reports with status, blockers, warnings, and confidence scores designed for RAG pipelines and downstream analysis automation, enabling seamless integration into CI/CD and data processing workflows.