Validation and Verification

Verify and validate scientific simulations using grid convergence and statistical metrics.

4|1|Updated Dec 30, 2025
One-click install
npx skills add https://github.com/doanchienthangdev/omgkit --skill validation-and-verification
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: Validation and Verification
Source: https://github.com/doanchienthangdev/omgkit/tree/main/plugin/skills/simulation/validation-verification
Command: npx skills add https://github.com/doanchienthangdev/omgkit --skill validation-and-verification

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires numpy, scipy, pytest, sympy, SALib, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the critical need to ensure that scientific simulations are both correctly implemented (verification) and accurately represent the physical phenomena they model (validation), thereby increasing confidence in simulation results.

Core Features & Use Cases

  • Code Verification: Implements unit testing for numerical code, method of manufactured solutions (MMS), and checks for conservation properties.
  • Solution Verification: Utilizes grid convergence index (GCI) and Richardson extrapolation to assess numerical accuracy.
  • Model Validation: Compares simulation outputs against experimental data using metrics like RMSE, bias, correlation, and skill scores, including statistical hypothesis testing.
  • Uncertainty Quantification (UQ): Employs Monte Carlo methods and sensitivity analysis (Sobol indices) to quantify input and output uncertainties.
  • Use Case: A research team developing a climate model can use this Skill to rigorously verify their code, validate its predictions against historical weather data, and quantify the uncertainty in future climate projections.

Quick Start

Use the validation-verification skill to perform a grid convergence study on the simulation results provided in 'simulation_data.csv' against experimental data in 'experimental_data.csv'.

Frequently Asked Questions about Validation and Verification

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I perform grid convergence studies and Richardson extrapolation for numerical simulations?

Grid convergence studies assess numerical accuracy by calculating the Grid Convergence Index and applying Richardson extrapolation to estimate the exact solution, ensuring simulation reliability as the grid refines.

What is the method of manufactured solutions for code verification in scientific computing?

The method of manufactured solutions verifies numerical code correctness by exact comparison against analytical solutions, checking for conservation properties and implementation errors in scientific simulations.

How do I validate computational models against experimental data using statistical metrics?

Model validation compares simulation outputs against experimental datasets using statistical metrics like RMSE, bias, correlation, and skill scores, including hypothesis testing to quantify predictive accuracy.

Can I use Monte Carlo methods and Sobol indices for uncertainty quantification in Python?

Yes, uncertainty quantification employs Monte Carlo methods and Sobol sensitivity analysis via SALib to quantify input and output uncertainties in computational models.

Does this verification and validation methodology require specific numerical libraries like NumPy and SciPy?

Yes, the methodology relies on NumPy, SciPy, SymPy, and SALib to perform numerical computations, symbolic mathematics, and sensitivity analysis for rigorous scientific simulation V&V.