Parameter Recovery Checker

Validate parameter recovery for computational cognitive models under planned experimental designs.

34|5|Updated Feb 28, 2026
One-click install
npx skills add https://github.com/NeuroAIHub/awesome_cognitive_and_neuroscience_skills --skill parameter-recovery-checker-neuroaihub
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: Parameter Recovery Checker
Source: https://github.com/NeuroAIHub/awesome_cognitive_and_neuroscience_skills/tree/main/skills/parameter-recovery-checker
Command: npx skills add https://github.com/NeuroAIHub/awesome_cognitive_and_neuroscience_skills --skill parameter-recovery-checker-neuroaihub

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This skill prevents cognitive scientists from interpreting fitted model parameters that may not be identifiable by guiding them through comprehensive parameter recovery and model recovery diagnostics matched to their actual experimental design, sample size, and optimization pipeline. It highlights common failure modes (non-identifiability, insufficient trials, local minima, misspecification) and reminds researchers to verify assumptions before trusting any numerical estimates.

Core Features & Use Cases

  • Structured planning protocol: Prompts researchers to state their question, justify method choices, declare expected outcomes, and note assumptions before running recovery simulations, ensuring thoughtful readiness.
  • End-to-end recovery workflow: Covers grid or space-filling sampling, simulation with real design constraints, identical fitting procedures with multiple starts, and evaluation via correlations, bias, RMSE, coverage, and visualization templates from the references.
  • Model recovery and reporting guidance: Details confusion-matrix construction, trial-count sweeps, objective landscapes, and a reporting checklist so reviewers can confirm parameters and models are trustworthy.
  • Use case: Before publishing a drift-diffusion analysis, use this skill to simulate the full range of drift rates, boundaries, and noise levels your experiment might produce and ensure fitted parameters recover reliably for the collected trials.

Quick Start

Ask the skill whether your model's parameters can be reliably recovered given your planned experimental design.

Frequently Asked Questions about Parameter Recovery Checker

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
What is parameter recovery in computational modeling and when do I need it?

Parameter recovery validates whether your fitting pipeline accurately retrieves known ground-truth parameters from simulated data. You need it before interpreting fitted cognitive model parameters to avoid reporting non-identifiable estimates caused by insufficient trials or model misspecification.

How do I check parameter recovery for a drift-diffusion model before data collection?

Simulate data across a grid of expected drift rates, boundaries, and noise levels, then fit using your exact optimization pipeline with multiple starts. Evaluate recovery success using correlation, bias, and RMSE metrics between ground-truth and fitted parameters.

Can I assess model identifiability and recovery with a limited number of experimental trials?

Yes, you can run trial-count sweeps during recovery simulations to test identifiability under actual design constraints. This reveals minimum trial thresholds needed for reliable parameter recovery before committing to the experimental design.

Why does my parameter recovery fail and how do I fix non-identifiability issues?

Parameter recovery fails due to local minima, insufficient trials, or model misspecification. Diagnose failure modes by inspecting objective landscapes and confusion matrices, then adjust your experimental design or fitting procedure until recovery metrics show reliable parameter retrieval.

What metrics should I report for model recovery diagnostics in cognitive neuroscience?

Report quantitative recovery metrics including correlations, bias, RMSE, and coverage between ground-truth and fitted parameters. Include confusion matrices for model recovery and use a reporting checklist so reviewers can confirm parameters and models are trustworthy.