verify-pick-alternatives

Selects method, dataset, and model swap variants to stress-test research claims.

75|7|Updated May 2, 2026
One-click install
npx skills add https://github.com/zjunlp/Mechanist --skill verify-pick-alternatives-zjunlp
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: verify-pick-alternatives
Source: https://github.com/zjunlp/Mechanist/tree/main/skills/auto-verify/pick-alternatives
Command: npx skills add https://github.com/zjunlp/Mechanist --skill verify-pick-alternatives-zjunlp

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Verifying a research claim requires testing it against genuinely different methods, datasets, and models, but choosing weak or redundant variants produces verification results that reviewers will not trust. ## Core Features & Use Cases - Candidate Harvesting: Scans existing project research artifacts (idea reports, refinement logs, findings, research wiki) to build a candidate pool before searching externally. - Focused Literature Top-Up: Invokes /research-lit in focused mode only for dimensions with fewer than two credible candidates, avoiding full surveys. - External Reviewer Ranking: Sends the candidate pool to an external LLM reviewer that picks and ranks one swap per dimension by strength of independent test. - Use Case: Given a claim that a probing method detects sentiment in residual streams, the skill selects a different probing submethod, a different-distribution dataset, and a different model family, then writes a structured PLAN.md with expected outcomes and confound controls. ## Quick Start Ask the agent to pick method, dataset, and model swap alternatives for a specific claim ID and statement so the claim can be stress-tested.

Frequently Asked Questions about verify-pick-alternatives

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I choose alternative methods to verify a research claim?

Provide a claim ID and statement, and the skill harvests candidates from existing project research, then has an external reviewer pick one swap per dimension. Method swaps stay within the same mechanism family, such as swapping one probing submethod for another.

What dimensions does claim verification test?

By default it tests three dimensions: method, dataset, and model, producing exactly one variant per axis. You can restrict the scope with a dimensions parameter, for example method only, and excluded axes get zero variants.

When does the skill call external literature search?

It calls /research-lit only when a dimension has fewer than two credible candidates after harvesting existing project research. The search runs in focused mode with at most six papers on a single dimension, not a full survey.

Can the method swap come from a different mechanism family?

No, for mechanism claims the method candidate must come from the same mechanism-skills family as the main experiment, such as Probing to Probing. The constraint is dropped only for behavioral-only proposals where no mechanism family was committed.

What happens if no strong candidates exist for a dimension?

If the pool remains weak after one extra top-up round, the dimension is marked SKIPPED with an explanation rather than filling the slot with a weak swap. The parent /auto-verify then reduces the variant count for that claim.