semif-decide

Score typed decision options from local LLM answer-slot logits in one forward pass.

Updated May 13, 2026
One-click install
npx skills add https://github.com/onesmash/slm-as-harness --skill semif-decide-onesmash
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: semif-decide
Source: https://github.com/onesmash/slm-as-harness/tree/main/skills/semif-decide
Command: npx skills add https://github.com/onesmash/slm-as-harness --skill semif-decide-onesmash

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires mlx, mlx-lm, huggingface-hub, transformers, torch, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Routing, gating, and classification decisions in software usually require a chat model to generate text that is then parsed back into an if statement, which is slow and fragile. This Skill runs runtime-defined semantic decisions locally: you supply unstructured state, a criterion question, and 2-16 typed options, and the semif-score CLI reads option probabilities directly from answer-slot logits in a single forward pass, with no text generation, no JSON repair, and no external API. ## Core Features & Use Cases - Generation-free local decisions: One JSONL row per decision (state + question + typed options) is scored in one forward pass, returning probabilities that sum to 1 plus full provenance (model revision, per-file sha256, prompt hash). - Self-repairing environment: A read-only doctor (check_env.sh) diagnoses the setup, an idempotent setup script installs the pinned MLX or Torch runtime, and a wrapper runner selects cached verified Qwen3.5 presets, validates every row, and commits results atomically. - Use Case: On an Apple Silicon Mac, triage incoming customer messages by writing a JSONL file where each row asks which queue should handle the request, then run the wrapper offline to get per-row winning options and probabilities, auto-accepting rows above a calibrated threshold and routing the rest to a human. ## Quick Start Ask the AI to run the bundled examples file through the SemIf runner offline on this Mac and report the winning option and probability for every row.

Frequently Asked Questions about semif-decide

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
Can I use GGUF models with the semif-score CLI?▼

No, GGUF builds such as Q4_K_M are for the browser wllama track only. The CLI loads Hugging Face checkpoints or prequantized MLX safetensors repos, and passing --mlx-bits for an already quantized repo is a hard error.