obliteratus

Removes guardrail behaviors from open-weight LLMs via CLI without retraining.

247|22|Updated Dec 11, 2024
One-click install
npx skills add https://github.com/graniet/kheish --skill obliteratus-graniet
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: obliteratus
Source: https://github.com/graniet/kheish/tree/main/skills/mlops/inference/obliteratus
Command: npx skills add https://github.com/graniet/kheish --skill obliteratus-graniet

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Open-weight LLMs often have embedded refusal and guardrail behaviors that block desired outputs, and modifying these traditionally requires expensive retraining or fine-tuning workflows that are inaccessible for most users.

Core Features & Use Cases

This Skill uses mechanistic interpretability techniques to surgically excise refusal directions from model weights without retraining, preserving reasoning capabilities. It supports 9 CLI methods tailored to different model types (dense, MoE, reasoning), includes 28 analysis modules to map refusal mechanisms, offers 116 model presets across 5 compute tiers, and provides tournament evaluation and telemetry-driven parameter recommendations. Common use cases include uncensoring Llama, Qwen, and Mistral models, analyzing how refusal is encoded in model architectures, and creating custom uncensored model variants for research.

Quick Start

Use the obliteratus skill to remove all refusal behaviors from your open-weight LLM using the recommended advanced method.

Frequently Asked Questions about obliteratus

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I remove refusal behaviors from an open-weight LLM without retraining?

You can remove refusal behaviors without retraining by applying weight projection surgery to surgically excise refusal directions from the model's weights. This preserves reasoning capabilities while bypassing expensive fine-tuning workflows.

What is abliteration and how does it modify LLM guardrails?

Abliteration modifies LLM guardrails by using mechanistic interpretability techniques to identify and surgically remove refusal directions encoded in the model's weights. This allows uncensoring pre-trained models without altering their underlying reasoning capabilities.

Can I use weight projection surgery to uncensor Llama, Qwen, or Mistral models?

Yes, weight projection surgery supports uncensoring Llama, Qwen, and Mistral models, along with other common open-weight architectures. The system provides 116 model presets across 5 compute tiers to facilitate this process.

Do I need the OBLITERATUS CLI tool to perform model surgery on my local model?

Yes, performing model surgery requires the OBLITERATUS CLI tool, which enforces AGPL license compliance via CLI-only invocation. The CLI supports 9 methods tailored to dense, MoE, and reasoning model types.

What interpretability techniques are used to map refusal mechanisms in LLMs?

Mapping refusal mechanisms uses mechanistic interpretability techniques including diff-in-means, SVD, LEACE, and SAE decomposition. The system includes 28 analysis modules to analyze how refusal is encoded in model architectures.

What are the limitations of removing LLM guardrails via weight projection?

Limitations of removing LLM guardrails via weight projection include the requirement of the OBLITERATUS CLI tool and strict AGPL license compliance. Additionally, users must select from 9 specific methods and 5 compute tiers appropriate for their model type.