What problem does it solve?
OBLITERATUS removes or reduces refusal/guardrail behaviors from open-weight LLMs by directly modifying model weights using mechanistic interpretability, avoiding the need for retraining or fine-tuning.
Core Features & Use Cases
- Refusal direction extraction: Identifies refusal-relevant activation directions via diff-in-means, multi-direction SVD, or LEACE concept erasure to localize what to remove.
- Surgical weight projection (mechanism-preserving): Projects refusal directions out of model weight matrices using configurable, norm-preserving approaches and iterative refinement passes.
- Hardware-aware model processing: Supports tiered presets and quantization for practical VRAM constraints, with verification metrics to detect coherence damage.
- Evaluation-first workflow: Benchmarks refusal rate, perplexity change, and KL divergence to confirm the behavioral shift.
- Use cases: When you need a model variant that answers more freely (e.g., for research on alignment mechanisms), or when you want to study how refusal circuits behave and where they live.
Quick Start
Run the ablation for a target model by executing the command: obliteratus obliterate <model_name> --method advanced --output-dir ./abliterated-models