curiosity-driven

Compute compression-progress intrinsic rewards with PyTorch or JAX.

60|13|Updated Dec 22, 2025
One-click install
npx skills add https://github.com/plurigrid/asi --skill curiosity-driven
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: curiosity-driven
Source: https://github.com/plurigrid/asi/tree/main/skills/curiosity-driven
Command: npx skills add https://github.com/plurigrid/asi --skill curiosity-driven

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Sets up intrinsic motivation for agents via compression progress to drive learning and exploration.

Core Features & Use Cases

  • Compression Progress: reward signal from description-length improvement.
  • Intrinsic Motivation: encourages exploration of learnable patterns.
  • Integration: pairs with world models and compressors.

Quick Start

Create a CuriosityDrivenAgent with a world model and a compressor, then evaluate compression_progress on a sample observation.

Frequently Asked Questions about curiosity-driven

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How does compression progress drive exploration in reinforcement learning?

Compression progress measures how much an agent's world model improves at predicting observations. The agent receives intrinsic reward equal to the reduction in description length, encouraging exploration of patterns that improve the model rather than random novelty. This satisfies curiosity-driven learning by directly measuring learnable structure.

Can I use a curiosity-driven approach with PyTorch or JAX?

Yes. The Skill integrates with Python frameworks PyTorch and JAX to compute intrinsic rewards. You pair a differentiable world model and compressor, then calculate rewards as description-length improvement to guide action selection in model-based control.

What's the difference between compression-based and novelty-based curiosity?

Novelty-based curiosity rewards the agent for visiting unfamiliar states. Compression-based curiosity rewards improvement in the world model's ability to compress observations, focusing exploration on learnable patterns that reduce description length rather than mere surprise.

How do I set up a curiosity-driven agent with a world model?

Create a CuriosityDrivenAgent with a differentiable world model and compressor. Define a description-length-based reward where reward equals the previous description length minus the current length. Integrate with PyTorch or JAX to compute intrinsic rewards and select actions that maximize compression progress.

What input data do I need before using compression-based curiosity?

You need observations from the environment and a differentiable world model capable of predicting future states. The compressor must operate on model outputs to measure description length. Both components must support gradient computation in PyTorch or JAX.

When should I use compression progress instead of other exploration methods?

Use compression progress when you need intrinsic motivation that targets learnable structure in the environment. It suits model-based reinforcement learning and control scenarios where the agent benefits from discovering patterns that improve world-model accuracy.