rl

Train dual-agent reinforcement learning with epistemic reward shaping in Jupyter notebooks.

1|Updated Apr 2, 2026
One-click install
npx skills add https://github.com/hrushi2501/rl-teacher --skill rl
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: rl
Source: https://github.com/hrushi2501/rl-teacher/tree/main/.agents/skills/rl
Command: npx skills add https://github.com/hrushi2501/rl-teacher --skill rl

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill captures a reproducible, self-contained dual-agent reinforcement learning workflow that demonstrates epistemic reward shaping, enabling researchers to study how a teacher network can shape a student's learning via task-specific reward maps and per-task delta signals, improving generalization to unseen environments.

Core Features & Use Cases

  • Dual PPO Student networks with separate optimizers and memory buffers.
  • Teacher network that outputs an 8x8 reward map conditioned on an epistemic state.
  • Deterministic, notebook-based training without external RL libraries.
  • Per-task delta-based teacher reward, per-task success tracking, and a curriculum of 10 training tasks plus 3 unseen test tasks.
  • ONNX export for frontend visualization and JSON/episode logs for analysis.
  • Generalization evaluation on unseen gridworld layouts to quantify transfer.

Quick Start

Open the epistemic_rl.ipynb notebook and run the training loop for the teacher-guided or baseline random conditions to reproduce PPOStudent and TeacherAgent interactions and export ONNX models.

Frequently Asked Questions about rl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How does epistemic reward shaping improve reinforcement learning generalization?

Epistemic reward shaping uses a teacher network to output task-specific spatial reward maps, augmenting a student agent's rewards during training to improve zero-shot transfer to unseen environments.

How do I train a teacher-student reinforcement learning system without external RL libraries?

Open the provided Jupyter notebook and run the training loop to execute dual PPO student networks and a teacher agent entirely from scratch, without requiring any external reinforcement learning libraries.

Can I export trained PPO student models to ONNX for visualization?

Yes, the notebook training loop automatically exports trained student and teacher models to ONNX format, enabling direct frontend visualization alongside JSON and episode logs for analysis.

Does this reinforcement learning skill support zero-shot evaluation on unseen environments?

Yes, the system trains across 10 gridworld tasks and evaluates generalization through zero-shot testing on 3 unseen gridworld layouts to quantify the transfer of learned policies.

What are the constraints for implementing dual-agent PPO with per-task delta rewards?

The implementation mandates separate student network optimizers, per-task delta-based teacher rewards, no external RL libraries, deterministic notebook execution, and detailed logging to ensure reproducible experiments.