pufferlib

Train PPO agents on vectorized environments with the PufferEnv API.

557|98|Updated Nov 7, 2025
One-click install
npx skills add https://github.com/jimmc414/Kosmos --skill pufferlib-jimmc414
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: pufferlib
Source: https://github.com/jimmc414/Kosmos/tree/main/kosmos-claude-scientific-skills/scientific-skills/pufferlib
Command: npx skills add https://github.com/jimmc414/Kosmos --skill pufferlib-jimmc414

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill streamlines the development and training of Reinforcement Learning (RL) agents by providing a high-performance library for vectorized environment simulation and efficient training algorithms.

Core Features & Use Cases

  • High-Performance Training: Utilizes PuffeRL (PPO+LSTM) for millions of steps per second.
  • Custom Environment Development: Create optimized environments using the PufferEnv API.
  • Seamless Integration: Works with Gymnasium, PettingZoo, Atari, Procgen, and more.
  • Vectorization: Achieves maximum throughput with optimized parallel simulation.
  • Use Case: Train complex multi-agent RL policies on custom environments at unprecedented speeds, accelerating research and development cycles.

Quick Start

Use the pufferlib skill to train a PPO agent on the procgen-coinrun environment with 256 parallel environments.

Frequently Asked Questions about pufferlib

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I speed up reinforcement learning training with parallel environment simulation?

Speed up reinforcement learning training by using optimized vectorization for parallel environment simulation, enabling algorithms like PPO+LSTM to achieve millions of steps per second.

How does vectorized environment simulation work for multi-agent RL policies?

Vectorized environment simulation works by maximizing throughput through optimized parallel execution, allowing you to train complex multi-agent RL policies at unprecedented speeds.

Can I integrate custom RL environments with Gymnasium and PettingZoo?

Yes, you can integrate custom RL environments seamlessly. You can develop optimized environments using the PufferEnv API and connect them with existing frameworks like Gymnasium and PettingZoo.

Does this high-performance RL library support Atari and Procgen environments?

Yes, the high-performance RL library supports Atari and Procgen environments, alongside Gymnasium and PettingZoo, to accelerate training and research development cycles.

What is the best way to train a PPO agent on procgen-coinrun using 256 parallel environments?

The best way to train a PPO agent on procgen-coinrun with 256 parallel environments is to utilize the optimized PuffeRL training implementation for maximum throughput.

Are there limitations when developing custom environments via the PufferEnv API?

Limitations depend on your ability to map custom logic into the PufferEnv API structure, though it is specifically designed to facilitate optimized, high-performance parallel simulation without hard-coded restrictions.