pufferlib

Train PPO agents on vectorized environments with the PufferEnv API.

557|98|Updated Nov 7, 2025
One-click install
npx skills add https://github.com/jimmc414/Kosmos --skill pufferlib-jimmc414
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: pufferlib
Source: https://github.com/jimmc414/Kosmos/tree/main/kosmos-claude-scientific-skills/scientific-skills/pufferlib
Command: npx skills add https://github.com/jimmc414/Kosmos --skill pufferlib-jimmc414

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill streamlines the development and training of Reinforcement Learning (RL) agents by providing a high-performance library for vectorized environment simulation and efficient training algorithms.

Core Features & Use Cases

  • High-Performance Training: Utilizes PuffeRL (PPO+LSTM) for millions of steps per second.
  • Custom Environment Development: Create optimized environments using the PufferEnv API.
  • Seamless Integration: Works with Gymnasium, PettingZoo, Atari, Procgen, and more.
  • Vectorization: Achieves maximum throughput with optimized parallel simulation.
  • Use Case: Train complex multi-agent RL policies on custom environments at unprecedented speeds, accelerating research and development cycles.

Quick Start

Use the pufferlib skill to train a PPO agent on the procgen-coinrun environment with 256 parallel environments.

Frequently Asked Questions about pufferlib

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I speed up reinforcement learning training with parallel environment simulation?▼

Speed up reinforcement learning training by using optimized vectorization for parallel environment simulation, enabling algorithms like PPO+LSTM to achieve millions of steps per second.

How does vectorized environment simulation work for multi-agent RL policies?▼

Vectorized environment simulation works by maximizing throughput through optimized parallel execution, allowing you to train complex multi-agent RL policies at unprecedented speeds.

Can I integrate custom RL environments with Gymnasium and PettingZoo?▼

Yes, you can integrate custom RL environments seamlessly. You can develop optimized environments using the PufferEnv API and connect them with existing frameworks like Gymnasium and PettingZoo.

Does this high-performance RL library support Atari and Procgen environments?▼

Yes, the high-performance RL library supports Atari and Procgen environments, alongside Gymnasium and PettingZoo, to accelerate training and research development cycles.

What is the best way to train a PPO agent on procgen-coinrun using 256 parallel environments?▼

The best way to train a PPO agent on procgen-coinrun with 256 parallel environments is to utilize the optimized PuffeRL training implementation for maximum throughput.

Are there limitations when developing custom environments via the PufferEnv API?▼

Limitations depend on your ability to map custom logic into the PufferEnv API structure, though it is specifically designed to facilitate optimized, high-performance parallel simulation without hard-coded restrictions.