Pufferlib

k-dense-ai/scientific-agent-skills

If you're doing reinforcement learning and hitting performance walls, this is worth checking out. PufferLib gets you 2-10x speedups over standard implementations through optimized vectorization and parallel environment simulation, hitting millions of steps per second. It's built around an efficient PPO implementation and works with all the usual frameworks (Gymnasium, PettingZoo, Atari, Procgen). The multi-agent support is native rather than bolted on, which matters if you're working with those environments. Fair warning: the learning curve is steeper than stable-baselines3, so this makes sense when you actually need the speed or are scaling up experiments. The documentation covers training loops, custom environments, and distributed setups across the reference files.

skills.sh installs

2K

GitHub stars

56.6K

last updated

Aug 21, 2026

Sponsors

Promote your product hereReach 125k+ visitors monthlyPromote your product hereReach 125k+ visitors monthlyAgent CaffeineSponsoredClose your lid, come back to finished workSnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthlyWaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthlyknobsSponsoredSee your site on any phone, any day, in any language