PPO And Friends (PPO-AF) is an MPI distributed PyTorch implementation of Proximal Policy Optimization along with various extra optimizations and add-ons (friends). It is currently compatible with the following environment frameworks: Gymnasium, Gym (including versions <= 0.21), PettingZoo, and Abmarl Gridworld.