The Guppy Gym The guppy gym is an OpenAI gym environment for learning and evaluating controlled robotic fish that interact with (simulated) live fish. The guppy gym is based on the kilobots gym.