Our latest paper presenting the MDP Playground has been accepted published by JAIR. With the MDPP, you can create and control your own cheap but challenging RL environments to better analyze and understand the behavior of RL algorithms.