Carla_Gym_Env build a gym-like Environment for Carla Simulator Install Carla Simulator from official website, referring to the below link: https://carla.readthedocs.io/en/latest/start_quickstart/ Build OpenAI Gym like Carla_Env: change parameters or settings you want in Class CARLA_PARAMS in Carla_Env.py. Generate Carla_env, and use it like OpenAI gym.