Welcome to the leaderboard-cloud repository. Here, users can find all the resources, steps and information about the infraestructure used by the CARLA Leaderboard's cloud. The aim is to have a clear open source, easy to understand pipeline that can be used to deploy either future versions of the official CARLA Leaderboard, or possible variations done by the users. While a minimum of cloud infraestructure is expected from the users, the docs are created so that a deep understanding of it isn't really needed.
As for the repositories structure, aws
, evalai
and leaderboard
are the different sections of the cloud's implementation. While the first two are the same for any of the two Leaderboard version, the leaderboard
folder explains the creation of the cluster, which has slight variations between versions, hence the leaderboard_1.0
and leaderboard_2.0
folders.
Below is a summary of the different topics that will be discussed for a succesful implementation of the cloud infraestructure.
- Install prerequisites
- Infrastructure overview
- Leaderboard cluster
- Running user submissions
- AWS interface
- EvalAI Frontend
- Useful Commands
_NOTE: These docs assume that you are using Linux and that all commands are run from either of the leaderboard folders.