Official Command Line utility to use EvalAI in your terminal.
EvalAI-CLI is designed to extend the functionality of the EvalAI web application to command line to make the platform more accessible and terminal-friendly to its users.
EvalAI-CLI and its required dependencies can be installed using pip:
pip install evalai
Once EvalAI-CLI is installed, check out the usage documentation.
If you are interested in contributing to EvalAI-CLI, follow our contribution guidelines.
-
Setup the development environment for EvalAI and make sure that it is running perfectly.
-
Clone the evalai-cli repository to your machine via git
git clone https://github.com/Cloud-CV/evalai-cli.git evalai-cli
-
Create a virtual environment
cd evalai-cli virtualenv -p python3 venv source venv/bin/activate
-
Install the package locally
pip install -e .
-
Change the evalai-cli host to make request to local EvalAI server running on
http://localhost:8000
by running:evalai host -sh http://localhost:8000
-
Login to cli using the command
evalai login
Two users will be created by default which are listed below -Host User - username: host, password: password Participant User - username: participant, password: password