-
Python: Required. Multi Model Server (MMS) works with Python 2 or 3. When installing MMS, we recommend that you use a Python and Conda environment to avoid conflicts with your other Apache MXNet or Open Neural Network Exchange (ONNX) installations.
-
java 8: Required. MMS use java to serve HTTP requests. You must install java 8 (or later) and make sure java is on available in $PATH environment variable before installing MMS. If you have multiple java installed, you can use $JAVA_HOME environment vairable to control which java to use.
For ubuntu:
sudo apt-get install openjdk-8-jre-headless
For centos
sudo yum install java-1.8.0-openjdk
For Mac:
brew tap caskroom/versions
brew update
brew cask install java8
You can also download and install Oracle JDK manually if you have trouble with above commands.
- MXNet: Recommended. MMS won't install
mxnet
by default. MXNet is required for most of examples in this project. MMS won't install mxnet engine by default, you can install mxnet-mkl or mxnet-cu90mkl based on your need. And you can also choose specific version of mxnet if you want.
pip install mxnet-mkl
or for GPU instance:
pip install mxnet-cu90mkl
-
Curl: Optional. Curl is used in all of the examples. Install it with your preferred package manager.
-
Unzip: Optional. Unzip allows you to easily extract model files and inspect their content. If you choose to use it, associate it with
.mar
extensions.
To install MMS for the first time, install Python, then run the following command:
pip install multi-model-server
To upgrade from a previous version of MMS, run:
pip install -U multi-model-server
If you prefer, you can clone MMS from source code. First, run the following command:
git clone https://github.com/awslabs/multi-model-server.git && cd multi-model-server
To install MMS, run:
pip install .
To upgrade MMS, run:
pip install -U .
If you plan to develop with MMS and change some of the source code, install it from source code and make your changes executable with this command:
pip install -e .
To upgrade MMS from source code and make changes executable, run:
pip install -U -e .
Issue | Solution |
---|---|
java not found, please make sure JAVA_HOME is set properly. | Make sure java is installed. java is on the $PATH or $JAVA_HOME is set properly. |
Your PYTHONPATH points to a site-packages dir for Python 3.x but you are running Python 2.x! | You do one of following:
|