Skip to content

Latest commit

 

History

History
28 lines (23 loc) · 998 Bytes

deploying_server.md

File metadata and controls

28 lines (23 loc) · 998 Bytes

Deploy Model Server {#ovms_docs_deploying_server}

---
maxdepth: 1
hidden:
---
ovms_docs_deploying_server_docker
ovms_docs_deploying_server_baremetal
ovms_docs_deploying_server_kubernetes
ovms_docs_serving_model
ovms_docs_parameters
ovms_docs_target_devices
ovms_docs_security

There are multiple options for deploying OpenVINO Model Server

  1. With Docker - use pre-built container images available on Docker Hub and Red Hat Ecosystem Catalog or build your own image from source.
  2. On baremetal Linux or Windows - download packaged binary and run it directly on your system.
  3. In Kubernetes - use helm chart, Kubernetes Operator or OpenShift Operator.

Starting and configuring Model Server

  1. Startup modes
  2. Startup parameters
  3. Using AI Accelerators
  4. Security Considerations