This repository has been archived by the owner on Nov 17, 2023. It is now read-only.
Replies: 1 comment
-
@crazyleg Please post your question on https://github.com/awslabs/mxnet-model-server/issues @reminisce Please tag : Question |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Description
When using mxnet.model.server custom Service model.get_outputs() returns only one result, while data supplied to self.mx_model.forward(DataBatch(data), is_train=False) has a list of many.
Environment info (Required)
I assume not required here
I'am using Python.
Minimum reproducible example
What have you tried to solve it?
Currently I am iterating over data and wrap each separate sample into DataBatch and run separate inference. While this works, I assume that running forward with full DataBatch will give better performance.
How should I do model.forward(DataBatch(data)) to get a list of outputs that is equal to len(data) ? Looks like a problem.
Beta Was this translation helpful? Give feedback.
All reactions