Skip to content

[rllib] Add a simple REST policy server and client example#2232

Merged
ericl merged 108 commits intoray-project:masterfrom
ericl:policy-server
Jun 20, 2018
Merged

[rllib] Add a simple REST policy server and client example#2232
ericl merged 108 commits intoray-project:masterfrom
ericl:policy-server

Conversation

@ericl
Copy link
Contributor

@ericl ericl commented Jun 11, 2018 •
edited
Loading

What do these changes do?

This adds an example implementation of a policy server and client using rllib's ServingEnv.

@AmplabJenkins
Copy link

AmplabJenkins commented Jun 18, 2018

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6103/
Test FAILed.

@AmplabJenkins
Copy link

AmplabJenkins commented Jun 18, 2018

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6104/
Test FAILed.

@ericl ericl changed the title [WIP] Policy server for rllib [rllib] Add a simple REST policy server and client example Jun 18, 2018
@AmplabJenkins
Copy link

AmplabJenkins commented Jun 18, 2018

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6105/
Test FAILed.

@AmplabJenkins
Copy link

AmplabJenkins commented Jun 18, 2018

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6107/
Test FAILed.

richardliaw
richardliaw reviewed Jun 19, 2018
View reviewed changes
python/ray/rllib/examples/serving/cartpole_client.py
@@ -0,0 +1,55 @@
from __future__ import absolute_import
Copy link
Contributor

@richardliaw richardliaw Jun 19, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we should probably move examples into another repo (or at least something more accessible)

richardliaw
richardliaw approved these changes Jun 19, 2018
View reviewed changes
Copy link
Contributor

@richardliaw richardliaw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks fine. We should expose this in the docs (and overall do a better job exposing examples).

@AmplabJenkins
Copy link

AmplabJenkins commented Jun 20, 2018

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6142/
Test FAILed.

@AmplabJenkins
Copy link

AmplabJenkins commented Jun 20, 2018

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6146/
Test FAILed.

@AmplabJenkins
Copy link

AmplabJenkins commented Jun 20, 2018

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6149/
Test FAILed.

@AmplabJenkins
Copy link

AmplabJenkins commented Jun 20, 2018

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6150/
Test FAILed.

@AmplabJenkins
Copy link

AmplabJenkins commented Jun 20, 2018

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6152/
Test FAILed.

@AmplabJenkins
Copy link

AmplabJenkins commented Jun 20, 2018

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6156/
Test PASSed.

@ericl ericl merged commit e5724a9 into ray-project:master Jun 20, 2018
royf added a commit to royf/ray that referenced this pull request Jun 22, 2018
@royf
Merge branch 'master' of https://github.com/ray-project/ray
d1a3e44 
* 'master' of https://github.com/ray-project/ray: (157 commits)
  Fix build failure while using make -j1. Issue 2257 (ray-project#2279)
  Cast locator with index type (ray-project#2274)
  fixing zero length partitions (ray-project#2237)
  Make actor handles work in Python mode. (ray-project#2283)
  [xray] Add error table and push error messages to driver through node manager. (ray-project#2256)
  addressing comments (ray-project#2210)
  Re-enable some actor tests. (ray-project#2276)
  Experimental: enable automatic GCS flushing with configurable policy. (ray-project#2266)
  [xray] Sets good object manager defaults. (ray-project#2255)
  [tune] Update Trainable doc to expose interface (ray-project#2272)
  [rllib] Add a simple REST policy server and client example (ray-project#2232)
  [asv] Pushing to s3 (ray-project#2246)
  [rllib] Remove need to pass around registry (ray-project#2250)
  Support multiple availability zones in AWS (fix ray-project#2177) (ray-project#2254)
  [rllib] Add squash_to_range model option (ray-project#2239)
  Mitigate randomly building failure: adding gen_local_scheduler_fbs to raylet lib. (ray-project#2271)
  [rllib] Refactor Multi-GPU for PPO (ray-project#1646)
  [rllib] Envs for vectorized execution, async execution, and policy serving (ray-project#2170)
  [Dataframe] Change pandas and ray.dataframe imports (ray-project#1942)
  [Java] Replace binary rewrite with Remote Lambda Cache (SerdeLambda) (ray-project#2245)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@richardliaw richardliaw richardliaw approved these changes

Assignees

@richardliaw richardliaw

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@ericl @AmplabJenkins @richardliaw